Translate to your Language

Disclaimer Statement

Total Pageviews

Track

Follow us on FaceBook

About

Powered by Blogger.

Popular Posts

Friday, July 26, 2013

Sql Server Sp to Read row by row from a table and create a file for each row- Without Cursor

by Unknown  |  in Other at  6:11 AM
Here is the Sp,

1) Creates a temp table called t1
2) Store all data from table to temp table t1
3) Count the number of rows from the table and store in a variable
4) select top 1 row from the temp table
5) Create the file name by combaning values from the table
6) out put the value to the file
7) Delete the processed row from the table
8) move to the next line

declare @SQL varchar(8000)
declare @counter intdeclare
@maxrows intdeclare
@filename varchar(30)declare @count intdeclare
@id varchar(50)declare @id1 varchar(30)declare @id3 varchar(50)DECLARE @Statement VARCHAR(8000)select @counter=1, @maxrows = 0
create table t1(cola varchar(50), colb varchar(30), colc varchar(50),cold varchar(max))
insert into t1 SELECT c1,c2,c3,c4 FROM Tableselect @count=(select COUNT(1) from t1)while (@count <>0)beginselect @id = (select top 1 cola from t1)select @id1 = (select top 1 colb from t1)select @id3 = (select top 1 colc from t1)select @filename =(select top 1 cola + '_'+colb +'_'+colc from t1)SET @SQL ='SET NOCOUNT ON select cast(cold as varchar(max)) from t1 where cola=' + @id + ' and colb=' + @id1 + ' and colc=' + @id3 + ' 'print @SQLSET @Statement = 'sqlcmd -E -S <servername> -d <dbname> -h -1 -y 0 -q "' + @SQL + '" > "C:\' + @filename + '.txt"' EXEC xp_cmdshell @Statement delete from t1 where cola=@id and colb=@id1 and colc=@id3set @count=@count-1end
drop
table t1

Wednesday, July 24, 2013

SAP Business Objects BI 4.0 Server Installation Step by Step

by Unknown  |  in SAP BO at  5:33 AM
1. Run the setup.exe from Business objects 4 Installer disc / Folder
.  (BI Platform 4 Server – Only for 64 Bit)
image  image image
image
image
2. Click ‘I accept the License Agreement’ & then click –> Next.
image
image
image
image
3. Select “Use an existing database” if you had SQL Server installed otherwise select “Install and use default database (SQL Server Express will be installed).
image
image
image
image
4. Click ‘Install and use Subversion’ & click –> Next (Something new here… now BO 4.0 has Lifecycle Manager with Subversion).
image
image
image
image
5. Create System DSN – ODBC Connection that connect to SQL Server Database (e.g.  BO4_CMS & BO4_CMS_AUDIT) then press refresh. Select the System DSN accordingly.
image
image
image
image
6. click -> ‘ Do not configure connectivity to SMD Agent ‘ and click -> Next
Note: Please check on installation guide and Administration/Configuration Guide to set  connectivity to Solution Manager
 (Something new) image
7. Click ‘Do not integrate connectivity to Introscope Enterprise Manager ‘ and click -> Next
Note: Please check on installation guide and administration/configuration guide to set connectivity to Introscope Enterprise Manager
(Something new) image
8. Click Next to start installation, The installation process will take some time.
image
image
image
Below are some of the screen captures to share …
image 
Designer, Query as Web Service, Web Intelligence Rich Client, etc can be found on BI Platform 4.0 Client Tools Installation.
image

image

image
image
image
image
image
image
Lifecycle management console for SAP BusinessObjects Business Intelligence platform 4.0 is a
web-based tool that enables you to move BI resources from one system to another system, without
affecting the dependencies of these resources. It also enables you to manage different versions of BI
resources, manage dependencies of BI resources, and roll back a promoted resource to restore the
destination system to its previous state.
The lifecycle management console tool is a plug-in for the SAP BusinessObjects Business Intelligence
platform application. You can promote a BI resource from one system to another system only if the
same version of the SAP BusinessObjects Business Intelligence platform application is installed on
both the source and destination systems.
SAP Dashboard Design require separate installation file.
image
Web Intelligence Rich Client 4 SP2
image
image
Live Office 4 SP2 (Web Service URL for Live Office /dswsbobje/services/session">/dswsbobje/services/session">http://<YourServer>/dswsbobje/services/session)
image
Universe Designer 4 SP2
image
Query as Web Service 4 SP2
image
Data Services 4 SP2 – Designer
image
Data Services 4 SP2 – Management Console
image
SharePoint Integration image 

Monday, July 15, 2013

Hadoop Tutorial: Intro to HDFS

by Unknown  |  in Other at  1:14 PM

Wednesday, July 10, 2013

BIg Data

by Unknown  |  in Other at  11:08 PM
What is Big Data :
Big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications. The challenges include capture, curation, storage, search, sharing, transfer, analysis, and visualization. The trend to larger data sets is due to the additional information derivable from analysis of a single large set of related data, as compared to separate smaller sets with the same total amount of data, allowing correlations to be found to "spot business trends, determine quality of research, prevent diseases, link legal citations, combat crime, and determine real-time roadway traffic conditions."


Thursday, July 4, 2013

QlikView Interview Question and Answers

by Unknown  |  in Q&A at  6:54 AM

QueryWhat to look for...
How would you describe a: a) Dashboard b) MI solutionBasic BI / MI knowledge
What is it that drew you to working with QlikViewResponse around solutions that can be delivered / end user satisfaction - rather than a feature list
Describe some of the solutions you have built in QlikViewApplicacations around finance / insurance
What parts of QlikView project life cycles have you been involved inComfortable in dealing with people as well as software
What feature of QlikView would you like best, and whyThis one is subjective - but may draw an interesting response
What would you say the limitations / flaws with QlikView areAgain very subjective
What presentation object would best suit......Holds an opinion on basic data presentataion
What is a QVD file and why might you use oneIt's a data repository file, can aid a robust / quick reload strategy, essential for incremental loads of data
What is the difference between optimized and non optimized QVD loadWhen retreiving from QVD optimized mode is up to 100x quicker - only works if you follow a set of rules
Describe the use of the ApplyMap statementUsed for mapping data from one source onto another at load time, very flexible in how it does this
How might you seek to decrease memory usage by a documentDrop redundant items, remove granularity (eg. drop time from datetime fields), split fields (eg. post codes)
What kind of optimisations can be done to data modelsMerge tables to reduce joins at run time - create a flatter structure at load time
Describe the crosstab directive; how and why would you use itTransforms columns into rows by dimensions (eg. in Excel where have cols for description then one col per month)
What is a calculation condition and why would you use oneStops a potentially costly calculation / display taking place by checking a more efficient expression first
What is a show condition and how does it differ from calculation conditionSimilar to calculation condition but the object is removed from the screen rather than displaying a message
What are the advantages of using a themeContains all UI attributes in a single file, when new objects are created they can pick up from the theme
Why might you make use of variablesCan keep re-useable code snippets, calculate values for global use, maintaining state of objects

Wednesday, July 3, 2013

Extracting data from Twitter

by Unknown  |  in Other at  8:48 AM
I found this following article useful for DW people.

http://www.brelson.com/2009/11/using-google-spreadsheets-to-extract-twitter-data/

Tuesday, March 12, 2013

What is Fact Table

by Unknown  |  in DW at  9:25 PM

A fact table is the primary table in a dimensional model where the numerical performance measurements of the business are stored. We strive to store the measurement data resulting from a business process in a single data mart. Since measurement data is overwhelmingly the largest part of any data mart, we avoid duplicating it in multiple places around the enterprise.

The term fact represents a business measure. A measurement is taken at the intersection of all the dimensions (day, product, and store). This list of dimensions defines the grain of the fact table and tells us what the scope of the measurement is.

All the measurements in a fact table must be at the same grain.

The most useful facts are numeric and additive. Additivity is crucial because data warehouse applications almost never retrieve a single fact table row. Semi additive facts can be added only along some of the dimensions, and non- additive facts simply can’t be added at all. With non additive facts we are forced to use counts or averages if we wish to summarize the rows or are reduced to printing out the fact rows one at a time. Also, there are factless fact tables which do not contain any measurement metrics; but merely capture the relationship between the involved keys.

Can a measured fact be textual?

It is theoretically possible for a measured fact to be textual; however, the condition arises rarely. In most cases, a textual measurement is a description of something and is drawn from a discrete list of values. A true text fact is rare in a data warehouse because the unpredictable content of a text fact, like a free text comment, makes it nearly impossible to analyze.


Transaction and Snapshot grained fact tables

Transaction-grained fact tables are often richly dimensional and usually have only a single fact (the amount of the transaction). The context of a transaction is modeled as a set of generally independent dimensions. The measured transaction amount is in a fact table that refers to all the dimensions by foreign keys pointing outward to their respective dimension tables.

A snapshot is a measurement of status at a specific point in time. In the data warehouse world, there are two different snapshots of status, both equally important. The periodic snapshotis a regular, predictable statement of status. The monthly snapshot, the most common type, may contain a whole set of measurements. Some of these snapshots are instantaneous measurements at the end of the period, and some are measurements accumulated throughout the period. The design of this snapshot focuses on the activity that occurred during the time interval between snapshots.

The other important kind of snapshot is the accumulating snapshot, which shows us the status at any given moment. If we ask for the current status an hour from now, it may be different. The accumulating snapshot often combines the most recent volatile status with measures that accumulate from the beginning of history.

The transaction-grained fact table represents an atomic action that occurs at an instantaneous point in time. There is often no guarantee that a record for a given policy or customer exists in the transaction fact table; a record exists only if a transaction occurs. Conversely, there is no upper limit to the number of records for a given policy or customer. The date/timestamp on the transaction record may be accurate to the individual day, or it may be accurate to the hour and minute. Normally there is only a single fact generically called “amount.” Its meaning depends on the value of the transaction key. After posting it, we don’t usually revisit a transaction-grained fact record for any type of update.

The periodic-snapshot-grained fact table represents a predefined time span. Usually, exactly one record exists for each combination of significant keys. The timestamp on the periodic snapshot is only the name of the period and usually denotes the end of the period. Periodic snapshots can have any number of facts, depending on what measures are possible or useful to calculate. Some of these facts may be extraordinarily difficult to calculate directly from the transactions. Finally, once it’s posted, we do not normally revisit a periodic-snapshot fact record for any type of update unless we decide to add a completely new periodic-snapshot fact to the entire table.
The accumulating-snapshot-grained fact table represents an indeterminate time span, covering the entire history starting when the transaction started and ending with the present moment. Accumulating-snapshot fact tables almost always have multiple time stamps. One time stamp represents the last time the snapshot was updated, and the others represent generic or predictable events that may have taken place in the life of the coverage. Note that some of these time stamps may have to handle null values because, for example, the first_claim_date will not have a real value unless a claim has been filed. The correct treatment of null date keys requires using integer-valued surrogate keys.

Accumulating snapshots, such as the periodic ones, can have any number of facts depending on what measures are possible or useful to calculate. In dramatic contrast to the other fact-table types, we frequently revisit accumulating-snapshot fact records to update the facts. As history unfolds, we must revisit the same record several times to revise the accumulating status.


When to choose which kind of fact table?

The transaction-grained fact table is the only table that can answer detailed questions about timing and questions about unpredictable, repetitive behavior.

The periodic-snapshot fact table is often the only table that can easily generate a regular, predictable view of the important measures of a business. Calculating basic measures, such as revenue and cost, may be impractical if starting from any sort of transactional view of the business. So we publish such measures only once each month at a low level of granularity and let all the company’s managers and analysts roll these measures upward into different combinations from our periodic-snapshot table.
The accumulating-snapshot fact table is appealing when we are tracking items that have a finite lifetime, such as insurance policy coverages or line items on orders. If the coverage or the order line item exists for a finite period of time, there is a flurry of updating activity on those records when they are “open,” and then the record quiets down. It remains in the database as a summary of the activity surrounding that coverage or line item. The advantage of the accumulating snapshot is that we can do a great deal of useful reporting without complex constraints on the time dimension and without double counting across the multiple records of a periodic snapshot.




© Copyright © 2014Bigdata-dwbi. by