ETL Rule of Tumb for loading Dimension and Fact

I would recommend following simple rules for loading Dimension and Fact tablesDimensions:1)      No duplicate values in Natural Keys.2)      Dummy record (-1) has to be present in the table, if the table is truncate and load then inserting the dummy row should be first step.3)     The Natural key shouldn't be blank except the dummy record.Facts:1)      Any fact field that is not mapped from source... Read More »

SAP BO Information Design Tool UNX universes

The 4.0 release of SAP BusinessObjects introduced a new universe format called UNX. This new format will eventually replace the existing UNV universe format. UNX universes also add a bunch of new features, perhaps most notably the ability to create multi-source universes. These UNX universes are created using a new tool called the Information Design Tool(IDT)Universe Consumption in BI 4.0Web Intelligence Web Intelligence tool supports... Read More »

File Archive using Hadoop Archive

 Archiving small filesThe Hadoop Archive's data format is called har, with the following layout:foo.har/_masterindex //stores hashes and offsetsfoo.har/_index //stores file statusesfoo.har/part-[1..n] //stores actual file dataThe file data is stored in multiple part files, which are indexed for keeping the original separation of data intact. Moreover, the part files can be accessed by MapReduce programs in parallel. The index files also record the original directory tree... Read More »

SAP BO Open Document in 4.1

The open document functionality between 3 and 4 is exactly the same expect a change the default URL The default URL to the OpenDocument web application bundle has changed in SAP BusinessObjectsBusiness Intelligence platform 4.0. New absolute OpenDocument links need to use the new defaultURL:http://<servername>:<port>/BOE/OpenDocument/opendoc/openDocument.jsp?<parameter1>&<parameter2>&...&<parameterN>If you are migrating reports with existing links from an XI 3.x release platform, resolve the issue bysetting up the following... Read More »

SAP BO 4.1 New Features

Source SAP BO:... Read More »

SSIS 2012 New features

Source - MSDN BLog#1 – Change Data CaptureWe’ve partnered with Attunity to provide some great CDC functionality out of the box. This includes a CDC Control Task, a CDC Source component, and a CDC Splitter transform (that splits the output based on the CDC operation – insert/update/delete). It also includes CDC support for Oracle. More details to follow.#2 – ODBC SupportODBC Source and Destination components, also... Read More »

Big Data Technologies

Column-oriented databasesTraditional, row-oriented databases are excellent for online transaction processing with high update speeds, but they fall short on query performance as the data volumes grow and as data becomes more unstructured. Column-oriented databases store data with a focus on columns, instead of rows, allowing for huge data compression and very fast query times. The downside to these databases is that they will generally... Read More »