Difference between ETL and ELT

Today I heard an interesting answer to the question : what is the difference between ETL and ELT ?
The answer is : in ETL the transformations are processed by the ETL tools while in ELT the transformations are processed by the target datasources (RDBMS). I guess that the rising scalability of databases allows this kind of data integration to be possible.
Continue reading

Control and data flows in SSIS

I created this package while working with SSIS for the first time.
The objective of this package is to extract data from 3 flat files in .txt format and perform some controls before inserting the data into 3 tables,
one table (destination) for each file (source).
These files are Territoires.txt, Personnes.txt and Ventes.txt. The data is extracted in that order.
The tables are SimuTerritoires, SimuPersonnes and SimuVentes.
These controls aim to :
– check if the SalesQuota is null
– check if the TotalDue is empty. If so, assign the value 0
– check the  Orderdate value. If it is empty, assign the value 01/01/2001
– check the referential integrity. In the Ventes.txt file, if the Territory ID is not found in the table SimuTerritoires, then reject the row.

Inside my script component, I have a very simple method which processes every row.
The Microsoft Visual C# 2008 code for that method is :

 public override void Input0_ProcessInputRow(Input0Buffer Row)
    {
        if (Row.OrderDateConverti_IsNull == true)
        {
            Row.OrderDateConverti =
            DateTime.ParseExact("01/01/2001", "MM/dd/yyyy", System.Globalization.CultureInfo.InvariantCulture);
        }
    }

The data of the files comes originally from the AdventureWorks sample database (Territories, Persons and Sales tables). You can download the package file, Simulation2.dtx, here.

Here are a few screenshots :

Continue reading

Executing MDX queries against an SQL Server 2008 Analysis Services database in Java

If you are looking for a quick way to connect to an OLAP / multidimensional database like
SQL Server 2008 Analysis Services, here is the procedure.
Be aware that you need to set up XML/A HTTP access for SQL Server Analysis in IIS first.
Basically you need to load a component that enables data exchanges between a client and SSAS.

Continue reading