About the BI Monkey SSIS ETL Framework

The BI Monkey SSIS ETL Framework is an ETL Execution, Control and Logging system for ETL projects using SSIS. It is supported by a SQL Server metadata database.

It is created by James Beresford, SSIS & MS BI Blogger at http://www.bimonkey.com

The project will be released in 2 flavours, the v1 and v2 framework. The v1 framework is simpler and suited to smaller deployments, whereas the v2 will be more complex to allow for more demanding projects. The v1 release currently is in Beta and is ready to use. It remains in Beta purely because the reporting side is not complete at this point.

The v2 is currently under development - it will be SQL2012 only and take full advantage of the new features. There is no timeline however other than hopefully in 2012.

Framework v1

The v1 Framework described below is the initial, simple release that is suited to simple linear processes in single server environments. It supports the following execution features, all of which are configurable at the metadata level:
  • Recoverability
  • Data Extraction Ranges
  • Execution Orders
  • Task Dependencies
  • Failure Handling

The Framework consists of:
  • Two SSIS Packages
    • A Master Package to control Execution of all the packages under the frameworks control
    • A Template Child package to add code to
  • A SQL Server database to provide execution metadata
    • Packages to Execute
    • Control information
    • Execution history
  • Reports on the framework
    • Current setup and configuration
    • Status and performance

Framework v2

The v2 Framework will be a more industrial level framework which will add the following features:
  • Multi-Server aware configuration tables
    • Multi Server Process Execution
  • Threading (Paralell Execution) )within processes

The v2 framework is planned for release late Q4 2012

Last edited May 9, 2012 at 10:33 AM by BI_Monkey, version 14