ETLGEN / USER GUIDE
ETLGen documentation
A practical guide to moving from SQL and requirements to production-ready integration artifacts.
ETLGen turns the parts of data integration that are repeated and easy to get wrong into a guided workflow. Use this guide to set up the application, define a specification, and generate outputs for Azure Data Factory or SSIS.
Install ETLGen, have access to a SQL Server database for metadata, and decide where generated files should be stored. Azure Data Factory users should also prepare a service principal and ADLS Gen2 staging location.
The ETLGen workflow
Set up the workspace
Connect ETLGen to its metadata database and choose an output folder.
Describe the pipeline
Choose a target, add sources, define joins and filters, and map destination columns.
Generate and review
Create ADF or SSIS artifacts, DDL, and the supporting specification files.
Choose a guide
Overview
Start here and understand the full workflow.
Settings
Connect the app to SQL Server and choose output folders.
Azure credentials
Prepare secure access for ADF and ADLS Gen2.
Home workspace
Create, find, and maintain specifications.
New specification
Choose targets, load behavior, and deployment options.
Specification editor
Model sources, transformations, and destination columns.
ADF expressions
Translate SQL logic into ADF expressions.
SSIS expressions
Translate SQL logic into SSIS expressions.
WATCH ETLGEN IN ACTION
See the workflow end to end.
Short demonstrations from the ETLGen team show how SQL and specifications become working integration artifacts.
SQL query to ADF pipeline and data flow
See a T-SQL query translated into an Azure Data Factory pipeline and data flow.
Watch on YouTube ↗Specification to SSIS package
Follow a specification through to a native SSIS package ready for your project.
Watch on YouTube ↗Download the application
Get the latest installer and access details from the ETLGen download page.