What’s New in SSIS with SQL 2008

Bret StatehamTraining ManagerVortex Learning Solutionsbstateham@vortexls.comblogs.netconnex.com

Agenda

• What’s New Overview• Samples on CodePlex• Scripting Changes• Lookup Transformation• Data Profiling

Comments & Questions

• Please hold “Can I ….” & “How would I…” questions until the end

• Send me an email with follow up questions:

bstateham@vortexls.com

What’s New OverviewCategory Enhancement

Installation Features • Need to get Samples from CodePlex• DTS Support Issues

Component Enhancements • Lookup Transformation • ADO.NET Sources & Destinations• Data Profiling Task• Connections Project Wizard• New Scripting Environment & Features• Package Upgrade

Data Management Enhancements • Import/Export Wiz Data Type Handling• Support for new Date / Time Data Types• SQL Language Enhancements• Change Data Capture

Performance and Troubleshooting • Debug Dump Files (.tmp)

Samples on CodePlex

• Sample Databases and Code Samples– No Longer installed with SQL Server– Go to CodePlex to download them:

www.codeplex.com/SQLServerSamples

Scripting Changes

• Visual Studio Tools for Applications (VSTA)• Now supports C# as well as VB.Net• Easier to reference custom assemblies– No longer have to store the assemblies in the

Framework or SDK folders

Demo

Lookup Transformations

• New “Cache Transform” and “Cache Connection Manager” components

• Cache Transform uses a Cache Connection Manager to populate a cache

• Lookup Transform use a Cache Connection Manager to read from an existing cache

• Caches can be persisted to a file for re-use across packages and time

Demo

Data Profiling

• Investigates data characteristics• Data Profile Viewer to view output• Can use Script Tasks to parse XML

Profile TypesProfile Use

Candidate Key Verify Uniqueness of Key Values, or Identify Keys

Column Null Ratio Find percentage of NULL in a column across rows

Column Statistics Min, Max, Median, Deviation

Column Value Distribution Distinct values and counts

Column Length Distribution Lengths of the column values with row counts

Column Pattern Regular Expressions and counts

Functional Dependency Verify parent child relationships, multiple parents

Value Inclusion Verify parent child relationships, locate orphans

Demo

Transact SQL Enhancements

Summary

• What’s New Overview• Samples on CodePlex• Scripting Changes• Lookup Transformation• Data Profiling

Thanks!

• Stay in touch:

bstateham@vortexls.comblogs.netconnex.com

• Today’s Sessions:– Understanding SSIS Data Flows (next)– What’s New is SSIS with SQL Server 2008 (4:00pm)

• Tomorrow’s Sessions:– Extending SQL Server Integration Services (SSIS) – 9:00am– Understanding SQL 2008 Change Data Capture – 10:15am