Best of MSDN Blogs–SSIS “Balanced Data Distributor” transformation component

A blog this week from the SQL Server Performance Team tells about a new SQL Server Integration Services (SSIS) component available for BIDS in SQL Server 2008 and SQL 2008 R2 on Windows Server 2008/R2:

There is a new transform component available for SQL Server Integration Services.  It’s called the Balanced Data Distributor (BDD) and the download is available here.  The BDD provides an easy way to amp up your usage of multi-processor and multi-core servers by introducing parallelism in the data flow of an SSIS package.

More info:

Microsoft® SSIS Balanced Data Distributor (BDD) is a new SSIS transform. This transform takes a single input and distributes the incoming rows to one or more outputs uniformly via multithreading. The transform takes one pipeline buffer worth of rows at a time and moves it to the next output in a round robin fashion. It’s balanced and synchronous so if one of the downstream transforms or destinations is slower than the others, the rest of the pipeline will stall so this transform works best if all of the outputs have identical transforms and destinations. The intention of BDD is to improve performance via multi-threading. Several characteristics of the scenarios BDD applies to: 1) the destinations would be uniform, or at least be of the same type. 2) the input is faster than the output, for example, reading from flat file to OleDB.

In case you haven’t geeked with a lot of hardware lately, the influx of multi-core processing has exploded; even the manufacturers are adding HyperThreading technology back into servers and laptops. These CPUs are capable of multi-threading while some of the processes that use them – namely SSIS – have a hard time keeping up with the capability of parallelism.  It looks like this demand has prompted this mid-release of a component to help us since components in the current and latest version of SSIS doesn’t support this type of parallel processing. You can read about it here download it here. Links are below to check out.  I’ll have to fire up a couple of examples and see what’s up. 

Oh, about the download…you download a Word document from the download page, enable editing if necessary, and then click on a button at the bottom, which opens links for x32 and x64.

Thanks for reading,
Lee

---------------------

http://blogs.msdn.com/b/sqlperf/archive/2011/05/25/the-balanced-data-distributor-for-ssis.aspx

http://www.microsoft.com/downloads/en/details.aspx?FamilyID=ea0a1544-5ee4-4ad4-9d76-296d0632f162

http://www.microsoft.com/downloads/en/confirmation.aspx?FamilyID=ea0a1544-5ee4-4ad4-9d76-296d0632f162