Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2008 Forums
 SSIS and Import/Export (2008)
 SCD TIPS?

Author  Topic 

Sonu619
Posting Yak Master

202 Posts

Posted - 2011-09-20 : 11:01:22
Hi guys,

My package is preety simple/straight fwd,
1) Two Ole db source
2) using sort transformation ( I know Sort transformation is expensive,I don't what is the reason if i didn't use transformation before Merge Transformation i am not getting that what i want, i mean i am getting less result, after i use Sort transformation i am getting what i want, so i am using Sort Transformation)
3) Merge Transformation
4) Data Conversion Transformation
5) Derived Column
6) SCD

but its taking forever to execute that package. Please advise any tips i can use to fast execution? Thanks.

visakh16
Very Important crosS Applying yaK Herder

52326 Posts

Posted - 2011-09-20 : 11:04:50
why using SCD? SCD works poorly on large dataset. whats the amount of data you're dealing from source? how do you want updations to be handled? as type 1 or type 2?

------------------------------------------------------------------------------------------------------
SQL Server MVP
http://visakhm.blogspot.com/

Go to Top of Page

Sonu619
Posting Yak Master

202 Posts

Posted - 2011-09-20 : 11:07:00
Source data is 57k records and i am using Type1 and Type 3.
Go to Top of Page

visakh16
Very Important crosS Applying yaK Herder

52326 Posts

Posted - 2011-09-20 : 11:10:54
you can simulate that if you want using lookup . another way is to use Tabledifference component which is third party utility

------------------------------------------------------------------------------------------------------
SQL Server MVP
http://visakhm.blogspot.com/

Go to Top of Page

Sonu619
Posting Yak Master

202 Posts

Posted - 2011-09-20 : 11:23:54
How about if i use "Check Sum Transformation" with SCD ? if it's helpful? if yes, could you please give me idea how i can use Check sum ):
Go to Top of Page

andris_sh
Starting Member

3 Posts

Posted - 2011-09-30 : 08:54:00
Hi.

What SCD element you are using? If one that comes with SSIS, you could consider using this one: http://dimensionmergescd.codeplex.com/
Go to Top of Page
   

- Advertisement -