Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
Author |
Topic |
Sonu619
Posting Yak Master
202 Posts |
Posted - 2011-09-20 : 11:01:22
|
Hi guys,My package is preety simple/straight fwd, 1) Two Ole db source2) using sort transformation ( I know Sort transformation is expensive,I don't what is the reason if i didn't use transformation before Merge Transformation i am not getting that what i want, i mean i am getting less result, after i use Sort transformation i am getting what i want, so i am using Sort Transformation)3) Merge Transformation4) Data Conversion Transformation5) Derived Column6) SCDbut its taking forever to execute that package. Please advise any tips i can use to fast execution? Thanks. |
|
visakh16
Very Important crosS Applying yaK Herder
52326 Posts |
Posted - 2011-09-20 : 11:04:50
|
why using SCD? SCD works poorly on large dataset. whats the amount of data you're dealing from source? how do you want updations to be handled? as type 1 or type 2?------------------------------------------------------------------------------------------------------SQL Server MVPhttp://visakhm.blogspot.com/ |
|
|
Sonu619
Posting Yak Master
202 Posts |
Posted - 2011-09-20 : 11:07:00
|
Source data is 57k records and i am using Type1 and Type 3. |
|
|
visakh16
Very Important crosS Applying yaK Herder
52326 Posts |
Posted - 2011-09-20 : 11:10:54
|
you can simulate that if you want using lookup . another way is to use Tabledifference component which is third party utility------------------------------------------------------------------------------------------------------SQL Server MVPhttp://visakhm.blogspot.com/ |
|
|
Sonu619
Posting Yak Master
202 Posts |
Posted - 2011-09-20 : 11:23:54
|
How about if i use "Check Sum Transformation" with SCD ? if it's helpful? if yes, could you please give me idea how i can use Check sum ): |
|
|
andris_sh
Starting Member
3 Posts |
|
|
|
|