Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
Author |
Topic |
under2811
Constraint Violating Yak Guru
366 Posts |
Posted - 2014-08-07 : 04:26:44
|
Experts need helpI am importing excel records to database through SSIS. I have created package--- first chk file exists or not then proceed to Excel Source => Derived Column (need for business) => Conditional Split => Data Conversion => <Now here need advise> Option 1 - whether go for Merge SQL (in OLEDB Command) like (match then delete and insert or not match then insert) Option 2 - SCD component.If merge SQL used then how i can proceed with, means i need to take script task to assgin column value and then used in Merge sql (in OLEDB Command)??Currently i am using SCD component but performance wise which one is good? My data is around I am using daily 500 to 1000 excel files having 80 to 100 records in each files.Thanks in Advance |
|
gbritton
Master Smack Fu Yak Hacker
2780 Posts |
Posted - 2014-08-07 : 08:07:12
|
Your volume is so low that it scarcely matters which approach you use. Generally though, a SQL MERGE command will be faster since it all happens on the server. If you're permitted to do it, check out custom components that use MERGE, e.g. https://dimensionmergescd.codeplex.com/Otherwise, check out this tip from the Kimball Group:http://www.kimballgroup.com/2008/11/design-tip-107-using-the-sql-merge-statement-for-slowly-changing-dimension-processing/ |
|
|
|
|
|