Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
zion99
Posting Yak Master
141 Posts |
 Posted - 2008-06-15 : 10:06:11
|
| Hi,I have written one SSIS script for Initial data load. Then everyday, there will be an incremental insert and/or update; which means there needs to be a separate script for Incremental data load.Currently, script for initial data load has scripts containing SELECT queries. it just copies the data from source table to the destination. How should I go about putting both initial & incremental scripts together? Is there any way or do I need to build 2 separate packages ?Thanks :) |
|
|
visakh16
Very Important crosS Applying yaK Herder
52326 Posts |
Posted - 2008-06-15 : 13:17:58
|
| You could keep a control table which justs stores a date value which is used by SSIS package to take data from your source table. Each successfull run of SSIS will populate a new record into table with date equal to maximum date value of data extracted to destination. For initial population, the table will be empty and you will take a default date value (1 jan 1900) from which date the data will be extracted. And i guess you'll be having a date audit field in your source like datemodified which is compared with date value in the control table to decide which all data have to be brought into destination.Then based on if data already exists or not you'll decide whether its is to be updated or inserted. For that you can use SCD task which is available in SSIS. |
 |
|
|
zion99
Posting Yak Master
141 Posts |
Posted - 2008-06-17 : 07:51:24
|
| Thanks for ur help visakh16 :). SCD is really great.. it made my task easier. but i had a question. i was just going through the various tutorials on the web and they had this concept of checksum on columns. If one wants to know if any update is required, u first check the checksum. If possible plz. tell me will there be any performance issue by not using checksum & just relying on SCD. |
|
|
|
|
|
|
SSIS - Insert & Update packages