Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
scruffy_77
Starting Member
1 Post |
 Posted - 2012-01-27 : 09:16:48
|
| Hi All,Firstly I am new to these forums and apologies if this question has already been answered. I have been looking for some time now, however maybe I am not looking in the right context for the solution. Here is the issue,I have been tasked with creating a data warehouse that is in fine sync, 8 hours out of a master 30GB live SQL database. Now its fairly simple in SSIS to move the data, and in a very quick way... however, I need changes to the live to reflect in the warehouse. I have started to impliment Slowly Chaning Dimensions, and the fact is these do work, however, on some of the tables with larger record sets, it takes a beyond reasonable amount of time to complete... Therefore not viable, So my question is, am I doing something wrong with the SCD's or is there a better way to achieve what I am looking for? Ive tried using two lookups with conditions, but seems a very cumbersome way to achieve this...Any information would be appreciated a lot!Thanks! |
|
|
visakh16
Very Important crosS Applying yaK Herder
52326 Posts |
Posted - 2012-01-27 : 09:37:19
|
| nope..SCDs are known to have performance issue for large datasets. what you can do is to use some custom tasks like table difference component. Another way is implement it using a lookup and then using OLEDB command and destination components.------------------------------------------------------------------------------------------------------SQL Server MVPhttp://visakhm.blogspot.com/ |
 |
|
|
|
|
|
|
|
SSIS and SCD