Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
Analyzer
Posting Yak Master
115 Posts |
 Posted - 2008-01-15 : 11:59:46
|
| Been handed a system which inserts millions of records per day into a single table with a composite 'wide' index (they tell me it's the only way to achieve uniqueness) and they run large financial reports from this 300,000,000 row table and of course we are I/O is an understatment.I wish to split the data feed (inserts) workload away from the reporting tables however I need method to transfer the feed data into the report tables and control the volume of traffic. first choice is replication but is this sufficiently robust enough for a commodeties system? If not any ideas? |
|
|
sqlsquirrel
Starting Member
21 Posts |
Posted - 2008-01-15 : 14:08:00
|
| Have you looked into what SSIS has to offer? I am thinking initially I would use BCP to move that much data and control it by batching the inserts.Brett DavisSenior SQL Server DBAFor more helpful tips checkout my blog at: http://www.lockergnome.com/sqlsquirrel/ |
 |
|
|
Analyzer
Posting Yak Master
115 Posts |
Posted - 2008-01-16 : 10:06:19
|
| Thank you - I had considered this however wanted to solicted the thoughts of others. I'll begin testing the mileage in this option. |
|
|
|
|
|
|
Data Transfer Technique