Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 General SQL Server Forums
 New to SQL Server Programming
 merge 15 tables and export to text

Author  Topic 

albertkohl
Aged Yak Warrior

740 Posts

Posted - 2011-03-29 : 07:59:40
Hey guys, i have kinda unique situation (for me) where i have to take my database (that's vertically split accross 15 tables) join it based off an ID column i added to a customers database, and export EVERYTHING.

my data consists of about 15 tables (totalling about 200 columns), all matched off a UID column that i added to the customers database (about 20 columns).

what's the best way to export this w/o taking FOREVER!? i've tried doing 1 million record join/inserts, took forever (looks like because of a RID Lookup or something like that) then i tried adding all the columns of my data onto their table, and do rolling updates (2 million record incraments) and THATS taking forever... right now i'm building the code for and SSIS package that's basically query up 1M records, sort, merge etc...

just trying to get an idea of what the heck i should do here... my database is optimized for quick reads, not this kinda stuff :(

any direction or ideas would be VERY helpful (oh by the way, this database is about 230 million rows incase you wonder)

Thanks!
   

- Advertisement -