Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
8022421
Starting Member
45 Posts |
 Posted - 2011-04-18 : 12:17:57
|
| We are trying to write data from sybase server database to a output file using SSIS package. While writing to a flat file,we need to verify if we have a duplicate rows in the table. For that we use a query in the OLEDB source, if the table has millions of record the output file generation is very slow. Is there a better method that we can do to get the output file quicker with out the duplicate rows.As per customer we were not suppose to use BCP for this. Only way is to go with SSIS package. |
|
|
yosiasz
Master Smack Fu Yak Hacker
1635 Posts |
Posted - 2011-04-18 : 12:38:15
|
| maybe you could do it in batches. you could also dump it to multiple flat files. is the requirement to dump it out to a single file. what is the cause of duplicates? source has duplicates?If you don't have the passion to help people, you have no passion |
 |
|
|
|
|
|
Generating Output File WithOut Duplicate Rows.