Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2005 Forums
 SSIS and Import/Export (2005)
 Problem Loading Data From FlatFile Source

Author  Topic 

pradev26
Starting Member

1 Post

Posted - 2007-09-10 : 10:41:18
Hi i am trying to do a straight forward load from a Flatfile source , i have defined the columns according to the lenghts defined in the Data Dictionary Provided but when i am trying to run the Task i am encounterring this error



The column data for column "Column 20" overflowed the disk I/O buffer.


I tried to add another column 21 at the end and truncate or leave that column unmapped to destination but the same problem occurs for column 21 what should i do to over come this .



In case of Bad Data how to clean up the source.. Please help me with this


Kristen
Test

22859 Posts

Posted - 2007-09-10 : 11:00:36
"In case of Bad Data how to clean up the source"

We usually import into a "staging table" first, with all columns set to varchar(8000), and then we can report on columns that are "wider than expected" and so on, e.g.

SELECT [Col1] = MAX(LEN(MyCol1)), [Col2] = MAX(LEN(MyCol2)) ...
FROM MyStagingTable

Kristen
Go to Top of Page
   

- Advertisement -