Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2005 Forums
 SSIS and Import/Export (2005)
 Load Tab delimited file while modifying.

Author  Topic 

kumar1248
Starting Member

20 Posts

Posted - 2010-07-11 : 23:35:01

Hi Team,

I have around 1GB tab delimited file that contains around 100 Million records, one of them column is string data type and other columns are numeric. I need to load this file into SQL Server and i need to convert the string datatype to numeric (by extracing numerics only from the string value, for ex: Input= Engineer41 , output=41).


I am using SSIS and thinking of using BULK insert for fast processing, but here the problem is one of the input column is String and should be convert to INT by extracting numerics. how can we do this in SSIS?

Even if i direct load .TAB file and then updating the table in SQL is how much feasible ? I think i need two tables in SQL Server for this solution. One table is first to load as it is TAB file then another table that contains all numeric columns. Then copy all the Table1 data to Table2 thorough Numeric extraction from string column in Table1.


Please advice me a better solution .
Thanks,
Kumar.
   

- Advertisement -