Please start any new threads on our new site at https://forums.sqlteam.com. We've got lots of great SQL Server experts to answer whatever question you can come up with.

 All Forums
 SQL Server 2008 Forums
 SSIS and Import/Export (2008)
 Helped needed with 2-stage parsing of text files

Author  Topic 

Medic
Starting Member

1 Post

Posted - 2010-10-28 : 22:32:34
Hi All,

I get plain text log files with each line consisting of a date,time, event code and information relating to the code. There are no delimiter and the information that follows the code includes parameters mixed up with descriptive text. The spacing of the descriptive text and parameter order changes depending on which of seven languages the log is written in... Language can and does change within files based on the user logged on.

I wrote a regex expression that returns an array containing just the code and separated descriptive text.

Here's the tricky bit; I do a table join into a table definition of the language parameter strings using the code to get the correct regex string for parsing out the code specific parameters LINE BY LINE.

What I have works but it takes a day to run each set of data and I thought there may be a more efficient way of doing this type of two stage import..

Any suggestions very much welcomed.

Mark.

madhivanan
Premature Yak Congratulator

22864 Posts

Posted - 2010-11-03 : 10:17:46
Post some sample data with expected result

Madhivanan

Failing to plan is Planning to fail
Go to Top of Page
   

- Advertisement -