Please start any new threads on our new
site at https://forums.sqlteam.com. We've got lots of great SQL Server
experts to answer whatever question you can come up with.
| Author |
Topic |
|
AustraliaDBA
Starting Member
38 Posts |
 Posted - 2010-11-30 : 23:20:56
|
| Hi All,I got stuck in a bad situation which is getting worst day by day. I have to export data from sql database to csv file(, delimited and " text qualifier) in UTF8 format. Spent so much time on internet and found a work around.. which involves following steps1. Create connection to db2. Use data conversion and convert all DT_STR,DT_TEXT to DT_WSTR,DT_NTEXT3. Use data conversion and convert all DT_WSTR,DT_NTEXT to DT_STR,DT_TEXT and in codepage select UTF-84.Create destination csv file and again in codepage select UTF-8this is working fine for me but moment there are chinese characters in the data it lost them because of the conversions i use in the package.Is there anyway to convert nvarchar to utf-8 format and store in csv file.. any help would be much appreciated....Thanks |
|
|
nigelrivett
Master Smack Fu Yak Hacker
3385 Posts |
Posted - 2010-12-01 : 04:58:47
|
| MS in their wisdom removed utf-8 support from most things so now SSIS is really the only way to deal with it reliably.Are you sure that you are losing chinese characters rather than having an issue with whatever you are using to view them - in UTF-8 they can be stored in up to 5 bytes per character.I'm a bit surprised you need to go through all that - I'm pretty sure that I've done this by just exporting directly to a UTF-8 file - but my test was to make sure that I could import and export and end up with the same result - may not have had any non-unicode strings. As far as utf-8 is concerned ascii characters aren't affected. I'll see if I can find the packages I used and check.==========================================Cursors are useful if you don't know sql.SSIS can be used in a similar way.Beer is not cold and it isn't fizzy. |
 |
|
|
AustraliaDBA
Starting Member
38 Posts |
Posted - 2010-12-01 : 19:08:25
|
| Hi Nigelyes i have to go through this long process... unfortunately couldn't figure out any otehr way around.... i tried to export the csv back into database abd loosing all the chinese characters. any help would be much appreciated.Thanks |
|
|
|
AustraliaDBA
Starting Member
38 Posts |
Posted - 2010-12-06 : 23:58:31
|
| any update on this one.. anyone...?Thanks |
|
|
|
nigelrivett
Master Smack Fu Yak Hacker
3385 Posts |
Posted - 2010-12-07 : 06:01:37
|
| I'm not finding it easy to find what I did - probably best to repost. A lot of people probably don't look at questions that already have posts.==========================================Cursors are useful if you don't know sql.SSIS can be used in a similar way.Beer is not cold and it isn't fizzy. |
|
|
|
Lumbago
Norsk Yak Master
3271 Posts |
Posted - 2010-12-07 : 08:07:56
|
| Hm, just a thought...I have no idea if it will work for you. But at least using the Export Data wizard in SSMS you have an option of exporting the csv-file in a unicode format. Is it then possible for you to convert the unicoode file to UTF-8 using Powershell for example? Using the method specified here -> http://stackoverflow.com/questions/750449/converting-xml-from-utf-16-to-utf-8-using-powershell- LumbagoMy blog (yes, I have a blog now! just not that much content yet) -> www.thefirstsql.com |
|
|
|
Lumbago
Norsk Yak Master
3271 Posts |
Posted - 2010-12-07 : 08:19:55
|
Hm, the powershell script wasn't very well suited. This might work better:$file = get-content file.csvset-content -encoding utf8 file2.csv - LumbagoMy blog (yes, I have a blog now! just not that much content yet) -> www.thefirstsql.com |
|
|
|
|
|
|
Unicode to UTF8