November 06, 2006 Character recognition and output | ||||
---|---|---|---|---|
| ||||
Wondering if someone can point me in the right direction on small problem. I'm attempting to parse(?) a file with the following string "ÿÿÿÿÿÿÿÿÿÿÿÿÿ" embeded somewhere in it. When I try to output the information, however, writef() chokes if it comes across one of these characters. I thought that this was simply a writef [doFormat] problem so I tried to read the file using Christopher Miller's sample richtext viewer that accompanies DFL and the same thing happens (Error: 4invalid UTF-8 sequence). I tried different combinations of wchar[], dchar[], and byte[] but to no avail. How do I fix this? import std.stdio: emitln = writefln, emit = writef; import std.file: exists, read; void main (char[][] args) { if (args.length == 2 && args[1].exists()) { char[] file = cast(char[])args[1].read(); foreach(sizendx, char ch; file) { try { emit(ch); } // terminates on ÿ catch { emit(" ");continue; } } } else emit ("usage is: ids filename"); } Andrew Edwards |
November 06, 2006 Re: Character recognition and output | ||||
---|---|---|---|---|
| ||||
Posted in reply to Tyro |
Tyro wrote:
> Wondering if someone can point me in the right direction on small
> problem.
>
> I'm attempting to parse(?) a file with the following
> string "�������������" embeded somewhere in it. When I try to
> output the information, however, writef() chokes if it comes across
> one of these characters. I thought that this was simply a writef
> [doFormat] problem so I tried to read the file using Christopher
> Miller's sample richtext viewer that accompanies DFL and the same
> thing happens (Error: 4invalid UTF-8 sequence). I tried different
> combinations of wchar[], dchar[], and byte[] but to no avail. How
> do I fix this?
>
> import std.stdio: emitln = writefln, emit = writef;
> import std.file: exists, read;
>
> void main (char[][] args)
> {
> if (args.length == 2 && args[1].exists())
> {
> char[] file = cast(char[])args[1].read();
> foreach(sizendx, char ch; file)
> {
> try { emit(ch); } // terminates on �
> catch { emit(" ");continue; }
> }
> }
> else
> emit ("usage is: ids filename");
> }
>
> Andrew Edwards
Seems to me an encoding problem.
Even my mozilla Thunderbird client doesn't recognize the characters, it prints little diamonds with a question mark inside (the encoding is set to UTF-8).
I think the standard library is written to deal mainly with unicode text only.
If it's just one file (or a couple of them) the easiest way to trans-code it is probably to just open it with notepad then save it again with UTF-8 encoding.
|
Copyright © 1999-2021 by the D Language Foundation