Problems with csv module

[Fredrik Lundh]

Richie Hindle wrote:

> [Florian]
> > You mean that csv.reader can't work with unicode as the delimiter parameter?
>
> Exactly.  http://www.python.org/doc/2.3.5/lib/module-csv.html says:
>
> "Note: This version of the csv module doesn't support Unicode input. Also,
> there are currently some issues regarding ASCII NUL characters. Accordingly,
> all input should generally be printable ASCII to be safe. These restrictions
> will be removed in the future. "
>
> That note is still there in the current development docs, so it looks like
> it hasn't yet been fixed.

does the CSV format even support Unicode-encoded data streams?

(in contrast to, say, Latin-1 or UTF-8 encoded string fields)

this is a very common XML confusion, where people think that just be-
cause a file format can be used to store Unicode data, a parser for that
format ought to be able to parse Unicode strings...

</F>