Behaviour of htmllib's HTML parser and formatter

[Morten W. Petersen]

Hi,

I have an HTML page that displays some content, and a part of that
content is HTML changed into regular text.  The encoding of the page
is UTF-8.

Here's the code that makes the change (the HTML in self.contents is
UTF-8 encoded):

file = cStringIO.StringIO()
parser = htmllib.HTMLParser(formatter.AbstractFormatter(
    formatter.DumbWriter(file=file)))
parser.feed(self.contents)
parser.close()
data = file.getvalue()[:size]
return return data

This renders entities such as   as black diamonds with a ? sign
in them in Firefox, so I guess something is going wrong along the way.
 Any suggestions what it might be?

Thanks,

Morten