[I18n-sig] UTF-8 and BOM

[Paul Prescod]

"M.-A. Lemburg" wrote:
> 
>...
> 
> You have to be careful here: UTF-16 prepends a BOM mark to
> every string pushed through the codec -- even small snippets.
> You certainly don't want to make that the default for the
> much more common UTF-8 which has no real requirement to include
> BOM marks at all... having the decoder automatically remove
> BOM marks is easy to implement and won't cause any harm,
> but carelessly adding them will get us into trouble.

Yes, I meant to say that the standard decoder should remove them and
left it up to you whether we should have another codec where the encoder
adds them.

-- 
Take a recipe. Leave a recipe.  
Python Cookbook!  http://www.ActiveState.com/pythoncookbook