marshal.dumps quadratic growth and marshal.dump not allowing file-like objects

[John Machin]

On Jun 16, 1:08 am, bkus... at gmail.com wrote:
> On Jun 15, 3:16 am, John Machin <sjmac... at lexicon.net> wrote:
>
> > But that change went into the svn trunk on 11-May-2008; perhaps the OP
> > is using a production release which would have the previous version,
> > which is merely "newsize = size + 1024;".
>
> > Do people really generate 32MB pyc files, or is stopping doubling at
> > 32MB just a safety valve in case someone/something runs amok?
>
> Indeed. I (the OP) am using a production release which has the 1k
> linear growth.
> I am seeing the problems with ~5MB and ~10MB sizes.
> Apparently this will be improved greatly in Python 2.6, at least up to
> the 32MB limit.

Apparently you intend to resist good advice and persist [accidental
pun!] with marshal -- how much slower is cPickle for various sizes of
data? What kinds of objects are you persisting?