How pickle helps in reading huge files?

Mark Lawrence breamoreboy at yahoo.co.uk
Wed Oct 16 03:39:57 EDT 2013


On 16/10/2013 07:55, Harsh Jha wrote:
> I've a huge csv file and I want to read stuff from it again and again. Is it useful to pickle it and keep and then unpickle it whenever I need to use that data? Is it faster that accessing that file simply by opening it again and again? Please explain, why?
>
> Thank you.
>

What's your definition of huge?  Maybe it would be effective to pickle 
and unpickle but until you try it, perhaps with a relatively small data 
sample, how can you know?  Why can't you leave the file open and keep 
iterating over the contents?

-- 
Roses are red,
Violets are blue,
Most poems rhyme,
But this one doesn't.

Mark Lawrence




More information about the Python-list mailing list