Processing large CSV files - how to maximise throughput?

[Mark Lawrence]

On 25/10/2013 02:38, Victor Hooi wrote:
>
> So for the reading, it'll iterates over the lines one by one, and won't read it into memory which is good.
>

Wow this is fantastic, which OS are you using?  Or do you actually mean 
that the whole file doesn't get read into memory, only one line at a 
time? :)

-- 
Python is the second best programming language in the world.
But the best has yet to be invented.  Christian Tismer

Mark Lawrence