python reading file memory cost

Tong Zhang warriorlance at gmail.com
Mon Aug 1 11:05:27 EDT 2011


Hello, everyone!

 

I am trying to read a little big txt file (~1 GB) by python2.7, what I want
to do is to read these data into a array, meanwhile, I monitor the memory
cost, I found that it cost more than 6 GB RAM! So I have two questions:

1: How to estimate memory cost before exec python script?

2: How to save RAM while do not increase exec time?

 

Any answer will be grateful!

 

--Tony Zhang

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20110801/d6ec9924/attachment.html>


More information about the Python-list mailing list