python resource management
S.Selvam Siva
s.selvamsiva at gmail.com
Tue Jan 20 14:21:47 EST 2009
On Tue, Jan 20, 2009 at 7:27 PM, Tim Arnold <Tim.Arnold at sas.com> wrote:
> I had the same problem you did, but then I changed the code to create a new
> soup object for each file.That drastically increased the speed. I don't
> know why, but it looks like the soup object just keeps getting bigger with
> each feed.
>
> --Tim
>
> I have found the actual solution for this problem.
I tried using *BeautifulSoup.SoupStrainer()* and it improved memory
usage to the
greatest extent.Now it uses max of 20 MB(earlier
it was >800 MB on 1GB RAM system).
thanks all.
--
Yours,
S.Selvam
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20090121/10a48c0c/attachment-0001.html>
More information about the Python-list
mailing list