python resource management

S.Selvam Siva s.selvamsiva at gmail.com
Tue Jan 20 14:21:47 EST 2009


On Tue, Jan 20, 2009 at 7:27 PM, Tim Arnold <Tim.Arnold at sas.com> wrote:

> I had the same problem you did, but then I changed the code to create a new
> soup object for each file.That drastically increased the speed.  I don't
> know why, but it looks like the soup object just keeps getting bigger with
> each feed.
>
> --Tim
>
>     I have found the actual solution for this problem.
    I tried using *BeautifulSoup.SoupStrainer()* and it improved memory
usage to the
    greatest extent.Now it uses max of 20 MB(earlier
    it was >800 MB on 1GB RAM system).
    thanks all.



-- 
Yours,
S.Selvam
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-list/attachments/20090121/10a48c0c/attachment-0001.html>


More information about the Python-list mailing list