10GB XML Blows out Memory, Suggestions?

Kay Schluehr kay.schluehr at gmx.net
Tue Jun 6 12:02:59 EDT 2006


axwack at gmail.com wrote:
> I wrote a program that takes an XML file into memory using Minidom. I
> found out that the XML document is 10gb.
>
> I clearly need SAX or something else?
>
> Any suggestions on what that something else is? Is it hard to convert
> the code from DOM to SAX?

If your XML files grow so large you might rethink the representation
model. Maybe you give eXist a try?

http://exist.sourceforge.net/

Regards,
Kay




More information about the Python-list mailing list