From noreply at sourceforge.net Sun Mar 1 00:00:01 2009 From: noreply at sourceforge.net (SourceForge.net) Date: Sat, 28 Feb 2009 23:00:01 +0000 Subject: [Expat-bugs] [ expat-Bugs-2518079 ] incorrect pointer adjustments on buffer reallocation Message-ID: Bugs item #2518079, was opened at 2009-01-18 16:38 Message generated for change (Comment added) made by kwaclaw You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2518079&group_id=10127 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed Resolution: Out of Date Priority: 7 Private: No Submitted By: Daniel Leidert (dleidert) Assigned to: Karl Waclawek (kwaclaw) Summary: incorrect pointer adjustments on buffer reallocation Initial Comment: This bug has been reported as Debian bug #245840: http://bugs.debian.org/245840 http://bugs.debian.org/cgi-bin/bugreport.cgi?msg=27;bug=245840 Some developers thought, that this might be exploitable. I did not yet have the time to take a look at it. Please check yourself. ---------------------------------------------------------------------- >Comment By: Karl Waclawek (kwaclaw) Date: 2009-02-28 18:00 Message: Closing this as no objections were raised. ---------------------------------------------------------------------- Comment By: Karl Waclawek (kwaclaw) Date: 2009-01-18 17:49 Message: This is quite an old report, and the code mentioned has changed since then. It also seems it does not apply anymore - see http://bugs.python.org/issue883495. I am inclined to close this issue, unless given a good reason to revive it. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2518079&group_id=10127 From noreply at sourceforge.net Wed Mar 11 00:46:02 2009 From: noreply at sourceforge.net (SourceForge.net) Date: Tue, 10 Mar 2009 23:46:02 +0000 Subject: [Expat-bugs] [ expat-Bugs-2680699 ] Memory leak: outName Message-ID: Bugs item #2680699, was opened at 2009-03-10 19:46 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2680699&group_id=10127 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Bill Egert (boogachamp) Assigned to: Nobody/Anonymous (nobody) Summary: Memory leak: outName Initial Comment: Using cppcheck 1.30 against expat 2.0.1 yeilds: cppcheck -j2 -a -s -q . [./xmlwf/xmlwf.c:857]: (all) Memory leak: outName . . . if (outputDir) { if (outputType == 'm') metaEndDocument(parser); fclose(fp); if (!result) tremove(outName); free(outName); } XML_ParserFree(parser); } return 0; } shouldn't outName be freed regardless of outputDir's value? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2680699&group_id=10127 From noreply at sourceforge.net Wed Mar 11 00:58:34 2009 From: noreply at sourceforge.net (SourceForge.net) Date: Tue, 10 Mar 2009 23:58:34 +0000 Subject: [Expat-bugs] [ expat-Bugs-2680730 ] Memory leak: outName Message-ID: Bugs item #2680730, was opened at 2009-03-10 19:58 Message generated for change (Tracker Item Submitted) made by Item Submitter You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2680730&group_id=10127 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: Bill Egert (boogachamp) Assigned to: Nobody/Anonymous (nobody) Summary: Memory leak: outName Initial Comment: Using cppcheck 1.30 against expat 2.0.1 yeilds: cppcheck -j2 -a -s -q . [./xmlwf/xmlwf.c:857]: (all) Memory leak: outName . . . if (outputDir) { if (outputType == 'm') metaEndDocument(parser); fclose(fp); if (!result) tremove(outName); free(outName); } XML_ParserFree(parser); } return 0; } shouldn't outName be freed regardless of outputDir's value? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2680730&group_id=10127 From noreply at sourceforge.net Wed Mar 11 00:59:51 2009 From: noreply at sourceforge.net (SourceForge.net) Date: Tue, 10 Mar 2009 23:59:51 +0000 Subject: [Expat-bugs] [ expat-Bugs-2680730 ] Memory leak: outName Message-ID: Bugs item #2680730, was opened at 2009-03-10 19:58 Message generated for change (Comment added) made by boogachamp You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2680730&group_id=10127 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None >Status: Closed >Resolution: Duplicate >Priority: 1 Private: No Submitted By: Bill Egert (boogachamp) Assigned to: Nobody/Anonymous (nobody) Summary: Memory leak: outName Initial Comment: Using cppcheck 1.30 against expat 2.0.1 yeilds: cppcheck -j2 -a -s -q . [./xmlwf/xmlwf.c:857]: (all) Memory leak: outName . . . if (outputDir) { if (outputType == 'm') metaEndDocument(parser); fclose(fp); if (!result) tremove(outName); free(outName); } XML_ParserFree(parser); } return 0; } shouldn't outName be freed regardless of outputDir's value? ---------------------------------------------------------------------- >Comment By: Bill Egert (boogachamp) Date: 2009-03-10 19:59 Message: don't know how I submitted this twice...sorry. ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2680730&group_id=10127 From apoorvag at tataelxsi.co.in Fri Mar 13 11:43:13 2009 From: apoorvag at tataelxsi.co.in (apoorvag) Date: Fri, 13 Mar 2009 16:13:13 +0530 Subject: [Expat-bugs] expat build errors on Mac Message-ID: Hi, I am trying to build expat (2.0.1) on Mac which is required for hal(0.5.11), Initially while building expat there are no errors ..But while building hal the following error occurs .. Please help me to build hal using expat . expat_configure.txt ------ ./configure expat_make.txt ------ make expat_make_install.txt ------ make install hal_configure.txt ------ ./configure checking expat.h usability... yes checking expat.h presence... yes checking for expat.h... yes checking for XML_ParserCreate in -lexpat... no configure: error: Can't find expat library. Please install expat. Thanks..... This message (including any attachment) is confidential and may be legally privileged. Access to this message by anyone other than the intended recipient(s) listed above is unauthorized. If you are not the intended recipient you are hereby notified that any disclosure, copying, or distribution of the message, or any action taken or omission of action by you in reliance upon it, is prohibited and may be unlawful. Please immediately notify the sender by reply e-mail and permanently delete all copies of the message if you have received this message in error. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: expat_configure.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: expat_make.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: expat_make_install.txt URL: -------------- next part -------------- An embedded and charset-unspecified text was scrubbed... Name: hal_configure.txt URL: From noreply at sourceforge.net Wed Mar 18 07:03:09 2009 From: noreply at sourceforge.net (SourceForge.net) Date: Wed, 18 Mar 2009 06:03:09 +0000 Subject: [Expat-bugs] [ expat-Bugs-2691027 ] Memory issues with Expat 1.1 Message-ID: Bugs item #2691027, was opened at 2009-03-18 15:03 Message generated for change (Tracker Item Submitted) made by sameerkarjatkar You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2691027&group_id=10127 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: None Status: Open Resolution: None Priority: 5 Private: No Submitted By: sameer karjatkar (sameerkarjatkar) Assigned to: Nobody/Anonymous (nobody) Summary: Memory issues with Expat 1.1 Initial Comment: Hi, I am using Expat parser to parse a 15 GB XML file . My RAM size is 2 GB and the OS is Windows XP (32 bit). After scanning for about 7.5 GB the parser reports an error "Out of memory ". Is that a bug ? Is it resolved in later versions ? regards Sameer ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2691027&group_id=10127 From noreply at sourceforge.net Tue Mar 31 17:50:47 2009 From: noreply at sourceforge.net (SourceForge.net) Date: Tue, 31 Mar 2009 15:50:47 +0000 Subject: [Expat-bugs] [ expat-Bugs-2723522 ] expat memory consumption issue - advise needed Message-ID: Bugs item #2723522, was opened at 2009-03-31 18:50 Message generated for change (Tracker Item Submitted) made by alexmanovbg You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2723522&group_id=10127 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: Not a Bug Status: Open Resolution: None Priority: 5 Private: No Submitted By: Alex Manov (alexmanovbg) Assigned to: Nobody/Anonymous (nobody) Summary: expat memory consumption issue - advise needed Initial Comment: We have a application which uses expat to convert a xml data file into a binary version of the file. The file at the moment is about 600M but will grow. We encountered a blocking problem - while parsing the file the application starts using a huge amount of memory it needs 4G of RAM to finish successfuly a 600MB file. Our engineers explained that this is due to block memory management in expat when it builds the xml tree. They explained that our xml has alot of tags which in turn requires separate 4K memory pages for even 3 bytes of actual data. Is there any way to improve this? Could anyone suggest how we can optimize this process? Is there any settings which we can use to make it work? Here is the file structure ( I am not uploading the file since it is 600M I can provide it though ). 9 Active 196912311900 203012301700 2345737 20000101 20351231 00:00 00:00 0,1,2,3,4,5,6 1619 0.0000 0.0000 1 0 1 0.0000 0.0000 Default 0 1 0.0000 0.0000 There can be many Groups - in practice about 100 Each Group can have many elements - in practice about 100,000 Each Element can have many subelements - in practice about 4 ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2723522&group_id=10127 From noreply at sourceforge.net Tue Mar 31 21:22:37 2009 From: noreply at sourceforge.net (SourceForge.net) Date: Tue, 31 Mar 2009 19:22:37 +0000 Subject: [Expat-bugs] [ expat-Bugs-2723522 ] expat memory consumption issue - advise needed Message-ID: Bugs item #2723522, was opened at 2009-03-31 11:50 Message generated for change (Comment added) made by kwaclaw You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2723522&group_id=10127 Please note that this message will contain a full copy of the comment thread, including the initial issue submission, for this request, not just the latest update. Category: None Group: Not a Bug Status: Open Resolution: None Priority: 5 Private: No Submitted By: Alex Manov (alexmanovbg) Assigned to: Nobody/Anonymous (nobody) Summary: expat memory consumption issue - advise needed Initial Comment: We have a application which uses expat to convert a xml data file into a binary version of the file. The file at the moment is about 600M but will grow. We encountered a blocking problem - while parsing the file the application starts using a huge amount of memory it needs 4G of RAM to finish successfuly a 600MB file. Our engineers explained that this is due to block memory management in expat when it builds the xml tree. They explained that our xml has alot of tags which in turn requires separate 4K memory pages for even 3 bytes of actual data. Is there any way to improve this? Could anyone suggest how we can optimize this process? Is there any settings which we can use to make it work? Here is the file structure ( I am not uploading the file since it is 600M I can provide it though ). 9 Active 196912311900 203012301700 2345737 20000101 20351231 00:00 00:00 0,1,2,3,4,5,6 1619 0.0000 0.0000 1 0 1 0.0000 0.0000 Default 0 1 0.0000 0.0000 There can be many Groups - in practice about 100 Each Group can have many elements - in practice about 100,000 Each Element can have many subelements - in practice about 4 ---------------------------------------------------------------------- >Comment By: Karl Waclawek (kwaclaw) Date: 2009-03-31 15:22 Message: I think your engineers are mistaken. Expat does not build an in-memory tree of the XML file at all, and its memory consumption is negligible, even for multi-gigabyte files. The only exceptions are entity declarations in the DTD which could use a lot of memory (google for "million laughs attack"). If you don't have a DTD (it looks like that from your example), then I cannot see how Expat would consume much memory. Maybe you have a software library/layer on top of Expat which builds the tree? Karl ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=110127&aid=2723522&group_id=10127