Help with large data set and fatal python error

Vineet Jain vineet at eswap.com
Sat May 15 10:27:39 EDT 2004


I'm running a process which uses python numeric arrays extensively and also
does some calculations in c. All objects are created in python or through
the Numeric library and then passed to the c routines. I'm dealing with very
large sets of data.

I'm getting the following exceptions in the early part of the program:

Exception exceptions.AssertionError: <exceptions.AssertionError instance at
0x02639C10> in <function remove at 0x025CF5B0> ignored

...and then after about at the 1060 iteration of the main processing loop I
get the following error:

Fatal Python error: deallocating None

Questions:
1. Is there any way to catch this error and close my database connection so
my uncommitted transactions get saved to the db
2. When I profile the larger dataset the .prof file does not get generated.
Is there any way to incrementally build the .prof file
3. Any ideas what the errors means and how can I debug/catch them?

vinj






More information about the Python-list mailing list