[Python-Dev] regression test question

[Thomas Wouters]

On Mon, Aug 21, 2000 at 04:32:22PM -0400, Fred L. Drake, Jr. wrote:

>   I'm working on bringing the parser module up to date and introducing
> a regression test for it.  (And if the grammar stops changing, it may
> actually get finished!)

Well, I have augmented assignment in the queue, but that's about it for
Grammar changing patches ;)

>   I'm having a bit of a problem, though:  the test passes when run as
> a script, but not when run via the regression test framework.  The
> problem is *not* with the output file.  I'm getting an exception from
> the module which is not expected, and is only raised when it runs
> using the regression framework.
>   Has anyone else encountered a similar problem?  I've checked to make
> sure the right version or parsermodule.so and test_parser.py are being
> picked up.

I've seen this kind of problem when writing the pty test suite: fork() can
do nasty things to the regression test suite. You have to make sure the
child process exits brutally, in all cases, and *does not output anything*,
etc. I'm not sure if that's your problem though. Another issue I've had to
deal with was with a signal/threads problem on BSDI: enabling threads
screwed up random tests *after* the signal or thread test (never could
figure out what triggered it ;)

(This kind of problem is generic: several test modules, like test_signal,
set 'global' attributes to test something, and don't always reset them. If
you type ^C at the right moment in the test process, test_signal doesn't
remove the SIGINT-handler, and subsequent ^C's dont do anything other than
saying 'HandlerBC called' and failing the test ;))

I'm guessing this is what your parser test is hitting: the regression tester
itself sets something differently from running it directly. Try importing
the test from a script rather than calling it directly ? Did you remember to
set PYTHONPATH and such, like 'make test' does ? Did you use '-tt' like
'make test' does ?

-- 
Thomas Wouters <thomas@xs4all.net>

Hi! I'm a .signature virus! copy me into your .signature file to help me spread!