[SciPy-User] Testing scipy: a curiosity

[Sergio Rojas]

Hello all,


 Running the scipy tests in sequence:

 scipy.test()
 then, after the previous test finished without errors
 or failures I run:
 scipy.test('full')
 some tests fails (see below).

 Exiting and starting a new python session and
 executing only the test suite:

 scipy.test('full')

 No failures or errors are reported. The test ends with:
 ...
 ----------------------------------------------------------------------
 Ran 5832 tests in 423.039s
 OK (KNOWNFAIL=14, SKIP=42)
 <nose.result.TextTestResult run=5832 errors=0 failures=0>

 What could be the problem?. Can we trust these tests results?
 Is there a way to run these failed tests individually so one can
 make sure the scipy system is working properly? perhaps an
 especific hard example could be usefull.


 Sergio
 >$ python_gnu
 Python 2.7.2 (default, Apr 18 2012, 13:06:38)
 [GCC 4.6.1] on linux3
 Type "help", "copyright", "credits" or "license" for more information.
 >>>
 >>>
 >>> scipy.test('full')
 Running unit tests for scipy
 NumPy version 1.6.1
 NumPy is installed in /home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/si
 te-packages/numpy
 SciPy version 0.10.1
 SciPy is installed in /home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/si
 te-packages/scipy
 Python version 2.7.2 (default, Apr 18 2012, 13:06:38) [GCC 4.6.1]
 nose version 1.1.2

 .....

 ======================================================================
 ERROR: test_iv_cephes_vs_amos_mass_test (test_basic.TestBessel)
 ----------------------------------------------------------------------
 Traceback (most recent call last):
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc
 ipy/special/tests/test_basic.py", line 1642, in test_iv_cephes_vs_amos_mass_test
 c1 = special.iv(v, x)
 RuntimeWarning: divide by zero encountered in iv

 ======================================================================
 FAIL: test_mio.test_mat4_3d
 ----------------------------------------------------------------------
 Traceback (most recent call last):
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/no
 se/case.py", line 197, in runTest
 self.test(*self.arg)
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc
 ipy/io/matlab/tests/test_mio.py", line 740, in test_mat4_3d
 stream, {'a': arr}, True, '4')
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu
 mpy/testing/utils.py", line 1008, in assert_raises
 return nose.tools.assert_raises(*args,**kwargs)
 AssertionError: DeprecationWarning not raised

 ======================================================================
 FAIL: Regression test for #651: better handling of badly conditioned
 ----------------------------------------------------------------------
 Traceback (most recent call last):
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc
 ipy/signal/tests/test_filter_design.py", line 34, in test_bad_filter
 assert_raises(BadCoefficients, tf2zpk, [1e-15], [1.0, 1.0])
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu
 mpy/testing/utils.py", line 1008, in assert_raises
 return nose.tools.assert_raises(*args,**kwargs)
 AssertionError: BadCoefficients not raised

 ----------------------------------------------------------------------
 Ran 5832 tests in 252.953s

 FAILED (KNOWNFAIL=14, SKIP=42, errors=1, failures=2)
 <nose.result.TextTestResult run=5832 errors=1 failures=2>

 scipy.test('full')
 scipy.test()

 ======================================================================
 FAIL: test_mio.test_mat4_3d
 ----------------------------------------------------------------------
 Traceback (most recent call last):
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/no
 se/case.py", line 197, in runTest
 self.test(*self.arg)
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc
 ipy/io/matlab/tests/test_mio.py", line 740, in test_mat4_3d
 stream, {'a': arr}, True, '4')
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu
 mpy/testing/utils.py", line 1008, in assert_raises
 return nose.tools.assert_raises(*args,**kwargs)
 AssertionError: DeprecationWarning not raised

 ======================================================================
 FAIL: Regression test for #651: better handling of badly conditioned
 ----------------------------------------------------------------------
 Traceback (most recent call last):
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/sc
 ipy/signal/tests/test_filter_design.py", line 34, in test_bad_filter
 assert_raises(BadCoefficients, tf2zpk, [1e-15], [1.0, 1.0])
 File "/home/srojas/myPROG/Python272GNU/Linux64b/lib/python2.7/site-packages/nu
 mpy/testing/utils.py", line 1008, in assert_raises
 return nose.tools.assert_raises(*args,**kwargs)
 AssertionError: BadCoefficients not raised

 ----------------------------------------------------------------------
 Ran 5101 tests in 40.225s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.scipy.org/pipermail/scipy-user/attachments/20120420/9eec73f9/attachment.html>