[SciPy-dev] stringency of the tests

[Nils Wagner]

Hi all,

I have filed a test failure. The comment by Stefan was

#375: FAIL: check_syevr (scipy.lib.tests.test_lapack.test_flapack_float)
-----------------------+----------------------------------------------------
 Reporter:  nils       |        Owner:  somebody
     Type:  defect     |       Status:  new     
 Priority:  normal     |    Milestone:          
Component:  scipy.lib  |      Version:          
 Severity:  normal     |   Resolution:          
 Keywords:             |  
-----------------------+----------------------------------------------------
Comment (by stefan):

 We should just relax the stringency of the test -- those results look
 good.


I guess this is also true for

======================================================================
FAIL: Solve: single precision complex
----------------------------------------------------------------------
Traceback (most recent call last):
  File
"/usr/local/lib64/python2.5/site-packages/scipy/linsolve/umfpack/tests/test_umfpack.py",
line 32, in check_solve_complex_without_umfpack
    assert_array_almost_equal(a*x, b)
  File
"/usr/local/lib64/python2.5/site-packages/numpy/testing/utils.py", line
230, in assert_array_almost_equal
    header='Arrays are not almost equal')
  File
"/usr/local/lib64/python2.5/site-packages/numpy/testing/utils.py", line
215, in assert_array_compare
    assert cond, msg
AssertionError:
Arrays are not almost equal

(mismatch 20.0%)
 x: array([ 1.        +0.j,  1.99999809+0.j,  3.        +0.j, 
4.00000048+0.j,
        5.        +0.j], dtype=complex64)
 y: array([1, 2, 3, 4, 5])



Can someone reproduce the errors wrt odr ?

======================================================================
ERROR: test_explicit (scipy.tests.test_odr.test_odr)
----------------------------------------------------------------------
Traceback (most recent call last):
  File
"/usr/local/lib64/python2.5/site-packages/scipy/odr/tests/test_odr.py",
line 46, in test_explicit
    out = explicit_odr.run()
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 1049, in run
    self.output = Output(apply(odr, args, kwds))
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 576, in __init__
    self.stopreason = report_error(self.info)
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 143, in report_error
    'Iteration limit reached')[info % 10]
IndexError: tuple index out of range

======================================================================
ERROR: test_lorentz (scipy.tests.test_odr.test_odr)
----------------------------------------------------------------------
Traceback (most recent call last):
  File
"/usr/local/lib64/python2.5/site-packages/scipy/odr/tests/test_odr.py",
line 291, in test_lorentz
    out = l_odr.run()
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 1049, in run
    self.output = Output(apply(odr, args, kwds))
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 576, in __init__
    self.stopreason = report_error(self.info)
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 143, in report_error
    'Iteration limit reached')[info % 10]
IndexError: tuple index out of range

======================================================================
ERROR: test_multi (scipy.tests.test_odr.test_odr)
----------------------------------------------------------------------
Traceback (most recent call last):
  File
"/usr/local/lib64/python2.5/site-packages/scipy/odr/tests/test_odr.py",
line 187, in test_multi
    out = multi_odr.run()
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 1049, in run
    self.output = Output(apply(odr, args, kwds))
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 576, in __init__
    self.stopreason = report_error(self.info)
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 143, in report_error
    'Iteration limit reached')[info % 10]
IndexError: tuple index out of range

======================================================================
ERROR: test_pearson (scipy.tests.test_odr.test_odr)
----------------------------------------------------------------------
Traceback (most recent call last):
  File
"/usr/local/lib64/python2.5/site-packages/scipy/odr/tests/test_odr.py",
line 235, in test_pearson
    out = p_odr.run()
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 1049, in run
    self.output = Output(apply(odr, args, kwds))
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 576, in __init__
    self.stopreason = report_error(self.info)
  File "/usr/local/lib64/python2.5/site-packages/scipy/odr/odrpack.py",
line 143, in report_error
    'Iteration limit reached')[info % 10]
IndexError: tuple index out of range