[Python-3000] Move to a "py3k" branch *DONE*

Guido van Rossum guido at python.org
Fri Aug 10 21:16:47 CEST 2007


I've updated the wiki page with the status for these. I've confirmed
the test_datetime segfault, but I can only provoke it when run in
sequence with all the others.

I'm also experiencing a hang of test_asynchat when run in sequence.

http://wiki.python.org/moin/Py3kStrUniTests

--Guido

On 8/10/07, Guido van Rossum <guido at python.org> wrote:
> Um, Neal reported some more failures with -R earlier. I can reproduce
> the failures for test_collections and test_runpy, but test_gzip passes
> fine for me (standalone). I'll look into these. I'm still running the
> full set as well, it'll take all day. I can't reproduce Neal's problem
> with test_poplib (which was pegging the CPU for him).
>
> On 8/10/07, Guido van Rossum <guido at python.org> wrote:
> > Status update:
> >
> > The following still leak (regrtest.py -R4:3:)
> >
> > test_array leaked [11, 11, 11] references, sum=33
> > test_multibytecodec leaked [72, 72, 72] references, sum=216
> > test_parser leaked [5, 5, 5] references, sum=15
> > test_zipimport leaked [29, 29, 29] references, sum=87
> >
> > I can't reproduce the test_shelve failure.
> >
> > I *do* see the test_structmember failure, will investigate.
> >
> > I see a failure but no segfault in test_datetime; will investigate.
> >
> > Regarding test_univnewlines, this is virgin territory. I've never met
> > anyone who used the newlines attribute on file objects. I'll make a
> > separate post to call it out.
> >
> > --Guido
> >
> > On 8/10/07, Neal Norwitz <nnorwitz at gmail.com> wrote:
> > > Bah, who needs sleep anyways.  This list of problems should be fairly
> > > complete when running with -R.  (it skips the fatal error from
> > > test_datetime though)
> > >
> > > Code to trigger a leak:   b'\xff'.decode("utf8", "ignore")
> > >
> > > Leaks:
> > > test_array leaked [11, 11, 11] references, sum=33
> > > test_bytes leaked [4, 4, 4] references, sum=12
> > > test_codeccallbacks leaked [21, 21, 21] references, sum=63
> > > test_codecs leaked [260, 260, 260] references, sum=780
> > > test_ctypes leaked [-22, 43, 10] references, sum=31
> > > test_multibytecodec leaked [72, 72, 72] references, sum=216
> > > test_parser leaked [5, 5, 5] references, sum=15
> > > test_unicode leaked [4, 4, 4] references, sum=12
> > > test_xml_etree leaked [128, 128, 128] references, sum=384
> > > test_xml_etree_c leaked [128, 128, 128] references, sum=384
> > > test_zipimport leaked [29, 29, 29] references, sum=87
> > >
> > > Failures with -R:
> > >
> > > test test_collections failed -- errors occurred; run in verbose mode for details
> > >
> > > test test_gzip failed -- Traceback (most recent call last):
> > >  File "/home/neal/python/dev/py3k/Lib/test/test_gzip.py", line 77, in
> > > test_many_append
> > >    ztxt = zgfile.read(8192)
> > >  File "/home/neal/python/dev/py3k/Lib/gzip.py", line 236, in read
> > >    self._read(readsize)
> > >  File "/home/neal/python/dev/py3k/Lib/gzip.py", line 301, in _read
> > >    self._read_eof()
> > >  File "/home/neal/python/dev/py3k/Lib/gzip.py", line 317, in _read_eof
> > >    crc32 = read32(self.fileobj)
> > >  File "/home/neal/python/dev/py3k/Lib/gzip.py", line 40, in read32
> > >    return struct.unpack("<l", input.read(4))[0]
> > >  File "/home/neal/python/dev/py3k/Lib/struct.py", line 97, in unpack
> > >    return o.unpack(s)
> > > struct.error: unpack requires a string argument of length 4
> > >
> > > test test_runpy failed -- Traceback (most recent call last):
> > >  File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 230,
> > > in test_run_module
> > >    self._check_module(depth)
> > >  File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 168,
> > > in _check_module
> > >    d2 = run_module(mod_name) # Read from bytecode
> > >  File "/home/neal/python/dev/py3k/Lib/runpy.py", line 72, in run_module
> > >    raise ImportError("No module named %s" % mod_name)
> > > ImportError: No module named runpy_test
> > >
> > > test test_shelve failed -- errors occurred; run in verbose mode for details
> > >
> > > test test_structmembers failed -- errors occurred; run in verbose mode
> > > for details
> > >
> > > test_univnewlines skipped -- This Python does not have universal newline support
> > >
> > > Traceback (most recent call last):
> > >   File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 222, in
> > > handle_request
> > >     self.process_request(request, client_address)
> > >   File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 241, in
> > > process_request
> > >     self.finish_request(request, client_address)
> > >   File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 254, in
> > > finish_request
> > >     self.RequestHandlerClass(request, client_address, self)
> > >   File "/home/neal/python/dev/py3k/Lib/SocketServer.py", line 522, in __init__
> > >     self.handle()
> > >   File "/home/neal/python/dev/py3k/Lib/BaseHTTPServer.py", line 316, in handle
> > >     self.handle_one_request()
> > >   File "/home/neal/python/dev/py3k/Lib/BaseHTTPServer.py", line 303,
> > > in handle_one_request
> > >     if not self.parse_request(): # An error code has been sent, just exit
> > >   File "/home/neal/python/dev/py3k/Lib/BaseHTTPServer.py", line 281,
> > > in parse_request
> > >     self.headers = self.MessageClass(self.rfile, 0)
> > >   File "/home/neal/python/dev/py3k/Lib/mimetools.py", line 16, in __init__
> > >     rfc822.Message.__init__(self, fp, seekable)
> > >   File "/home/neal/python/dev/py3k/Lib/rfc822.py", line 104, in __init__
> > >     self.readheaders()
> > >   File "/home/neal/python/dev/py3k/Lib/rfc822.py", line 172, in readheaders
> > >     headerseen = self.isheader(line)
> > >   File "/home/neal/python/dev/py3k/Lib/rfc822.py", line 202, in isheader
> > >     return line[:i].lower()
> > > AttributeError: 'bytes' object has no attribute 'lower'
> > >
> > > On 8/9/07, Neal Norwitz <nnorwitz at gmail.com> wrote:
> > > > I wonder if a lot of the refleaks may have the same cause as this one:
> > > >
> > > >   b'\xff'.decode("utf8", "ignore")
> > > >
> > > > No leaks jumped out at me.  Here is the rest of the leaks that have
> > > > been reported so far.  I don't know how many have the same cause.
> > > >
> > > > test_multibytecodec leaked [72, 72, 72] references, sum=216
> > > > test_parser leaked [5, 5, 5] references, sum=15
> > > >
> > > > The other failures that occurred with -R:
> > > >
> > > > test test_collections failed -- errors occurred; run in verbose mode for details
> > > >
> > > > test test_gzip failed -- Traceback (most recent call last):
> > > >   File "/home/neal/python/dev/py3k/Lib/test/test_gzip.py", line 77, in
> > > > test_many_append
> > > >     ztxt = zgfile.read(8192)
> > > >   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 236, in read
> > > >     self._read(readsize)
> > > >   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 301, in _read
> > > >     self._read_eof()
> > > >   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 317, in _read_eof
> > > >     crc32 = read32(self.fileobj)
> > > >   File "/home/neal/python/dev/py3k/Lib/gzip.py", line 40, in read32
> > > >     return struct.unpack("<l", input.read(4))[0]
> > > >   File "/home/neal/python/dev/py3k/Lib/struct.py", line 97, in unpack
> > > >     return o.unpack(s)
> > > > struct.error: unpack requires a string argument of length 4
> > > >
> > > > test test_runpy failed -- Traceback (most recent call last):
> > > >   File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 230,
> > > > in test_run_module
> > > >     self._check_module(depth)
> > > >   File "/home/neal/python/dev/py3k/Lib/test/test_runpy.py", line 168,
> > > > in _check_module
> > > >     d2 = run_module(mod_name) # Read from bytecode
> > > >   File "/home/neal/python/dev/py3k/Lib/runpy.py", line 72, in run_module
> > > >     raise ImportError("No module named %s" % mod_name)
> > > > ImportError: No module named runpy_test
> > > >
> > > > test_textwrap was the last test to complete.  test_thread was still running.
> > > >
> > > > n
> > > > --
> > > > On 8/9/07, Neal Norwitz <nnorwitz at gmail.com> wrote:
> > > > > On 8/9/07, Guido van Rossum <guido at python.org> wrote:
> > > > > > This is done. The new py3k branch is ready for business.
> > > > > >
> > > > > > Left to do:
> > > > > >
> > > > > > - switch the buildbot and the doc builder to use the new branch (Neal)
> > > > >
> > > > > I've updated to use the new branch.  I got the docs building, but
> > > > > there are many more problems.  I won't re-enable the cronjob until
> > > > > more things are working.
> > > > >
> > > > > > There are currently about 7 failing unit tests left:
> > > > > >
> > > > > > test_bsddb
> > > > > > test_bsddb3
> > > > > > test_email
> > > > > > test_email_codecs
> > > > > > test_email_renamed
> > > > > > test_sqlite
> > > > > > test_urllib2_localnet
> > > > >
> > > > > Ok, I disabled these, so if only they fail, mail shouldn't be sent
> > > > > (when I enable the script).
> > > > >
> > > > > There are other problems:
> > > > >  * had to kill test_poplib due to taking all cpu without progress
> > > > >  * bunch of tests leak (./python ./Lib/test/regrtest.py -R 4:3:
> > > > > test_foo test_bar ...)
> > > > >  * at least one test fails with a fatal error
> > > > >  * make install fails
> > > > >
> > > > > Here are the details (probably best to update the wiki with status
> > > > > before people start working on these):
> > > > >
> > > > > I'm not sure what was happening with test_poplib.  I had to kill
> > > > > test_poplib due to taking all cpu without progress.  When I ran it by
> > > > > itself, it was fine.  So there was some bad interaction with another
> > > > > test.
> > > > >
> > > > > Ref leaks and fatal error (see
> > > > > http://docs.python.org/dev/3.0/results/make-test-refleak.out):
> > > > > test_array leaked [11, 11, 11] references, sum=33
> > > > > test_bytes leaked [4, 4, 4] references, sum=12
> > > > > test_codeccallbacks leaked [21, 21, 21] references, sum=63
> > > > > test_codecs leaked [260, 260, 260] references, sum=780
> > > > > test_ctypes leaked [10, 10, 10] references, sum=30
> > > > > Fatal Python error:
> > > > > /home/neal/python/py3k/Modules/datetimemodule.c:1175 object at
> > > > > 0xb60b19c8 has negative ref count -4
> > > > >
> > > > > There are probably more, but I haven't had a chance to run more after
> > > > > test_datetime.
> > > > >
> > > > > This failure occurred while running with -R:
> > > > >
> > > > > test test_coding failed -- Traceback (most recent call last):
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/test/test_coding.py",
> > > > > line 12, in test_bad_coding2
> > > > >     self.verify_bad_module(module_name)
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/test/test_coding.py",
> > > > > line 20, in verify_bad_module
> > > > >     text = fp.read()
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/io.py", line 1148, in read
> > > > >     res += decoder.decode(self.buffer.read(), True)
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/encodings/ascii.py",
> > > > > line 26, in decode
> > > > >     return codecs.ascii_decode(input, self.errors)[0]
> > > > > UnicodeDecodeError: 'ascii' codec can't decode byte 0xef in position
> > > > > 0: ordinal not in range(128)
> > > > >
> > > > >
> > > > > See http://docs.python.org/dev/3.0/results/make-install.out for this failure:
> > > > >
> > > > > Compiling /tmp/python-test-3.0/local/lib/python3.0/test/test_pep263.py ...
> > > > > Traceback (most recent call last):
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > > > > 162, in <module>
> > > > >     exit_status = int(not main())
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > > > > 152, in main
> > > > >     force, rx, quiet):
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > > > > 89, in compile_dir
> > > > >     if not compile_dir(fullname, maxlevels - 1, dfile, force, rx, quiet):
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/compileall.py", line
> > > > > 65, in compile_dir
> > > > >     ok = py_compile.compile(fullname, None, dfile, True)
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/py_compile.py", line
> > > > > 144, in compile
> > > > >     py_exc = PyCompileError(err.__class__,err.args,dfile or file)
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/py_compile.py", line
> > > > > 49, in __init__
> > > > >     tbtext = ''.join(traceback.format_exception_only(exc_type, exc_value))
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/traceback.py", line
> > > > > 179, in format_exception_only
> > > > >     filename = value.filename or "<string>"
> > > > > AttributeError: 'tuple' object has no attribute 'filename'
> > > > >
> > > > > I'm guessing this came from the change in exception args handling?
> > > > >
> > > > >   File "/tmp/python-test-3.0/local/lib/python3.0/py_compile.py", line
> > > > > 144, in compile
> > > > >     py_exc = PyCompileError(err.__class__,err.args,dfile or file)
> > > > >
> > > > > n
> > > > >
> > > >
> > >
> >
> >
> > --
> > --Guido van Rossum (home page: http://www.python.org/~guido/)
> >
>
>
> --
> --Guido van Rossum (home page: http://www.python.org/~guido/)
>


-- 
--Guido van Rossum (home page: http://www.python.org/~guido/)


More information about the Python-3000 mailing list