[Python-Dev] Current start-up times

[Brett Cannon]

tl;dr:
2.7 -> 3.3 = 1.92x slower
2.7 -> 3.4 = 1.36x slower
3.3 -> 3.4 = 1.40x faster

IOW the work people have been putting in to speed up interpreter startup
are definitely paying off.



> ./perf.py -b normal_startup,startup_nosite ../cpython/py3.3/python.exe
../cpython/default/python.exe
Running normal_startup...
INFO:root:Running `../cpython/default/python.exe -c ` 1000 times
INFO:root:Running `../cpython/py3.3/python.exe -c ` 1000 times
Running startup_nosite...
INFO:root:Running `../cpython/default/python.exe -S -c ` 2000 times
INFO:root:Running `../cpython/py3.3/python.exe -S -c ` 2000 times

Report on Darwin bcannon-macbookpro2.roam.corp.google.com 12.5.0 Darwin
Kernel Version 12.5.0: Sun Sep 29 13:33:47 PDT 2013;
root:xnu-2050.48.12~1/RELEASE_X86_64 x86_64 i386
Total CPU cores: 8

### normal_startup ###
Min: 0.679865 -> 0.484924: 1.40x faster
Avg: 0.696644 -> 0.497123: 1.40x faster
Significant (t=47.03)
Stddev: 0.02796 -> 0.01087: 2.5731x smaller

### startup_nosite ###
Min: 0.297685 -> 0.285106: 1.04x faster
Avg: 0.319151 -> 0.309291: 1.03x faster
Significant (t=5.64)
Stddev: 0.01219 -> 0.01252: 1.0272x larger
> ./perf.py -b normal_startup,startup_nosite ../cpython/py2.7/python.exe
../cpython/default/python.exe
Running normal_startup...
INFO:root:Running `../cpython/default/python.exe -c ` 1000 times
INFO:root:Running `../cpython/py2.7/python.exe -c ` 1000 times
Running startup_nosite...
INFO:root:Running `../cpython/default/python.exe -S -c ` 2000 times
INFO:root:Running `../cpython/py2.7/python.exe -S -c ` 2000 times

Report on Darwin bcannon-macbookpro2.roam.corp.google.com 12.5.0 Darwin
Kernel Version 12.5.0: Sun Sep 29 13:33:47 PDT 2013;
root:xnu-2050.48.12~1/RELEASE_X86_64 x86_64 i386
Total CPU cores: 8

### normal_startup ###
Min: 0.350003 -> 0.484200: 1.38x slower
Avg: 0.362935 -> 0.492708: 1.36x slower
Significant (t=-44.29)
Stddev: 0.02021 -> 0.00459: 4.3999x smaller

### startup_nosite ###
Min: 0.165302 -> 0.282765: 1.71x slower
Avg: 0.169915 -> 0.293589: 1.73x slower
Significant (t=-222.46)
Stddev: 0.00273 -> 0.00484: 1.7705x larger
> ./perf.py -b normal_startup,startup_nosite ../cpython/py2.7/python.exe
../cpython/py3.3/python.exe
Running normal_startup...
INFO:root:Running `../cpython/py3.3/python.exe -c ` 1000 times
INFO:root:Running `../cpython/py2.7/python.exe -c ` 1000 times
Running startup_nosite...
INFO:root:Running `../cpython/py3.3/python.exe -S -c ` 2000 times
INFO:root:Running `../cpython/py2.7/python.exe -S -c ` 2000 times

Report on Darwin bcannon-macbookpro2.roam.corp.google.com 12.5.0 Darwin
Kernel Version 12.5.0: Sun Sep 29 13:33:47 PDT 2013;
root:xnu-2050.48.12~1/RELEASE_X86_64 x86_64 i386
Total CPU cores: 8

### normal_startup ###
Min: 0.350545 -> 0.675245: 1.93x slower
Avg: 0.363317 -> 0.696069: 1.92x slower
Significant (t=-120.97)
Stddev: 0.01682 -> 0.00977: 1.7222x smaller

### startup_nosite ###
Min: 0.166232 -> 0.289506: 1.74x slower
Avg: 0.172511 -> 0.300979: 1.74x slower
Significant (t=-209.92)
Stddev: 0.00299 -> 0.00534: 1.7862x larger
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-dev/attachments/20131018/6e8e832a/attachment.html>