[Distutils] distribute 0.7.3 causing installation error?

Liam Kirsher liamk at numenet.com
Thu Jul 18 06:28:13 CEST 2013


Hi,

I ran into an error about a month ago caused by a change in the PyPi
version of distribute.  Thankfully, someone was able to roll back the
change.  Unfortunately, I'm getting a similar kind of problem now -- and
I notice that 0.7.3 was released on 5 July, so... I'm wondering if it
might be related.  This is being included in a Chef recipe.

I'm attaching the pip.log, which shows it uninstalling distribute (which
looks like version 0.6.49), and then failing to find it and attempting
to install 0.7.3, and subsequent package installs failing.

Anyway, I'm not quite sure what to do here!  How can I fix this
problem?  (And also, how can I prevent it from happening in the future
by pegging the version to something that works?)


The pip recipe includes the following comments, which may be relevant.

> # Ubuntu's python-setuptools, python-pip and py thon-virtualenv packages
> # are broken...this feels like Rubygems!
> #
> http://stackoverflow.com/questions/4324558/whats-the-proper-way-to-install-pip-virtualenv-and-distribute-for-python
> # https://bitbucket.org/ianb/pip/issue/104/pip-uninstall-on-ubuntu-linux
> remote_file "#{Chef::Config[:file_cache_path]}/distribute_setup.py" do
>   source node['python']['distribute_script_url']
>   mode "0644"
>   not_if { ::File.exists?(pip_binary) }
> end
> execute "install-pip" do
>   cwd Chef::Config[:file_cache_path]
>   command <<-EOF
> #{node['python']['binary']} distribute_setup.py
> --download-base=#{node['python']['distribute_option']['download_base']}
> #{::File.dirname(pip_binary)}/easy_install pip
> EOF
>   not_if { ::File.exists?(pip_binary) }
> end



Chef run log:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe:
> python::virtualenv
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   *
> python_pip[virtualenv] action install
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     - install package
> python_pip[virtualenv] version latest
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe:
> supervisor::default
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   *
> python_pip[supervisor] action upgrade
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ================================================================================
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Error executing
> action `upgrade` on resource 'python_pip[supervisor]'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ================================================================================
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> Mixlib::ShellOut::ShellCommandFailed
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ------------------------------------
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Expected process to
> exit with [0], but received '1'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- Begin output of
> pip install  --upgrade supervisor ----
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDOUT:
> Downloading/unpacking supervisor
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package supervisor
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking
> distribute from
> https://pypi.python.org/packages/source/d/distribute/distribute-0.7.3.zip#md5=c6c59594a7b180af57af8a0cc0cf5b4a
> (from supervisor)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package distribute
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking
> meld3>=0.6.5 (from supervisor)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package meld3
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking
> setuptools>=0.7 (from distribute->supervisor)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing collected
> packages: supervisor, distribute, meld3, setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> install for supervisor
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Skipping
> installation of
> /usr/local/lib/python2.7/dist-packages/supervisor/__init__.py
> (namespace package)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> /usr/local/lib/python2.7/dist-packages/supervisor-3.0b2-py2.7-nspkg.pth
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> echo_supervisord_conf script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> pidproxy script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> supervisorctl script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> supervisord script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Found existing
> installation: distribute 0.6.49
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Uninstalling
> distribute:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com       Successfully
> uninstalled distribute
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> install for distribute
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> install for meld3
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most
> recent call last):
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com       File
> "<string>", line 1, in <module>
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     ImportError: No
> module named setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Complete output
> from command /usr/bin/python -c "import
> setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n',
> '\n'), __file__, 'exec'))" install --record
> /tmp/pip-mDCOBa-record/install-record.txt
> --single-version-externally-managed:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most
> recent call last):
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   File "<string>",
> line 1, in <module>
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No
> module named setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ----------------------------------------
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Command
> /usr/bin/python -c "import setuptools;__file__='/tmp/pip-build
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> -root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n',
> '\n'), __file__, 'exec'))" install --record
> /tmp/pip-mDCOBa-record/install-record.txt
> --single-version-externally-managed failed with error code 1 in
> /tmp/pip-build-root/meld3
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Storing complete log
> in /home/ubuntu/.pip/pip.log
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDERR:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- End output of
> pip install  --upgrade supervisor ----
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Ran pip install 
> --upgrade supervisor returned 1
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Cookbook Trace:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---------------
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> /var/chef/cache/cookbooks/python/providers/pip.rb:155:in `pip_cmd'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> /var/chef/cache/cookbooks/python/providers/pip.rb:139:in `install_package'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> /var/chef/cache/cookbooks/python/providers/pip.rb:144:in `upgrade_package'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> /var/chef/cache/cookbooks/python/providers/pip.rb:60:in `block (2
> levels) in class_from_file'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> /var/chef/cache/cookbooks/python/providers/pip.rb:58:in `block in
> class_from_file'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Resource Declaration:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---------------------
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com # In
> /var/chef/cache/cookbooks/supervisor/recipes/default.rb
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com  29: python_pip
> "supervisor" do
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com  30:   action :upgrade
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com  31:   version
> node['supervisor']['version'] if node['supervisor']['version']
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com  32: end
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com  33:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Compiled Resource:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ------------------
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com # Declared in
> /var/chef/cache/cookbooks/supervisor/recipes/default.rb:29:in `from_file'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> python_pip("supervisor") do
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   action [:upgrade]
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   retries 0
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   retry_delay 2
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   cookbook_name
> "supervisor"
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   recipe_name "default"
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   package_name
> "supervisor"
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   timeout 900
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   options " --upgrade"
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com end
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: ntp::default
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   * service[ntp]
> action restart
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     - restart service
> service[ntp]
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Recipe: rabbitmq::default
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   *
> service[rabbitmq-server] action restart
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     - restart service
> service[rabbitmq-server]
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> [2013-07-16T02:36:50+00:00] ERROR: Running exception handlers
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> [2013-07-16T02:36:51+00:00] FATAL: Saving node information to
> /var/chef/cache/failed-run-data.json
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> [2013-07-16T02:36:51+00:00] ERROR: Exception handlers complete
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Chef Client failed.
> 35 resources updated
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> [2013-07-16T02:36:51+00:00] FATAL: Stacktrace dumped to
> /var/chef/cache/chef-stacktrace.out
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> [2013-07-16T02:36:51+00:00] FATAL:
> Mixlib::ShellOut::ShellCommandFailed: python_pip[supervisor]
> (supervisor::default line 29) had an error:
> Mixlib::ShellOut::ShellCommandFailed: Expected process to exit with
> [0], but received '1'
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- Begin output of
> pip install  --upgrade supervisor ----
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDOUT:
> Downloading/unpacking supervisor
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package supervisor
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking
> distribute from
> https://pypi.python.org/packages/source/d/distribute/distribute-0.7.3.zip#md5=c6c59594a7b180af57af8a0cc0cf5b4a
> (from supervisor)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package distribute
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking
> meld3>=0.6.5 (from supervisor)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package meld3
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Downloading/unpacking
> setuptools>=0.7 (from distribute->supervisor)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> egg_info for package setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Installing collected
> packages: supervisor, distribute, meld3, setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> install for supervisor
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Skipping
> installation of
> /usr/local/lib/python2.7/dist-packages/supervisor/__init__.py
> (namespace package)
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> /usr/local/lib/python2.7/dist-packages/supervisor-3.0b2-py2.7-nspkg.pth
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> echo_supervisord_conf script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> pidproxy script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> supervisorctl script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Installing
> supervisord script to /usr/local/bin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Found existing
> installation: distribute 0.6.49
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Uninstalling
> distribute:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com       Successfully
> uninstalled distribute
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> install for distribute
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   Running setup.py
> install for meld3
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most
> recent call last):
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com       File
> "<string>", line 1, in <module>
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     ImportError: No
> module named setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Complete output
> from command /usr/bin/python -c "import
> setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n',
> '\n'), __file__, 'exec'))" install --record
> /tmp/pip-mDCOBa-record/install-record.txt
> --single-version-externally-managed:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com     Traceback (most
> recent call last):
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com   File "<strin
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com g>", line 1, in <module>
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ImportError: No
> module named setuptools
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com
> ----------------------------------------
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Command
> /usr/bin/python -c "import
> setuptools;__file__='/tmp/pip-build-root/meld3/setup.py';exec(compile(open(__file__).read().replace('\r\n',
> '\n'), __file__, 'exec'))" install --record
> /tmp/pip-mDCOBa-record/install-record.txt
> --single-version-externally-managed failed with error code 1 in
> /tmp/pip-build-root/meld3
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Storing complete log
> in /home/ubuntu/.pip/pip.log
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com STDERR:
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com ---- End output of
> pip install  --upgrade supervisor ----
> ec2-54-245-36-62.us-west-2.compute.amazonaws.com Ran pip install 
> --upgrade supervisor returned 1

-- 
Liam Kirsher
PGP: http://liam.numenet.com/pgp/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/distutils-sig/attachments/20130717/32c56b15/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: pip.log
Type: text/x-log
Size: 149042 bytes
Desc: not available
URL: <http://mail.python.org/pipermail/distutils-sig/attachments/20130717/32c56b15/attachment-0001.bin>


More information about the Distutils-SIG mailing list