[IPython-dev] Help needed: stumped by odd MANIFEST.in/distutils behavior

[Paul Ivanov]

On Sun, Oct 9, 2011 at 1:51 PM, Fernando Perez <fperez.net at gmail.com> wrote:
> Hi folks,
>
> I was doing some build tests, and since I have mathjax in my local
> tree, it's getting included by default in the tree.  Fair enough, I
> thought: just add a prune rule to the MANIFEST.in file, and it's all
> good.  But for the life of me, I can't get anything to work in there,
> it looks like on my system, the manifest.in file is just getting
> ignored!  The relevant section reads:
>
> graft IPython
> prune IPython/deathrow
> prune IPython/frontend/html/notebook/static/mathjax
>
> but that mathjax directory is still getting copied over to the build
> dir when running `setup.py build`.  Furthermore, I don't even see a
> MANIFEST file be generated at all anymore, which I don't understand.
>
> >From reading the official docs:
>
> http://docs.python.org/distutils/sourcedist.html#manifest-related-options
>
> I don't understand at all why there's no manifest file being created,
> or why the manifest.in rules are being ignored.
>
> This is the behavior I'm seeing on ubuntu 10.10 and 11.10 boxes, both
> with python 2.6 and 2.7...
>
> We need to understand this one, because ignoring the various rules in
> the manifest.in will make the downloads unnecessarily large...
>
> I'm pretty stumped, so any ideas would be very much appreciated.

I took a brief look - it looks like something about distribute and
setuptools being used together.

Wit this:
23:20 at ipython(master)$ git diff
diff --git a/setup2.py b/setup2.py
index 1c12356..0c340b9 100755
--- a/setup2.py
+++ b/setup2.py
@@ -193,7 +193,7 @@ data_files = find_data_files()

 # For some commands, use setuptools.  Note that we do NOT list install here!
 # If you want a setuptools-enhanced install, just run 'setupegg.py install'
-needs_setuptools = set(('develop', 'sdist', 'release', 'bdist_egg',
'bdist_rpm',
+needs_setuptools = set(('develop', 'release', 'bdist_egg', 'bdist_rpm',
            'bdist', 'bdist_dumb', 'bdist_wininst', 'install_egg_info',
            'build_sphinx', 'egg_info', 'easy_install', 'upload',
             ))

23:21 at ipython(master)$ python setup.py sdist --manifest-only
mkdir -p build/html build/doctrees
sphinx-build -b html -d build/doctrees   source build/html
Running Sphinx v1.0.7

loading pickled environment... not yet created
building [html]: targets for 217 source files that are out of date
updating environment: 217 added, 0 changed, 0 removed
^C^Cing sources... [  2%] api/generated/IPython.config.configurable
make: *** [html] Error 1
============================================================================
BUILDING IPYTHON
                python: 2.7.2 |EPD 7.1-2 (32-bit)| (default, Jul 27 2011,
                        13:29:32)  [GCC 4.0.1 (Apple Inc. build 5493)]
              platform: darwin

OPTIONAL DEPENDENCIES
                sphinx: 1.0.7
              pygments: 1.4
                  nose: 1.0.0
               pexpect: no (required for running standalone doctests)
                 pyzmq: 2.1.7
              readline: yes
running sdist
running check
warning: sdist: standard file not found: should have one of README, README.txt

reading manifest template 'MANIFEST.in'
warning: no previously-included files found matching 'docs/#*'
no previously-included directories found matching 'docs/gh-pages'
warning: no previously-included files matching '*~' found anywhere in
distribution
warning: no previously-included files matching '*.flc' found anywhere
in distribution
warning: no previously-included files matching '.dircopy.log' found
anywhere in distribution
warning: no previously-included files matching '.svn' found anywhere
in distribution
warning: no previously-included files matching '.bzr' found anywhere
in distribution
warning: no previously-included files matching '.hgignore' found
anywhere in distribution
writing manifest file 'MANIFEST'
23:21 at ipython(master)$

best,
-- 
Paul Ivanov
314 address only used for lists,  off-list direct email at:
http://pirsquared.org | GPG/PGP key id: 0x0F3E28F7