[IPython-dev] Confusing NameError in Parallelizing with IPython

MinRK benjaminrk at gmail.com
Fri Sep 7 17:04:55 EDT 2012


On Fri, Sep 7, 2012 at 1:48 PM, Michael Bilow <michael.k.bilow at gmail.com>wrote:

> Hi!
>
> I'm new to this list and to IPython, and I started using IPython to
> parallelize some code I'd written (complete code:
> https://github.com/chuyelchulo/ipython-nameerror, requires numpy and
> PIL). I've been encountering a confusing NameError that keeps popping up
> when I try to run this program: The function to be mapped (parallel_run) is
> imported from a module different from __main__, but the interpreter
> complains that the functions and modules used by parallel_run are not part
> of the namespace.
>
> I asked about the error here (
> http://stackoverflow.com/questions/12304847/ipython-parallel-computing-namespace-issues),
> and was told to come to this list.
>

Hi again!

When I do the following:

$> cd /path/to/ipython-nameerror
$> ipcluster start -n 4 --daemon
$> python wrapper_wrapper.py
Time elapsed:  5.85908985138 s

It seems to work as expected.

A few quick questions:

1. what is the cwd when you run ipcluster?  Are your engines local or
remote?  What do you get from:

import os
import pprint
from IPython import parallel

client = parallel.Client()
pprint.pprint(client[:].apply_async(os.getcwdu).get_dict())

or:

%px import wrapper

If I start the engines somewhere else such that `wrapper` is not
importable, I get the NameErrors you are seeing.

-MinRK


> Thanks!
>
> Michael
>
> _______________________________________________
> IPython-dev mailing list
> IPython-dev at scipy.org
> http://mail.scipy.org/mailman/listinfo/ipython-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20120907/ebc0cfca/attachment.html>


More information about the IPython-dev mailing list