From ccordoba12 at gmail.com Sat Feb 1 00:21:31 2014 From: ccordoba12 at gmail.com (=?UTF-8?B?Q2FybG9zIEPDs3Jkb2Jh?=) Date: Sat, 01 Feb 2014 00:21:31 -0500 Subject: [IPython-dev] Embedding IPython in IEP In-Reply-To: References: <52E1DBFD.8010509@gmail.com> Message-ID: <52EC845B.9060003@gmail.com> Hi Almar, El 24/01/14 17:13, Almar Klein escribi?: > > Just a quick question: why are not you guys using > RichIPythonWidget from the IPython.qt submodule? I mention it because > > a) It seems easier to use in a Qt environment than InteractiveShell. > > > Since we already have kernel-IDE communication, debugging, etc. > implemented, using an approach that integrates in a light manner with > our existing framework seemed an easy solution. And until now it seems > a pretty good approach. But I will have a look at the qt module too to > see what it brings extra and what extra work it would entail to > integrate it with IEP. > > b) I think your users would expect the same IPython behavior as > Canopy and Spyder offer through it right now. > > > What kind of behavior do you mean? Well, I mean matplotlib inline plots, pretty printing of sympy objects (using latex or matplotlib), pandas dataframes (using html) and any other object that uses the rich display IPython system. Cheers, Carlos > > - Almar > > > > > Cheers, > Carlos > > El 20/01/14 09:14, Almar Klein escribi?: >> Hi all, >> >> I am currently working on embedding IPython in IEP (Interactive >> Editor for Python - http://iep-project.org), and I am interested >> in getting some feedback. >> >> The approach that I am taking right now is to hook into IPython >> at a rather low level and integrate it with relatively small >> changes to the existing code-base for the IEP kernel. It >> basically comes down to this: >> >> from IPython.core.interactiveshell import InteractiveShell >> >> self._ipython = InteractiveShell(user_module=__main__) >> # set a few hooks ... >> ... >> # When user is sending a line to execute ... >> if self._ipython: >> >> self._ipython.run_cell(source, True) >> >> else: >> >> self._run_cell_natively(source) >> >> >> Apart from this I use custom prompts at sys.ps1 and sys ps2 to >> simulate the IPython prompts, plus a handfull of small tweaks to >> make things work as expected. >> >> >> The kernel runs the event loop as usual and arranges for GUI >> integration. >> >> >> So far things are looking good and everything seems to work as >> expected. I was mostly wondering whether this approach has any >> limitations that I overlooked, like some specific IPython feature >> that is not available with this approach. Also, I would be happy >> to learn any specific things that I should take into account. >> >> >> Thanks in advance, >> >> Almar >> >> >> >> >> >> >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > -- > Almar Klein, PhD > Science Applied > phone: +31 6 19268652 > e-mail: a.klein at science-applied.nl > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: From jabooth at gmail.com Sun Feb 2 10:44:49 2014 From: jabooth at gmail.com (James Booth) Date: Sun, 2 Feb 2014 15:44:49 +0000 Subject: [IPython-dev] Strange %matplotlib qt behavior OS X 10.9 Message-ID: Hi guys, I'm seeing strange behaviour with the %matplotlib qt magic on OS X 10.9 when using Mayavi. Basically, on creation of a notebook (with only `ipython notebook` being run, no pylab/gui mode set), running a cell like this: %matplotlib qt ... import + do work with mayavi Causes the kernel to hang, whereas %matplotlib qt # returns fine -- NEW CELL -- ... import + do work with mayavi # returns fine works as expected. I've exemplified it in a notebook, with additional details: http://nbviewer.ipython.org/gist/jabooth/8770104 Any ideas what might be causing this? I thought App Nap might be an issue, but I see a fix has already been issued for this: https://github.com/ipython/ipython/pull/4453 Note I am running off a recent master. Best wishes James -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Sun Feb 2 14:35:22 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Sun, 2 Feb 2014 11:35:22 -0800 Subject: [IPython-dev] Strange %matplotlib qt behavior OS X 10.9 In-Reply-To: References: Message-ID: Hi James, I don't have a solution handy, but FWIW, it's not a mac/osx problem: I can replicate the issue here on linux as well... Would you mind filing a bug on this on the tracker? Thanks! f On Sun, Feb 2, 2014 at 7:44 AM, James Booth wrote: > Hi guys, > > I'm seeing strange behaviour with the %matplotlib qt magic on OS X 10.9 > when using Mayavi. > > Basically, on creation of a notebook (with only `ipython notebook` being > run, no pylab/gui mode set), running a cell like this: > > %matplotlib qt > ... import + do work with mayavi > > Causes the kernel to hang, whereas > > %matplotlib qt # returns fine > -- NEW CELL -- > ... import + do work with mayavi # returns fine > > works as expected. > > I've exemplified it in a notebook, with additional details: > http://nbviewer.ipython.org/gist/jabooth/8770104 > > Any ideas what might be causing this? I thought App Nap might be an issue, > but I see a fix has already been issued for this: > https://github.com/ipython/ipython/pull/4453 > > Note I am running off a recent master. > > Best wishes > James > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: From jabooth at gmail.com Sun Feb 2 16:02:48 2014 From: jabooth at gmail.com (James Booth) Date: Sun, 2 Feb 2014 21:02:48 +0000 Subject: [IPython-dev] Strange %matplotlib qt behavior OS X 10.9 In-Reply-To: References: Message-ID: Hi Fernando, Thanks for confirming that. Not a problem, here's the bug report: https://github.com/ipython/ipython/issues/4997 Let me know if I can do any more to help. Best wishes James On 2 February 2014 19:35, Fernando Perez wrote: > Hi James, > > I don't have a solution handy, but FWIW, it's not a mac/osx problem: I can > replicate the issue here on linux as well... > > Would you mind filing a bug on this on the tracker? > > Thanks! > > f > > > On Sun, Feb 2, 2014 at 7:44 AM, James Booth wrote: > >> Hi guys, >> >> I'm seeing strange behaviour with the %matplotlib qt magic on OS X 10.9 >> when using Mayavi. >> >> Basically, on creation of a notebook (with only `ipython notebook` being >> run, no pylab/gui mode set), running a cell like this: >> >> %matplotlib qt >> ... import + do work with mayavi >> >> Causes the kernel to hang, whereas >> >> %matplotlib qt # returns fine >> -- NEW CELL -- >> ... import + do work with mayavi # returns fine >> >> works as expected. >> >> I've exemplified it in a notebook, with additional details: >> http://nbviewer.ipython.org/gist/jabooth/8770104 >> >> Any ideas what might be causing this? I thought App Nap might be an >> issue, but I see a fix has already been issued for this: >> https://github.com/ipython/ipython/pull/4453 >> >> Note I am running off a recent master. >> >> Best wishes >> James >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Sun Feb 2 16:32:02 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Sun, 2 Feb 2014 13:32:02 -0800 Subject: [IPython-dev] Strange %matplotlib qt behavior OS X 10.9 In-Reply-To: References: Message-ID: Great, thanks! I guess for now, use the split-cell workaround, which at least exists. We can track further discussion on the GH page. On Sun, Feb 2, 2014 at 1:02 PM, James Booth wrote: > Hi Fernando, > > Thanks for confirming that. Not a problem, here's the bug report: > https://github.com/ipython/ipython/issues/4997 > > Let me know if I can do any more to help. > > Best wishes > James > > > > On 2 February 2014 19:35, Fernando Perez wrote: > >> Hi James, >> >> I don't have a solution handy, but FWIW, it's not a mac/osx problem: I >> can replicate the issue here on linux as well... >> >> Would you mind filing a bug on this on the tracker? >> >> Thanks! >> >> f >> >> >> On Sun, Feb 2, 2014 at 7:44 AM, James Booth wrote: >> >>> Hi guys, >>> >>> I'm seeing strange behaviour with the %matplotlib qt magic on OS X 10.9 >>> when using Mayavi. >>> >>> Basically, on creation of a notebook (with only `ipython notebook` being >>> run, no pylab/gui mode set), running a cell like this: >>> >>> %matplotlib qt >>> ... import + do work with mayavi >>> >>> Causes the kernel to hang, whereas >>> >>> %matplotlib qt # returns fine >>> -- NEW CELL -- >>> ... import + do work with mayavi # returns fine >>> >>> works as expected. >>> >>> I've exemplified it in a notebook, with additional details: >>> http://nbviewer.ipython.org/gist/jabooth/8770104 >>> >>> Any ideas what might be causing this? I thought App Nap might be an >>> issue, but I see a fix has already been issued for this: >>> https://github.com/ipython/ipython/pull/4453 >>> >>> Note I am running off a recent master. >>> >>> Best wishes >>> James >>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> >> -- >> Fernando Perez (@fperez_org; http://fperez.org) >> fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) >> fernando.perez-at-berkeley: contact me here for any direct mail >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: From zvoros at gmail.com Mon Feb 3 06:15:45 2014 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Mon, 03 Feb 2014 12:15:45 +0100 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? Message-ID: <52EF7A61.1010003@gmail.com> Hi all, When a notebook contains sympy-generated latex code, the latex content is not rendered on load, instead an "Untrusted text/latex output ignored." messageis displayed. On the other hand, latex in a markdown cell is trusted, and rendered properly. Is there a way to instruct the notebook to "trust" the latex code even in the output field of a code cell? Are there any security issues involved here? Cheers, Zolt?n -------------- next part -------------- An HTML attachment was scrubbed... URL: From damianavila at gmail.com Mon Feb 3 07:10:49 2014 From: damianavila at gmail.com (=?ISO-8859-1?Q?Dami=E1n_Avila?=) Date: Mon, 3 Feb 2014 10:10:49 -0200 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: <52EF7A61.1010003@gmail.com> References: <52EF7A61.1010003@gmail.com> Message-ID: You have to trust your notebook: https://github.com/ipython/ipython/pull/4824/files#diff-bc52f1067c30eefcdb7ec4212e7d843aR467 This is the relevant PR, just merged a couple of day ago: https://github.com/ipython/ipython/pull/4824 But Brian is working in sanitizing the markdown cells too... so we are waiting a little bit to announce this "trust" feature to the list. 2014-02-03 Zolt?n V?r?s : > Hi all, > > When a notebook contains sympy-generated latex code, the latex content is > not rendered on load, instead an "Untrusted text/latex output ignored." > message is displayed. On the other hand, latex in a markdown cell is > trusted, and rendered properly. Is there a way to instruct the notebook to > "trust" the latex code even in the output field of a code cell? Are there > any security issues involved here? > > Cheers, > Zolt?n > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Dami?n Avila Scientific Python Developer Quantitative Finance Analyst Statistics, Biostatistics and Econometrics Consultant Biochemist -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Mon Feb 3 07:15:11 2014 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Mon, 3 Feb 2014 13:15:11 +0100 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: <52EF7A61.1010003@gmail.com> References: <52EF7A61.1010003@gmail.com> Message-ID: Hi zoltan, we havent yet posted info on the ML about that and will do soon. In short, we sign the notebook when you save it, and if the signaure don't mach we don't render potentially dangerous ouput. We will do the same in markdown soon if it contains script tag. WhiteListing latex might be an oversight. If you rerun the all notebook and save, the ouput should be tusted, a least for you, more info soon. -- Matthias On Mon, Feb 3, 2014 at 12:15 PM, Zolt?n V?r?s wrote: > Hi all, > > When a notebook contains sympy-generated latex code, the latex content is > not rendered on load, instead an "Untrusted text/latex output ignored." > message is displayed. On the other hand, latex in a markdown cell is > trusted, and rendered properly. Is there a way to instruct the notebook to > "trust" the latex code even in the output field of a code cell? Are there > any security issues involved here? > > Cheers, > Zolt?n > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From zvoros at gmail.com Mon Feb 3 07:23:20 2014 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Mon, 03 Feb 2014 13:23:20 +0100 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: References: <52EF7A61.1010003@gmail.com> Message-ID: <52EF8A38.8010304@gmail.com> Hi Dami?n, Thanks for the feedback! On 03/02/14 13:10, Dami?n Avila wrote: > You have to trust your notebook: > https://github.com/ipython/ipython/pull/4824/files#diff-bc52f1067c30eefcdb7ec4212e7d843aR467 > > > This is the relevant PR, just merged a couple of day ago: > https://github.com/ipython/ipython/pull/4824 I am using the latest from master, so this should not be an issue. > > But Brian is working in sanitizing the markdown cells too... so we are > waiting a little bit to announce this "trust" feature to the list. > I also figured that I have the same problem with SVG figures. Those are also untrusted, and don't render. PNG figures seem to be OK. @Mathias > In short, we sign the notebook when you save it, and if the signaure > don't mach we don't render potentially dangerous ouput. > We will do the same in markdown soon if it contains script tag. > > WhiteListing latex might be an oversight. > > If you rerun the all notebook and save, the ouput should be tusted, a > least for you, more info soon. Does that mean that the whole notebook has to be rerun? Because if I re-run only the affected cells, that is not enough, I still have to the issue, when I open the notebook again, those cells still fail to render. Cheers, Zolt?n -------------- next part -------------- An HTML attachment was scrubbed... URL: From ronena at gmail.com Mon Feb 3 10:48:06 2014 From: ronena at gmail.com (Ronen Abravanel) Date: Mon, 3 Feb 2014 17:48:06 +0200 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: <52EF8A38.8010304@gmail.com> References: <52EF7A61.1010003@gmail.com> <52EF8A38.8010304@gmail.com> Message-ID: Hi, Is there any way to trust a notebook without running it? It seems common to me to send someone a notebook to show him a result, when he can not \ should not run (some of ) the code cell. For example, if some code cells contains very long computation or try to read from a data file that dose not present on a colleague's computer. The extreme case is "send him an HTML output" of the notebook", but if he can run most of the code cells but not all, I should either send an HTML-exported notebook or a runable notebook. ? -------------- next part -------------- An HTML attachment was scrubbed... URL: From zvoros at gmail.com Mon Feb 3 10:50:51 2014 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Mon, 03 Feb 2014 16:50:51 +0100 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: References: <52EF7A61.1010003@gmail.com> Message-ID: <52EFBADB.8020100@gmail.com> Hi all, I don't want to be seen as impatient, or anything like that, but I feel that this signature thing is somehow broken, so I would like to follow up on Dami?n's and Matthias' comments. No matter what I do, if I try to use an old notebook (old meaning created last Friday:) its content is not trusted. I have run ipython trust mynotebook.ipynb and I can see the signature at the top of the file. However, latex/svg are still not displayed. According to the PR that Dami?n referred to, only javascript and HTML items should be affected by this change, although, I understand that SVG might also be exploited for some injection attack. All this is not a major issue for me at the moment, I would just like to make sure that the developers know about it. Chees, Zolt?n On 03/02/14 13:15, Matthias Bussonnier wrote: > Hi zoltan, > > we havent yet posted info on the ML about that and will do soon. > > > In short, we sign the notebook when you save it, and if the signaure > don't mach we don't render potentially dangerous ouput. > We will do the same in markdown soon if it contains script tag. > > WhiteListing latex might be an oversight. > > If you rerun the all notebook and save, the ouput should be tusted, a > least for you, more info soon. > > -- > Matthias > > > > > On Mon, Feb 3, 2014 at 12:15 PM, Zolt?n V?r?s > wrote: > > Hi all, > > When a notebook contains sympy-generated latex code, the latex > content is not rendered on load, instead an "Untrusted text/latex > output ignored." messageis displayed. On the other hand, latex in > a markdown cell is trusted, and rendered properly. Is there a way > to instruct the notebook to "trust" the latex code even in the > output field of a code cell? Are there any security issues > involved here? > > Cheers, > Zolt?n > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Mon Feb 3 15:56:08 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Mon, 3 Feb 2014 21:56:08 +0100 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: <52EFBADB.8020100@gmail.com> References: <52EF7A61.1010003@gmail.com> <52EFBADB.8020100@gmail.com> Message-ID: <125266F7-8762-478D-8E21-340E28B9D797@gmail.com> Le 3 f?vr. 2014 ? 16:50, Zolt?n V?r?s a ?crit : > Hi all, > > I don't want to be seen as impatient, or anything like that, but I feel that this signature thing is somehow broken, so I would like to follow up on Dami?n's and Matthias' comments. > > No matter what I do, if I try to use an old notebook (old meaning created last Friday:) its content is not trusted. I have run > > ipython trust mynotebook.ipynb > > and I can see the signature at the top of the file. However, latex/svg are still not displayed. According to the PR that Dami?n referred to, only javascript and HTML items should be affected by this change, although, I understand that SVG might also be exploited for some injection attack. > > All this is not a major issue for me at the moment, I would just like to make sure that the developers know about it. Please open a issue on github. we'll figure it out. -- M > > Chees, > Zolt?n > > On 03/02/14 13:15, Matthias Bussonnier wrote: >> Hi zoltan, >> >> we havent yet posted info on the ML about that and will do soon. >> >> >> In short, we sign the notebook when you save it, and if the signaure don't mach we don't render potentially dangerous ouput. >> We will do the same in markdown soon if it contains script tag. >> >> WhiteListing latex might be an oversight. >> >> If you rerun the all notebook and save, the ouput should be tusted, a least for you, more info soon. >> >> -- >> Matthias >> >> >> >> >> On Mon, Feb 3, 2014 at 12:15 PM, Zolt?n V?r?s wrote: >> Hi all, >> >> When a notebook contains sympy-generated latex code, the latex content is not rendered on load, instead an "Untrusted text/latex output ignored." message is displayed. On the other hand, latex in a markdown cell is trusted, and rendered properly. Is there a way to instruct the notebook to "trust" the latex code even in the output field of a code cell? Are there any security issues involved here? >> >> Cheers, >> Zolt?n >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From bussonniermatthias at gmail.com Mon Feb 3 15:57:30 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Mon, 3 Feb 2014 21:57:30 +0100 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: References: <52EF7A61.1010003@gmail.com> <52EF8A38.8010304@gmail.com> Message-ID: <92EF4DAA-DD9E-495A-B6D4-CECED7AEB542@gmail.com> Le 3 f?vr. 2014 ? 16:48, Ronen Abravanel a ?crit : > Hi, > > Is there any way to trust a notebook without running it? It seems common to me to send someone a notebook to show him a result, when he can not \ should not run (some of ) the code cell. > > For example, if some code cells contains very long computation or try to read from a data file that dose not present on a colleague's computer. > > The extreme case is "send him an HTML output" of the notebook", but if he can run most of the code cells but not all, I should either send an HTML-exported notebook or a runable notebook. Yes there is a way(ipython trust ), and we will bundle nbviewer in ipython at she point so that you can view a notebook with full output without the risks. Nbconvert to export as HTML also should works. -- M > > > ? > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From zvoros at gmail.com Mon Feb 3 16:05:16 2014 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Mon, 03 Feb 2014 22:05:16 +0100 Subject: [IPython-dev] what is this "Untrusted text/latex output ignored." stuff? In-Reply-To: <125266F7-8762-478D-8E21-340E28B9D797@gmail.com> References: <52EF7A61.1010003@gmail.com> <52EFBADB.8020100@gmail.com> <125266F7-8762-478D-8E21-340E28B9D797@gmail.com> Message-ID: <52F0048C.3000201@gmail.com> Done. https://github.com/ipython/ipython/issues/5009 Z. On 03/02/14 21:56, Matthias BUSSONNIER wrote: > Le 3 f?vr. 2014 ? 16:50, Zolt?n V?r?s a ?crit : > >> Hi all, >> >> I don't want to be seen as impatient, or anything like that, but I feel that this signature thing is somehow broken, so I would like to follow up on Dami?n's and Matthias' comments. >> >> No matter what I do, if I try to use an old notebook (old meaning created last Friday:) its content is not trusted. I have run >> >> ipython trust mynotebook.ipynb >> >> and I can see the signature at the top of the file. However, latex/svg are still not displayed. According to the PR that Dami?n referred to, only javascript and HTML items should be affected by this change, although, I understand that SVG might also be exploited for some injection attack. >> >> All this is not a major issue for me at the moment, I would just like to make sure that the developers know about it. > > Please open a issue on github. we'll figure it out. -------------- next part -------------- An HTML attachment was scrubbed... URL: From nezar at mit.edu Mon Feb 3 18:53:08 2014 From: nezar at mit.edu (Nezar Alexander Abdennur) Date: Mon, 3 Feb 2014 18:53:08 -0500 Subject: [IPython-dev] plugin for Sublime Text editor Message-ID: Hello devs, First time caller, occasional listener (...just another procrastinating grad student :p) . I would first of all, just like to thank you for all your great work! IPython is a wonderful tool! So, I'm not much of a vim or emacs person (yet!), but I do enjoy using SublimeText as a general purpose editor. It's sexy and cross-platform. Though, one thing I missed from my old work flows in Matlab was to be able to evaluate small code snippets between double-comment tags -- similar to notebook cells but without the output being embedded in the document. So I wrote a small plugin to do just that with Sublime. I thought I would share. Any feedback or ideas are more than welcome! https://github.com/nvictus/SublimeIPython It's really just a little hack: the plugin opens a default python or a virtualenv python subprocess to connect to an existing kernel instance and execute the cell code. Right now, the script runs on the editor's main thread, but I've got a nonblocking version in development on a separate branch. One issue I ran into is that I can't figure out how to obtain the stdout when I send code over the execute wire so that, e.g. I can display the output of print statements either in the text editor's console or, better yet, in the terminal console. Is this possible? I actually got a chance to meet and talk to Fernando briefly at a data science symposium at Harvard just over a week ago, and he encouraged me to ping the mailing list. He also pointed me to the very similar vim-ipython project, which I'll definitely be taking a look at for inspiration! :) Cheers, Nezar -------------- next part -------------- An HTML attachment was scrubbed... URL: From jiffyclub at gmail.com Mon Feb 3 19:01:56 2014 From: jiffyclub at gmail.com (Matt Davis) Date: Mon, 3 Feb 2014 16:01:56 -0800 Subject: [IPython-dev] plugin for Sublime Text editor In-Reply-To: References: Message-ID: You might be interested in a couple of similar plugins: https://github.com/maximsch2/SublimeIPythonNotebook https://github.com/wuub/SublimeREPL Best, Matt On Mon, Feb 3, 2014 at 3:53 PM, Nezar Alexander Abdennur wrote: > Hello devs, > > First time caller, occasional listener (...just another procrastinating > grad student :p) . I would first of all, just like to thank you for all > your great work! IPython is a wonderful tool! > > So, I'm not much of a vim or emacs person (yet!), but I do enjoy using > SublimeText as a general purpose editor. It's sexy and cross-platform. > Though, one thing I missed from my old work flows in Matlab was to be able > to evaluate small code snippets between double-comment tags -- similar to > notebook cells but without the output being embedded in the document. So I > wrote a small plugin to do just that with Sublime. I thought I would share. > Any feedback or ideas are more than welcome! > > https://github.com/nvictus/SublimeIPython > > It's really just a little hack: the plugin opens a default python or a > virtualenv python subprocess to connect to an existing kernel instance and > execute the cell code. Right now, the script runs on the editor's main > thread, but I've got a nonblocking version in development on a separate > branch. > > One issue I ran into is that I can't figure out how to obtain the stdout > when I send code over the execute wire so that, e.g. I can display the > output of print statements either in the text editor's console or, better > yet, in the terminal console. Is this possible? > > I actually got a chance to meet and talk to Fernando briefly at a data > science symposium at Harvard just over a week ago, and he encouraged me to > ping the mailing list. He also pointed me to the very similar vim-ipython > project, which I'll definitely be taking a look at for inspiration! :) > > Cheers, > > Nezar > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Mon Feb 3 19:18:59 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 3 Feb 2014 16:18:59 -0800 Subject: [IPython-dev] plugin for Sublime Text editor In-Reply-To: References: Message-ID: On 3 February 2014 15:53, Nezar Alexander Abdennur wrote: > One issue I ran into is that I can't figure out how to obtain the stdout > when I send code over the execute wire so that, e.g. I can display the > output of print statements either in the text editor's console or, better > yet, in the terminal console. Is this possible? > There's a second ZMQ socket which will publish output - stdout will come in a 'stream' message: http://ipython.org/ipython-doc/dev/development/messaging.html#messages-on-the-pub-sub-socket Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From benjaminrk at gmail.com Mon Feb 3 20:40:43 2014 From: benjaminrk at gmail.com (MinRK) Date: Mon, 3 Feb 2014 17:40:43 -0800 Subject: [IPython-dev] Parallel computing segfault behavior In-Reply-To: <0DC1CAB7F6C7FC4A8B54EE1FD49046990FB7E021@ap-embx-sp20.RES.AD.JPL> References: <0DC1CAB7F6C7FC4A8B54EE1FD49046990FB7E021@ap-embx-sp20.RES.AD.JPL> Message-ID: Supervisord might be the easiest way to relaunch engines, but you can run a Client and watch for engine unregistration notifications, and when they come, just start a new engine in its place. On Wed, Jan 29, 2014 at 9:48 AM, Drain, Theodore R (392P) < theodore.r.drain at jpl.nasa.gov> wrote: > I'd be interested in an automatic restart capability as well. We have > some very long running jobs where a loss of one more more engines might be > a problem. Could you outline what you mean by an "extra watcher"? Is that > just a Client object that polls the engine id's to see if they change (I > assume UUID's would be needed, not the simple integer id's)? > > Thanks, > Ted > > ------------------------------ > *From:* ipython-dev-bounces at scipy.org [ipython-dev-bounces at scipy.org] on > behalf of Min RK [benjaminrk at gmail.com] > *Sent:* Wednesday, January 29, 2014 9:29 AM > *To:* IPython developers list > *Cc:* IPython developers list > *Subject:* Re: [IPython-dev] Parallel computing segfault behavior > > > > On Jan 29, 2014, at 5:56, Patrick Fuller wrote: > > Thanks for that code! It's good to know that the remaining cores are > still working and that the results are all recoverable. > > One last question: each segfault offlines an engine, which means that > the cluster slows down and eventually crashes as the number of segfaults > approaches the number of ipengines. Should the controller instead start new > engines to take the place of killed ones? > > > No, engine management is done by the user at this point, the controller > never starts an engine. If you want to monitor the cluster and bring up > replacement engines, this is not hard to do with an extra watcher (or > starting engines with supervisord, etc.) > > > Thanks, > Pat > > On Tuesday, January 28, 2014, MinRK wrote: > >> >> >> On Tue, Jan 28, 2014 at 5:04 PM, Patrick Fuller >> > wrote: >> >>> ...the difference being that this would require starting a new engine on >>> each segfault >>> >>> >>> On Tuesday, January 28, 2014, Patrick Fuller > >>> wrote: >>> >>>> I guess my question is more along the lines of: should the cluster >>>> continue on to complete the queued jobs (as it would if the segfaults were >>>> instead python exceptions)? >>> >>> >> I see what you mean - the generator halts when it sees an exception, so >> it's inconvenient to get the successes, while ignoring the failures. I >> guess we could add separate methods that only iterate through just the >> successful results. >> >> As far as task submission goes, it does indeed do what you seem to >> expect, so it's just viewing the results where there is an issue. >> >> Here is an example of >> iterating through only the successful results of a map that segfaults. >> >> -MinRK >> >> >> >> On Tuesday, January 28, 2014, MinRK wrote: >> >> I get an EngineError when an engine dies running a task: >> >> http://nbviewer.ipython.org/gist/minrk/8679553 >> >> I think this is the desired behavior. >> >> >> On Tue, Jan 28, 2014 at 2:18 PM, Patrick Fuller wrote: >> >> Hi, >> >> Has there been any discussion around how ipython parallel handles >> segfaulting? >> >> To make this question more specific, the following code will cause some >> workers to crash. All results will become unreadable (or at least >> un-iterable), and future runs require a restart of the cluster. Is this >> behavior intended, or is it just something that hasn?t been discussed? >> >> from IPython.parallel import Clientfrom random import random >> def segfaulty_function(random_number, chance=0.25): >> if random_number < chance: >> import ctypes >> i = ctypes.c_char('a') >> j = ctypes.pointer(i) >> c = 0 >> while True: >> j[c] = 'a' >> c += 1 >> return j >> else: >> return random_number >> >> view = Client(profile="something-parallel-here").load_balanced_view() >> results = view.map(segfaulty_function, [random() for _ in range(100)]) >> for i, result in enumerate(results): >> print i, result >> >> Backstory: Recently I?ve been working with a large monte carlo library >> that segfaults for, like, no reason at all. It?s due to some weird >> underlying random number issue and happens once every 5-10 thousand runs. I >> currently have each worker spin out a child process to isolate the >> occasional segfault, but this seems excessive. (I'm also trying to fix the >> source of the segfaults, but debugging is a slow process.) >> >> Thanks, >> Pat >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.sci >> >> >> _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From alimanfoo at googlemail.com Tue Feb 4 05:12:19 2014 From: alimanfoo at googlemail.com (Alistair Miles) Date: Tue, 4 Feb 2014 10:12:19 +0000 Subject: [IPython-dev] parallel job arrays Message-ID: Hi all, I'm just starting to use IPython parallel with our SGE cluster, it's a wonderful piece of work, thank you. I'm using a load balanced view over a cluster to do asynchronous map operations. One map operation may be over a large number of tasks, and may take a while (hours-days). I'd like to be able to setup and launch the job (from an IPython notebook) then check later if everything has finished and retrieve the results (possibly from a different computer). I've configured the controller to use the SQLite DB and have figured out how to retrieve results from the hub given a list of msg ids. All good so far. If I understand right, in order to be able to fetch the results later from a different client session, I need to keep a record of all the msg ids from the map job I launched earlier, right? I guess the simplest thing to do is write the msg ids to a file, then read again later? Is this what other folks do, or am I missing something? I'm used to using job arrays in SGE, and when you launch a job array you get a single job ID (e.g., 1234567) representing the whole job array, as well as job IDs for each of the tasks (e.g., 1234567.1, 1234567.2 etc.). It's just a thought, but if IPython parallel had some sort of similar notion (i.e., when you submit a parallel map, you get a msg id for the whole map operation as well as msg ids for each of the individual tasks), then that might support some small conveniences. For example, you could call client.get_result() with just the msg id for the whole map operation and get back something like an AsyncMapResult. You could also call client.abort() with the same msg id to cancel the whole map. Btw when I passed a list of msg ids to client.get_result() then called wait_interactive() on the returned AsyncHubResult, it showed '8/8 tasks finished' right from the start, even though tasks were still pending/running. I'm on IPython 1.1.0. Thanks again for the great work, Alistair -- Alistair Miles Head of Epidemiological Informatics Centre for Genomics and Global Health The Wellcome Trust Centre for Human Genetics Roosevelt Drive Oxford OX3 7BN United Kingdom Web: http://purl.org/net/aliman Email: alimanfoo at gmail.com Tel: +44 (0)1865 287721 ***new number*** -------------- next part -------------- An HTML attachment was scrubbed... URL: From raymond.yee at gmail.com Tue Feb 4 12:43:46 2014 From: raymond.yee at gmail.com (Raymond Yee) Date: Tue, 04 Feb 2014 09:43:46 -0800 Subject: [IPython-dev] other people seeing missing buttons when using IPython master Message-ID: <52F126D2.40105@gmail.com> I see the following problem when using commit 8017e1d99d1da5b30d405680237a3f9e1d4ecf7a on master -- missing buttons -- see: https://www.evernote.com/shard/s1/sh/43f87a5e-3c6b-491b-aaba-12896c57b97c/85c93223407014f786848a082666c6ad Others seeing this problem? -Raymond From benjaminrk at gmail.com Tue Feb 4 18:52:39 2014 From: benjaminrk at gmail.com (MinRK) Date: Tue, 4 Feb 2014 15:52:39 -0800 Subject: [IPython-dev] [ANN] IPython 1.2.0-rc1 Message-ID: First release candidate of IPython 1.2.0 bugfix release is up: http://archive.ipython.org/testing/1.2.0/ What's been backported to 1.2: http://ipython.org/ipython-doc/1.x/whatsnew/github-stats-1.0.html If people could take it for a spin and see if we broke anything, that would be great. Hopefully this will tide people over as we put together the 2.0 release. -MinRK -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Wed Feb 5 01:54:02 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Tue, 4 Feb 2014 22:54:02 -0800 Subject: [IPython-dev] other people seeing missing buttons when using IPython master In-Reply-To: <52F126D2.40105@gmail.com> References: <52F126D2.40105@gmail.com> Message-ID: This is most likely just a browser cache issue. Verify by running on an incognito window. If that works better, then you can clear your main cache. On Feb 4, 2014 9:44 AM, "Raymond Yee" wrote: > I see the following problem when using commit > 8017e1d99d1da5b30d405680237a3f9e1d4ecf7a on master -- missing buttons -- > see: > > > https://www.evernote.com/shard/s1/sh/43f87a5e-3c6b-491b-aaba-12896c57b97c/85c93223407014f786848a082666c6ad > > Others seeing this problem? > > -Raymond > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Thu Feb 6 17:46:41 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 6 Feb 2014 14:46:41 -0800 Subject: [IPython-dev] Berkeley - are you using IPython in your research? Message-ID: If you're not at UC Berkeley, you can ignore this. We think there might be some Berkeley people on this list who we won't reach by other means. We're trying to collect a list of people in Berkeley who use IPython in their research, to demonstrate the impact that the project is having. If you are using IPython, or have recently used it, please can you write us a couple of sentences summarising what you study and how you use IPython for that? You can either e-mail this to me, or edit this wiki page to add your name and project summary: https://github.com/ipython/ipython/wiki/Research-at-UC-Berkeley-using-IPython Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From raymond.yee at gmail.com Thu Feb 6 23:26:41 2014 From: raymond.yee at gmail.com (Raymond Yee) Date: Thu, 06 Feb 2014 20:26:41 -0800 Subject: [IPython-dev] other people seeing missing buttons when using IPython master In-Reply-To: References: <52F126D2.40105@gmail.com> Message-ID: <52F46081.4080709@gmail.com> I think I figured what I was doing wrong....I did a git pull but forgot to do a git submodule update as documented on https://github.com/ipython/ipython/blob/master/README.rst -Raymond On 2/4/14 10:54 PM, Fernando Perez wrote: > > This is most likely just a browser cache issue. Verify by running on > an incognito window. If that works better, then you can clear your > main cache. > > On Feb 4, 2014 9:44 AM, "Raymond Yee" > wrote: > > I see the following problem when using commit > 8017e1d99d1da5b30d405680237a3f9e1d4ecf7a on master -- missing > buttons -- > see: > > https://www.evernote.com/shard/s1/sh/43f87a5e-3c6b-491b-aaba-12896c57b97c/85c93223407014f786848a082666c6ad > > Others seeing this problem? > > -Raymond > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: From jason-sage at creativetrax.com Fri Feb 7 05:09:56 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Fri, 07 Feb 2014 04:09:56 -0600 Subject: [IPython-dev] changing md5 for different archive versions Message-ID: <52F4B0F4.9030809@creativetrax.com> I just noticed that the md5 checksum for these two "official" archived versions is different: https://github.com/ipython/ipython/releases/download/rel-1.0.0/ipython-1.0.0.tar.gz http://archive.ipython.org/release/1.0.0/ipython-1.0.0.tar.gz MD5 (ipython-1.0.0.tar.gz-github) = 2268fa83f257d14943eb04e3333a6fac MD5 (ipython-1.0.0.tar.gz.-ipython.org) = fcba21b5a3827bf4e6c921d04d984c2f What's going on? Thanks, Jason From bussonniermatthias at gmail.com Fri Feb 7 05:44:33 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Fri, 7 Feb 2014 11:44:33 +0100 Subject: [IPython-dev] changing md5 for different archive versions In-Reply-To: <52F4B0F4.9030809@creativetrax.com> References: <52F4B0F4.9030809@creativetrax.com> Message-ID: <88611DAF-195E-4667-8C84-9EF2C94EEFAC@gmail.com> Le 7 f?vr. 2014 ? 11:09, Jason Grout a ?crit : > I just noticed that the md5 checksum for these two "official" archived > versions is different: > > https://github.com/ipython/ipython/releases/download/rel-1.0.0/ipython-1.0.0.tar.gz > > http://archive.ipython.org/release/1.0.0/ipython-1.0.0.tar.gz > > MD5 (ipython-1.0.0.tar.gz-github) = 2268fa83f257d14943eb04e3333a6fac > MD5 (ipython-1.0.0.tar.gz.-ipython.org) = fcba21b5a3827bf4e6c921d04d984c2f The unpacked source seem identical. Though the github.com-gunzip tar alway appear from the 9 of august But last modify date of the ipython.org one always is the download time? weird. > What's going on? > > Thanks, > > Jason > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From mark.voorhies at ucsf.edu Fri Feb 7 12:16:51 2014 From: mark.voorhies at ucsf.edu (Mark Voorhies) Date: Fri, 7 Feb 2014 09:16:51 -0800 Subject: [IPython-dev] changing md5 for different archive versions In-Reply-To: <88611DAF-195E-4667-8C84-9EF2C94EEFAC@gmail.com> References: <52F4B0F4.9030809@creativetrax.com> <88611DAF-195E-4667-8C84-9EF2C94EEFAC@gmail.com> Message-ID: <52F51503.9010500@ucsf.edu> On 02/07/2014 02:44 AM, Matthias BUSSONNIER wrote: > > Le 7 f?vr. 2014 ? 11:09, Jason Grout a ?crit : > >> I just noticed that the md5 checksum for these two "official" archived >> versions is different: >> >> https://github.com/ipython/ipython/releases/download/rel-1.0.0/ipython-1.0.0.tar.gz >> >> http://archive.ipython.org/release/1.0.0/ipython-1.0.0.tar.gz >> >> MD5 (ipython-1.0.0.tar.gz-github) = 2268fa83f257d14943eb04e3333a6fac >> MD5 (ipython-1.0.0.tar.gz.-ipython.org) = fcba21b5a3827bf4e6c921d04d984c2f > > The unpacked source seem identical. > Though the github.com-gunzip tar alway appear from the 9 of august > But last modify date of the ipython.org one always is the download time? > weird. Some sort of timestamp in the gzip header is expected behavior: mvoorhie at virgil:~$ date && echo "Hello, world" | md5sum Fri Feb 7 09:14:25 PST 2014 a7966bf58e23583c9a5a4059383ff850 - mvoorhie at virgil:~$ date && echo "Hello, world" | md5sum Fri Feb 7 09:14:27 PST 2014 a7966bf58e23583c9a5a4059383ff850 - mvoorhie at virgil:~$ date && echo "Hello, world" | md5sum Fri Feb 7 09:14:28 PST 2014 a7966bf58e23583c9a5a4059383ff850 - mvoorhie at virgil:~$ date && echo "Hello, world" | gzip - | md5sum Fri Feb 7 09:14:30 PST 2014 25344640395b8542b76a9610c6a9bac3 - mvoorhie at virgil:~$ date && echo "Hello, world" | gzip - | md5sum Fri Feb 7 09:14:31 PST 2014 a1dafaad89bd1a40e8cb01bc3603d663 - mvoorhie at virgil:~$ date && echo "Hello, world" | gzip - | md5sum Fri Feb 7 09:14:32 PST 2014 be8d99c50c031e4b2573ea2fe82f2a20 - --Mark > >> What's going on? >> >> Thanks, >> >> Jason >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From jtaylor.debian at googlemail.com Fri Feb 7 12:32:39 2014 From: jtaylor.debian at googlemail.com (Julian Taylor) Date: Fri, 07 Feb 2014 18:32:39 +0100 Subject: [IPython-dev] changing md5 for different archive versions In-Reply-To: <52F51503.9010500@ucsf.edu> References: <52F4B0F4.9030809@creativetrax.com> <88611DAF-195E-4667-8C84-9EF2C94EEFAC@gmail.com> <52F51503.9010500@ucsf.edu> Message-ID: <52F518B7.3020008@googlemail.com> On 07.02.2014 18:16, Mark Voorhies wrote: > On 02/07/2014 02:44 AM, Matthias BUSSONNIER wrote: >> >> Le 7 f?vr. 2014 ? 11:09, Jason Grout a ?crit : >> >>> I just noticed that the md5 checksum for these two "official" archived >>> versions is different: >>> >>> https://github.com/ipython/ipython/releases/download/rel-1.0.0/ipython-1.0.0.tar.gz >>> >>> http://archive.ipython.org/release/1.0.0/ipython-1.0.0.tar.gz >>> >>> MD5 (ipython-1.0.0.tar.gz-github) = 2268fa83f257d14943eb04e3333a6fac >>> MD5 (ipython-1.0.0.tar.gz.-ipython.org) = fcba21b5a3827bf4e6c921d04d984c2f >> >> The unpacked source seem identical. >> Though the github.com-gunzip tar alway appear from the 9 of august >> But last modify date of the ipython.org one always is the download time? >> weird. > > Some sort of timestamp in the gzip header is expected behavior: you can avoid that with the -n argument From torsten.edeler at haw-hamburg.de Fri Feb 7 15:04:33 2014 From: torsten.edeler at haw-hamburg.de (Edeler, Torsten) Date: Fri, 7 Feb 2014 20:04:33 +0000 Subject: [IPython-dev] Paste images into the notebook Message-ID: Hi everybody. I'm playing around with the notebook. It is fantastic! Thank you for this amazing piece of software! I'm just missing the ability to paste images directly from the clipboard (e.g. screenshots) into the notebook. My OS is Win7. How do I make that work? Thank you very much, Torsten -------------- next part -------------- An HTML attachment was scrubbed... URL: From alessandro.gagliardi at glassdoor.com Fri Feb 7 15:36:24 2014 From: alessandro.gagliardi at glassdoor.com (Alessandro Gagliardi) Date: Fri, 7 Feb 2014 20:36:24 +0000 Subject: [IPython-dev] RandomForestClassifier w/ IPython.parallel Message-ID: Not sure if I?m addressing the best list for this question, so if there?s a more appropriate list, please direct me to it. I want to run a large sklearn.ensemble.RandomForestClassifier (with maybe a dozens or maybe hundreds of trees and 100,000 samples). My desktop won?t handle this so I want to try using StarCluster. RandomForestClassifier seems to parallelize easily, but I don?t know how I would split it across many IPython.parallel engines (if that?s even possible). (Or maybe I should be foregoing IPython.parallel and using MPI?) Any help would be greatly appreciated. Thanks, Alessandro Gagliardi| Glassdoor| alessandro at glassdoor.com We?re hiring! Check out our open jobs. Twitter | Facebook | Glassdoor Blog 2012 Webby Award Winner: Best Employment Site 2013 Webby Award Winner: Best Guides/Ratings/Review Site -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Fri Feb 7 16:03:00 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 7 Feb 2014 13:03:00 -0800 Subject: [IPython-dev] Paste images into the notebook In-Reply-To: References: Message-ID: There is no direct image clipboard support, and given the underlying format and model we use, it' not something that is likely. You should save your images to a file, and then reference them with markdown image syntax ![Alt text for the image](path/to/your/image/file.png) Best f On Fri, Feb 7, 2014 at 12:04 PM, Edeler, Torsten < torsten.edeler at haw-hamburg.de> wrote: > Hi everybody. > > I'm playing around with the notebook. > > It is fantastic! Thank you for this amazing piece of software! > > > > I'm just missing the ability to paste images directly from the clipboard > (e.g. screenshots) into the notebook. My OS is Win7. How do I make that > work? > > > > Thank you very much, > > Torsten > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Fri Feb 7 16:06:54 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 7 Feb 2014 13:06:54 -0800 Subject: [IPython-dev] RandomForestClassifier w/ IPython.parallel In-Reply-To: References: Message-ID: While Olivier Grisel may hang out here, I strongly suggest you repost on the sklearn list. He's a core dev for sklearn and an expert precisely on the intersection of sklearn and IPython.parallel (a topic on which he's teaching a tutorial next week at Strata). The only catch is that he's likely traveling precisely for his Strata tutorial... But he's much more likely to give you an authoritative response on that than any of us from the IPython team. Note also that sklearn supports simple parallelization with joblib for many of its tools (though I don't know if their RF classifier does). That *may* do the trick for you. Cheers, f On Fri, Feb 7, 2014 at 12:36 PM, Alessandro Gagliardi < alessandro.gagliardi at glassdoor.com> wrote: > Not sure if I'm addressing the best list for this question, so if > there's a more appropriate list, please direct me to it. > > I want to run a large sklearn.ensemble.RandomForestClassifier (with > maybe a dozens or maybe hundreds of trees and 100,000 samples). My desktop > won't handle this so I want to try using StarCluster. > RandomForestClassifier seems to parallelize easily, but I don't know how I > would split it across many IPython.parallel engines (if that's even > possible). (Or maybe I should be foregoing IPython.parallel and using MPI?) > > Any help would be greatly appreciated. > > Thanks, > > Alessandro Gagliardi| Glassdoor| alessandro at glassdoor.com > > *We're hiring! Check out our open jobs > .* > > *Twitter ** | Facebook > | Glassdoor Blog > * > > *2012 Webby Award Winner: Best Employment Site* > > *2013 Webby Award Winner: Best Guides/Ratings/Review Site* > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Fri Feb 7 16:07:36 2014 From: fperez.net at gmail.com (Fernando Perez) Date: Fri, 7 Feb 2014 13:07:36 -0800 Subject: [IPython-dev] other people seeing missing buttons when using IPython master In-Reply-To: <52F46081.4080709@gmail.com> References: <52F126D2.40105@gmail.com> <52F46081.4080709@gmail.com> Message-ID: Ah, yes. I've become so used to doing this (after getting burned just like you many times in the past), that I forgot to mention it. Git submodules, the only aspect of git that I really, really don't like... Cheers, f On Thu, Feb 6, 2014 at 8:26 PM, Raymond Yee wrote: > I think I figured what I was doing wrong....I did a git pull but forgot > to do a > > git submodule update > > as documented on https://github.com/ipython/ipython/blob/master/README.rst > > > -Raymond > > > On 2/4/14 10:54 PM, Fernando Perez wrote: > > This is most likely just a browser cache issue. Verify by running on an > incognito window. If that works better, then you can clear your main cache. > On Feb 4, 2014 9:44 AM, "Raymond Yee" wrote: > >> I see the following problem when using commit >> 8017e1d99d1da5b30d405680237a3f9e1d4ecf7a on master -- missing buttons -- >> see: >> >> >> https://www.evernote.com/shard/s1/sh/43f87a5e-3c6b-491b-aaba-12896c57b97c/85c93223407014f786848a082666c6ad >> >> Others seeing this problem? >> >> -Raymond >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > > _______________________________________________ > IPython-dev mailing listIPython-dev at scipy.orghttp://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Fri Feb 7 16:29:34 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Fri, 7 Feb 2014 22:29:34 +0100 Subject: [IPython-dev] Paste images into the notebook In-Reply-To: References: Message-ID: <3BC30423-3AFD-4473-86CA-3853B0920915@gmail.com> Hi there, Le 7 f?vr. 2014 ? 21:04, Edeler, Torsten a ?crit : > Hi everybody. > I?m playing around with the notebook. > It is fantastic! Thank you for this amazing piece of software! > > I?m just missing the ability to paste images directly from the clipboard (e.g. screenshots) into the notebook. My OS is Win7. How do I make that work? > Short answer is you can't. Longer is, depends what you want to do. Add it in cwd, use IPython.display.Image or use like to image url which depending on IPython version in markdown is : ![alt text](files/) on < 2.0 ![alt text]() on >= 2.0 More information in example notebooks that introduce all theses concepts. -- Matthias From python at elbonia.de Fri Feb 7 16:47:34 2014 From: python at elbonia.de (Juergen Hasch) Date: Fri, 07 Feb 2014 22:47:34 +0100 Subject: [IPython-dev] Paste images into the notebook In-Reply-To: <3BC30423-3AFD-4473-86CA-3853B0920915@gmail.com> References: <3BC30423-3AFD-4473-86CA-3853B0920915@gmail.com> Message-ID: <52F55476.4030406@elbonia.de> Am 07.02.2014 22:29, schrieb Matthias BUSSONNIER: > Hi there, > > > Le 7 f?vr. 2014 ? 21:04, Edeler, Torsten a ?crit : > >> Hi everybody. >> I?m playing around with the notebook. >> It is fantastic! Thank you for this amazing piece of software! >> >> I?m just missing the ability to paste images directly from the clipboard (e.g. screenshots) into the notebook. My OS is Win7. How do I make that work? >> > > Short answer is you can't. Actually, it works :-) It only takes around 15 lines of Javascript code to implement this as clipboard paste event for Chrome. All you have to do is receive the image from clipboard, create a markdown cell, and paste the image as base64. Not efficient and slow as hell for larger images, so I won't say this is a viable solution. Still, technically it can be done. From raymond.yee at gmail.com Fri Feb 7 16:48:51 2014 From: raymond.yee at gmail.com (Raymond Yee) Date: Fri, 07 Feb 2014 13:48:51 -0800 Subject: [IPython-dev] Paste images into the notebook In-Reply-To: <52F55476.4030406@elbonia.de> References: <3BC30423-3AFD-4473-86CA-3853B0920915@gmail.com> <52F55476.4030406@elbonia.de> Message-ID: <52F554C3.7050207@gmail.com> Juergen, Can you publish your code? I'm definitely interested in this feature even if it's hacky. Thanks, -Raymond On 2/7/14 1:47 PM, Juergen Hasch wrote: > Am 07.02.2014 22:29, schrieb Matthias BUSSONNIER: >> Hi there, >> >> >> Le 7 f?vr. 2014 ? 21:04, Edeler, Torsten a ?crit : >> >>> Hi everybody. >>> I?m playing around with the notebook. >>> It is fantastic! Thank you for this amazing piece of software! >>> >>> I?m just missing the ability to paste images directly from the clipboard (e.g. screenshots) into the notebook. My OS is Win7. How do I make that work? >>> >> Short answer is you can't. > Actually, it works :-) > > It only takes around 15 lines of Javascript code to implement this as clipboard paste event for Chrome. > All you have to do is receive the image from clipboard, create a markdown cell, and paste the image as base64. > > Not efficient and slow as hell for larger images, so I won't say this is a viable solution. Still, technically it can be > done. > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From python at elbonia.de Fri Feb 7 16:56:31 2014 From: python at elbonia.de (Juergen Hasch) Date: Fri, 07 Feb 2014 22:56:31 +0100 Subject: [IPython-dev] Paste images into the notebook In-Reply-To: <52F554C3.7050207@gmail.com> References: <3BC30423-3AFD-4473-86CA-3853B0920915@gmail.com> <52F55476.4030406@elbonia.de> <52F554C3.7050207@gmail.com> Message-ID: <52F5568F.8080608@elbonia.de> This is my hack. Slow as hell for anything larger than some 10k. window.addEventListener('paste', function(event){ var cell = IPython.notebook.get_selected_cell(); var items = event.clipboardData.items; for (var i = 0; i < items.length; ++i) { if (items[i].kind == 'file' && items[i].type.indexOf('image/') !== -1) { var blob = items[i].getAsFile(); window.URL = window.URL || window.webkitURL; var blobUrl = window.URL.createObjectURL(blob); var img = document.createElement('img'); img.src = blobUrl; var reader = new FileReader(); reader.onload = ( function(evt) { var new_cell = IPython.notebook.insert_cell_below('markdown'); var str = ''; new_cell.set_text(str); new_cell.edit_mode(); new_cell.execute(); } ); reader.readAsDataURL(blob); } } }); Am 07.02.2014 22:48, schrieb Raymond Yee: > Juergen, > > Can you publish your code? I'm definitely interested in this feature > even if it's hacky. > > Thanks, > > -Raymond > > On 2/7/14 1:47 PM, Juergen Hasch wrote: >> Am 07.02.2014 22:29, schrieb Matthias BUSSONNIER: >>> Hi there, >>> >>> >>> Le 7 f?vr. 2014 ? 21:04, Edeler, Torsten a ?crit : >>> >>>> Hi everybody. >>>> I?m playing around with the notebook. >>>> It is fantastic! Thank you for this amazing piece of software! >>>> >>>> I?m just missing the ability to paste images directly from the clipboard (e.g. screenshots) into the notebook. My OS is Win7. How do I make that work? >>>> >>> Short answer is you can't. >> Actually, it works :-) >> >> It only takes around 15 lines of Javascript code to implement this as clipboard paste event for Chrome. >> All you have to do is receive the image from clipboard, create a markdown cell, and paste the image as base64. >> >> Not efficient and slow as hell for larger images, so I won't say this is a viable solution. Still, technically it can be >> done. >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From benjaminrk at gmail.com Fri Feb 7 17:22:35 2014 From: benjaminrk at gmail.com (MinRK) Date: Fri, 7 Feb 2014 14:22:35 -0800 Subject: [IPython-dev] other people seeing missing buttons when using IPython master In-Reply-To: References: <52F126D2.40105@gmail.com> <52F46081.4080709@gmail.com> Message-ID: We ship example git hooks (in git-hooks dir) that ensure submodules are correct on every pull / checkout. I use them, and haven't had issues with submodules being in the wrong state in months. It does slow down switching between branches a bit. -MinRK On Fri, Feb 7, 2014 at 1:07 PM, Fernando Perez wrote: > Ah, yes. I've become so used to doing this (after getting burned just like > you many times in the past), that I forgot to mention it. > > Git submodules, the only aspect of git that I really, really don't like... > > Cheers, > > f > > > On Thu, Feb 6, 2014 at 8:26 PM, Raymond Yee wrote: > >> I think I figured what I was doing wrong....I did a git pull but forgot >> to do a >> >> git submodule update >> >> as documented on >> https://github.com/ipython/ipython/blob/master/README.rst >> >> >> -Raymond >> >> >> On 2/4/14 10:54 PM, Fernando Perez wrote: >> >> This is most likely just a browser cache issue. Verify by running on an >> incognito window. If that works better, then you can clear your main cache. >> On Feb 4, 2014 9:44 AM, "Raymond Yee" wrote: >> >>> I see the following problem when using commit >>> 8017e1d99d1da5b30d405680237a3f9e1d4ecf7a on master -- missing buttons -- >>> see: >>> >>> >>> https://www.evernote.com/shard/s1/sh/43f87a5e-3c6b-491b-aaba-12896c57b97c/85c93223407014f786848a082666c6ad >>> >>> Others seeing this problem? >>> >>> -Raymond >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >> >> >> _______________________________________________ >> IPython-dev mailing listIPython-dev at scipy.orghttp://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From stefan at sun.ac.za Sat Feb 8 01:27:38 2014 From: stefan at sun.ac.za (=?iso-8859-1?Q?St=E9fan?= van der Walt) Date: Sat, 8 Feb 2014 08:27:38 +0200 Subject: [IPython-dev] Default values for widgets Message-ID: <20140208062738.GB12156@gmail.com> Hi all, I'm giving a demo of the interactive functionality later today, and I was hoping there was a way to specify default parameter values. E.g., the image blurring example in the notebook by default sets the r, g, b values to 0.5, instead of to 1 (as provided by the keyword arguments). The widgets are awesome! Cheers St?fan From ellisonbg at gmail.com Sat Feb 8 01:56:36 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Fri, 7 Feb 2014 22:56:36 -0800 Subject: [IPython-dev] Default values for widgets In-Reply-To: <20140208062738.GB12156@gmail.com> References: <20140208062738.GB12156@gmail.com> Message-ID: Currently, to get this you have to pass an actual Widget to interact: interact(f, a=FloatSliderWidget(..., value=10), ...) Even custom Widgets can be passed this way and they will work with interact, as long as the Widget has a value attribute. We decided that we wanted to keep the abbreviations as simple as possible and just allow people to pass Widgets for the more complicated usage cases. Part of this is that we are wanting to be as slow/conservative as possible in introducing complexity to new APIs. We want to see how this stuff works in practice and gather data from our users (like this!). Cheers, Brian On Fri, Feb 7, 2014 at 10:27 PM, St?fan van der Walt wrote: > Hi all, > > I'm giving a demo of the interactive functionality later today, and I was > hoping there was a way to specify default parameter values. E.g., the > image blurring example in the notebook by default sets the r, g, b values to > 0.5, instead of to 1 (as provided by the keyword arguments). > > The widgets are awesome! > > Cheers > St?fan > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From stefan at sun.ac.za Sat Feb 8 02:08:31 2014 From: stefan at sun.ac.za (=?iso-8859-1?Q?St=E9fan?= van der Walt) Date: Sat, 8 Feb 2014 09:08:31 +0200 Subject: [IPython-dev] Default values for widgets In-Reply-To: References: <20140208062738.GB12156@gmail.com> Message-ID: <20140208070831.GC12156@gmail.com> On Fri, 07 Feb 2014 22:56:36 -0800, Brian Granger wrote: > interact(f, a=FloatSliderWidget(..., value=10), ...) That will do the trick for me, thanks. > We decided that we wanted to keep the abbreviations as simple as > possible and just allow people to pass Widgets for the more > complicated usage cases. Part of this is that we are wanting to be as > slow/conservative as possible in introducing complexity to new APIs. > We want to see how this stuff works in practice and gather data from > our users (like this!). The data point for me then is that it feels unintuitive that the default keyword argument is not respected. Thanks for all your hard work on this! St?fan From zvoros at gmail.com Sat Feb 8 11:29:21 2014 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Sat, 08 Feb 2014 17:29:21 +0100 Subject: [IPython-dev] popping out individual notebook cells Message-ID: <52F65B61.7040604@gmail.com> Hi all, I find myself comparing cells quite frequently (either for debugging code, or checking plots, outputs etc.), and I think that it would be great, if the two cells in question could be placed side by side. At the moment, I simply move up one of the cells, so that they are next to each other, but that is a bit clumsy. In any case, I was thinking that, if a cell could be popped out, that would probably be a more decent solution. I don't mean that the popped-out cell should be editable in the child window, I simply mean a verbatim copy of the cell's input and output without the capability of running anything from the child. In this regard, the child would no longer be part of the notebook. All this machinery could be attached to the cell toolbar, which is already in the notebook. Now, as far as I see, there are two options here. One is to use a modeless window, which has the advantage that everything could be done on client side, and could even be implemented as an extension, it wouldn't have to be part of the core. But this has the downside that the window can be moved only within the boundaries of the browser window. The other possibility is to open a new headless browser window, but that has to go through the server, and then the server has to be equipped with facilities to serve the content of a single cell, so this route is certainly more involving. I just wanted to toss up this idea to see what others think about it, whether it makes sense at all, or, perhaps, someone already has done some work along these lines. Cheers, Zolt?n -------------- next part -------------- An HTML attachment was scrubbed... URL: From abie at uw.edu Sat Feb 8 11:32:50 2014 From: abie at uw.edu (Abraham D. Flaxman) Date: Sat, 8 Feb 2014 16:32:50 +0000 Subject: [IPython-dev] Paste images into the notebook In-Reply-To: <52F5568F.8080608@elbonia.de> References: <3BC30423-3AFD-4473-86CA-3853B0920915@gmail.com> <52F55476.4030406@elbonia.de> <52F554C3.7050207@gmail.com> <52F5568F.8080608@elbonia.de> Message-ID: This works for me, and it is something I've thought would be useful for a while now. So thanks! I put an example notebook together using it here: http://nbviewer.ipython.org/gist/aflaxman/8886274 I agree that it is slow, but I want it so much I'm willing to wait. But do you have any thoughts on how it can go faster? --Abie -----Original Message----- From: ipython-dev-bounces at scipy.org [mailto:ipython-dev-bounces at scipy.org] On Behalf Of Juergen Hasch Sent: Friday, February 07, 2014 1:57 PM To: IPython developers list Subject: Re: [IPython-dev] Paste images into the notebook This is my hack. Slow as hell for anything larger than some 10k. window.addEventListener('paste', function(event){ var cell = IPython.notebook.get_selected_cell(); var items = event.clipboardData.items; for (var i = 0; i < items.length; ++i) { if (items[i].kind == 'file' && items[i].type.indexOf('image/') !== -1) { var blob = items[i].getAsFile(); window.URL = window.URL || window.webkitURL; var blobUrl = window.URL.createObjectURL(blob); var img = document.createElement('img'); img.src = blobUrl; var reader = new FileReader(); reader.onload = ( function(evt) { var new_cell = IPython.notebook.insert_cell_below('markdown'); var str = ''; new_cell.set_text(str); new_cell.edit_mode(); new_cell.execute(); } ); reader.readAsDataURL(blob); } } }); Am 07.02.2014 22:48, schrieb Raymond Yee: > Juergen, > > Can you publish your code? I'm definitely interested in this feature > even if it's hacky. > > Thanks, > > -Raymond > > On 2/7/14 1:47 PM, Juergen Hasch wrote: >> Am 07.02.2014 22:29, schrieb Matthias BUSSONNIER: >>> Hi there, >>> >>> >>> Le 7 f?vr. 2014 ? 21:04, Edeler, Torsten a ?crit : >>> >>>> Hi everybody. >>>> I'm playing around with the notebook. >>>> It is fantastic! Thank you for this amazing piece of software! >>>> >>>> I'm just missing the ability to paste images directly from the clipboard (e.g. screenshots) into the notebook. My OS is Win7. How do I make that work? >>>> >>> Short answer is you can't. >> Actually, it works :-) >> >> It only takes around 15 lines of Javascript code to implement this as clipboard paste event for Chrome. >> All you have to do is receive the image from clipboard, create a markdown cell, and paste the image as base64. >> >> Not efficient and slow as hell for larger images, so I won't say this >> is a viable solution. Still, technically it can be done. >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev From python at elbonia.de Sat Feb 8 11:47:02 2014 From: python at elbonia.de (Juergen Hasch) Date: Sat, 08 Feb 2014 17:47:02 +0100 Subject: [IPython-dev] Paste images into the notebook In-Reply-To: References: <3BC30423-3AFD-4473-86CA-3853B0920915@gmail.com> <52F55476.4030406@elbonia.de> <52F554C3.7050207@gmail.com> <52F5568F.8080608@elbonia.de> Message-ID: <52F65F86.8070105@elbonia.de> I have updated this to be more useful and much faster. It was very slow because the code snipped entered edit mode to render the graphics. Once I skipped this, it is actually fast. You can find the very experimental extension as clipboard_dragdrop.js in the folder usability here: https://github.com/ipython-contrib A short demo video is here: http://youtu.be/buAL1bTZ73c Am 08.02.2014 17:32, schrieb Abraham D. Flaxman: > This works for me, and it is something I've thought would be useful for a while now. So thanks! I put an example notebook together using it here: http://nbviewer.ipython.org/gist/aflaxman/8886274 > > I agree that it is slow, but I want it so much I'm willing to wait. But do you have any thoughts on how it can go faster? > > --Abie > > > -----Original Message----- > From: ipython-dev-bounces at scipy.org [mailto:ipython-dev-bounces at scipy.org] On Behalf Of Juergen Hasch > Sent: Friday, February 07, 2014 1:57 PM > To: IPython developers list > Subject: Re: [IPython-dev] Paste images into the notebook > > This is my hack. Slow as hell for anything larger than some 10k. > > window.addEventListener('paste', function(event){ > var cell = IPython.notebook.get_selected_cell(); > var items = event.clipboardData.items; > for (var i = 0; i < items.length; ++i) { > if (items[i].kind == 'file' && items[i].type.indexOf('image/') !== -1) { > var blob = items[i].getAsFile(); > window.URL = window.URL || window.webkitURL; > var blobUrl = window.URL.createObjectURL(blob); > var img = document.createElement('img'); > img.src = blobUrl; > > var reader = new FileReader(); > reader.onload = ( function(evt) { > var new_cell = IPython.notebook.insert_cell_below('markdown'); > var str = ''; > new_cell.set_text(str); > new_cell.edit_mode(); > new_cell.execute(); > } ); > reader.readAsDataURL(blob); > } > } > }); > > > > Am 07.02.2014 22:48, schrieb Raymond Yee: >> Juergen, >> >> Can you publish your code? I'm definitely interested in this feature >> even if it's hacky. >> >> Thanks, >> >> -Raymond >> >> On 2/7/14 1:47 PM, Juergen Hasch wrote: >>> Am 07.02.2014 22:29, schrieb Matthias BUSSONNIER: >>>> Hi there, >>>> >>>> >>>> Le 7 f?vr. 2014 ? 21:04, Edeler, Torsten a ?crit : >>>> >>>>> Hi everybody. >>>>> I'm playing around with the notebook. >>>>> It is fantastic! Thank you for this amazing piece of software! >>>>> >>>>> I'm just missing the ability to paste images directly from the clipboard (e.g. screenshots) into the notebook. My OS is Win7. How do I make that work? >>>>> >>>> Short answer is you can't. >>> Actually, it works :-) >>> >>> It only takes around 15 lines of Javascript code to implement this as clipboard paste event for Chrome. >>> All you have to do is receive the image from clipboard, create a markdown cell, and paste the image as base64. >>> >>> Not efficient and slow as hell for larger images, so I won't say this >>> is a viable solution. Still, technically it can be done. >>> >>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From tburnett at myuw.net Sat Feb 8 13:35:30 2014 From: tburnett at myuw.net (Toby Burnett) Date: Sat, 8 Feb 2014 18:35:30 +0000 Subject: [IPython-dev] notebook display Message-ID: There are two status indicators in the v2-dev notebook display that I'd like to enhance: * Kernel Busy indication * Edit mode Both are very important to know, but neither is displayed very prominently; a small bit of text in the upper corner for the former, a rather thin green line for the latter. Since Kernel Busy affects the entire notebook, I'd like a more global indicator, to make it clear that there is no point to try to execute a cell. (I don't know how many times I've forgotten to quit the debug, then wonder why nothing is happening. Or do a restart, and forget to wait for that text to go away.) Edit mode should be rather easy, just increase the width. So I'd like to experiment with alternatives, by adjusting the css. There is a way, I seem to remember, for a user to customize the relevant css. Could someone point me to the instructions, or suggest changes? --Toby Burnett -------------- next part -------------- An HTML attachment was scrubbed... URL: From ellisonbg at gmail.com Sat Feb 8 15:25:32 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Sat, 8 Feb 2014 12:25:32 -0800 Subject: [IPython-dev] notebook display In-Reply-To: References: Message-ID: We have added new global kernel and edit/command mode indicators in a recent pull request - just today. Can you pull the latest and let us know what you think? Cheers, Brian On Sat, Feb 8, 2014 at 10:35 AM, Toby Burnett wrote: > There are two status indicators in the v2-dev notebook display that I'd like > to enhance: > > > > ? Kernel Busy indication > > ? Edit mode > > Both are very important to know, but neither is displayed very prominently; > a small bit of text in the upper corner for the former, a rather thin green > line for the latter. Since Kernel Busy affects the entire notebook, I'd like > a more global indicator, to make it clear that there is no point to try to > execute a cell. (I don't know how many times I've forgotten to quit the > debug, then wonder why nothing is happening. Or do a restart, and forget to > wait for that text to go away.) Edit mode should be rather easy, just > increase the width. > > > > So I'd like to experiment with alternatives, by adjusting the css. There is > a way, I seem to remember, for a user to customize the relevant css. Could > someone point me to the instructions, or suggest changes? > > > > --Toby Burnett > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From ellisonbg at gmail.com Sat Feb 8 17:20:32 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Sat, 8 Feb 2014 14:20:32 -0800 Subject: [IPython-dev] Default values for widgets In-Reply-To: <20140208070831.GC12156@gmail.com> References: <20140208062738.GB12156@gmail.com> <20140208070831.GC12156@gmail.com> Message-ID: Thinking a bit more... Right now, we look at the following places for widget abbreviations: 1. kwargs to interact 2. annotations 3. defaults to individual keyword args in the def of the function. I think it is a bit dangerous to do 3. It would probably be a better solution to use 3 for setting the initial value of the widget. Otherwise, I think we are making defaults for functions do too many things. Stefan, want to open an issue on this? If others like it, you could even to a PR ;-) It shouldn't be too difficult. Cheers, Brian On Fri, Feb 7, 2014 at 11:08 PM, St?fan van der Walt wrote: > On Fri, 07 Feb 2014 22:56:36 -0800, Brian Granger wrote: >> interact(f, a=FloatSliderWidget(..., value=10), ...) > > That will do the trick for me, thanks. > >> We decided that we wanted to keep the abbreviations as simple as >> possible and just allow people to pass Widgets for the more >> complicated usage cases. Part of this is that we are wanting to be as >> slow/conservative as possible in introducing complexity to new APIs. >> We want to see how this stuff works in practice and gather data from >> our users (like this!). > > The data point for me then is that it feels unintuitive that the default > keyword argument is not respected. > > Thanks for all your hard work on this! > > St?fan > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From stefan at sun.ac.za Sat Feb 8 17:47:25 2014 From: stefan at sun.ac.za (=?iso-8859-1?Q?St=E9fan?= van der Walt) Date: Sun, 9 Feb 2014 00:47:25 +0200 Subject: [IPython-dev] Default values for widgets In-Reply-To: References: <20140208062738.GB12156@gmail.com> <20140208070831.GC12156@gmail.com> Message-ID: <20140208224725.GE20211@gmail.com> On Sat, 08 Feb 2014 14:20:32 -0800, Brian Granger wrote: > Right now, we look at the following places for widget abbreviations: > > 1. kwargs to interact > 2. annotations > 3. defaults to individual keyword args in the def of the function. I can certainly add a PR to set the default widget value from the keyword. Another question: how do you prevent a keyword argument from being turned into a widget? Currently all arguments are processed, irrespective of whether they are specified in "interactive". St?fan From ellisonbg at gmail.com Sat Feb 8 17:56:40 2014 From: ellisonbg at gmail.com (Brian Granger) Date: Sat, 8 Feb 2014 14:56:40 -0800 Subject: [IPython-dev] Default values for widgets In-Reply-To: <20140208224725.GE20211@gmail.com> References: <20140208062738.GB12156@gmail.com> <20140208070831.GC12156@gmail.com> <20140208224725.GE20211@gmail.com> Message-ID: This function: https://github.com/ipython/ipython/blob/master/IPython/html/widgets/interaction.py#L121 has two branches where it tests for: elif default is not empty: Just remove those. Then you would need to add logic *after* the actual widgets that does something like: widget.value = default To set the value to the default. The only difficulty is for something like a slider widget with finite step sizes, we would have to think about what to do if the value wasn't at a valid step: (0, 100, 10) with a default of 33 We could just allow it , or we could raise a ValueError. On Sat, Feb 8, 2014 at 2:47 PM, St?fan van der Walt wrote: > On Sat, 08 Feb 2014 14:20:32 -0800, Brian Granger wrote: >> Right now, we look at the following places for widget abbreviations: >> >> 1. kwargs to interact >> 2. annotations >> 3. defaults to individual keyword args in the def of the function. > > I can certainly add a PR to set the default widget value from the keyword. > Another question: how do you prevent a keyword argument from being turned into > a widget? Currently all arguments are processed, irrespective of whether they > are specified in "interactive". > > St?fan > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com From doug.blank at gmail.com Sun Feb 9 07:59:48 2014 From: doug.blank at gmail.com (Doug Blank) Date: Sun, 9 Feb 2014 07:59:48 -0500 Subject: [IPython-dev] Suggestions for easier understanding Message-ID: Devs, In looking over the new example notebooks (which are great to learn the new features), I see a couple of places that could use a little polish to make them easier to understand, especially for those that aren't expert programmers. For example, taking a look at: http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/widgets/Part%202%20-%20Events.ipynb it would be easy to change: print(widgets.Widget.on_trait_change.__doc__) to: help(widgets.Widget.on_trait_change) which actually looks better, is more informative (even for experts), and hides unnecessary implementation details. Another suggestion is to consider hiding the implementational "trait" details. One could use the interface by just thinking in terms of standard Python terms, such as "attribute" or "value". For example, the code: """ def on_value_change(name, value): print(value) int_range.on_trait_change(on_value_change, 'value') """ might be easier to understand if it were: """ def callback(name, new_value): print(name, "changed to", new_value) int_range.on_value_change(callback, 'value') """ Another reason to consider using the method name "on_value_change" rather than "on_trait_change" is that I'm replicating this API for a different kernel, and the implementation doesn't use "traitlets". Doesn't seem necessary to have this implementational detail show in the UI. What do you think? -Doug -------------- next part -------------- An HTML attachment was scrubbed... URL: From tburnett at myuw.net Sun Feb 9 13:37:09 2014 From: tburnett at myuw.net (Toby Burnett) Date: Sun, 9 Feb 2014 18:37:09 +0000 Subject: [IPython-dev] notebook display In-Reply-To: References: Message-ID: <5b510b1c02fd4f7b9faa5999be2d5d8a@BLUPR01MB306.prod.exchangelabs.com> pip install on the current version gives me this: AssertionError: Missing package data: IPython/html/static/components/backbone/backbone-min.js --Toby From: ipython-dev-request at scipy.org Sent: ?Sunday?, ?February? ?9?, ?2014 ?10?:?06 To: 'ipython-dev at scipy.org' Send IPython-dev mailing list submissions to ipython-dev at scipy.org To subscribe or unsubscribe via the World Wide Web, visit http://mail.scipy.org/mailman/listinfo/ipython-dev or, via email, send a message with subject or body 'help' to ipython-dev-request at scipy.org You can reach the person managing the list at ipython-dev-owner at scipy.org When replying, please edit your Subject line so it is more specific than "Re: Contents of IPython-dev digest..." Today's Topics: 1. notebook display (Toby Burnett) 2. Re: notebook display (Brian Granger) 3. Re: Default values for widgets (Brian Granger) 4. Re: Default values for widgets (St?fan van der Walt) 5. Re: Default values for widgets (Brian Granger) 6. Suggestions for easier understanding (Doug Blank) ---------------------------------------------------------------------- Message: 1 Date: Sat, 8 Feb 2014 18:35:30 +0000 From: Toby Burnett Subject: [IPython-dev] notebook display To: "'ipython-dev at scipy.org'" Message-ID: Content-Type: text/plain; charset="us-ascii" There are two status indicators in the v2-dev notebook display that I'd like to enhance: * Kernel Busy indication * Edit mode Both are very important to know, but neither is displayed very prominently; a small bit of text in the upper corner for the former, a rather thin green line for the latter. Since Kernel Busy affects the entire notebook, I'd like a more global indicator, to make it clear that there is no point to try to execute a cell. (I don't know how many times I've forgotten to quit the debug, then wonder why nothing is happening. Or do a restart, and forget to wait for that text to go away.) Edit mode should be rather easy, just increase the width. So I'd like to experiment with alternatives, by adjusting the css. There is a way, I seem to remember, for a user to customize the relevant css. Could someone point me to the instructions, or suggest changes? --Toby Burnett -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.scipy.org/pipermail/ipython-dev/attachments/20140208/1b6d4dc9/attachment-0001.html ------------------------------ Message: 2 Date: Sat, 8 Feb 2014 12:25:32 -0800 From: Brian Granger Subject: Re: [IPython-dev] notebook display To: IPython developers list Message-ID: Content-Type: text/plain; charset=ISO-8859-1 We have added new global kernel and edit/command mode indicators in a recent pull request - just today. Can you pull the latest and let us know what you think? Cheers, Brian On Sat, Feb 8, 2014 at 10:35 AM, Toby Burnett wrote: > There are two status indicators in the v2-dev notebook display that I'd like > to enhance: > > > > ? Kernel Busy indication > > ? Edit mode > > Both are very important to know, but neither is displayed very prominently; > a small bit of text in the upper corner for the former, a rather thin green > line for the latter. Since Kernel Busy affects the entire notebook, I'd like > a more global indicator, to make it clear that there is no point to try to > execute a cell. (I don't know how many times I've forgotten to quit the > debug, then wonder why nothing is happening. Or do a restart, and forget to > wait for that text to go away.) Edit mode should be rather easy, just > increase the width. > > > > So I'd like to experiment with alternatives, by adjusting the css. There is > a way, I seem to remember, for a user to customize the relevant css. Could > someone point me to the instructions, or suggest changes? > > > > --Toby Burnett > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com ------------------------------ Message: 3 Date: Sat, 8 Feb 2014 14:20:32 -0800 From: Brian Granger Subject: Re: [IPython-dev] Default values for widgets To: IPython developers list Message-ID: Content-Type: text/plain; charset=ISO-8859-1 Thinking a bit more... Right now, we look at the following places for widget abbreviations: 1. kwargs to interact 2. annotations 3. defaults to individual keyword args in the def of the function. I think it is a bit dangerous to do 3. It would probably be a better solution to use 3 for setting the initial value of the widget. Otherwise, I think we are making defaults for functions do too many things. Stefan, want to open an issue on this? If others like it, you could even to a PR ;-) It shouldn't be too difficult. Cheers, Brian On Fri, Feb 7, 2014 at 11:08 PM, St?fan van der Walt wrote: > On Fri, 07 Feb 2014 22:56:36 -0800, Brian Granger wrote: >> interact(f, a=FloatSliderWidget(..., value=10), ...) > > That will do the trick for me, thanks. > >> We decided that we wanted to keep the abbreviations as simple as >> possible and just allow people to pass Widgets for the more >> complicated usage cases. Part of this is that we are wanting to be as >> slow/conservative as possible in introducing complexity to new APIs. >> We want to see how this stuff works in practice and gather data from >> our users (like this!). > > The data point for me then is that it feels unintuitive that the default > keyword argument is not respected. > > Thanks for all your hard work on this! > > St?fan > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com ------------------------------ Message: 4 Date: Sun, 9 Feb 2014 00:47:25 +0200 From: St?fan van der Walt Subject: Re: [IPython-dev] Default values for widgets To: IPython developers list Message-ID: <20140208224725.GE20211 at gmail.com> Content-Type: text/plain; charset=iso-8859-1 On Sat, 08 Feb 2014 14:20:32 -0800, Brian Granger wrote: > Right now, we look at the following places for widget abbreviations: > > 1. kwargs to interact > 2. annotations > 3. defaults to individual keyword args in the def of the function. I can certainly add a PR to set the default widget value from the keyword. Another question: how do you prevent a keyword argument from being turned into a widget? Currently all arguments are processed, irrespective of whether they are specified in "interactive". St?fan ------------------------------ Message: 5 Date: Sat, 8 Feb 2014 14:56:40 -0800 From: Brian Granger Subject: Re: [IPython-dev] Default values for widgets To: IPython developers list Message-ID: Content-Type: text/plain; charset=ISO-8859-1 This function: https://github.com/ipython/ipython/blob/master/IPython/html/widgets/interaction.py#L121 has two branches where it tests for: elif default is not empty: Just remove those. Then you would need to add logic *after* the actual widgets that does something like: widget.value = default To set the value to the default. The only difficulty is for something like a slider widget with finite step sizes, we would have to think about what to do if the value wasn't at a valid step: (0, 100, 10) with a default of 33 We could just allow it , or we could raise a ValueError. On Sat, Feb 8, 2014 at 2:47 PM, St?fan van der Walt wrote: > On Sat, 08 Feb 2014 14:20:32 -0800, Brian Granger wrote: >> Right now, we look at the following places for widget abbreviations: >> >> 1. kwargs to interact >> 2. annotations >> 3. defaults to individual keyword args in the def of the function. > > I can certainly add a PR to set the default widget value from the keyword. > Another question: how do you prevent a keyword argument from being turned into > a widget? Currently all arguments are processed, irrespective of whether they > are specified in "interactive". > > St?fan > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Brian E. Granger Cal Poly State University, San Luis Obispo bgranger at calpoly.edu and ellisonbg at gmail.com ------------------------------ Message: 6 Date: Sun, 9 Feb 2014 07:59:48 -0500 From: Doug Blank Subject: [IPython-dev] Suggestions for easier understanding To: IPython developers list Message-ID: Content-Type: text/plain; charset="iso-8859-1" Devs, In looking over the new example notebooks (which are great to learn the new features), I see a couple of places that could use a little polish to make them easier to understand, especially for those that aren't expert programmers. For example, taking a look at: http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/widgets/Part%202%20-%20Events.ipynb it would be easy to change: print(widgets.Widget.on_trait_change.__doc__) to: help(widgets.Widget.on_trait_change) which actually looks better, is more informative (even for experts), and hides unnecessary implementation details. Another suggestion is to consider hiding the implementational "trait" details. One could use the interface by just thinking in terms of standard Python terms, such as "attribute" or "value". For example, the code: """ def on_value_change(name, value): print(value) int_range.on_trait_change(on_value_change, 'value') """ might be easier to understand if it were: """ def callback(name, new_value): print(name, "changed to", new_value) int_range.on_value_change(callback, 'value') """ Another reason to consider using the method name "on_value_change" rather than "on_trait_change" is that I'm replicating this API for a different kernel, and the implementation doesn't use "traitlets". Doesn't seem necessary to have this implementational detail show in the UI. What do you think? -Doug -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.scipy.org/pipermail/ipython-dev/attachments/20140209/d9fa1804/attachment-0001.html ------------------------------ _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev End of IPython-dev Digest, Vol 121, Issue 11 ******************************************** -------------- next part -------------- An HTML attachment was scrubbed... URL: From benjaminrk at gmail.com Sun Feb 9 16:17:12 2014 From: benjaminrk at gmail.com (MinRK) Date: Sun, 9 Feb 2014 13:17:12 -0800 Subject: [IPython-dev] Suggestions for easier understanding In-Reply-To: References: Message-ID: On Sun, Feb 9, 2014 at 4:59 AM, Doug Blank wrote: > Devs, > > In looking over the new example notebooks (which are great to learn the > new features), I see a couple of places that could use a little polish to > make them easier to understand, especially for those that aren't expert > programmers. For example, taking a look at: > > > http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/widgets/Part%202%20-%20Events.ipynb > > it would be easy to change: > > print(widgets.Widget.on_trait_change.__doc__) > > to: > > help(widgets.Widget.on_trait_change) > Or the IPython way: `widgets.Widget.on_trait_change?` It's been many years since I called `help` on something. > > which actually looks better, is more informative (even for experts), and > hides unnecessary implementation details. Another suggestion is to consider > hiding the implementational "trait" details. One could use the interface by > just thinking in terms of standard Python terms, such as "attribute" or > "value". For example, the code: > > """ > def on_value_change(name, value): > print(value) > int_range.on_trait_change(on_value_change, 'value') > """ > > might be easier to understand if it were: > > """ > def callback(name, new_value): > print(name, "changed to", new_value) > int_range.on_value_change(callback, 'value') > """ > > Another reason to consider using the method name "on_value_change" rather > than "on_trait_change" is that I'm replicating this API for a different > kernel, and the implementation doesn't use "traitlets". Doesn't seem > necessary to have this implementational detail show in the UI. > > What do you think? > The events themselves are an implementation detail, and traitlets are the most logical way to implement them in IPython, so we use the traitlets API. I don't think there is a good reason to hide that. The part that is generic about widgets is some mechanism for synchronizing state (the messages), and we do not intend to enforce any kind of uniformity in APIs on kernels. I think there is a doc missing that's at the right level - what is the part of widgets that's actually generic and language agnostic, and what is just part of the IPython kernel implementation. -MinRK > > -Doug > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From doug.blank at gmail.com Sun Feb 9 17:37:49 2014 From: doug.blank at gmail.com (Doug Blank) Date: Sun, 9 Feb 2014 17:37:49 -0500 Subject: [IPython-dev] Suggestions for easier understanding In-Reply-To: References: Message-ID: Thanks for the feedback; comments below: On Sun, Feb 9, 2014 at 4:17 PM, MinRK wrote: > > > On Sun, Feb 9, 2014 at 4:59 AM, Doug Blank wrote: > >> Devs, >> >> In looking over the new example notebooks (which are great to learn the >> new features), I see a couple of places that could use a little polish to >> make them easier to understand, especially for those that aren't expert >> programmers. For example, taking a look at: >> >> >> http://nbviewer.ipython.org/github/ipython/ipython/blob/master/examples/widgets/Part%202%20-%20Events.ipynb >> >> it would be easy to change: >> >> print(widgets.Widget.on_trait_change.__doc__) >> >> to: >> >> help(widgets.Widget.on_trait_change) >> > > Or the IPython way: `widgets.Widget.on_trait_change?` > It's been many years since I called `help` on something. > > Sure, demonstrating the ? is even better. > > >> >> which actually looks better, is more informative (even for experts), and >> hides unnecessary implementation details. Another suggestion is to consider >> hiding the implementational "trait" details. One could use the interface by >> just thinking in terms of standard Python terms, such as "attribute" or >> "value". For example, the code: >> >> """ >> def on_value_change(name, value): >> print(value) >> int_range.on_trait_change(on_value_change, 'value') >> """ >> >> might be easier to understand if it were: >> >> """ >> def callback(name, new_value): >> print(name, "changed to", new_value) >> int_range.on_value_change(callback, 'value') >> """ >> >> Another reason to consider using the method name "on_value_change" rather >> than "on_trait_change" is that I'm replicating this API for a different >> kernel, and the implementation doesn't use "traitlets". Doesn't seem >> necessary to have this implementational detail show in the UI. >> >> What do you think? >> > > The events themselves are an implementation detail, and traitlets are the > most logical way to implement them in IPython, so we use the traitlets API. > I don't think there is a good reason to hide that. The part that is generic > about widgets is some mechanism for synchronizing state (the messages), and > we do not intend to enforce any kind of uniformity in APIs on kernels. > > My point is that it would be nice to have uniformity across kernels by using the same method names to attach the callbacks. But having "trait" in the API is unnecessary, and requires further explanation to the students. (And what happens in the future if you re-implement the mechanism with a different paradigm?) I'm not suggesting to hide the the fact that you use traitlets; just suggesting that it doesn't need to be in the API. > I think there is a doc missing that's at the right level - what is the > part of widgets that's actually generic and language agnostic, and what is > just part of the IPython kernel implementation. > > Yes, of course, these aren't designed for beginners. But just pointing out that there are places where implementation details pop through. -Doug > -MinRK > > > >> >> -Doug >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From pelson.pub at gmail.com Mon Feb 10 05:02:15 2014 From: pelson.pub at gmail.com (Phil Elson) Date: Mon, 10 Feb 2014 10:02:15 +0000 Subject: [IPython-dev] Cartopy - was maps inline In-Reply-To: <20140130203414.495our33k04c804w@webmail.light42.com> References: <20140130203414.495our33k04c804w@webmail.light42.com> Message-ID: Hi Brian, Thanks for the free publicity :) You're right - the notebook is killer for sharing examples (e.g. http://nbviewer.ipython.org/gist/pelson/7772265) and we're making pretty heavy use of it. I'm also super keen to convert the cartopy gallery ( http://scitools.org.uk/cartopy/docs/latest/gallery.html) to be notebook based - I think all the tools are available with IPython now, it's just a case of joining them all together and applying a bit of Python glue. Finally, a huge success story for me has been the course material that I've been able to write with the notebook. It's still in a state of flux, but I've been teaching introductions to numpy (3.5 hrs), matplotlib (3 hrs), cartopy (0.5 hrs) and iris (6 hrs) to experienced weather/climate research scientists using nothing but IPython notebook, and I've set up each of the students with notebook environments for the class exercises. If anybody is interested, the material is available on github ( https://github.com/SciTools/courses) and as an example, the Iris course can be seen on nbviewer at http://nbviewer.ipython.org/github/SciTools/courses/blob/master/course_content/iris_intro.ipynb. I've said it before, but I'll say it again - IPython notebook absolutely rocks so thank you to everybody who has been involved in its conception and development! Cheers, Phil On 31 January 2014 04:34, wrote: > people may be aware of this project: > > https://github.com/SciTools/cartopy > > they seem to use iPython-notebook a *lot* .. > > -- > Brian M Hamlin > OSGeo California Chapter > blog.light42.com > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From raymond.yee at gmail.com Mon Feb 10 14:14:17 2014 From: raymond.yee at gmail.com (Raymond Yee) Date: Mon, 10 Feb 2014 11:14:17 -0800 Subject: [IPython-dev] Experiences getting a d3.js example working in the Notebook and request for advice Message-ID: <52F92509.5050701@gmail.com> Hi everyone, Like many of you, I'm excited about the widgets and interact functionality. But as someone whose JavaScript skills and front-end web dev skills are modest (but which are rapidly growing while I'm learning about how to do more in the Notebook!), I have been focusing first on how to use the Notebook as a possible environment for the learning and teaching of HTML, CSS, and JavaScript. I like things like jsfiddle.net as environments to try out and share small units of front end web programming and wonder how to use the Notebook in a similar fashion. As a short term challenge, I'm looking at learning/teaching d3.js using the Notebook -- and using d3.js specifically to plot US-related census data at the county level. I've wanted to rework Mike Bostock's Choropleth (http://bl.ocks.org/mbostock/4060606) example into IPython Notebook code that can take data calculated via Python and then displayed using d3. I *think* I just figured out how to make the Choropleth example show up in a Notebook: http://nbviewer.ipython.org/github/rdhyee/working-open-data-2014/blob/master/notebooks/Day_07_A_D3_Choropleth.ipynb whose workings I illustrate in a silent video: http://www.youtube.com/watch?v=Vfc8nzR15ME I wrote up the mistakes I made to document the stumbling blocks for other novices to avoid. This example is not likely to be a big deal to experts -- but I'm interested in knowing whether I'm taking the right approach and how this example can be improved. Specifically: * Am I using requirejs correctly to load the external libraries in the Notebook? * What will be the best way for me to dynamically construct data in Python to pass to d3? I'll want to replace the unemployment data (in unemployment.csv that d3 loads externally) to something I can pass to d3 from Python. Should I serialize the Python object into JSON, which I can embed as a JavaScript literal in the code? Or is there a way for me to serve up JSON data via a local URL (served up by the Notebook machinery)? If so, should I write the data out to a file that can be served up by the Notebook via http? Or is there a way to serve up data without explicitly writing to the local filesystem? * What gotchas should I be aware of, especially as someone who wants to show this in class tomorrow or later this week? :-) * Any tips on how I might think of turning my code into can be used with interact? Thanks in advance, -Raymond From jakevdp at cs.washington.edu Mon Feb 10 14:19:43 2014 From: jakevdp at cs.washington.edu (Jacob Vanderplas) Date: Mon, 10 Feb 2014 11:19:43 -0800 Subject: [IPython-dev] Experiences getting a d3.js example working in the Notebook and request for advice In-Reply-To: <52F92509.5050701@gmail.com> References: <52F92509.5050701@gmail.com> Message-ID: One quick note: you're correct that you need to use require.js within the notebook, but nbviewer and other static views do not necessarily include require.js, so you need to provide an alternative d3-loading behavior. Here's the snippet of JS that I used to get around this issue within mpld3: https://github.com/jakevdp/mpld3/blob/master/mpld3/_objects.py#L186 Hope that helps, Jake On Mon, Feb 10, 2014 at 11:14 AM, Raymond Yee wrote: > Hi everyone, > > Like many of you, I'm excited about the widgets and interact > functionality. But as someone whose JavaScript skills and front-end web > dev skills are modest (but which are rapidly growing while I'm learning > about how to do more in the Notebook!), I have been focusing first on > how to use the Notebook as a possible environment for the learning and > teaching of HTML, CSS, and JavaScript. I like things like jsfiddle.net > as environments to try out and share small units of front end web > programming and wonder how to use the Notebook in a similar fashion. > > As a short term challenge, I'm looking at learning/teaching d3.js using > the Notebook -- and using d3.js specifically to plot US-related census > data at the county level. I've wanted to rework Mike Bostock's > Choropleth (http://bl.ocks.org/mbostock/4060606) example into IPython > Notebook code that can take data calculated via Python and then > displayed using d3. > > I *think* I just figured out how to make the Choropleth example show up > in a Notebook: > > > > http://nbviewer.ipython.org/github/rdhyee/working-open-data-2014/blob/master/notebooks/Day_07_A_D3_Choropleth.ipynb > > whose workings I illustrate in a silent video: > > http://www.youtube.com/watch?v=Vfc8nzR15ME > > I wrote up the mistakes I made to document the stumbling blocks for > other novices to avoid. This example is not likely to be a big deal to > experts -- but I'm interested in knowing whether I'm taking the right > approach and how this example can be improved. Specifically: > > * Am I using requirejs correctly to load the external libraries in the > Notebook? > > * What will be the best way for me to dynamically construct data in > Python to pass to d3? I'll want to replace the unemployment data (in > unemployment.csv that d3 loads externally) to something I can pass to > d3 from Python. Should I serialize the Python object into JSON, which I > can embed as a JavaScript literal in the code? Or is there a way for me > to serve up JSON data via a local URL (served up by the Notebook > machinery)? If so, should I write the data out to a file that can be > served up by the Notebook via http? Or is there a way to serve up data > without explicitly writing to the local filesystem? > > * What gotchas should I be aware of, especially as someone who wants to > show this in class tomorrow or later this week? :-) > > * Any tips on how I might think of turning my code into can be used with > interact? > > Thanks in advance, > > -Raymond > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From raymond.yee at gmail.com Mon Feb 10 15:46:31 2014 From: raymond.yee at gmail.com (Raymond Yee) Date: Mon, 10 Feb 2014 12:46:31 -0800 Subject: [IPython-dev] Cartopy - was maps inline In-Reply-To: References: <20140130203414.495our33k04c804w@webmail.light42.com> Message-ID: <52F93AA7.4090208@gmail.com> Hi Phil, I'd definitely like to try cartopy. I'm hesitant to dive in at the moment because according to http://scitools.org.uk/cartopy/docs/latest/index.html#installation, Installation of cartopy can currently only be done from source. Build instructions for specific operating systems can be found in the building from source section. I'm leading a class in which I've had everyone install anaconda on their laptops -- whether it be running OS X, Windows, or Linux. You know how hard it will be in practice to install cartopy under those conditions? Thanks, -Raymond On 2/10/14 2:02 AM, Phil Elson wrote: > Hi Brian, > > Thanks for the free publicity :) > > You're right - the notebook is killer for sharing examples > (e.g. http://nbviewer.ipython.org/gist/pelson/7772265) and we're > making pretty heavy use of it. I'm also super keen to convert the > cartopy gallery > (http://scitools.org.uk/cartopy/docs/latest/gallery.html) to be > notebook based - I think all the tools are available with IPython now, > it's just a case of joining them all together and applying a bit of > Python glue. > > Finally, a huge success story for me has been the course material that > I've been able to write with the notebook. It's still in a state of > flux, but I've been teaching introductions to numpy (3.5 hrs), > matplotlib (3 hrs), cartopy (0.5 hrs) and iris (6 hrs) to experienced > weather/climate research scientists using nothing but IPython > notebook, and I've set up each of the students with notebook > environments for the class exercises. If anybody is interested, the > material is available on github (https://github.com/SciTools/courses) > and as an example, the Iris course can be seen on nbviewer at > http://nbviewer.ipython.org/github/SciTools/courses/blob/master/course_content/iris_intro.ipynb > . > > I've said it before, but I'll say it again - IPython notebook > absolutely rocks so thank you to everybody who has been involved in > its conception and development! > > Cheers, > > Phil > > > > > On 31 January 2014 04:34, > wrote: > > people may be aware of this project: > > https://github.com/SciTools/cartopy > > they seem to use iPython-notebook a *lot* .. > > -- > Brian M Hamlin > OSGeo California Chapter > blog.light42.com > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at hilboll.de Mon Feb 10 16:03:16 2014 From: lists at hilboll.de (Andreas Hilboll) Date: Mon, 10 Feb 2014 22:03:16 +0100 Subject: [IPython-dev] Cartopy - was maps inline In-Reply-To: <52F93AA7.4090208@gmail.com> References: <20140130203414.495our33k04c804w@webmail.light42.com> <52F93AA7.4090208@gmail.com> Message-ID: <52F93E94.9000204@hilboll.de> On 10.02.2014 21:46, Raymond Yee wrote: > Hi Phil, > > I'd definitely like to try cartopy. I'm hesitant to dive in at the > moment because according to > http://scitools.org.uk/cartopy/docs/latest/index.html#installation, > > Installation of cartopy can currently only be done from source. > Build instructions for specific operating systems can be found in the > building from source section. > > I'm leading a class in which I've had everyone install anaconda on their > laptops -- whether it be running OS X, Windows, or Linux. You know how > hard it will be in practice to install cartopy under those conditions? Just as a side note: last Friday I contacted the Anaconda team (aka. Continuum) to ask if they would include iris and cartopy in their anaconda distribution. They promised to add them to the package wishlist but told me to be patient since they have limited resources. Cheers, Andreas. > > Thanks, > -Raymond > > > On 2/10/14 2:02 AM, Phil Elson wrote: >> Hi Brian, >> >> Thanks for the free publicity :) >> >> You're right - the notebook is killer for sharing examples >> (e.g. http://nbviewer.ipython.org/gist/pelson/7772265) and we're >> making pretty heavy use of it. I'm also super keen to convert the >> cartopy gallery >> (http://scitools.org.uk/cartopy/docs/latest/gallery.html) to be >> notebook based - I think all the tools are available with IPython now, >> it's just a case of joining them all together and applying a bit of >> Python glue. >> >> Finally, a huge success story for me has been the course material that >> I've been able to write with the notebook. It's still in a state of >> flux, but I've been teaching introductions to numpy (3.5 hrs), >> matplotlib (3 hrs), cartopy (0.5 hrs) and iris (6 hrs) to experienced >> weather/climate research scientists using nothing but IPython >> notebook, and I've set up each of the students with notebook >> environments for the class exercises. If anybody is interested, the >> material is available on github (https://github.com/SciTools/courses) >> and as an example, the Iris course can be seen on nbviewer at >> http://nbviewer.ipython.org/github/SciTools/courses/blob/master/course_content/iris_intro.ipynb >> . >> >> I've said it before, but I'll say it again - IPython notebook >> absolutely rocks so thank you to everybody who has been involved in >> its conception and development! >> >> Cheers, >> >> Phil >> >> >> >> >> On 31 January 2014 04:34, > > wrote: >> >> people may be aware of this project: >> >> https://github.com/SciTools/cartopy >> >> they seem to use iPython-notebook a *lot* .. >> >> -- >> Brian M Hamlin >> OSGeo California Chapter >> blog.light42.com >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- -- Andreas. From patrick.surry at gmail.com Mon Feb 10 16:37:54 2014 From: patrick.surry at gmail.com (Patrick Surry) Date: Mon, 10 Feb 2014 16:37:54 -0500 Subject: [IPython-dev] Experiences getting a d3.js example working in the Notebook and request for advice Message-ID: Great stuff! I've been using pandas (http://pandas.pydata.org/) in the notebook to create data for D3. I've used both df.to_csv() and df.to_json() and methods to dump to CSV or serialize a dataframe to embed directly in a Javascript template for D3. But I hadn't worked out how to embed D3 in the notebook itself. Very handy. Thanks, Patrick > Like many of you, I'm excited about the widgets and interact > functionality. But as someone whose JavaScript skills and front-end web > dev skills are modest (but which are rapidly growing while I'm learning > about how to do more in the Notebook!), I have been focusing first on > how to use the Notebook as a possible environment for the learning and > teaching of HTML, CSS, and JavaScript. I like things like jsfiddle.net > as environments to try out and share small units of front end web > programming and wonder how to use the Notebook in a similar fashion. > > As a short term challenge, I'm looking at learning/teaching d3.js using > the Notebook -- and using d3.js specifically to plot US-related census > data at the county level. I've wanted to rework Mike Bostock's > Choropleth (http://bl.ocks.org/mbostock/4060606) example into IPython > Notebook code that can take data calculated via Python and then > displayed using d3. > > I *think* I just figured out how to make the Choropleth example show up > in a Notebook: > > > > http://nbviewer.ipython.org/github/rdhyee/working-open-data-2014/blob/master/notebooks/Day_07_A_D3_Choropleth.ipynb > > whose workings I illustrate in a silent video: > > http://www.youtube.com/watch?v=Vfc8nzR15ME > > I wrote up the mistakes I made to document the stumbling blocks for > other novices to avoid. This example is not likely to be a big deal to > experts -- but I'm interested in knowing whether I'm taking the right > approach and how this example can be improved. Specifically: > > * Am I using requirejs correctly to load the external libraries in the > Notebook? > > * What will be the best way for me to dynamically construct data in > Python to pass to d3? I'll want to replace the unemployment data (in > unemployment.csv that d3 loads externally) to something I can pass to > d3 from Python. Should I serialize the Python object into JSON, which I > can embed as a JavaScript literal in the code? Or is there a way for me > to serve up JSON data via a local URL (served up by the Notebook > machinery)? If so, should I write the data out to a file that can be > served up by the Notebook via http? Or is there a way to serve up data > without explicitly writing to the local filesystem? > > * What gotchas should I be aware of, especially as someone who wants to > show this in class tomorrow or later this week? :-) > > * Any tips on how I might think of turning my code into can be used with > interact? > > Thanks in advance, > > -Raymond > -------------- next part -------------- An HTML attachment was scrubbed... URL: From alessandro.gagliardi at glassdoor.com Mon Feb 10 19:52:45 2014 From: alessandro.gagliardi at glassdoor.com (Alessandro Gagliardi) Date: Tue, 11 Feb 2014 00:52:45 +0000 Subject: [IPython-dev] 'module' object has no attribute 'SingleBlockManager' Message-ID: Sorry for the cross-post. I can?t tell if this is an IPython issue, a scikit-learn issue, or a StarCluster issue. When I try to get back results from ExtraTreesRegressor from a load_balanced_view on StarCluster, I get: AttributeError: 'module' object has no attribute 'SingleBlockManager' Not sure if this is a StarCluster specific problem, an IPython.parallel, but, or an issue with the ExtraTreesRegressor. The weird thing is that it worked and then it didn?t and I don?t see what changed. I restarted the cluster, but that didn?t help. I?m using sklearn 0.14.1, StarCluster 0.95, IPython 1.1 remotely and IPython 2.0 locally. Thanks, -Alessandro -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Mon Feb 10 20:07:26 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 10 Feb 2014 17:07:26 -0800 Subject: [IPython-dev] 'module' object has no attribute 'SingleBlockManager' In-Reply-To: References: Message-ID: A quick search on Github suggests that SingleBlockManager is a pandas thing, but I don't know why it would be failing. On 10 February 2014 16:52, Alessandro Gagliardi < alessandro.gagliardi at glassdoor.com> wrote: > Sorry for the cross-post. I can't tell if this is an IPython issue, a > scikit-learn issue, or a StarCluster issue. > > When I try to get back results from ExtraTreesRegressor from a > load_balanced_view on StarCluster, I get: > > AttributeError: 'module' object has no attribute 'SingleBlockManager' > > Not sure if this is a StarCluster specific problem, an IPython.parallel, > but, or an issue with the ExtraTreesRegressor. The weird thing is that it > worked and then it didn't and I don't see what changed. I restarted the > cluster, but that didn't help. I'm using sklearn 0.14.1, StarCluster 0.95, > IPython 1.1 remotely and IPython 2.0 locally. > > Thanks, > -Alessandro > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From javi.martinez.lopez at gmail.com Tue Feb 11 03:59:21 2014 From: javi.martinez.lopez at gmail.com (=?ISO-8859-1?Q?Javier_Mart=EDnez=2DL=F3pez?=) Date: Tue, 11 Feb 2014 09:59:21 +0100 Subject: [IPython-dev] RandomForestClassifier w/ IPython.parallel In-Reply-To: References: Message-ID: Hi, maybe you could also use the "bigrf" package in R through "rpy2": http://cran.r-project.org/web/packages/bigrf/index.html Cheers, Javier On Fri, Feb 7, 2014 at 9:36 PM, Alessandro Gagliardi wrote: > Not sure if I'm addressing the best list for this question, so if there's a > more appropriate list, please direct me to it. > > I want to run a large sklearn.ensemble.RandomForestClassifier (with maybe a > dozens or maybe hundreds of trees and 100,000 samples). My desktop won't > handle this so I want to try using StarCluster. RandomForestClassifier seems > to parallelize easily, but I don't know how I would split it across many > IPython.parallel engines (if that's even possible). (Or maybe I should be > foregoing IPython.parallel and using MPI?) > > Any help would be greatly appreciated. > > Thanks, > > Alessandro Gagliardi| Glassdoor| alessandro at glassdoor.com > > We're hiring! Check out our open jobs. > > Twitter | Facebook | Glassdoor Blog > > 2012 Webby Award Winner: Best Employment Site > > 2013 Webby Award Winner: Best Guides/Ratings/Review Site > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From atakan.dogan at gmail.com Tue Feb 11 04:25:13 2014 From: atakan.dogan at gmail.com (Atakan Dogan) Date: Tue, 11 Feb 2014 11:25:13 +0200 Subject: [IPython-dev] Plot does not work in Lesson 1 Message-ID: Hi Guys, I followed the lesson 1 at http://nbviewer.ipython.org/urls/bitbucket.org/hrojas/learn-pandas/raw/master/lessons/01%20-%20Lesson.ipynb There was no problem until plotting (In [19]). There is no error but also there is no plotting, no screen. What can be the problem? I tried it on: Canopy Version 1.3.0 (32 bit) Windows 7 Enterpries (64 bit) Regards, Atakan -------------- next part -------------- An HTML attachment was scrubbed... URL: From konrad.hinsen at fastmail.net Tue Feb 11 05:40:13 2014 From: konrad.hinsen at fastmail.net (Konrad Hinsen) Date: Tue, 11 Feb 2014 11:40:13 +0100 Subject: [IPython-dev] Running the test suite Message-ID: <21241.65037.821171.400885@Konrad-Hinsens-MacBook-Pro-2.local> My latest PR gets lots of test failures, so I am finally looking seriously at running the IPython test suite locally on my machine. Details: IPython master branch, Python 2.7/3.3, "installed" with 'python setup.py develop'. MacOS X 10.9. 1) The obvious approach: iptest All tests fail for the same reason: ImportError: cannot import name globalipapp globalipapp is a module under IPython/testing, so this looks like some issue with sys.path. Until now, I just decided to write my own little test scripts for my own modifications, which seemed like less effort than debugging the test system. But my own test scripts pass, whereas the official test suite fails, so I need to figure out how to run the official test suite. 2) Try running subsets: iptest config ... Same problem as under 1) iptest -v IPython.utils (copy-paste straight from the Wiki!) iptest: error: unrecognized arguments: -v 3) Run IPython/testing/ipython.py as script: python IPython/testing/iptest.py config Works fine, but it's a pain to run all parts individually. Moreover, the parts I know (what iptest lists) all pass, so there must be some other parts that I don't know about. python IPython/testing/iptest.py Fails because iptest.py accesses sys.argv[1] At this point I am willing to give up - would someone please tell me what the solution is? Thanks in advance, Konrad. From bussonniermatthias at gmail.com Tue Feb 11 05:46:15 2014 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Tue, 11 Feb 2014 11:46:15 +0100 Subject: [IPython-dev] Running the test suite In-Reply-To: <21241.65037.821171.400885@Konrad-Hinsens-MacBook-Pro-2.local> References: <21241.65037.821171.400885@Konrad-Hinsens-MacBook-Pro-2.local> Message-ID: Are you running iptest from inside IPython dir ? Try running it from ~/ -- M Le 11 f?vr. 2014 ? 11:40, Konrad Hinsen a ?crit : > My latest PR gets lots of test failures, so I am finally looking > seriously at running the IPython test suite locally on my machine. > > Details: IPython master branch, Python 2.7/3.3, "installed" with > 'python setup.py develop'. MacOS X 10.9. > > 1) The obvious approach: > iptest > All tests fail for the same reason: > ImportError: cannot import name globalipapp > > globalipapp is a module under IPython/testing, so this looks like some > issue with sys.path. Until now, I just decided to write my own little > test scripts for my own modifications, which seemed like less effort > than debugging the test system. But my own test scripts pass, whereas > the official test suite fails, so I need to figure out how to run the > official test suite. > > 2) Try running subsets: > > iptest config ... > Same problem as under 1) > > iptest -v IPython.utils (copy-paste straight from the Wiki!) > iptest: error: unrecognized arguments: -v > > 3) Run IPython/testing/ipython.py as script: > > python IPython/testing/iptest.py config > Works fine, but it's a pain to run all parts individually. Moreover, > the parts I know (what iptest lists) all pass, so there must be > some other parts that I don't know about. > > python IPython/testing/iptest.py > Fails because iptest.py accesses sys.argv[1] > > At this point I am willing to give up - would someone please tell me what the > solution is? > > Thanks in advance, > Konrad. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From konrad.hinsen at fastmail.net Tue Feb 11 07:01:56 2014 From: konrad.hinsen at fastmail.net (Konrad Hinsen) Date: Tue, 11 Feb 2014 13:01:56 +0100 Subject: [IPython-dev] Running the test suite In-Reply-To: References: <21241.65037.821171.400885@Konrad-Hinsens-MacBook-Pro-2.local> Message-ID: <21242.4404.98457.797467@Konrad-Hinsens-MacBook-Pro-2.local> Matthias BUSSONNIER writes: > Are you running iptest from inside IPython dir ? > > Try running it from ~/ Aaaahhhhh...... A proposal for a bit more user friendliness: http://github.com/ipython/ipython/pull/5090 Thanks, Konrad From nathan12343 at gmail.com Tue Feb 11 19:21:02 2014 From: nathan12343 at gmail.com (Nathan Goldbaum) Date: Tue, 11 Feb 2014 16:21:02 -0800 Subject: [IPython-dev] Removing displayed javascript Message-ID: Hi all, Recently I've been making use of the very nice notebook-aware fork of the python-progressbar library: https://github.com/fnoble/python-progressbar Inside a command-line session, this acts just like the original python-progressbar library, displaying a nicely formatted ascii progress bar. Inside of a notebook, it makes use of the display protocal to create a nicely formatted animated HTML progressbar using a bit of javascript to update the progressbar and clean up old elements. The library has already been patched so that the progressbar removes all traces of itself from the cell display area after it has finished up. However, I can't seem to find a way to also remove all traces of the progress bar from the .ipynb json file. Is it possible to dynamically remove displayed javascript from the notebook .ipynb file? Since python-progressbar uses a javascript callback invoked via display() to update the progress bar, this means that there is a json entry for each progress bar update and for the progress bar itself. In a notebook with many progress bars, this means that the notebook file can quickly balloon in size as it is filled up with repeats of the same javascript cleanup code. The cleanup could happen on the python side or on the javascript side, whichever is more convenient. Thanks for your advice, Nathan Goldbaum From benjaminrk at gmail.com Tue Feb 11 19:51:51 2014 From: benjaminrk at gmail.com (MinRK) Date: Tue, 11 Feb 2014 16:51:51 -0800 Subject: [IPython-dev] Removing displayed javascript In-Reply-To: References: Message-ID: clear_output() should remove any output from a cell. It doesn't allow selectively removing particular outputs, though. -------------- next part -------------- An HTML attachment was scrubbed... URL: From dineshvadhia at outlook.com Wed Feb 12 09:39:58 2014 From: dineshvadhia at outlook.com (Dinesh Vadhia) Date: Wed, 12 Feb 2014 06:39:58 -0800 Subject: [IPython-dev] ipython.parallel - running programs on cores with persistent data Message-ID: Hi! New to the list and have a few questions about ipython.parallel for building a request/response system: a. Does ipython.parallel support computations on persistent data objects at the nodes or does it (always) recreate the data objects for each new request? b. Assuming a), each core runs a python program that operates on persistant data objects in-memory and the programs are running continuously servicing requests from the controller. - How are the programs started up (and stopped) on each core using ipython.parallel without using any of the magic commands because the system is not "interactive" in the ipython sense? - Are 3rd party distributed/cluster systems management tools needed to achieve these functions? Best ... Dinesh -------------- next part -------------- An HTML attachment was scrubbed... URL: From jchendy at gmail.com Wed Feb 12 13:31:35 2014 From: jchendy at gmail.com (Jeff Hendy) Date: Wed, 12 Feb 2014 13:31:35 -0500 Subject: [IPython-dev] Getting started with widgets Message-ID: I've seen a few people excitedly talking about the new widgets here. Is it correct that widget support is now in the master branch on git? Is there some documentation on how to get started on playing around with the widgets? Thanks! Jeff -------------- next part -------------- An HTML attachment was scrubbed... URL: From jason-sage at creativetrax.com Wed Feb 12 13:45:32 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Wed, 12 Feb 2014 12:45:32 -0600 Subject: [IPython-dev] pyzmq problems in sending shell messages to a kernel Message-ID: <52FBC14C.5090702@creativetrax.com> Hi everyone, I'm trying to track down a problem we're seeing in the Sage cell server with sending computation messages to an IPython kernel. This may end up being a problem with using pyzmq or zmq, so apologies in advance if it turns out to be OT for this list. The tl;dr version is: it appears that in some very sporadic cases, pyzmq is sending a message (an execute_request message) to a kernel's shell channel tcp port on localhost, but wireshark never registers that message being sent, and the kernel that is supposed to receive the message never acts on it. My question is: does anyone have suggestions on debugging this or narrowing down the problem? The (abbreviated, simplified) long version: in the sage cell server, we start up a number of IPython kernels that we keep waiting around for computations. When a computation is requested, we hook up the kernel's shell/iopub/heartbeat channels (i.e., create pyzmq zmqstream objects connecting to the tcp ports corresponding to the kernel's shell/io/heartbeat channels), send an execute_request, and assemble an answer for the user from output coming back on the iopub channel. When the system is under moderate load, every now and then (maybe every 300 computations), we send an execute_request message to one of these kernels that is waiting around, and I see the zmq socket code claiming that it sent the message, but wireshark indicates that the message was never transmitted when looking at raw tcp traffic, and the kernel acts like it never received the message. We didn't change the high water mark for zmq, and I'm running zmq 3.2.2 and pyzmq 14.0.1. I've spent a long time narrowing the issue down to a zmq message not being sent, even though pyzmq seems to have thought it sent it. Does anyone have any suggestions for narrowing this down more, or possible causes? I realize that my setup is a bit complicated, and I've tried to simplify the issues (but hopefully not too much). Any suggestions or help would be appreciated. The next thing I'm going to do is (a) upgrade zmq to 4.x, and (b) insert some debugging statements in the zmq library itself to see if the C zmq library thinks it sent the message. Thanks, Jason From benjaminrk at gmail.com Wed Feb 12 13:54:51 2014 From: benjaminrk at gmail.com (MinRK) Date: Wed, 12 Feb 2014 10:54:51 -0800 Subject: [IPython-dev] pyzmq problems in sending shell messages to a kernel In-Reply-To: <52FBC14C.5090702@creativetrax.com> References: <52FBC14C.5090702@creativetrax.com> Message-ID: Nothing springs to mind, but I will think about this one for a while. Are there likely other outstanding requests to the same kernel at the time, and/or from the same requesting socket? If so, can you ballpark how many? What are you using to indicate that pyzmq thinks the message has been sent? -MinRK On Wed, Feb 12, 2014 at 10:45 AM, Jason Grout wrote: > Hi everyone, > > I'm trying to track down a problem we're seeing in the Sage cell server > with sending computation messages to an IPython kernel. This may end up > being a problem with using pyzmq or zmq, so apologies in advance if it > turns out to be OT for this list. > > The tl;dr version is: it appears that in some very sporadic cases, pyzmq > is sending a message (an execute_request message) to a kernel's shell > channel tcp port on localhost, but wireshark never registers that > message being sent, and the kernel that is supposed to receive the > message never acts on it. My question is: does anyone have suggestions > on debugging this or narrowing down the problem? > > The (abbreviated, simplified) long version: in the sage cell server, we > start up a number of IPython kernels that we keep waiting around for > computations. When a computation is requested, we hook up the kernel's > shell/iopub/heartbeat channels (i.e., create pyzmq zmqstream objects > connecting to the tcp ports corresponding to the kernel's > shell/io/heartbeat channels), send an execute_request, and assemble an > answer for the user from output coming back on the iopub channel. When > the system is under moderate load, every now and then (maybe every 300 > computations), we send an execute_request message to one of these > kernels that is waiting around, and I see the zmq socket code claiming > that it sent the message, but wireshark indicates that the message was > never transmitted when looking at raw tcp traffic, and the kernel acts > like it never received the message. We didn't change the high water > mark for zmq, and I'm running zmq 3.2.2 and pyzmq 14.0.1. I've spent a > long time narrowing the issue down to a zmq message not being sent, even > though pyzmq seems to have thought it sent it. Does anyone have any > suggestions for narrowing this down more, or possible causes? > > I realize that my setup is a bit complicated, and I've tried to simplify > the issues (but hopefully not too much). Any suggestions or help would > be appreciated. The next thing I'm going to do is (a) upgrade zmq to > 4.x, and (b) insert some debugging statements in the zmq library itself > to see if the C zmq library thinks it sent the message. > > Thanks, > > Jason > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From pi at berkeley.edu Wed Feb 12 13:55:55 2014 From: pi at berkeley.edu (Paul Ivanov) Date: Wed, 12 Feb 2014 10:55:55 -0800 Subject: [IPython-dev] Getting started with widgets In-Reply-To: References: Message-ID: <20140212185555.GC9713@HbI-OTOH.berkeley.edu> Jeff Hendy, on 2014-02-12 13:31, wrote: > I've seen a few people excitedly talking about the new widgets here. Is it > correct that widget support is now in the master branch on git? Is there > some documentation on how to get started on playing around with the widgets? Hi Jeff, Yes, in master, just start a notebook server in the examples/widgets directory. You'll see something like this [1] in your Dashboard - start with Part 1 and work your way through. 1. http://nbviewer.ipython.org/github/ipython/ipython/tree/master/examples/widgets/ best, -- _ / \ A* \^ - ,./ _.`\\ / \ / ,--.S \/ \ / `"~,_ \ \ __o ? _ \<,_ /:\ --(_)/-(_)----.../ | \ --------------.......J Paul Ivanov http://pirsquared.org From benjaminrk at gmail.com Wed Feb 12 14:01:08 2014 From: benjaminrk at gmail.com (MinRK) Date: Wed, 12 Feb 2014 11:01:08 -0800 Subject: [IPython-dev] pyzmq problems in sending shell messages to a kernel In-Reply-To: References: <52FBC14C.5090702@creativetrax.com> Message-ID: Do you perchance customize KernelManagers? Specifically, do you change how sockets are created or what socket types are used? -MinRK On Wed, Feb 12, 2014 at 10:54 AM, MinRK wrote: > Nothing springs to mind, but I will think about this one for a while. Are > there likely other outstanding requests to the same kernel at the time, > and/or from the same requesting socket? If so, can you ballpark how many? > What are you using to indicate that pyzmq thinks the message has been sent? > > -MinRK > > > On Wed, Feb 12, 2014 at 10:45 AM, Jason Grout > wrote: > >> Hi everyone, >> >> I'm trying to track down a problem we're seeing in the Sage cell server >> with sending computation messages to an IPython kernel. This may end up >> being a problem with using pyzmq or zmq, so apologies in advance if it >> turns out to be OT for this list. >> >> The tl;dr version is: it appears that in some very sporadic cases, pyzmq >> is sending a message (an execute_request message) to a kernel's shell >> channel tcp port on localhost, but wireshark never registers that >> message being sent, and the kernel that is supposed to receive the >> message never acts on it. My question is: does anyone have suggestions >> on debugging this or narrowing down the problem? >> >> The (abbreviated, simplified) long version: in the sage cell server, we >> start up a number of IPython kernels that we keep waiting around for >> computations. When a computation is requested, we hook up the kernel's >> shell/iopub/heartbeat channels (i.e., create pyzmq zmqstream objects >> connecting to the tcp ports corresponding to the kernel's >> shell/io/heartbeat channels), send an execute_request, and assemble an >> answer for the user from output coming back on the iopub channel. When >> the system is under moderate load, every now and then (maybe every 300 >> computations), we send an execute_request message to one of these >> kernels that is waiting around, and I see the zmq socket code claiming >> that it sent the message, but wireshark indicates that the message was >> never transmitted when looking at raw tcp traffic, and the kernel acts >> like it never received the message. We didn't change the high water >> mark for zmq, and I'm running zmq 3.2.2 and pyzmq 14.0.1. I've spent a >> long time narrowing the issue down to a zmq message not being sent, even >> though pyzmq seems to have thought it sent it. Does anyone have any >> suggestions for narrowing this down more, or possible causes? >> >> I realize that my setup is a bit complicated, and I've tried to simplify >> the issues (but hopefully not too much). Any suggestions or help would >> be appreciated. The next thing I'm going to do is (a) upgrade zmq to >> 4.x, and (b) insert some debugging statements in the zmq library itself >> to see if the C zmq library thinks it sent the message. >> >> Thanks, >> >> Jason >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jason-sage at creativetrax.com Wed Feb 12 14:04:30 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Wed, 12 Feb 2014 13:04:30 -0600 Subject: [IPython-dev] pyzmq problems in sending shell messages to a kernel In-Reply-To: References: <52FBC14C.5090702@creativetrax.com> Message-ID: <52FBC5BE.6040304@creativetrax.com> On 2/12/14 12:54 PM, MinRK wrote: > Nothing springs to mind, but I will think about this one for a while. > Are there likely other outstanding requests to the same kernel at the > time, and/or from the same requesting socket? If so, can you ballpark > how many? What are you using to indicate that pyzmq thinks the message > has been sent? > There shouldn't be any other outstanding requests to the same kernel tcp port (i.e., the receiving side; it literally is just sitting there waiting for computation requests). As for messages queuing up on the sending side, I'm pretty sure there shouldn't be any (i.e., we create a new socket), but I will check that both with our code and with wireshark. To tell pyzmq thought it was sending/receiving a message, I inserted code like this in the zmq/eventloop/zmqstream.py file, in the _handle_send and _handle_recv methods, just after the recv_multipart or send_multipart calls: import logging logging.getLogger('sagecell').info('sent ZMQ: %s %s'%(msg, status)) The result in the _handle_send is that the message was printed out, with a status of None. The receiving side didn't print anything out in the anomalous cases, but did print out the received message in the vast majority of times. Thanks, Jason > -MinRK > > > On Wed, Feb 12, 2014 at 10:45 AM, Jason Grout > > wrote: > > Hi everyone, > > I'm trying to track down a problem we're seeing in the Sage cell server > with sending computation messages to an IPython kernel. This may end up > being a problem with using pyzmq or zmq, so apologies in advance if it > turns out to be OT for this list. > > The tl;dr version is: it appears that in some very sporadic cases, pyzmq > is sending a message (an execute_request message) to a kernel's shell > channel tcp port on localhost, but wireshark never registers that > message being sent, and the kernel that is supposed to receive the > message never acts on it. My question is: does anyone have suggestions > on debugging this or narrowing down the problem? > > The (abbreviated, simplified) long version: in the sage cell server, we > start up a number of IPython kernels that we keep waiting around for > computations. When a computation is requested, we hook up the kernel's > shell/iopub/heartbeat channels (i.e., create pyzmq zmqstream objects > connecting to the tcp ports corresponding to the kernel's > shell/io/heartbeat channels), send an execute_request, and assemble an > answer for the user from output coming back on the iopub channel. When > the system is under moderate load, every now and then (maybe every 300 > computations), we send an execute_request message to one of these > kernels that is waiting around, and I see the zmq socket code claiming > that it sent the message, but wireshark indicates that the message was > never transmitted when looking at raw tcp traffic, and the kernel acts > like it never received the message. We didn't change the high water > mark for zmq, and I'm running zmq 3.2.2 and pyzmq 14.0.1. I've spent a > long time narrowing the issue down to a zmq message not being sent, even > though pyzmq seems to have thought it sent it. Does anyone have any > suggestions for narrowing this down more, or possible causes? > > I realize that my setup is a bit complicated, and I've tried to simplify > the issues (but hopefully not too much). Any suggestions or help would > be appreciated. The next thing I'm going to do is (a) upgrade zmq to > 4.x, and (b) insert some debugging statements in the zmq library itself > to see if the C zmq library thinks it sent the message. > > Thanks, > > Jason > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From benjaminrk at gmail.com Wed Feb 12 14:09:38 2014 From: benjaminrk at gmail.com (MinRK) Date: Wed, 12 Feb 2014 11:09:38 -0800 Subject: [IPython-dev] ipython.parallel - running programs on cores with persistent data In-Reply-To: References: Message-ID: On Wed, Feb 12, 2014 at 6:39 AM, Dinesh Vadhia wrote: Hi! New to the list and have a few questions about ipython.parallel for > building a request/response system: > > a. Does ipython.parallel support computations on persistent data objects > at the nodes or does it (always) recreate the data objects for each new > request? > Each task is just a Python function, evaluated in the namespace of the engine(s). So any objects created in that namespace are persistent until explicitly deleted. The namespace is persistent for the lifetime of the engine. Nothing is created except by explicit request of the Client. > b. Assuming a), each core runs a python program that operates on > persistent data objects in-memory and the programs are running continuously > servicing requests from the controller. > - How are the programs started up (and stopped) on each core using > ipython.parallel without using any of the magic commands because the system > is not "interactive" in the ipython sense? > - Are 3rd party distributed/cluster systems management tools needed to > achieve these functions? > The IPython Engine is actually the exact same code as the IPython Kernel used in the Notebook, so it is ?interactive? in the very same way. Each task submitted with View.apply (I assume this is what you mean by ?program?) is just a Python function. The function is serialized, sent to the Engine, where it is deserialized and just called. There is no ?stopping?, the functions just return. -MinRK > Best ... > Dinesh > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jason-sage at creativetrax.com Wed Feb 12 14:25:39 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Wed, 12 Feb 2014 13:25:39 -0600 Subject: [IPython-dev] pyzmq problems in sending shell messages to a kernel In-Reply-To: References: <52FBC14C.5090702@creativetrax.com> Message-ID: <52FBCAB3.9030901@creativetrax.com> On 2/12/14 1:01 PM, MinRK wrote: > Do you perchance customize KernelManagers? Specifically, do you change > how sockets are created or what socket types are used? We do have our own kernel manager. I'll check into the kinds of sockets we are creating. I don't think we changed the types of sockets. Thanks for throwing these ideas out here. Jason From pi at berkeley.edu Wed Feb 12 14:27:36 2014 From: pi at berkeley.edu (Paul Ivanov) Date: Wed, 12 Feb 2014 11:27:36 -0800 Subject: [IPython-dev] Removing displayed javascript In-Reply-To: References: Message-ID: <20140212192736.GA7708@HbI-OTOH.berkeley.edu> MinRK, on 2014-02-11 16:51, wrote: > clear_output() should remove any output from a cell. It doesn't allow > selectively removing particular outputs, though. Here's how you can remove a particular output in JavaScript IPython.notebook.get_cells() .filter(function (c) { return c.cell_type === 'code'; }) .map(function (c) { c.output_area.outputs .map(function (o) { delete o['application/javascript']; }); }) The 'application/javascript' key is what the right key is in master, in IPython 1.x and earlier, this key was called 'javascript' best, -- _ / \ A* \^ - ,./ _.`\\ / \ / ,--.S \/ \ / `"~,_ \ \ __o ? _ \<,_ /:\ --(_)/-(_)----.../ | \ --------------.......J Paul Ivanov http://pirsquared.org From jason-sage at creativetrax.com Wed Feb 12 14:29:55 2014 From: jason-sage at creativetrax.com (Jason Grout) Date: Wed, 12 Feb 2014 13:29:55 -0600 Subject: [IPython-dev] pyzmq problems in sending shell messages to a kernel In-Reply-To: <52FBCAB3.9030901@creativetrax.com> References: <52FBC14C.5090702@creativetrax.com> <52FBCAB3.9030901@creativetrax.com> Message-ID: <52FBCBB3.3020801@creativetrax.com> On 2/12/14 1:25 PM, Jason Grout wrote: > We do have our own kernel manager. I'll check into the kinds of sockets > we are creating. I don't think we changed the types of sockets. (here is our code to create the shell/iopub/hb streams from the "browser" side...) https://github.com/sagemath/sagecell/blob/master/trusted_kernel_manager.py#L356 Here's our code on the kernel side (which creates a kernel by forking a sage process and then creating a kernel): https://github.com/sagemath/sagecell/blob/master/forking_kernel_manager.py#L39 I don't expect you to slog through our code if you don't want to, but just in case you want to take a peek.... Jason From msg2mw at gmail.com Wed Feb 12 15:01:11 2014 From: msg2mw at gmail.com (Mike Witt) Date: Wed, 12 Feb 2014 12:01:11 -0800 Subject: [IPython-dev] Two questions about wakari Message-ID: <1392235271.2667.8@Vector> I suppose there are some wakari users here. Two quick questions: (1) How do you "un-share" (or otherwise get rid of) a shared bundle? (2) I there a wakari user list somewhere, where questions like this would be better asked? From jchendy at gmail.com Wed Feb 12 15:10:31 2014 From: jchendy at gmail.com (Jeff Hendy) Date: Wed, 12 Feb 2014 15:10:31 -0500 Subject: [IPython-dev] Getting started with widgets In-Reply-To: <20140212185555.GC9713@HbI-OTOH.berkeley.edu> References: <20140212185555.GC9713@HbI-OTOH.berkeley.edu> Message-ID: Thanks Paul, that is great! On Wed, Feb 12, 2014 at 1:55 PM, Paul Ivanov wrote: > Jeff Hendy, on 2014-02-12 13:31, wrote: > > I've seen a few people excitedly talking about the new widgets here. Is > it > > correct that widget support is now in the master branch on git? Is there > > some documentation on how to get started on playing around with the > widgets? > > Hi Jeff, > > Yes, in master, just start a notebook server in the > examples/widgets directory. > > You'll see something like this [1] in your Dashboard - start with > Part 1 and work your way through. > > 1. > http://nbviewer.ipython.org/github/ipython/ipython/tree/master/examples/widgets/ > > best, > -- > _ > / \ > A* \^ - > ,./ _.`\\ / \ > / ,--.S \/ \ > / `"~,_ \ \ > __o ? > _ \<,_ /:\ > --(_)/-(_)----.../ | \ > --------------.......J > Paul Ivanov > http://pirsquared.org > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dineshvadhia at outlook.com Wed Feb 12 15:55:04 2014 From: dineshvadhia at outlook.com (Dinesh Vadhia) Date: Wed, 12 Feb 2014 12:55:04 -0800 Subject: [IPython-dev] ipython.parallel - running programs on cores with persistent data Message-ID: a) Terrific! b) Still not clear about this! Each core runs an ipython/Python interpreter. At startup, I want to run a python program (p1) on each core which will operate on persistent data objects in its namespace. On system startup, how do I start the python program (p1) on each core? -------------- next part -------------- An HTML attachment was scrubbed... URL: From benjaminrk at gmail.com Thu Feb 13 14:20:50 2014 From: benjaminrk at gmail.com (MinRK) Date: Thu, 13 Feb 2014 11:20:50 -0800 Subject: [IPython-dev] [ANN] IPython 1.2.0 Message-ID: IPython 1.2.0 has been released, with various bugs fixed. For the backported patches, see what?s new . After release, we did discover a bug preventing the notebook from working properly in Python 2.6, so we will cut 1.2.1 next week with a fix for this. -MinRK -------------- next part -------------- An HTML attachment was scrubbed... URL: From asmeurer at gmail.com Thu Feb 13 19:01:07 2014 From: asmeurer at gmail.com (Aaron Meurer) Date: Thu, 13 Feb 2014 18:01:07 -0600 Subject: [IPython-dev] Two questions about wakari In-Reply-To: <1392235271.2667.8@Vector> References: <1392235271.2667.8@Vector> Message-ID: Try wakari_support at continuum.io. Aaron Meurer On Wed, Feb 12, 2014 at 2:01 PM, Mike Witt wrote: > I suppose there are some wakari users here. > Two quick questions: > > (1) How do you "un-share" (or otherwise get rid of) > a shared bundle? > > (2) I there a wakari user list somewhere, where questions > like this would be better asked? > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From alessandro.gagliardi at glassdoor.com Thu Feb 13 19:15:19 2014 From: alessandro.gagliardi at glassdoor.com (Alessandro Gagliardi) Date: Fri, 14 Feb 2014 00:15:19 +0000 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac Message-ID: I?m using a Mac with Anaconda installed. I was able to pip install the master branch of IPython 2 before but I wanted to update it (so I could get widgets). It looks like it dies while trying to build the readline extension module with regard to Darwin. I already have readline 6.2 installed (from conda). When I try to pip install readline, I get the same error: Command /Users/alessandro.gagliardi/anaconda/bin/python -c "import setuptools, tokenize;__file__='/private/var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip_build_alessandro.gagliardi/readline/setup.py';exec(compile(getattr(tokenize, 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" install --record /var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip-yvVpC0-record/install-record.txt --single-version-externally-managed --compile failed with error code 1 in /private/var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip_build_alessandro.gagliardi/readline Storing debug log for failure in /Users/alessandro.gagliardi/.pip/pip.log I?ve attached the pip.log file in case that helps. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: pip.log Type: application/octet-stream Size: 141709 bytes Desc: pip.log URL: From benjaminrk at gmail.com Thu Feb 13 19:56:49 2014 From: benjaminrk at gmail.com (MinRK) Date: Thu, 13 Feb 2014 16:56:49 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: This is a problem in both Anaconda and readline because of Anaconda's unfortunate choice of 10.5 as the target SDK, which then readline doesn't properly handle because the system is not actually 10.5, and it fails to build. I actually have fixes out to both, respectively, which will hopefully resolve before we release IPython 2.0. If they don't, I'll revert the annoying checking we have for readline on OS X so that it will install on Anaconda. In the meantime, you can install IPython with pip install --no-deps which will ignore the dependencies, and/or use the `setup.py symlink`, which is nicer than `pip install -e` or `setup.py develop`, and doesn't use setuptools, so it will not install dependencies. -MinRK On Thu, Feb 13, 2014 at 4:15 PM, Alessandro Gagliardi < alessandro.gagliardi at glassdoor.com> wrote: > I?m using a Mac with Anaconda installed. I was able to pip install the > master branch of IPython 2 before but I wanted to update it (so I could get > widgets). It looks like it dies while trying to build the readline > extension module with regard to Darwin. I already have readline 6.2 > installed (from conda). When I try to pip install readline, I get the same > error: > > Command /Users/alessandro.gagliardi/anaconda/bin/python -c "import > setuptools, > tokenize;__file__='/private/var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip_build_alessandro.gagliardi/readline/setup.py';exec(compile(getattr(tokenize, > 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" > install --record > /var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip-yvVpC0-record/install-record.txt > --single-version-externally-managed --compile failed with error code 1 in > /private/var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip_build_alessandro.gagliardi/readline > > Storing debug log for failure in /Users/alessandro.gagliardi/.pip/pip.log > > I?ve attached the pip.log file in case that helps. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From msg2mw at gmail.com Thu Feb 13 21:27:47 2014 From: msg2mw at gmail.com (Mike Witt) Date: Thu, 13 Feb 2014 18:27:47 -0800 Subject: [IPython-dev] Two questions about wakari In-Reply-To: (from asmeurer@gmail.com on Thu Feb 13 16:01:07 2014) References: <1392235271.2667.8@Vector> Message-ID: <1392344867.2667.21@Vector> On 02/13/2014 04:01:07 PM, Aaron Meurer wrote: > Try wakari_support at continuum.io. Yeah, I had already done that. Bear in mind, I do have a "free" account ... Here's a tip, in case anybody's interested. My support "ticket" didn't get answered for several days. Then, today, I noticed there was a support "chat" available. That was picked up immediately and the person was able to answer me. (I did close the ticket :-) -Mike From alessandro.gagliardi at glassdoor.com Fri Feb 14 13:22:55 2014 From: alessandro.gagliardi at glassdoor.com (Alessandro Gagliardi) Date: Fri, 14 Feb 2014 18:22:55 +0000 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: Message-ID: In case it matters, I?m doing this in a conda environment. I?ve run conda install pip and conda install readline (etc.) ahead of time. I try: $ pip install --no-deps -e ".[notebook]? and it ends with Installed /Users/alessandro.gagliardi/Devel/ipython Successfully installed ipython Cleaning up? But when I try $ ipython It gives me Traceback (most recent call last): File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/bin/ipython", line 5, in from pkg_resources import load_entry_point File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-pack ages/setuptools-2.2-py2.7.egg/pkg_resources.py", line 2716, in File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-pack ages/setuptools-2.2-py2.7.egg/pkg_resources.py", line 685, in require File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-pack ages/setuptools-2.2-py2.7.egg/pkg_resources.py", line 588, in resolve pkg_resources.DistributionNotFound: readline (FWIW, if I run strait up python and import readline, it works fine.) Since that didn?t work, I tried using setup.py as you recommended, but I may have done it wrong. First: $ python setup.py symlink =========================================================================== = BUILDING IPYTHON python: 2.7.6 |Continuum Analytics, Inc.| (default, Jan 10 2014, 11:23:15) [GCC 4.0.1 (Apple Inc. build 5493)] platform: darwin OPTIONAL DEPENDENCIES sphinx: Not found (required for docs and nbconvert) pygments: Not found (required for docs and nbconvert) nose: 1.3.0 pexpect: no (will use bundled version in IPython.external) pyzmq: no (required for qtconsole, notebook, and parallel computing capabilities) tornado: no (required for notebook) readline: yes jinja2: Not found (required for notebook and nbconvert) running symlink running install_lib_symlink symlinking /Users/alessandro.gagliardi/Devel/ipython/IPython -> /Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-packa ges/IPython running install_scripts_sym running build_scripts . . . Then: $ python setup.py develop running develop running egg_info creating ipython.egg-info writing requirements to ipython.egg-info/requires.txt writing ipython.egg-info/PKG-INFO writing top-level names to ipython.egg-info/top_level.txt writing dependency_links to ipython.egg-info/dependency_links.txt writing entry points to ipython.egg-info/entry_points.txt writing manifest file 'ipython.egg-info/SOURCES.txt' reading manifest file 'ipython.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' no previously-included directories found matching 'IPython/html/static/mathjax' warning: no files found matching 'IPython/.git_commit_info.ini' warning: no previously-included files found matching 'docs/#*' warning: no previously-included files found matching 'docs/man/*.1.gz' no previously-included directories found matching 'docs/build' no previously-included directories found matching 'docs/gh-pages' no previously-included directories found matching 'docs/dist' warning: no previously-included files matching '*~' found anywhere in distribution warning: no previously-included files matching '*.flc' found anywhere in distribution warning: no previously-included files matching '*.pyo' found anywhere in distribution warning: no previously-included files matching '.dircopy.log' found anywhere in distribution warning: no previously-included files matching '.ipynb_checkpoints' found anywhere in distribution writing manifest file 'ipython.egg-info/SOURCES.txt' running build_ext Creating /Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-packa ges/ipython.egg-link (link to .) ipython 2.0.0-dev is already the active version in easy-install.pth Installing ipengine2 script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing iptest script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing ipython2 script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing ipcluster2 script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing ipcluster script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing ipython script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing ipcontroller2 script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing ipcontroller script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing iptest2 script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installing ipengine script to /Users/alessandro.gagliardi/anaconda/envs/ipython2/bin Installed /Users/alessandro.gagliardi/Devel/ipython Processing dependencies for ipython==2.0.0-dev Searching for readline Reading https://pypi.python.org/simple/readline/ Best match: readline 6.2.4.1 Downloading https://pypi.python.org/packages/source/r/readline/readline-6.2.4.1.tar.gz# md5=578237939c81fdbc2c8334d168b17907 Processing readline-6.2.4.1.tar.gz Writing /var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/easy_install-ezbbrQ/readli ne-6.2.4.1/setup.cfg Running readline-6.2.4.1/setup.py -q bdist_egg --dist-dir /var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/easy_install-ezbbrQ/readli ne-6.2.4.1/egg-dist-tmp-zQtRft In file included from Modules/2.x/readline.c:8: In file included from /Users/alessandro.gagliardi/anaconda/envs/ipython2/include/python2.7/Python .h:19: In file included from /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolch ain/usr/bin/../lib/clang/5.0/include/limits.h:38: In file included from /usr/include/limits.h:63: /usr/include/sys/cdefs.h:655:2: error: Unsupported architecture #error Unsupported architecture ^ In file included from Modules/2.x/readline.c:8: In file included from /Users/alessandro.gagliardi/anaconda/envs/ipython2/include/python2.7/Python .h:19: In file included from /Applications/Xcode.app/Contents/Developer/Toolchains/XcodeDefault.xctoolch ain/usr/bin/../lib/clang/5.0/include/limits.h:38: In file included from /usr/include/limits.h:64: /usr/include/machine/limits.h:8:2: error: architecture not supported #error architecture not supported ^ In file included from Modules/2.x/readline.c:8: In file included from /Users/alessandro.gagliardi/anaconda/envs/ipython2/include/python2.7/Python .h:33: In file included from /usr/include/stdio.h:67: In file included from /usr/include/_types.h:27: In file included from /usr/include/sys/_types.h:33: /usr/include/machine/_types.h:34:2: error: architecture not supported #error architecture not supported ^ In file included from Modules/2.x/readline.c:8: In file included from /Users/alessandro.gagliardi/anaconda/envs/ipython2/include/python2.7/Python .h:33: In file included from /usr/include/stdio.h:67: In file included from /usr/include/_types.h:27: /usr/include/sys/_types.h:94:9: error: unknown type name '__int64_t' typedef __int64_t __darwin_blkcnt_t; /* total blocks */ ^ /usr/include/sys/_types.h:95:9: error: unknown type name '__int32_t' typedef __int32_t __darwin_blksize_t; /* preferred block size */ ^ Etc. etc. etc. So it looks like setup.py symlink is finding readline but then when I try to install it gives me the same error. Date: Thu, 13 Feb 2014 16:56:49 -0800 From: MinRK This is a problem in both Anaconda and readline because of Anaconda's unfortunate choice of 10.5 as the target SDK, which then readline doesn't properly handle because the system is not actually 10.5, and it fails to build. I actually have fixes out to both, respectively, which will hopefully resolve before we release IPython 2.0. If they don't, I'll revert the annoying checking we have for readline on OS X so that it will install on Anaconda. In the meantime, you can install IPython with pip install --no-deps which will ignore the dependencies, and/or use the `setup.py symlink`, which is nicer than `pip install -e` or `setup.py develop`, and doesn't use setuptools, so it will not install dependencies. -MinRK On Thu, Feb 13, 2014 at 4:15 PM, Alessandro Gagliardi < alessandro.gagliardi at glassdoor.com> wrote: > I?m using a Mac with Anaconda installed. I was able to pip install the > master branch of IPython 2 before but I wanted to update it (so I could >get > widgets). It looks like it dies while trying to build the readline > extension module with regard to Darwin. I already have readline 6.2 > installed (from conda). When I try to pip install readline, I get the >same > error: > > Command /Users/alessandro.gagliardi/anaconda/bin/python -c "import > setuptools, > >tokenize;__file__='/private/var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/ >T/pip_build_alessandro.gagliardi/readline/setup.py';exec(compile(getattr(t >okenize, > 'open', open)(__file__).read().replace('\r\n', '\n'), __file__, 'exec'))" > install --record > >/var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip-yvVpC0-record/install >-record.txt > --single-version-externally-managed --compile failed with error code 1 in > >/private/var/folders/s2/y7672sbn1p77xsk1zlh4zpss4brwrw/T/pip_build_alessan >dro.gagliardi/readline > > Storing debug log for failure in /Users/alessandro.gagliardi/.pip/pip.log > > I?ve attached the pip.log file in case that helps. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: http://mail.scipy.org/pipermail/ipython-dev/attachments/20140213/36296c80/a ttachment-0001.html ------------------------------ Message: 2 Date: Thu, 13 Feb 2014 18:27:47 -0800 From: Mike Witt Subject: Re: [IPython-dev] Two questions about wakari To: IPython developers list Message-ID: <1392344867.2667.21 at Vector> Content-Type: text/plain; charset=us-ascii; DelSp=Yes; Format=Flowed On 02/13/2014 04:01:07 PM, Aaron Meurer wrote: > Try wakari_support at continuum.io. Yeah, I had already done that. Bear in mind, I do have a "free" account ... Here's a tip, in case anybody's interested. My support "ticket" didn't get answered for several days. Then, today, I noticed there was a support "chat" available. That was picked up immediately and the person was able to answer me. (I did close the ticket :-) -Mike ------------------------------ _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev End of IPython-dev Digest, Vol 121, Issue 21 ******************************************** From takowl at gmail.com Fri Feb 14 13:32:00 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 14 Feb 2014 10:32:00 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: On 14 February 2014 10:22, Alessandro Gagliardi < alessandro.gagliardi at glassdoor.com> wrote: > First: > > $ python setup.py symlink > . . . > > > Then: > $ python setup.py develop > setup.py symlink is an *alternative* to setup.py develop. You shouldn't need to run both. -------------- next part -------------- An HTML attachment was scrubbed... URL: From benjaminrk at gmail.com Fri Feb 14 14:01:50 2014 From: benjaminrk at gmail.com (MinRK) Date: Fri, 14 Feb 2014 11:01:50 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: So much hate for setuptools right now. I can't believe `--no-deps` skips dependency installation, but still adds a redundant check to entry points. Yes, right now on Anaconda, you will need to *not* use setuptools to install IPython dev. setup.py symlink is the best way to go, I think. Don't worry, this won't be the case by the time we release 2.0. -MinRK On Fri, Feb 14, 2014 at 10:32 AM, Thomas Kluyver wrote: > On 14 February 2014 10:22, Alessandro Gagliardi < > alessandro.gagliardi at glassdoor.com> wrote: > >> First: >> >> $ python setup.py symlink >> . . . >> >> >> Then: >> $ python setup.py develop >> > > setup.py symlink is an *alternative* to setup.py develop. You shouldn't > need to run both. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From alessandro.gagliardi at glassdoor.com Fri Feb 14 14:14:41 2014 From: alessandro.gagliardi at glassdoor.com (Alessandro Gagliardi) Date: Fri, 14 Feb 2014 19:14:41 +0000 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: Message-ID: $ python setup.py symlink $ python setup.py install worked. Thanks! From: Alessandro > Date: Friday, February 14, 2014 at 10:22 AM To: "ipython-dev at scipy.org" > Subject: Re: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In case it matters, I?m doing this in a conda environment. I?ve run conda install pip and conda install readline (etc.) ahead of time. I try: $ pip install --no-deps -e "[notebook]" and it ends with Installed /Users/alessandro.gagliardi/Devel/ipython Successfully installed ipython Cleaning up? But when I try $ ipython It gives me Traceback (most recent call last): File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/bin/ipython", line 5, in from pkg_resources import load_entry_point File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-pack ages/setuptools-2.2-py2.7.egg/pkg_resources.py", line 2716, in File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-pack ages/setuptools-2.2-py2.7.egg/pkg_resources.py", line 685, in require File "/Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-pack ages/setuptools-2.2-py2.7.egg/pkg_resources.py", line 588, in resolve pkg_resources.DistributionNotFound: readline (FWIW, if I run strait up python and import readline, it works fine.) Since that didn?t work, I tried using setup.py as you recommended, but I may have done it wrong. First: $ python setup.py symlink =========================================================================== = BUILDING IPYTHON python: 2.7.6 |Continuum Analytics, Inc.| (default, Jan 10 2014, 11:23:15) [GCC 4.0.1 (Apple Inc. build 5493)] platform: darwin OPTIONAL DEPENDENCIES sphinx: Not found (required for docs and nbconvert) pygments: Not found (required for docs and nbconvert) nose: 1.3.0 pexpect: no (will use bundled version in IPython.external) pyzmq: no (required for qtconsole, notebook, and parallel computing capabilities) tornado: no (required for notebook) readline: yes jinja2: Not found (required for notebook and nbconvert) running symlink running install_lib_symlink symlinking /Users/alessandro.gagliardi/Devel/ipython/IPython -> /Users/alessandro.gagliardi/anaconda/envs/ipython2/lib/python2.7/site-packa ges/IPython running install_scripts_sym running build_scripts . . . Then: $ python setup.py develop -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Fri Feb 14 14:32:25 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 14 Feb 2014 11:32:25 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: On 14 February 2014 11:14, Alessandro Gagliardi < alessandro.gagliardi at glassdoor.com> wrote: > $ python setup.py symlink > $ python setup.py install > worked. > Again, you'd normally use one or the other of these, not both. symlink installs the scripts and symlinks the IPython package into site-packages, so that updating the copy in that folder, e.g. by git pull, updates the version of IPython you're using. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From chris.barker at noaa.gov Fri Feb 14 15:09:20 2014 From: chris.barker at noaa.gov (Chris Barker) Date: Fri, 14 Feb 2014 12:09:20 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: On Fri, Feb 14, 2014 at 11:32 AM, Thomas Kluyver wrote: > On 14 February 2014 11:14, Alessandro Gagliardi < > alessandro.gagliardi at glassdoor.com> wrote: > >> $ python setup.py symlink >> > > Again, you'd normally use one or the other of these, not both. symlink >> installs the scripts and symlinks the IPython package into site-packages, >> so that updating the copy in that folder, e.g. by git pull, updates the >> version of IPython you're using. >> > Is this a new way to spell: $ ./setup.py develop ? Or an iPython specific thing? -Chris -- Christopher Barker, Ph.D. Oceanographer Emergency Response Division NOAA/NOS/OR&R (206) 526-6959 voice 7600 Sand Point Way NE (206) 526-6329 fax Seattle, WA 98115 (206) 526-6317 main reception Chris.Barker at noaa.gov -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Fri Feb 14 15:49:55 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 14 Feb 2014 12:49:55 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: On 14 February 2014 12:09, Chris Barker wrote: > Is this a new way to spell: > > $ ./setup.py develop > > ? > > Or an iPython specific thing? > Both ;-). We had some problems with setup.py develop - namely that if you try to use it for both Python 2 and Python 3, you can only have working scripts with one of them. So we wrote setup.py symlink, which does something similar, but doesn't involve setuptools, so it's easier to understand what's going on. Our implementation is not very polished (e.g. it may not work on Windows), but if other projects want to borrow it, they're welcome to - the implementation is a few small classes starting here: https://github.com/ipython/ipython/blob/master/setupbase.py#L394 Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From chris.barker at noaa.gov Fri Feb 14 16:09:43 2014 From: chris.barker at noaa.gov (Chris Barker) Date: Fri, 14 Feb 2014 13:09:43 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: On Fri, Feb 14, 2014 at 12:49 PM, Thomas Kluyver wrote: > Or an iPython specific thing? >> > > Both ;-). We had some problems with setup.py develop - namely that if you > try to use it for both Python 2 and Python 3, you can only have working > scripts with one of them. > fair enough -- has this been discussed on the distutils list? IT seem sothers would like this functionality. (e.g. it may not work on Windows), > Probably not, if it involves symlinks.... > but if other projects want to borrow it, they're welcome to - the > implementation is a few small classes starting here: > > https://github.com/ipython/ipython/blob/master/setupbase.py#L394 > cool, thanks. -Chris -- Christopher Barker, Ph.D. Oceanographer Emergency Response Division NOAA/NOS/OR&R (206) 526-6959 voice 7600 Sand Point Way NE (206) 526-6329 fax Seattle, WA 98115 (206) 526-6317 main reception Chris.Barker at noaa.gov -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Fri Feb 14 17:33:23 2014 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 14 Feb 2014 14:33:23 -0800 Subject: [IPython-dev] Trouble installing latest IPython 2.0 on Mac In-Reply-To: References: Message-ID: On 14 February 2014 13:09, Chris Barker wrote: > Both ;-). We had some problems with setup.py develop - namely that if you >> try to use it for both Python 2 and Python 3, you can only have working >> scripts with one of them. >> > > fair enough -- has this been discussed on the distutils list? IT seem > sothers would like this functionality. > It hasn't. We're happy for people to develop it further, but we're not interested in wading into the Python packaging situation ourselves (at least, I'm not). > (e.g. it may not work on Windows), >> > > Probably not, if it involves symlinks.... > Min and I have both just investigated it, and Python 3 has os.symlink(), but the process has to be run with admin privileges. We might take out the Windows check and let it try to make symlinks. Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From asmeurer at gmail.com Fri Feb 14 19:52:39 2014 From: asmeurer at gmail.com (Aaron Meurer) Date: Fri, 14 Feb 2014 18:52:39 -0600 Subject: [IPython-dev] Two questions about wakari In-Reply-To: <1392344867.2667.21@Vector> References: <1392235271.2667.8@Vector> <1392344867.2667.21@Vector> Message-ID: Ah, so I didn't realize that wakari_support just opens a ticket. It seems there should be a Wakari users group, similar to the Anaconda users group, which is a little more public than the ticket system. Aaron Meurer On Thu, Feb 13, 2014 at 8:27 PM, Mike Witt wrote: > On 02/13/2014 04:01:07 PM, Aaron Meurer wrote: >> Try wakari_support at continuum.io. > > Yeah, I had already done that. Bear in mind, I do have a "free" > account ... > > Here's a tip, in case anybody's interested. My support "ticket" > didn't get answered for several days. Then, today, I noticed there > was a support "chat" available. That was picked up immediately > and the person was able to answer me. (I did close the ticket :-) > > -Mike > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From zaharid at gmail.com Mon Feb 17 13:27:10 2014 From: zaharid at gmail.com (Zahari Dim) Date: Mon, 17 Feb 2014 19:27:10 +0100 Subject: [IPython-dev] Building an integrated measurement system with IPython Message-ID: Hi, My name is Zahari Dimitrov, and I am a last year Physics Student. My final year project consists on developing a system on top of IPython which is able to integrate the configuration of laboratory measurements with the analysis of the data of those measurements (which could be made in remote clusters). I would appreciate it very much if you could tell me what do you think on the overall design, and answer some (I'm afraid too many) specific questions I have. Apologies for this long message. Some information on this project can be found on zigzah.com (but it's not really up to date...) I have already done the part dedicated to talking with instruments (more or less), and now I would like to do the following: - I'd like to represent the computation process as a polytree ( http://en.wikipedia.org/wiki/Polytree ) where the nodes (which I call IObjects) would be functions that run on some ipengine. These functions have some parameters (inputs) and return a dict of outputs. The outputs of one node can be connected to the inputs of the next, and to execute a child node, all the parents must be executed and have some results. -This structures are saved on a MongoDb Database (seems really easy to use for now) and managed with the mongoengine ORM, -I'd like to be able to transform the inputs of the graph that are not connected to an output (or have a constant value set) in an html form (the inputs declare some types like str, int or range which are mapped to different JS input widgets where possible). The free outputs are turned into some display widgets as well. -When you type ipython notebook --iograph=mygraph, the form appears on the top of your ipython notebook, and you can set the parameters and execute different parts of the graph. The results are accessible as variables in the notebook. -Things like the instrument commands (ie, ask for the frequency in an oscilloscope) are just things that extend the IObject class and run on a dedicated engine with id __instruments in the computer where the instrument is connected (could be different for different instruments). -Other more complicated classes like RangedExperiment (measure something over a given range which is an input) are also IObjects. This classes would have the capability of reporting the measurements as they are produced and fill sequentially a plot with that. -Other IObjects can take the results from the experiment and process them in a remote cluster. -For a given IObject, all results (outputs) it produces are logged by default in the mongo database. You can always set the value of the outputs to a previous result and execute its children with this input. -There will be a decorator that converts any function in a IObject (and possibly use python 3 annotations for that) As said, I'd be very happy if I could complete this. But here are the questions: -At what level do I hack the IPython notebook to add the forms? I haven't found an extension mechanism capable of doing what I need, so I thing I have to fork the project. Is there any place that explains the conventions used for the templates and the JavaScript code in the notebook? -I believe the Ipython controller has some log system. Could it be integrated with the one I want for the IObjects? -I am thinking about using mongodb to deploy a shared filesystem in the computers where Ipython is running, so it's possible load data from anywhere. Is this a good solution, particularly to save things like text-pickled python objects? -How do I avoid moving around large amounts of data when the output and input IObjects are in the same computer, different from the controller. -Which is the best way to obtain partial results from the engines, like the ones needed for the RangedExperiment example (ie, display the measurement after it is produced and then do the next)? -Which is the current best way to display interactive plots in IPython? Thinking again about the Ranged Experiment. -I understand each Ipengine will see the hardware of the computer it runs in. Is this right? -Is there any problem for a node to itself run a paralell algorithm on other engines? Thank you again for your patience, Best regards, Zahari. -------------- next part -------------- An HTML attachment was scrubbed... URL: From ronena at gmail.com Mon Feb 17 17:18:56 2014 From: ronena at gmail.com (Ronen Abravanel) Date: Tue, 18 Feb 2014 00:18:56 +0200 Subject: [IPython-dev] Building an integrated measurement system with IPython In-Reply-To: References: Message-ID: This is awesome. I would very much like to see something like that working (at least as a proof of concept. And also in order to help and try to 'cell' python \ IPython to the experimentalists in my department. Regarding your first question, try looking at IPython 2.0 and the new widget mechanism, For some examples, see http://nbviewer.ipython.org/github/ipython/ipython/tree/master/examples/widgets/ On Mon, Feb 17, 2014 at 8:27 PM, Zahari Dim wrote: > Hi, > > My name is Zahari Dimitrov, and I am a last year Physics Student. My final > year project consists on developing a system on top of IPython which is > able to integrate the configuration of laboratory measurements with the > analysis of the data of those measurements (which could be made in remote > clusters). I would appreciate it very much if you could tell me what do you > think on the overall design, and answer some (I'm afraid too many) specific > questions I have. Apologies for this long message. > > Some information on this project can be found on zigzah.com (but it's not > really up to date...) > > I have already done the part dedicated to talking with instruments (more > or less), and now I would like to do the following: > > - I'd like to represent the computation process as a polytree ( > http://en.wikipedia.org/wiki/Polytree ) where the nodes (which I call > IObjects) would be functions that run on some ipengine. These functions > have some parameters (inputs) and return a dict of outputs. The outputs of > one node can be connected to the inputs of the next, and to execute a child > node, all the parents must be executed and have some results. > > -This structures are saved on a MongoDb Database (seems really easy to use > for now) and managed with the mongoengine ORM, > > -I'd like to be able to transform the inputs of the graph that are not > connected to an output (or have a constant value set) in an html form (the > inputs declare some types like str, int or range which are mapped to > different JS input widgets where possible). The free outputs are turned > into some display widgets as well. > > -When you type ipython notebook --iograph=mygraph, the form appears on the > top of your ipython notebook, and you can set the parameters and execute > different parts of the graph. The results are accessible as variables in > the notebook. > > -Things like the instrument commands (ie, ask for the frequency in an > oscilloscope) are just things that extend the IObject class and run on a > dedicated engine with id __instruments in the computer where the instrument > is connected (could be different for different instruments). > > -Other more complicated classes like RangedExperiment (measure something > over a given range which is an input) are also IObjects. This classes would > have the capability of reporting the measurements as they are produced and > fill sequentially a plot with that. > > -Other IObjects can take the results from the experiment and process them > in a remote cluster. > > -For a given IObject, all results (outputs) it produces are logged by > default in the mongo database. You can always set the value of the outputs > to a previous result and execute its children with this input. > > -There will be a decorator that converts any function in a IObject (and > possibly use python 3 annotations for that) > > > > As said, I'd be very happy if I could complete this. But here are the > questions: > > -At what level do I hack the IPython notebook to add the forms? I haven't > found an extension mechanism capable of doing what I need, so I thing I > have to fork the project. Is there any place that explains the conventions > used for the templates and the JavaScript code in the notebook? > > -I believe the Ipython controller has some log system. Could it be > integrated with the one I want for the IObjects? > > -I am thinking about using mongodb to deploy a shared filesystem in the > computers where Ipython is running, so it's possible load data from > anywhere. Is this a good solution, particularly to save things like > text-pickled python objects? > > -How do I avoid moving around large amounts of data when the output and > input IObjects are in the same computer, different from the controller. > > -Which is the best way to obtain partial results from the engines, like > the ones needed for the RangedExperiment example (ie, display the > measurement after it is produced and then do the next)? > > -Which is the current best way to display interactive plots in IPython? > Thinking again about the Ranged Experiment. > > -I understand each Ipengine will see the hardware of the computer it runs > in. Is this right? > > -Is there any problem for a node to itself run a paralell algorithm on > other engines? > > Thank you again for your patience, > > Best regards, > > Zahari. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From mmckerns at caltech.edu Mon Feb 17 17:51:21 2014 From: mmckerns at caltech.edu (Michael McKerns) Date: Mon, 17 Feb 2014 17:51:21 -0500 (EST) Subject: [IPython-dev] Building an integrated measurement system with IPython In-Reply-To: References: Message-ID: <56766.67.186.183.87.1392677481.squirrel@webmail.caltech.edu> Zahari, What you are looking to do is potentially a very large undertaking that could very likely require you to get some significant funding, if you want to do it robustly. If it pays off, however, you potentially will have built something that will be of a very broad general interest. I'd suggest trying to leverage as much existing technology as possible, and then picking one or so items on your list that would improve your own life the most? and try to do just that one thing well first. > This is awesome. I would very much like to see something like that > working (at least as a proof of concept. And also in order to help and try > to 'cell' python \ IPython to the experimentalists in my department. > > Regarding your first question, try looking at IPython 2.0 and the new > widget mechanism, > For some examples, see > http://nbviewer.ipython.org/github/ipython/ipython/tree/master/examples/widgets/ > > > > > On Mon, Feb 17, 2014 at 8:27 PM, Zahari Dim wrote: > >> Hi, >> >> My name is Zahari Dimitrov, and I am a last year Physics Student. My >> final >> year project consists on developing a system on top of IPython which is >> able to integrate the configuration of laboratory measurements with the >> analysis of the data of those measurements (which could be made in >> remote >> clusters). I would appreciate it very much if you could tell me what do >> you >> think on the overall design, and answer some (I'm afraid too many) >> specific >> questions I have. Apologies for this long message. >> >> Some information on this project can be found on zigzah.com (but it's >> not >> really up to date...) >> >> I have already done the part dedicated to talking with instruments (more >> or less), and now I would like to do the following: >> >> - I'd like to represent the computation process as a polytree ( >> http://en.wikipedia.org/wiki/Polytree ) where the nodes (which I call >> IObjects) would be functions that run on some ipengine. These functions >> have some parameters (inputs) and return a dict of outputs. The outputs >> of >> one node can be connected to the inputs of the next, and to execute a >> child >> node, all the parents must be executed and have some results. >> >> -This structures are saved on a MongoDb Database (seems really easy to >> use >> for now) and managed with the mongoengine ORM, >> >> -I'd like to be able to transform the inputs of the graph that are not >> connected to an output (or have a constant value set) in an html form >> (the >> inputs declare some types like str, int or range which are mapped to >> different JS input widgets where possible). The free outputs are turned >> into some display widgets as well. >> >> -When you type ipython notebook --iograph=mygraph, the form appears on >> the >> top of your ipython notebook, and you can set the parameters and execute >> different parts of the graph. The results are accessible as variables in >> the notebook. >> >> -Things like the instrument commands (ie, ask for the frequency in an >> oscilloscope) are just things that extend the IObject class and run on a >> dedicated engine with id __instruments in the computer where the >> instrument >> is connected (could be different for different instruments). >> >> -Other more complicated classes like RangedExperiment (measure something >> over a given range which is an input) are also IObjects. This classes >> would >> have the capability of reporting the measurements as they are produced >> and >> fill sequentially a plot with that. >> >> -Other IObjects can take the results from the experiment and process >> them >> in a remote cluster. >> >> -For a given IObject, all results (outputs) it produces are logged by >> default in the mongo database. You can always set the value of the >> outputs >> to a previous result and execute its children with this input. >> >> -There will be a decorator that converts any function in a IObject (and >> possibly use python 3 annotations for that) >> >> >> >> As said, I'd be very happy if I could complete this. But here are the >> questions: >> >> -At what level do I hack the IPython notebook to add the forms? I >> haven't >> found an extension mechanism capable of doing what I need, so I thing I >> have to fork the project. Is there any place that explains the >> conventions >> used for the templates and the JavaScript code in the notebook? >> >> -I believe the Ipython controller has some log system. Could it be >> integrated with the one I want for the IObjects? >> >> -I am thinking about using mongodb to deploy a shared filesystem in the >> computers where Ipython is running, so it's possible load data from >> anywhere. Is this a good solution, particularly to save things like >> text-pickled python objects? >> >> -How do I avoid moving around large amounts of data when the output and >> input IObjects are in the same computer, different from the controller. >> >> -Which is the best way to obtain partial results from the engines, like >> the ones needed for the RangedExperiment example (ie, display the >> measurement after it is produced and then do the next)? >> >> -Which is the current best way to display interactive plots in IPython? >> Thinking again about the Ranged Experiment. >> >> -I understand each Ipengine will see the hardware of the computer it >> runs >> in. Is this right? >> >> -Is there any problem for a node to itself run a paralell algorithm on >> other engines? >> >> Thank you again for your patience, >> >> Best regards, >> >> Zahari. >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > --- Mike McKerns California Institute of Technology TEL: (626)395-5773 or (626)590-8470 http://www.its.caltech.edu/~mmckerns mmckerns at caltech.edu From ntezak at stanford.edu Tue Feb 18 18:46:20 2014 From: ntezak at stanford.edu (Nikolas Tezak) Date: Tue, 18 Feb 2014 15:46:20 -0800 Subject: [IPython-dev] Embedding JointJS library Message-ID: <0713EC9C-0096-4BE2-9252-4AA785905397@stanford.edu> Hi all, I just installed the current IPython 2.0 dev version from github and I'm quite impressed! At this point I've converted half my lab to use IPython in their daily workflows. I'm especially excited about the upcoming widget features. Right now, I would like to try to embed a JointJS ( http://www.jointjs.com/ ) applet into an IPython notebook and have it talk back to the kernel. The reason is that I want to create a graphical schematic capture tool for circuit diagrams. I think I'll be able to figure out how to do this by emulating this: https://gist.github.com/minrk/6547109 However, I am already getting stuck on just importing the JointJS javascript library into a current notebook. If I have a javascript file "joint.js" and a css file "joint.css" in the same directory as a given notebook, is there any easy way of importing these into the notebook? I have looked into the IPython.display.Javascript and HTML object but couldn't get it to work. Thanks, Nik From ntezak at stanford.edu Tue Feb 18 19:23:35 2014 From: ntezak at stanford.edu (Nikolas Tezak) Date: Tue, 18 Feb 2014 16:23:35 -0800 Subject: [IPython-dev] Embedding JointJS library In-Reply-To: <0713EC9C-0096-4BE2-9252-4AA785905397@stanford.edu> References: <0713EC9C-0096-4BE2-9252-4AA785905397@stanford.edu> Message-ID: <9638C401-12D5-4F3E-BF2D-AB90BC8696E8@stanford.edu> Hey, I figured it out. To embed Javascript put it into the currently used ipython profile's "/static/custom" directory, i.e., for the default profile something like "~/.ipython/profile_default/static/custom" And then edit the custom js and css files: custom.js ---- $([IPython.events]).on('app_initialized.NotebookApp', function () { require(['/static/custom/myjs.js']); }); --- custom.css ---- @import url("mycss.css"); --- Sorry for the spam, Nik On Feb 18, 2014, at 3:46 PM, Nikolas Tezak wrote: > Hi all, > > I just installed the current IPython 2.0 dev version from github and I'm quite impressed! At this point I've converted half my lab to use IPython in their daily workflows. > I'm especially excited about the upcoming widget features. > > Right now, I would like to try to embed a JointJS ( http://www.jointjs.com/ ) applet into an IPython notebook and have it talk back to the kernel. > The reason is that I want to create a graphical schematic capture tool for circuit diagrams. > > I think I'll be able to figure out how to do this by emulating this: > https://gist.github.com/minrk/6547109 > > However, I am already getting stuck on just importing the JointJS javascript library into a current notebook. > > If I have a javascript file "joint.js" and a css file "joint.css" in the same directory as a given notebook, is there any easy way of importing these into the notebook? > I have looked into the IPython.display.Javascript and HTML object but couldn't get it to work. > > Thanks, > Nik > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From theodore.r.drain at jpl.nasa.gov Wed Feb 19 12:50:35 2014 From: theodore.r.drain at jpl.nasa.gov (Drain, Theodore R (392P)) Date: Wed, 19 Feb 2014 17:50:35 +0000 Subject: [IPython-dev] scp error in ipcluster start when profile doesn't exist on engine host Message-ID: <0DC1CAB7F6C7FC4A8B54EE1FD49046990FB892E7@ap-embx-sp20.RES.AD.JPL> I'm running the 2.0 development code and getting an error when I try to start a cluster using the ssh engine launcher. The error happens when it tries to copy the json security file to the engine. If any of the directories in the path to the json file (.ipython/profile_NAME/security) don't exist, then scp throws an exception which stops the cluster. It's fairly annoying to have to log in to each machine in my cluster and create a directory tree every time I change the name of the profile. So - is this the expected behavior? There are some ways to use scp (or maybe rsync) that might be more robust: http://stackoverflow.com/questions/1340048/how-do-i-create-a-directory-on-remote-host-if-it-doesnt-exist-without-ssh-ing-i Thanks, Ted From benjaminrk at gmail.com Wed Feb 19 13:21:06 2014 From: benjaminrk at gmail.com (MinRK) Date: Wed, 19 Feb 2014 10:21:06 -0800 Subject: [IPython-dev] scp error in ipcluster start when profile doesn't exist on engine host In-Reply-To: <0DC1CAB7F6C7FC4A8B54EE1FD49046990FB892E7@ap-embx-sp20.RES.AD.JPL> References: <0DC1CAB7F6C7FC4A8B54EE1FD49046990FB892E7@ap-embx-sp20.RES.AD.JPL> Message-ID: What is the commit you are using? I believe this was fixed very recently in master. -MinRK On Wed, Feb 19, 2014 at 9:50 AM, Drain, Theodore R (392P) < theodore.r.drain at jpl.nasa.gov> wrote: > I'm running the 2.0 development code and getting an error when I try to > start a cluster using the ssh engine launcher. The error happens when it > tries to copy the json security file to the engine. If any of the > directories in the path to the json file (.ipython/profile_NAME/security) > don't exist, then scp throws an exception which stops the cluster. > > It's fairly annoying to have to log in to each machine in my cluster and > create a directory tree every time I change the name of the profile. So - > is this the expected behavior? > > There are some ways to use scp (or maybe rsync) that might be more robust: > > http://stackoverflow.com/questions/1340048/how-do-i-create-a-directory-on-remote-host-if-it-doesnt-exist-without-ssh-ing-i > > Thanks, > Ted > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From theodore.r.drain at jpl.nasa.gov Wed Feb 19 13:34:58 2014 From: theodore.r.drain at jpl.nasa.gov (Drain, Theodore R (392P)) Date: Wed, 19 Feb 2014 18:34:58 +0000 Subject: [IPython-dev] scp error in ipcluster start when profile doesn't exist on engine host In-Reply-To: References: <0DC1CAB7F6C7FC4A8B54EE1FD49046990FB892E7@ap-embx-sp20.RES.AD.JPL>, Message-ID: <0DC1CAB7F6C7FC4A8B54EE1FD49046990FB8934A@ap-embx-sp20.RES.AD.JPL> It's from Feb 05. I'll update to the latest and go from there. Thanks. ________________________________ From: ipython-dev-bounces at scipy.org [ipython-dev-bounces at scipy.org] on behalf of MinRK [benjaminrk at gmail.com] Sent: Wednesday, February 19, 2014 10:21 AM To: IPython developers list Subject: Re: [IPython-dev] scp error in ipcluster start when profile doesn't exist on engine host What is the commit you are using? I believe this was fixed very recently in master. -MinRK On Wed, Feb 19, 2014 at 9:50 AM, Drain, Theodore R (392P) > wrote: I'm running the 2.0 development code and getting an error when I try to start a cluster using the ssh engine launcher. The error happens when it tries to copy the json security file to the engine. If any of the directories in the path to the json file (.ipython/profile_NAME/security) don't exist, then scp throws an exception which stops the cluster. It's fairly annoying to have to log in to each machine in my cluster and create a directory tree every time I change the name of the profile. So - is this the expected behavior? There are some ways to use scp (or maybe rsync) that might be more robust: http://stackoverflow.com/questions/1340048/how-do-i-create-a-directory-on-remote-host-if-it-doesnt-exist-without-ssh-ing-i Thanks, Ted _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: From zaharid at gmail.com Wed Feb 19 17:28:48 2014 From: zaharid at gmail.com (Zahari Dim) Date: Wed, 19 Feb 2014 23:28:48 +0100 Subject: [IPython-dev] Building an integrated measurement system with IPython In-Reply-To: <56766.67.186.183.87.1392677481.squirrel@webmail.caltech.edu> References: <56766.67.186.183.87.1392677481.squirrel@webmail.caltech.edu> Message-ID: Thank you very much for your comments. The module widgets looks awesome, and will avoid me having to put dirty hacks in an ipython fork. It seems that most of what I want can be done just with a custom profile/nbextension. On Mon, Feb 17, 2014 at 11:51 PM, Michael McKerns wrote: > Zahari, > > What you are looking to do is potentially a very large > undertaking that could very likely require you to get some > significant funding, if you want to do it robustly. If it pays > off, however, you potentially will have built something that > will be of a very broad general interest. I'd suggest trying > to leverage as much existing technology as possible, and > then picking one or so items on your list that would improve > your own life the most... and try to do just that one thing > well first. > > > --- > > I realize it's impossible for me alone to build a robust well tested application. However I think all the important bits are already present in IPython. At least, it should be possible to make a proof of concept that could work for the basic use cases, and potentially evolve from there. In fact now that I discovered the widgets module, I am a little bit more confident I could achieve some of the goals :). I guess the main question I have for now is how to do something like: def method_to_measure_in_remote_engine(): for point in points_to_measure: result=measure_one_point(point) update_local_dispay_and_dict(result) Can't see anything here that could help: http://ipython.org/ipython-doc/dev/parallel/parallel_multiengine.html Best regards, Zahari. -------------- next part -------------- An HTML attachment was scrubbed... URL: From andrew.gibiansky at gmail.com Wed Feb 19 18:37:24 2014 From: andrew.gibiansky at gmail.com (Andrew Gibiansky) Date: Wed, 19 Feb 2014 15:37:24 -0800 Subject: [IPython-dev] IPython Notebook Diagrams Message-ID: Hello, I am tired of needing to create diagrams externally and then either use Markdown links (which require the image to be exported and saved somewhere) or copy/pasting the base64 encoding of the image into the Markdown cell (which occasionally crashes my browser for big images). I would like to be able to create diagrams immediately within the Markdown cells. What's the best way to do this? I wanted to go with RaphaelJS and put