From guo.tang at bioprober.com Fri May 1 01:07:29 2015 From: guo.tang at bioprober.com (guo.tang at bioprober.com) Date: Thu, 30 Apr 2015 21:07:29 -0800 Subject: [IPython-dev] Spyre - interactive web apps References: Message-ID: <2015043021072462139442@bioprober.com> The demo looks pretty good with a desktop computer, but not very native on iphone safari. Any way to improve it? I am looking a solution to build a "virtual control panel" plus debugging interface to a medical device with least effort. IPython notebook solves the debugging interface part pretty well, still looking the "virtual control panel" part. Thanks, Guo From: Thomas Kluyver Date: 2015-04-30 16:58 To: IPython Development list CC: adam at nextbigsound.com Subject: [IPython-dev] Spyre - interactive web apps Hi all, I wanted to bring up Spyre, which I saw Adam's poster about at PyCon. Adam is CCed here, and a copy of his poster is attached. Spyre is a tool to build a simple interactive web application from Python. You can define some widgets for input, a processing step, and outputs like plots and tables. Then when you run it, Spyre constructs the HTML, runs a server, and updates the output in response to input changes. There's obvious overlap with IPython widgets, but it's aimed squarely at something we don't have a good answer for yet - making an interactive demo publicly available in a nice format, without exposing full code execution to any visitor. Adam and I both felt that it would be really nice to have this integrated with IPython so that you can build an interactive explorer in the notebook, and then export it to Spyre to put it online. There will probably be a bit of impedance mismatch with the different models, but I don't think it's anything we can't overcome. Live demo: http://adamhajari.com/ Code: https://github.com/adamhajari/spyre Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From nick.bollweg at gmail.com Fri May 1 01:04:46 2015 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Fri, 01 May 2015 05:04:46 +0000 Subject: [IPython-dev] Spyre - interactive web apps In-Reply-To: <2015043021072462139442@bioprober.com> References: <2015043021072462139442@bioprober.com> Message-ID: There's definitely a need for bringing rich data widgets to a more stand-alone, hostable presentation format that is easier to use/deploy. One approach to the latter problem we have taken is an SVG layout Container which uses inkscape layer names to position (and size) widgets on the page into shapes in the layer. This is very nice for going quickly from mockup to reality for dashboards, but you still have to have the first cell get executed on a vanilla environment. Combined with something like widgety spyre, I could see this becoming a great way to create interactive posters that had print-ready fallback: it's nice to work in a dedicated design environment like inkscape for large-format production. For the former problem, it seems like having a new app (nbposter, nbspyre, whatever) speaking a kernel dialect which only implemented widget messages might be the right level: the notebook cells are all executed, and the resulting widget id state is "compiled" into something for a slick frontend. On Fri, May 1, 2015 at 12:07 AM guo.tang at bioprober.com < guo.tang at bioprober.com> wrote: > The demo looks pretty good with a desktop computer, but not very native on > iphone safari. Any way to improve it? > > I am looking a solution to build a "virtual control panel" plus debugging > interface > to a medical device with least effort. IPython notebook solves the > debugging interface part pretty > well, still looking the "virtual control panel" part. > > Thanks, > Guo > > ------------------------------ > > > *From:* Thomas Kluyver > *Date:* 2015-04-30 16:58 > *To:* IPython Development list > *CC:* adam at nextbigsound.com > *Subject:* [IPython-dev] Spyre - interactive web apps > > Hi all, > > I wanted to bring up Spyre, which I saw Adam's poster about at PyCon. Adam > is CCed here, and a copy of his poster is attached. > > Spyre is a tool to build a simple interactive web application from Python. > You can define some widgets for input, a processing step, and outputs like > plots and tables. Then when you run it, Spyre constructs the HTML, runs a > server, and updates the output in response to input changes. There's > obvious overlap with IPython widgets, but it's aimed squarely at something > we don't have a good answer for yet - making an interactive demo publicly > available in a nice format, without exposing full code execution to any > visitor. > > Adam and I both felt that it would be really nice to have this integrated > with IPython so that you can build an interactive explorer in the notebook, > and then export it to Spyre to put it online. There will probably be a bit > of impedance mismatch with the different models, but I don't think it's > anything we can't overcome. > > Live demo: http://adamhajari.com/ > Code: https://github.com/adamhajari/spyre > > Thanks, > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From Nicolas.Rougier at inria.fr Fri May 1 03:51:06 2015 From: Nicolas.Rougier at inria.fr (Nicolas P. Rougier) Date: Fri, 1 May 2015 09:51:06 +0200 Subject: [IPython-dev] EuroScipy 2015: Extended deadline (15/05/2015) Message-ID: -------------------------------- Extended deadline: 15th May 2015 -------------------------------- EuroScipy 2015, the annual conference on Python in science will take place in Cambridge, UK on 26-30 August 2015. The conference features two days of tutorials followed by two days of scientific talks & posters and an extra day dedicated to developer sprints. It is the major event in Europe in the field of technical/scientific computing within the Python ecosystem. Data scientists, analysts, quants, PhD's, scientists and students from more than 20 countries attended the conference last year. The topics presented at EuroSciPy are very diverse, with a focus on advanced software engineering and original uses of Python and its scientific libraries, either in theoretical or experimental research, from both academia and the industry. Submissions for posters, talks & tutorials (beginner and advanced) are welcome on our website at http://www.euroscipy.org/2015/ Sprint proposals should be addressed directly to the organisation at euroscipy-org at python.org Important dates =============== Mar 24, 2015 Call for talks, posters & tutorials Apr 30, 2015 Talk and tutorials submission deadline May 15, 2015 EXTENDED DEADLINE May 1, 2015 Registration opens May 30, 2015 Final program announced Jun 15, 2015 Early-bird registration ends Aug 26-27, 2015 Tutorials Aug 28-29, 2015 Main conference Aug 30, 2015 Sprints We look forward to an exciting conference and hope to see you in Cambridge The EuroSciPy 2015 Team - http://www.euroscipy.org/2015/ -------------- next part -------------- An HTML attachment was scrubbed... URL: From mwaskom at stanford.edu Sun May 3 20:46:15 2015 From: mwaskom at stanford.edu (Michael Waskom) Date: Sun, 3 May 2015 17:46:15 -0700 Subject: [IPython-dev] Propagate errors with ipython nbconvert --execute? Message-ID: Hi, ipython nbconvert has, of late, the --execute flag, which makes it handy to work with notebooks as documentation source without having to keep the output in a git repository. However, when invoked as specified in the version 3 release notes: ipython nbconvert --to notebook --inplace --execute my_notebook.ipynb the converter trundles right along past exceptions raised in the code blocks. It would be helpful if there were some option so that the executable would return with a nonzero error code when an exception was raised so problems more easily detected. Is that possible? I didn't see any obvious arguments to that flag when I looked at the help, but it's a complicated tool. Thanks! Michael -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Sun May 3 22:41:36 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Sun, 3 May 2015 19:41:36 -0700 Subject: [IPython-dev] Propagate errors with ipython nbconvert --execute? In-Reply-To: References: Message-ID: This would be a valuable feature for someone to add. https://github.com/ipython/ipython/issues/8286 On 3 May 2015 at 17:46, Michael Waskom wrote: > Hi, > > ipython nbconvert has, of late, the --execute flag, which makes it handy > to work with notebooks as documentation source without having to keep the > output in a git repository. > > However, when invoked as specified in the version 3 release notes: > > ipython nbconvert --to notebook --inplace --execute my_notebook.ipynb > > the converter trundles right along past exceptions raised in the code > blocks. > > It would be helpful if there were some option so that the executable would > return with a nonzero error code when an exception was raised so problems > more easily detected. Is that possible? I didn't see any obvious arguments > to that flag when I looked at the help, but it's a complicated tool. > > Thanks! > Michael > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From nathan12343 at gmail.com Sun May 3 22:50:50 2015 From: nathan12343 at gmail.com (Nathan Goldbaum) Date: Sun, 3 May 2015 19:50:50 -0700 Subject: [IPython-dev] Propagate errors with ipython nbconvert --execute? In-Reply-To: References: Message-ID: Runipy will halt on exceptions: https://github.com/paulgb/runipy On Sunday, May 3, 2015, Michael Waskom wrote: > Hi, > > ipython nbconvert has, of late, the --execute flag, which makes it handy > to work with notebooks as documentation source without having to keep the > output in a git repository. > > However, when invoked as specified in the version 3 release notes: > > ipython nbconvert --to notebook --inplace --execute my_notebook.ipynb > > the converter trundles right along past exceptions raised in the code > blocks. > > It would be helpful if there were some option so that the executable would > return with a nonzero error code when an exception was raised so problems > more easily detected. Is that possible? I didn't see any obvious arguments > to that flag when I looked at the help, but it's a complicated tool. > > Thanks! > Michael > -------------- next part -------------- An HTML attachment was scrubbed... URL: From maximilian.albert at gmail.com Sun May 3 22:55:04 2015 From: maximilian.albert at gmail.com (Maximilian Albert) Date: Mon, 4 May 2015 03:55:04 +0100 Subject: [IPython-dev] Propagate errors with ipython nbconvert --execute? In-Reply-To: References: Message-ID: Incidentally, I needed precisely this functionality for a project I'm currently working on (where I'm generating a bunch of analysis notebooks from a "template" notebook into which I inject a couple of analysis-specific cells). I have a PR for this locally, but wanted to hold off submitting it until the IPyhon repo split is over. Happy to submit it when that's done (btw, is there a rough ETA for it?), or leave it to tritemio who mentions in issue #8266 that he also has one. Cheers, Max 2015-05-04 3:41 GMT+01:00 Thomas Kluyver : > This would be a valuable feature for someone to add. > > https://github.com/ipython/ipython/issues/8286 > > On 3 May 2015 at 17:46, Michael Waskom wrote: > >> Hi, >> >> ipython nbconvert has, of late, the --execute flag, which makes it handy >> to work with notebooks as documentation source without having to keep the >> output in a git repository. >> >> However, when invoked as specified in the version 3 release notes: >> >> ipython nbconvert --to notebook --inplace --execute my_notebook.ipynb >> >> the converter trundles right along past exceptions raised in the code >> blocks. >> >> It would be helpful if there were some option so that the executable >> would return with a nonzero error code when an exception was raised so >> problems more easily detected. Is that possible? I didn't see any obvious >> arguments to that flag when I looked at the help, but it's a complicated >> tool. >> >> Thanks! >> Michael >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Sun May 3 23:01:04 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Sun, 3 May 2015 20:01:04 -0700 Subject: [IPython-dev] Propagate errors with ipython nbconvert --execute? In-Reply-To: References: Message-ID: The main part of the repo split is done - there's still a few details being worked out, but nbconvert now lives here: https://github.com/jupyter/jupyter_nbconvert PRs are welcome. We might rename the repository in the next couple of days, but I don't think that should interfere with pull requests. Thomas On 3 May 2015 at 19:55, Maximilian Albert wrote: > Incidentally, I needed precisely this functionality for a project I'm > currently working on (where I'm generating a bunch of analysis notebooks > from a "template" notebook into which I inject a couple of > analysis-specific cells). I have a PR for this locally, but wanted to hold > off submitting it until the IPyhon repo split is over. Happy to submit it > when that's done (btw, is there a rough ETA for it?), or leave it to > tritemio who mentions in issue #8266 that he also has one. > > Cheers, > Max > > > 2015-05-04 3:41 GMT+01:00 Thomas Kluyver : > >> This would be a valuable feature for someone to add. >> >> https://github.com/ipython/ipython/issues/8286 >> >> On 3 May 2015 at 17:46, Michael Waskom wrote: >> >>> Hi, >>> >>> ipython nbconvert has, of late, the --execute flag, which makes it handy >>> to work with notebooks as documentation source without having to keep the >>> output in a git repository. >>> >>> However, when invoked as specified in the version 3 release notes: >>> >>> ipython nbconvert --to notebook --inplace --execute my_notebook.ipynb >>> >>> the converter trundles right along past exceptions raised in the code >>> blocks. >>> >>> It would be helpful if there were some option so that the executable >>> would return with a nonzero error code when an exception was raised so >>> problems more easily detected. Is that possible? I didn't see any obvious >>> arguments to that flag when I looked at the help, but it's a complicated >>> tool. >>> >>> Thanks! >>> Michael >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From andrew.gibiansky at gmail.com Mon May 4 00:36:36 2015 From: andrew.gibiansky at gmail.com (Andrew Gibiansky) Date: Sun, 3 May 2015 21:36:36 -0700 Subject: [IPython-dev] Propagate errors with ipython nbconvert --execute? In-Reply-To: References: Message-ID: What if you want to demonstrate in your notebook (or documentation) that particular behaviour causes an exception? -- Andrew On Sun, May 3, 2015 at 8:01 PM, Thomas Kluyver wrote: > The main part of the repo split is done - there's still a few details > being worked out, but nbconvert now lives here: > > https://github.com/jupyter/jupyter_nbconvert > > PRs are welcome. We might rename the repository in the next couple of > days, but I don't think that should interfere with pull requests. > > Thomas > > On 3 May 2015 at 19:55, Maximilian Albert > wrote: > >> Incidentally, I needed precisely this functionality for a project I'm >> currently working on (where I'm generating a bunch of analysis notebooks >> from a "template" notebook into which I inject a couple of >> analysis-specific cells). I have a PR for this locally, but wanted to hold >> off submitting it until the IPyhon repo split is over. Happy to submit it >> when that's done (btw, is there a rough ETA for it?), or leave it to >> tritemio who mentions in issue #8266 that he also has one. >> >> Cheers, >> Max >> >> >> 2015-05-04 3:41 GMT+01:00 Thomas Kluyver : >> >>> This would be a valuable feature for someone to add. >>> >>> https://github.com/ipython/ipython/issues/8286 >>> >>> On 3 May 2015 at 17:46, Michael Waskom wrote: >>> >>>> Hi, >>>> >>>> ipython nbconvert has, of late, the --execute flag, which makes it >>>> handy to work with notebooks as documentation source without having to keep >>>> the output in a git repository. >>>> >>>> However, when invoked as specified in the version 3 release notes: >>>> >>>> ipython nbconvert --to notebook --inplace --execute my_notebook.ipynb >>>> >>>> the converter trundles right along past exceptions raised in the code >>>> blocks. >>>> >>>> It would be helpful if there were some option so that the executable >>>> would return with a nonzero error code when an exception was raised so >>>> problems more easily detected. Is that possible? I didn't see any obvious >>>> arguments to that flag when I looked at the help, but it's a complicated >>>> tool. >>>> >>>> Thanks! >>>> Michael >>>> >>>> _______________________________________________ >>>> IPython-dev mailing list >>>> IPython-dev at scipy.org >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>> >>>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Mon May 4 00:50:27 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Sun, 3 May 2015 21:50:27 -0700 Subject: [IPython-dev] Propagate errors with ipython nbconvert --execute? In-Reply-To: References: Message-ID: Stop on error should be a configurable option. On 3 May 2015 9:37 pm, "Andrew Gibiansky" wrote: > What if you want to demonstrate in your notebook (or documentation) that > particular behaviour causes an exception? > > -- Andrew > > On Sun, May 3, 2015 at 8:01 PM, Thomas Kluyver wrote: > >> The main part of the repo split is done - there's still a few details >> being worked out, but nbconvert now lives here: >> >> https://github.com/jupyter/jupyter_nbconvert >> >> PRs are welcome. We might rename the repository in the next couple of >> days, but I don't think that should interfere with pull requests. >> >> Thomas >> >> On 3 May 2015 at 19:55, Maximilian Albert >> wrote: >> >>> Incidentally, I needed precisely this functionality for a project I'm >>> currently working on (where I'm generating a bunch of analysis notebooks >>> from a "template" notebook into which I inject a couple of >>> analysis-specific cells). I have a PR for this locally, but wanted to hold >>> off submitting it until the IPyhon repo split is over. Happy to submit it >>> when that's done (btw, is there a rough ETA for it?), or leave it to >>> tritemio who mentions in issue #8266 that he also has one. >>> >>> Cheers, >>> Max >>> >>> >>> 2015-05-04 3:41 GMT+01:00 Thomas Kluyver : >>> >>>> This would be a valuable feature for someone to add. >>>> >>>> https://github.com/ipython/ipython/issues/8286 >>>> >>>> On 3 May 2015 at 17:46, Michael Waskom wrote: >>>> >>>>> Hi, >>>>> >>>>> ipython nbconvert has, of late, the --execute flag, which makes it >>>>> handy to work with notebooks as documentation source without having to keep >>>>> the output in a git repository. >>>>> >>>>> However, when invoked as specified in the version 3 release notes: >>>>> >>>>> ipython nbconvert --to notebook --inplace --execute my_notebook.ipynb >>>>> >>>>> the converter trundles right along past exceptions raised in the code >>>>> blocks. >>>>> >>>>> It would be helpful if there were some option so that the executable >>>>> would return with a nonzero error code when an exception was raised so >>>>> problems more easily detected. Is that possible? I didn't see any obvious >>>>> arguments to that flag when I looked at the help, but it's a complicated >>>>> tool. >>>>> >>>>> Thanks! >>>>> Michael >>>>> >>>>> _______________________________________________ >>>>> IPython-dev mailing list >>>>> IPython-dev at scipy.org >>>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>>> >>>>> >>>> >>>> _______________________________________________ >>>> IPython-dev mailing list >>>> IPython-dev at scipy.org >>>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>>> >>>> >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From emanuele at relativita.com Mon May 4 17:37:02 2015 From: emanuele at relativita.com (Emanuele Olivetti) Date: Mon, 04 May 2015 23:37:02 +0200 Subject: [IPython-dev] Issues with IPython and emacs (in ubuntu 14.04) Message-ID: <5547E67E.80103@relativita.com> [re-posting from IPython-user, as suggested by T.Kluyver] Hi, I recently upgraded my laptop from Ubuntu 12.04 LTS to 14.04 LTS. As a consequence, IPython was upgraded from v0.12.1 to v1.2.1. I am very happy with the more recent IPython, but I am also experiencing a number of issues with its use within emacs, both v23 and v24, like: "py-execute-buffer" (C-c C-c) not working, "py-execute-region" (C-c |) not working, TAB-completion not working, among others. With IPython v.0.12.1 everything was working well within emacs. I followed these instructions on the IPython website: http://ipython.org/ipython-doc/1/config/editors.html and removed all my emacs customizations in order to understand where the issue is. My .emacs is now just (require 'ipython) as suggested there. Notice that the python-mode package shipped with Ubuntu 14.04 is v6.1.3, which should be recent enough. I also tried the instructions for the more recent IPtyhon v3.x: http://ipython.org/ipython-doc/3/config/details.html#editor-configuration Which boil down to: (require 'python) (setq python-shell-interpreter "ipython") Still no luck. I then upgraded python-mode.el with the most recent one (dev, i.e >v0.6.2.0) available from here: https://launchpad.net/python-mode and many issues disappeared with the following .emacs: (add-to-list 'load-path "/PATH_TO/python-mode/") (setq py-install-directory "/PATH_TO/python-mode/") (require 'ipython) (setq python-shell-interpreter "ipython") (require 'python-mode) Still "py-execute-region" (C-c |) is not working, with different output in emacs v24 ("Indentation error") vs. emacs v23 (hangs). What is your working set-up for emacs and IPython? Is there a way to make it work well as it was before? Thanks, Emanuele -------------- next part -------------- An HTML attachment was scrubbed... URL: From mark.voorhies at ucsf.edu Tue May 5 02:31:34 2015 From: mark.voorhies at ucsf.edu (Mark Voorhies) Date: Mon, 4 May 2015 23:31:34 -0700 Subject: [IPython-dev] Getting autorepeat keyboard events in ipython+matplotlib+PyQt4 Message-ID: <554863C6.4040002@ucsf.edu> I'm playing with an interactive dotplot based on a matplotlib figure created from an IPython notebook (basically, an IPython/matplotlib port of this: http://histo.ucsf.edu/BMS270/BMS270b_2013/code/pydotter_canopy.py) I'm trying it with both the TkAgg backend and the qt backend (which is PyQt4 on my system). In both cases, I'm binding keyboard and mouse events like this: # Disable default plot keybindings key_callbacks = self.fig.canvas.callbacks.callbacks[ "key_press_event"].keys() for i in key_callbacks: self.fig.canvas.mpl_disconnect(i) # Substitute our own keybindings self.fig.canvas.mpl_connect("key_press_event", self.keypress) # For mouse clicks, we'll do our cross-hairs update in series # with the default mouse interactions self.fig.canvas.mpl_connect("button_press_event", self.click) and in both cases, mouse clicks and single keypresses work. For the qt backend, however, holding down a key only triggers a single event (while it triggers repeated events for the TkAgg backend). I'm initializing the qt backend at the top of the notebook like this: %gui qt %matplotlib qt This is for IPython 2.3.1 (from git) on Kubuntu 14.04 with matplotlib 1.3.1-1ubuntu5 Has anyone run into this sort of thing? Thanks, --Mark From John.Holt at tessella.com Tue May 5 06:09:05 2015 From: John.Holt at tessella.com (John.Holt at tessella.com) Date: Tue, 5 May 2015 11:09:05 +0100 Subject: [IPython-dev] Problems starting parallel nodes with ssh launch Message-ID: An HTML attachment was scrubbed... URL: From John.Holt at tessella.com Tue May 5 11:56:36 2015 From: John.Holt at tessella.com (John.Holt at tessella.com) Date: Tue, 5 May 2015 16:56:36 +0100 Subject: [IPython-dev] Problems starting parallel nodes with ssh launch Message-ID: Hi, I am working on a project which is utilising what was IPython.parallel and I have been running into unexpected problems on startup of the nodes from the workbook. The problem seem to split into two distinct groups: 1) Nodes not completing initial registration process, log reads ??? 2015-04-30 15:58:43.435 [IPEngineApp] Loading url_file u'.ipython/profile_default/security/ipcontroller-engine.json' ??? 2015-04-30 15:58:43.455 [IPEngineApp] Registering with controller at tcp://192.168.3.18:42527 2) Nodes starting but failing to get through the registration, log reads: ??? 2015-04-30 15:58:59.514 [IPEngineApp] Loading url_file u'.ipython/profile_default/security/ipcontroller-engine.json' ??? 2015-04-30 15:58:59.530 [IPEngineApp] Registering with controller at tcp://192.168.3.18:42527 ??? 2015-04-30 15:59:03.793 [IPEngineApp] complete registration started In both cases the nodes don't automatically terminate themselves. The problem can be fixed by making the delay between launching nodes larger. I did a bit of digging and it appears that the first problem is an exception that is being thrown in connect() (within zmq) which is called from register(). The exception is: ??? 2015-04-30 15:58:43.760 [IPEngineApp] ERROR | problem with connect ??? Traceback (most recent call last): ??? ? File "/var/share/jupyter/virtualenv_2.7/src/ipython/IPython/parallel/engine/engine.py", line 147, in register ??? ??? connect(reg, self.url) ??? ? File "/var/share/jupyter/virtualenv_2.7/src/ipython/IPython/parallel/engine/engine.py", line 116, in connect ??? ??? password=password, ??? ? File "/var/share/jupyter/virtualenv_2.7/lib/python2.7/site-packages/zmq/ssh/tunnel.py", line 134, in tunnel_connection ??? ??? new_url, tunnel = open_tunnel(addr, server, keyfile=keyfile, password=password, paramiko=paramiko, timeout=timeout) ??? ? File "/var/share/jupyter/virtualenv_2.7/lib/python2.7/site-packages/zmq/ssh/tunnel.py", line 162, in open_tunnel ??? ??? tunnel = tunnelf(lport, rport, server, remoteip=ip, keyfile=keyfile, password=password, timeout=timeout) ??? ? File "/var/share/jupyter/virtualenv_2.7/lib/python2.7/site-packages/zmq/ssh/tunnel.py", line 240, in openssh_tunnel ??? ??? raise RuntimeError("tunnel '%s' failed to start"%(cmd)) ??? RuntimeError: tunnel 'ssh -i ~/.ssh/id_rsa -f -S none -L 127.0.0.1:53305:192.168.3.18:42527 192.168.3.18 sleep 60' failed to start This is probably caused by running multiple engines on my node (it is a multi core node). If one of the engines starts before the next one completes there is a race condition where the first engines connects to a port after the second engine determines that this is a free port, then when the second engine connects it finds the port isn't free. This exception is not caught and logged (or at least I can not find a log) and I added the exception catch to get the above output. Would it be possible to add a general exception catch and log to the register function? The next problem was that because the abort timer is not created until after the register is called the process never exits, but instead sits doing nothing. The second problem is more mysterious to me because I did less debugging so I am unsure what is going on; I would guess it is something similar. The complete_registration function is crashing at some point. I placed logging points through the function and it seemed to exit/hang at a number of points: 1) launching the heartbeat 2) creating the Shell Connections 3) creating the control stream The abort process is unregistered at the top of the registration_complete function so this process never exits. I am unsure whether this is throwing an exception (I may be able to look into this if it is important). So to summarise I think it would be great to have exception catching and logging around both the register and complete_registration functions. It would also be good to make sure that the abort loop is started before register and stopped at the end of compete_registation so that if an error does occur (including it just spinning) then the process will exit. However I may have misinterpreted the code so please let me know if I am doing something incorrect. Thank you for you help. JohnThis message is commercial in confidence and may be privileged. It is intended for the addressee(s) only. Access to this message by anyone else is unauthorized and strictly prohibited. If you have received this message in error, please inform the sender immediately. Please note that messages sent or received by the Tessella e-mail system may be monitored and stored in an information retrieval system. From takowl at gmail.com Tue May 5 12:29:34 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Tue, 5 May 2015 09:29:34 -0700 Subject: [IPython-dev] Getting autorepeat keyboard events in ipython+matplotlib+PyQt4 In-Reply-To: <554863C6.4040002@ucsf.edu> References: <554863C6.4040002@ucsf.edu> Message-ID: On 4 May 2015 at 23:31, Mark Voorhies wrote: > For the qt backend, however, holding down a key only triggers a single > event Does it work correctly when run outside of IPython? I suspect that the matplotlib devs will be better able to help you with this. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From ssanderson at quantopian.com Tue May 5 13:15:43 2015 From: ssanderson at quantopian.com (ssanderson) Date: Tue, 5 May 2015 10:15:43 -0700 (PDT) Subject: [IPython-dev] Issues with IPython and emacs (in ubuntu 14.04) In-Reply-To: <5547E67E.80103@relativita.com> References: <5547E67E.80103@relativita.com> Message-ID: <1430846143792-5094150.post@n6.nabble.com> I use the following in my .emacs, though I use python.el, which is different from python-mode.el. (eval-after-load "python" ;; Assumes we're using python.el, not python-mode.el '(progn (setq python-fill-docstring-style "django" python-shell-virtualenv-path "~/.virtualenvs" python-check-command "pylint" python-shell-interpreter "ipython" python-shell-interpreter-args "--profile myprofile" python-shell-prompt-regexp "In \\[[0-9]+\\]: " python-shell-prompt-output-regexp "Out\\[[0-9]+\\]: ")) The IPython-relevant pieces are the 4 python-shell-* variables. They tell python.el to use ipython as its python command, to pass "--profile myprofile" as an argument, and provide regexps used to parse IPython's input/output prompts. Some other .emacs snippets that you might find useful for Python: ;; Automatically run flake8 on .py files on save. (require 'flymake-python-pyflakes) (add-hook 'python-mode-hook 'flymake-python-pyflakes-load) (setq flymake-python-pyflakes-executable "flake8") ;; Mostly useful for transforming imports of the form: ;; from somemodule import ( ;; foo, ;; bar, ;; buzz, ;; ) ;; to ;; from somemodule import ( ;; bar, ;; buzz, ;; foo, ;; ) (defun sort-lines-between-parens(&optional case-sensitive) (interactive) (let ((sort-fold-case (not case-sensitive)) (right-paren (save-excursion (re-search-forward ")" nil t) (line-end-position 0))) (left-paren (save-excursion (re-search-backward "(" nil t) (line-beginning-position 2)))) (when (and right-paren left-paren) (sort-lines nil left-paren right-paren)))) ;; Transform ['foo', 'bar', 'buzz'] ;; into ;; ['foo', ;; 'bar', 'buzz'] ;; ;; You can run this repeatedly to columnize a function call or list/dict/set literal. ;; I bind this to C-, C-, (defun indent-after-comma() (interactive) (re-search-forward ",[ ]*" (line-end-position) t) (replace-match ",") (newline-and-indent)) ;; Not python-specific, but probably the most useful emacs snippet I've written for exploring ;; other people's libraries. I bind this to C-c g. (defun git-grep () "Grep for a symbol within the git repo of the current file." (interactive) (let* ((sym (thing-at-point 'symbol)) (regex (read-regexp "Expression" sym))) (require 'vc-git) (vc-git-grep regex "" (vc-git-root default-directory)))) -- View this message in context: http://python.6.x6.nabble.com/Issues-with-IPython-and-emacs-in-ubuntu-14-04-tp5094072p5094150.html Sent from the IPython - Development mailing list archive at Nabble.com. From ssanderson at quantopian.com Tue May 5 13:22:00 2015 From: ssanderson at quantopian.com (ssanderson) Date: Tue, 5 May 2015 10:22:00 -0700 (PDT) Subject: [IPython-dev] Issues with IPython and emacs (in ubuntu 14.04) In-Reply-To: <1430846143792-5094150.post@n6.nabble.com> References: <5547E67E.80103@relativita.com> <1430846143792-5094150.post@n6.nabble.com> Message-ID: <1430846520265-5094152.post@n6.nabble.com> Also, there's an excellent IPython Notebook client for emacs that's now maintained at https://github.com/millejoh/emacs-ipython-notebook, and is hosted on melpa under the package name "ein". -- View this message in context: http://python.6.x6.nabble.com/Issues-with-IPython-and-emacs-in-ubuntu-14-04-tp5094072p5094152.html Sent from the IPython - Development mailing list archive at Nabble.com. From dinov at microsoft.com Tue May 5 16:06:04 2015 From: dinov at microsoft.com (Dino Viehland) Date: Tue, 5 May 2015 20:06:04 +0000 Subject: [IPython-dev] ShellChannel.object_info equivalent? Message-ID: Is there a new equivalent to ShellChannel.object_info in 3.0+? I see that there's now a KernelClient.inspect that seems similar but it doesn't return the information at the same level of granularity - previously we'd get back the doc string, args, var args, var kw, and defaults. Now it seems like the reply just includes a textual representation without any of the information broken out. Is there any way to get the more detailed information? -------------- next part -------------- An HTML attachment was scrubbed... URL: From mark.voorhies at ucsf.edu Tue May 5 18:44:42 2015 From: mark.voorhies at ucsf.edu (Mark Voorhies) Date: Tue, 5 May 2015 15:44:42 -0700 Subject: [IPython-dev] Getting autorepeat keyboard events in ipython+matplotlib+PyQt4 In-Reply-To: References: <554863C6.4040002@ucsf.edu> Message-ID: <554947DA.1000201@ucsf.edu> On 05/05/2015 09:29 AM, Thomas Kluyver wrote: > On 4 May 2015 at 23:31, Mark Voorhies wrote: > >> For the qt backend, however, holding down a key only triggers a single >> event > > > Does it work correctly when run outside of IPython? I suspect that the > matplotlib devs will be better able to help you with this. > > Thomas Good thought. Outside of IPython, keypresses trapped via setting up the PyQt4 signals/slots directly do autorepeat (e.g., sillyAction = actionMenu.addAction(self.tr("Silly")) sillyAction.setShortcut(QtGui.QKeySequence(self.tr("b"))) self.connect(sillyAction, QtCore.SIGNAL("triggered()"), self.silly) ) but keypresses trapped via mpl_connect don't autorepeat (e.g. http://matplotlib.org/examples/user_interfaces/embedding_in_qt4_wtoolbar.html) Looks like this is a design decision in matplotlib: ------------------------------------------------------------------------- commit 02870bbdd8185994f0f3d0ccda440b934e8b76c6 Author: Eric Firing Date: Sun Apr 17 10:57:22 2011 -1000 BUG: in qt4 backend, ignore auto-repeat keyboard events. This makes constrained zoom/pan work. I don't see any need to support keyboard auto-repeat in mpl. ------------------------------------------------------------------------- If I can't hack around this, I'll contact the matplotlib devs. Thanks for your help, Mark From maximilian.albert at gmail.com Tue May 5 19:56:29 2015 From: maximilian.albert at gmail.com (Maximilian Albert) Date: Wed, 6 May 2015 00:56:29 +0100 Subject: [IPython-dev] How to inject "dynamic" information into a Jinja template for IPython notebook conversion Message-ID: Hi all, Let me first give a bit of background before I can ask my question. I'm doing a parameter study for which I need to execute the same analysis with a bunch of different inputs.I keep an IPython notebook "template.ipynb" containing un-executed code cells which serves as the template for my analysis. For each parameter value that I'd like to explore (e.g. "foo=42") I programmatically insert a code cell at the beginning of this notebook that defines this parameter value, and subsequently execute the notebook (using ExecutePreprocessor) so that the result now contains the analysis for this particular parameter. I save the executed notebook to something like "output_foo_42.ipynb" and run nbconvert over it, which generates a nice PDF report. So far so good. Here is my question. I'd like to be able to "dynamically" inject information derived from the parameter value into the LaTeX output generated by nbconvert (in the last step of the above workflow, just before the actual conversion to PDF). For example, I'd like to be able to define a custom document title that reports the parameter value. Also, I'd like to be able to tweak the page numbers of each report so that I can combine all individual PDF reports into a single long document with consecutive page numbers. I'm using a custom Jinja .tplx file with nbconvert to tweak the LaTeX output (e.g. adjust page margins) but so far all my attempts to inject "dynamic" information into it have failed. I saw that the "base.tplx" template uses "resources.metadata.name", so I tried to somehow adjust the notebook metadata (during the execution stage with ExecutePreprocessor), alas to no avail. Any ideas how I can achieve this? Or am I barking up the wrong tree and should be using a completely different approach? Many thanks for any suggestions! Max -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Wed May 6 12:48:34 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 6 May 2015 09:48:34 -0700 Subject: [IPython-dev] ShellChannel.object_info equivalent? In-Reply-To: References: Message-ID: Hi Dino, On 5 May 2015 at 13:06, Dino Viehland wrote: > Is there a new equivalent to ShellChannel.object_info in 3.0+? I see > that there?s now a KernelClient.inspect that seems similar but it doesn?t > return the information at the same level of granularity ? previously we?d > get back the doc string, args, var args, var kw, and defaults. Now it > seems like the reply just includes a textual representation without any of > the information broken out. > > > > Is there any way to get the more detailed information? > No, object_info was replaced with inspect. We decided to replace the structured data with text because a lot of the structured data was defined in a Python specific way, and it would have been hard to make it all language agnostic. What are you trying to use it for? We may be able to work out another way to do it, or add back a limited amount of structured information. Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Wed May 6 12:51:04 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Wed, 6 May 2015 09:51:04 -0700 Subject: [IPython-dev] ShellChannel.object_info equivalent? In-Reply-To: References: Message-ID: Hi Dino, the problem with doc string, args, var args, var kw, and defaults was it was purely python specific, so we replaced it with something more generic. maybe the response have metadata, or is a mimebundle so if you want more granular structured info you could used it there. -- M On Tue, May 5, 2015 at 1:06 PM, Dino Viehland wrote: > Is there a new equivalent to ShellChannel.object_info in 3.0+? I see that > there?s now a KernelClient.inspect that seems similar but it doesn?t return > the information at the same level of granularity ? previously we?d get back > the doc string, args, var args, var kw, and defaults. Now it seems like the > reply just includes a textual representation without any of the information > broken out. > > > > Is there any way to get the more detailed information? > > > > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From dinov at microsoft.com Wed May 6 22:52:36 2015 From: dinov at microsoft.com (Dino Viehland) Date: Thu, 7 May 2015 02:52:36 +0000 Subject: [IPython-dev] ShellChannel.object_info equivalent? In-Reply-To: References: , Message-ID: We use it to provide signature help inside of PTVS. By breaking out the arguments we can highlight the current arg that the user is typing. And we would display the doc string below the signature help. If it was available under a separate mime type that'd be great and we'd start displaying it again. For now we're just displaying the entire string which is a slightly degraded experience vs IPython 2 as well as our normal IDE experience. ________________________________ From: Thomas Kluyver Sent: ?5/?6/?2015 9:49 AM To: IPython developers list Subject: Re: [IPython-dev] ShellChannel.object_info equivalent? Hi Dino, On 5 May 2015 at 13:06, Dino Viehland > wrote: Is there a new equivalent to ShellChannel.object_info in 3.0+? I see that there?s now a KernelClient.inspect that seems similar but it doesn?t return the information at the same level of granularity ? previously we?d get back the doc string, args, var args, var kw, and defaults. Now it seems like the reply just includes a textual representation without any of the information broken out. Is there any way to get the more detailed information? No, object_info was replaced with inspect. We decided to replace the structured data with text because a lot of the structured data was defined in a Python specific way, and it would have been hard to make it all language agnostic. What are you trying to use it for? We may be able to work out another way to do it, or add back a limited amount of structured information. Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From diraol at diraol.eng.br Thu May 7 03:54:41 2015 From: diraol at diraol.eng.br (Diego Rabatone) Date: Thu, 7 May 2015 04:54:41 -0300 Subject: [IPython-dev] IPython Notebook server Message-ID: Hi friends, I've setup an IPython Notebook server. I can access it on my browser from anywhere and I can create a new notebook (ipynb file), always using python3. But when I enter on my notebook I get this error: *A connection to **the** notebook server **could* *not** be **established**. **The** notebook will continue **trying** to **reconnect**, **but** until it does, **you** will **NOT** be able to **run** code. Check **your** network connection or notebook server **configuration* And then there is a red "Not connected" notice on the upper right corner, and I don't know what to do. I just can't run the code of the notebook. Any idea on how to fix it? Thanks! -------------------------------- Diego Rabatone Oliveira diraol(arroba)diraol(ponto)eng(ponto)br Identica: (@diraol) http:// identi.ca /diraol Twitter: @diraol -------------- next part -------------- An HTML attachment was scrubbed... URL: From rgbkrk at gmail.com Thu May 7 10:50:52 2015 From: rgbkrk at gmail.com (Kyle Kelley) Date: Thu, 7 May 2015 09:50:52 -0500 Subject: [IPython-dev] IPython Notebook server In-Reply-To: References: Message-ID: What do your server side logs say? Are you running this behind a proxy? On Thu, May 7, 2015 at 2:54 AM, Diego Rabatone wrote: > Hi friends, > > I've setup an IPython Notebook server. I can access it on my browser from > anywhere and I can create a new notebook (ipynb file), always using python3. > > But when I enter on my notebook I get this error: > *A connection to **the** notebook server **could* *not** be **established**. > **The** notebook will continue **trying** to **reconnect**, **but** until > it does, **you** will **NOT** be able to **run** code. Check **your** > network connection or notebook server **configuration* > > And then there is a red "Not connected" notice on the upper right corner, > and I don't know what to do. I just can't run the code of the notebook. > > Any idea on how to fix it? > > Thanks! > > -------------------------------- > Diego Rabatone Oliveira > diraol(arroba)diraol(ponto)eng(ponto)br > Identica: (@diraol) http:// identi.ca > /diraol > Twitter: @diraol > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- Kyle Kelley (@rgbkrk ; lambdaops.com, developer.rackspace.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: From emanuele at relativita.com Thu May 7 11:04:44 2015 From: emanuele at relativita.com (Emanuele Olivetti) Date: Thu, 07 May 2015 17:04:44 +0200 Subject: [IPython-dev] Issues with IPython and emacs (in ubuntu 14.04) In-Reply-To: <1430846143792-5094150.post@n6.nabble.com> References: <5547E67E.80103@relativita.com> <1430846143792-5094150.post@n6.nabble.com> Message-ID: <554B7F0C.6030002@relativita.com> On 05/05/2015 07:15 PM, ssanderson wrote: > I use the following in my .emacs, though I use python.el, which is different > from python-mode.el. [...] Thank you for the very detailed information. It was pretty useful. I am trying python.el[0] and the py-execute-... operations works fine, with the exception of py-execute-region that raises IndentationError when a >=2 lines snippet, that is indeed indented, is selected. Both for python.el and python-mode[1], the issue above seems to be a recurrent one... I am also trying elpy[2], which is definitely more complex (and feature rich). At the moment it works well, with no (immediate) glitches. Best, Emanuele [0]: https://github.com/fgallina/python.el [1]: https://launchpad.net/python-mode [2]: https://github.com/jorgenschaefer/elpy From diraol at diraol.eng.br Thu May 7 11:08:06 2015 From: diraol at diraol.eng.br (Diego Rabatone) Date: Thu, 7 May 2015 12:08:06 -0300 Subject: [IPython-dev] IPython Notebook server In-Reply-To: References: Message-ID: Hi Kyle, I wasn't running behind any proxy. But I was running on the port 80. I've installed some more libs and changed the port to 9999 and now it is working just fine. I'm not sure if the problem was with the port or if it was missing any lib, but I think it was a problem with the port. Thanks =) -------------------------------- Diego Rabatone Oliveira diraol(arroba)diraol(ponto)eng(ponto)br Identica: (@diraol) http://identi.ca/diraol Twitter: @diraol 2015-05-07 11:50 GMT-03:00 Kyle Kelley : > What do your server side logs say? Are you running this behind a proxy? > > On Thu, May 7, 2015 at 2:54 AM, Diego Rabatone > wrote: > >> Hi friends, >> >> I've setup an IPython Notebook server. I can access it on my browser from >> anywhere and I can create a new notebook (ipynb file), always using python3. >> >> But when I enter on my notebook I get this error: >> *A connection to **the** notebook server **could* *not** be * >> *established**. **The** notebook will continue **trying** to **reconnect**, >> **but** until it does, **you** will **NOT** be able to **run** code. >> Check **your** network connection or notebook server **configuration* >> >> And then there is a red "Not connected" notice on the upper right corner, >> and I don't know what to do. I just can't run the code of the notebook. >> >> Any idea on how to fix it? >> >> Thanks! >> >> -------------------------------- >> Diego Rabatone Oliveira >> diraol(arroba)diraol(ponto)eng(ponto)br >> Identica: (@diraol) http:// identi.ca >> /diraol >> Twitter: @diraol >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > > -- > Kyle Kelley (@rgbkrk ; lambdaops.com, > developer.rackspace.com) > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ccordoba12 at gmail.com Thu May 7 16:35:26 2015 From: ccordoba12 at gmail.com (=?UTF-8?B?Q2FybG9zIEPDs3Jkb2Jh?=) Date: Thu, 07 May 2015 15:35:26 -0500 Subject: [IPython-dev] ShellChannel.object_info equivalent? In-Reply-To: References: , Message-ID: <554BCC8E.6010305@gmail.com> Hi, We were doing a similar thing in Spyder. Our solution was to: 1. Remove ANSI escape characters from the information returned by IPython (there is regex for that in the qt frontend). 2. Extract signatures using another regex. This is not that hard because there's a special line in IPython info for signatures. We're only showing signatures, but it shouldn't be hard to extract docstrings too following the same procedure :-) Cheers, Carlos El 06/05/15 a las 21:52, Dino Viehland escribi?: > We use it to provide signature help inside of PTVS. By breaking out > the arguments we can highlight the current arg that the user is > typing. And we would display the doc string below the signature help. > > If it was available under a separate mime type that'd be great and > we'd start displaying it again. For now we're just displaying the > entire string which is a slightly degraded experience vs IPython 2 as > well as our normal IDE experience. > ------------------------------------------------------------------------ > From: Thomas Kluyver > Sent: ?5/?6/?2015 9:49 AM > To: IPython developers list > Subject: Re: [IPython-dev] ShellChannel.object_info equivalent? > > Hi Dino, > > On 5 May 2015 at 13:06, Dino Viehland > wrote: > > Is there a new equivalent to ShellChannel.object_info in 3.0+? I > see that there?s now a KernelClient.inspect that seems similar but > it doesn?t return the information at the same level of granularity > ? previously we?d get back the doc string, args, var args, var kw, > and defaults. Now it seems like the reply just includes a textual > representation without any of the information broken out. > > Is there any way to get the more detailed information? > > > No, object_info was replaced with inspect. We decided to replace the > structured data with text because a lot of the structured data was > defined in a Python specific way, and it would have been hard to make > it all language agnostic. What are you trying to use it for? We may be > able to work out another way to do it, or add back a limited amount of > structured information. > > Thanks, > Thomas > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: From nathan12343 at gmail.com Thu May 7 19:38:11 2015 From: nathan12343 at gmail.com (Nathan Goldbaum) Date: Thu, 7 May 2015 16:38:11 -0700 Subject: [IPython-dev] Stand-alone single-cell live public demo Message-ID: Hi all, I asked about this a few months ago, but I'm curious if the status has changed in the meantime. I'd like to make a GUI that I've developed based on IPython widgets publically viewable. The end result I'd like is a way to paste a link to the demo along with the submission of my paper to the arxiv. Each user would get a unique live view of the GUI, although there would be no input from the user besides GUI interactions and everything will be read-only. Each instance would need to be able to see a few hundred megabytes of on-disk data. The last time I asked about this I was told I'd need to whip up something by-hand. Are there any services that do this already? Failing that, what would be best practice at this point for setting up this sort of thing? Thanks very much for your help, Nathan -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Thu May 7 19:44:59 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 7 May 2015 16:44:59 -0700 Subject: [IPython-dev] Stand-alone single-cell live public demo In-Reply-To: References: Message-ID: Hi Nathan, I saw at Pycon a poster on Spyre (https://github.com/adamhajari/spyre ), a tool to put an interactive GUI similar to IPython widgets on a website. At present, you'd have to write your code to use Spyre, but I'd love to see a tool that could go from a notebook to something like this. Best wishes, Thomas On 7 May 2015 at 16:38, Nathan Goldbaum wrote: > Hi all, > > I asked about this a few months ago, but I'm curious if the status has > changed in the meantime. > > I'd like to make a GUI that I've developed based on IPython widgets > publically viewable. The end result I'd like is a way to paste a link to > the demo along with the submission of my paper to the arxiv. Each user > would get a unique live view of the GUI, although there would be no input > from the user besides GUI interactions and everything will be read-only. > Each instance would need to be able to see a few hundred megabytes of > on-disk data. > > The last time I asked about this I was told I'd need to whip up something > by-hand. Are there any services that do this already? Failing that, what > would be best practice at this point for setting up this sort of thing? > > Thanks very much for your help, > > Nathan > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wstein at gmail.com Thu May 7 19:59:56 2015 From: wstein at gmail.com (William Stein) Date: Thu, 7 May 2015 16:59:56 -0700 Subject: [IPython-dev] Stand-alone single-cell live public demo In-Reply-To: References: Message-ID: On Thu, May 7, 2015 at 4:38 PM, Nathan Goldbaum wrote: > Hi all, > > I asked about this a few months ago, but I'm curious if the status has > changed in the meantime. > > I'd like to make a GUI that I've developed based on IPython widgets > publically viewable. The end result I'd like is a way to paste a link to the > demo along with the submission of my paper to the arxiv. Each user would get > a unique live view of the GUI, although there would be no input from the > user besides GUI interactions and everything will be read-only. Each > instance would need to be able to see a few hundred megabytes of on-disk > data. > > The last time I asked about this I was told I'd need to whip up something > by-hand. Are there any services that do this already? Failing that, what Jason Grout wrote something kind of like that, which Andrey Novoseltsev runs: http://sagecell.sagemath.org/ We just moved the hosting to both some machines in Germany and some machines on Google Compute Engine, to increase reliability, etc... The above is all BSD licensed, and provides the ability to nicely embed interactive computation in web sites. Anyways, thought you might find it relevant. > would be best practice at this point for setting up this sort of thing? > > Thanks very much for your help, > > Nathan > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -- William (http://wstein.org) From rgbkrk at gmail.com Fri May 8 15:40:04 2015 From: rgbkrk at gmail.com (Kyle Kelley) Date: Fri, 8 May 2015 14:40:04 -0500 Subject: [IPython-dev] Stand-alone single-cell live public demo In-Reply-To: <554CA904.2050409@creativetrax.com> References: <554CA904.2050409@creativetrax.com> Message-ID: Since you said thread and the details seem right Jason, I'm assuming you meant to respond to the whole list. If not, please banish me to the shadows. I'm not currently going to recommend running your own tmpnb to back widgets, since it requires a whole bunch of security constraints for me to feel it's reasonable to be hosting it. Docker does most of the sandboxing but then we take additional steps at an operating system level. These are in Ansible as well, publicly on github but that doesn't make it any easier. What I'd like to do is provide a much more simpler way of interacting with kernels that you can point to, as an API. You get the compute on demand, in a similar to way as seen in the beta.oreilly.com content. In the backend, that's running on tmpnb too but you as a user shouldn't have to manage that setup. You also don't necessarily want to pay for the kernels per your visiting user (maybe up to a point, as tmpnb does). Perhaps it gets offloaded to another provider of a kernels service. I've still got learning to do on my end. Can you provide access to the GUI you've developed to some number of us (or to everyone on the list)? I'm not in academia so I promise not to scoop you. ;) -- Kyle On Fri, May 8, 2015 at 7:16 AM, Jason Grout wrote: > On 5/7/15 19:59, William Stein wrote: > >> On Thu, May 7, 2015 at 4:38 PM, Nathan Goldbaum >> wrote: >> >>> Hi all, >>> >>> I asked about this a few months ago, but I'm curious if the status has >>> changed in the meantime. >>> >>> I'd like to make a GUI that I've developed based on IPython widgets >>> publically viewable. The end result I'd like is a way to paste a link to >>> the >>> demo along with the submission of my paper to the arxiv. Each user would >>> get >>> a unique live view of the GUI, although there would be no input from the >>> user besides GUI interactions and everything will be read-only. Each >>> instance would need to be able to see a few hundred megabytes of on-disk >>> data. >>> >>> The last time I asked about this I was told I'd need to whip up something >>> by-hand. Are there any services that do this already? Failing that, >>> what >>> >> >> Jason Grout wrote something kind of like that, which Andrey Novoseltsev >> runs: >> >> http://sagecell.sagemath.org/ >> >> We just moved the hosting to both some machines in Germany and some >> machines on Google Compute Engine, to increase reliability, etc... >> The above is all BSD licensed, and provides the ability to nicely >> embed interactive computation in web sites. Anyways, thought >> you might find it relevant. >> > > > The sage cell server sort of works (worked?) with IPython widgets. There > are two big issues with how well it works with IPython widgets: > > 1. it didn't include all of the necessary styling and libraries that > IPython widgets depended on (e.g., Twitter Bootstrap, etc.), so sometimes > they looked weird. A way to fix this would be to recode javascript > frontends for the IPython widgets that work in the context of any webpage > (not just pages that use Bootstrap, for example). Good news is that we > want to do this, but it will be a while before it is done. > > 2. It worked with an older version of IPython widgets, but I have not been > checking in the last year to see if any of our changes to IPython widgets > work well in sage cell server. And we have been making a lot of changes in > IPython widgets. > > The good news is that (1) you have total control over the webpage, so you > can include the necessary libraries for the IPython widgets to work, like > Bootstrap. However, (2) is still a possible issue. > > There are also other projects for providing a backend like this. For > example, try.jupyter.org or tmpnb.org host ephemeral IPython notebooks. > That might be the easiest solution. To find more about setting up > something like those, please ask in the IPython help room: > https://gitter.im/ipython/ipython/help, or Kyle Kelley might reply to > this thread here. > > Thanks, > > Jason > > > -- Kyle Kelley (@rgbkrk ; lambdaops.com, developer.rackspace.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: From nathan12343 at gmail.com Fri May 8 15:43:43 2015 From: nathan12343 at gmail.com (Nathan Goldbaum) Date: Fri, 8 May 2015 12:43:43 -0700 Subject: [IPython-dev] Stand-alone single-cell live public demo In-Reply-To: References: <554CA904.2050409@creativetrax.com> Message-ID: On Fri, May 8, 2015 at 12:40 PM, Kyle Kelley wrote: > Since you said thread and the details seem right Jason, I'm assuming you > meant to respond to the whole list. If not, please banish me to the shadows. > > I'm not currently going to recommend running your own tmpnb to back > widgets, since it requires a whole bunch of security constraints for me to > feel it's reasonable to be hosting it. Docker does most of the sandboxing > but then we take additional steps at an operating system level. These are > in Ansible as well, publicly on github but that doesn't make it any easier. > > What I'd like to do is provide a much more simpler way of interacting with > kernels that you can point to, as an API. You get the compute on demand, in > a similar to way as seen in the beta.oreilly.com content. In the backend, > that's running on tmpnb too but you as a user shouldn't have to manage that > setup. You also don't necessarily want to pay for the kernels per your > visiting user (maybe up to a point, as tmpnb does). Perhaps it gets > offloaded to another provider of a kernels service. I've still got learning > to do on my end. > > Can you provide access to the GUI you've developed to some number of us > (or to everyone on the list)? I'm not in academia so I promise not to scoop > you. ;) > > -- Kyle > > Hey Kyle, Thanks for taking a look at this. I'll set up a tarball this weekend that you can play around with. -Nathan > > On Fri, May 8, 2015 at 7:16 AM, Jason Grout > wrote: > >> On 5/7/15 19:59, William Stein wrote: >> >>> On Thu, May 7, 2015 at 4:38 PM, Nathan Goldbaum >>> wrote: >>> >>>> Hi all, >>>> >>>> I asked about this a few months ago, but I'm curious if the status has >>>> changed in the meantime. >>>> >>>> I'd like to make a GUI that I've developed based on IPython widgets >>>> publically viewable. The end result I'd like is a way to paste a link >>>> to the >>>> demo along with the submission of my paper to the arxiv. Each user >>>> would get >>>> a unique live view of the GUI, although there would be no input from the >>>> user besides GUI interactions and everything will be read-only. Each >>>> instance would need to be able to see a few hundred megabytes of on-disk >>>> data. >>>> >>>> The last time I asked about this I was told I'd need to whip up >>>> something >>>> by-hand. Are there any services that do this already? Failing that, >>>> what >>>> >>> >>> Jason Grout wrote something kind of like that, which Andrey Novoseltsev >>> runs: >>> >>> http://sagecell.sagemath.org/ >>> >>> We just moved the hosting to both some machines in Germany and some >>> machines on Google Compute Engine, to increase reliability, etc... >>> The above is all BSD licensed, and provides the ability to nicely >>> embed interactive computation in web sites. Anyways, thought >>> you might find it relevant. >>> >> >> >> The sage cell server sort of works (worked?) with IPython widgets. There >> are two big issues with how well it works with IPython widgets: >> >> 1. it didn't include all of the necessary styling and libraries that >> IPython widgets depended on (e.g., Twitter Bootstrap, etc.), so sometimes >> they looked weird. A way to fix this would be to recode javascript >> frontends for the IPython widgets that work in the context of any webpage >> (not just pages that use Bootstrap, for example). Good news is that we >> want to do this, but it will be a while before it is done. >> >> 2. It worked with an older version of IPython widgets, but I have not >> been checking in the last year to see if any of our changes to IPython >> widgets work well in sage cell server. And we have been making a lot of >> changes in IPython widgets. >> >> The good news is that (1) you have total control over the webpage, so you >> can include the necessary libraries for the IPython widgets to work, like >> Bootstrap. However, (2) is still a possible issue. >> >> There are also other projects for providing a backend like this. For >> example, try.jupyter.org or tmpnb.org host ephemeral IPython notebooks. >> That might be the easiest solution. To find more about setting up >> something like those, please ask in the IPython help room: >> https://gitter.im/ipython/ipython/help, or Kyle Kelley might reply to >> this thread here. >> >> Thanks, >> >> Jason >> >> >> > > > -- > Kyle Kelley (@rgbkrk ; lambdaops.com, > developer.rackspace.com) > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ice.rikh at gmail.com Fri May 8 18:17:32 2015 From: ice.rikh at gmail.com (Erik Hvatum) Date: Fri, 8 May 2015 17:17:32 -0500 Subject: [IPython-dev] make ctrl-c stop causing a crash exit with %gui and PyQt5 Message-ID: Patch attached. I think I'm fixing a straightforward oversight; create_inputhook_qt4 wants a an InputHookManager object as its first argument, not an InputHookBase. However, we get away with supplying the wrong object until someone hits ctrl-c. Passing the right object makes graceful ctrl-c event loop integration work properly, rather than causing IPython to exit. This seems familiar, but I'm not finding anything when I search. Apologies if this issue is old news :) Cheers, Erik -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- diff --git a/IPython/lib/inputhook.py b/IPython/lib/inputhook.py index baeed8f..4ae2cb3 100644 --- a/IPython/lib/inputhook.py +++ b/IPython/lib/inputhook.py @@ -363,7 +363,7 @@ def enable(self, app=None): app = QtGui.QApplication(sys.argv) """ from IPython.lib.inputhookqt4 import create_inputhook_qt4 - app, inputhook_qt4 = create_inputhook_qt4(self, app) + app, inputhook_qt4 = create_inputhook_qt4(self.manager, app) self.manager.set_inputhook(inputhook_qt4) if _use_appnope(): from appnope import nope From takowl at gmail.com Fri May 8 18:24:35 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 8 May 2015 15:24:35 -0700 Subject: [IPython-dev] make ctrl-c stop causing a crash exit with %gui and PyQt5 In-Reply-To: References: Message-ID: Thanks Erik! Do you want to make a pull request with that change against https://github.com/jupyter/qtconsole ? Best wishes, Thomas On 8 May 2015 at 15:17, Erik Hvatum wrote: > Patch attached. I think I'm fixing a straightforward oversight; > create_inputhook_qt4 wants a an InputHookManager object as its first > argument, not an InputHookBase. However, we get away with supplying the > wrong object until someone hits ctrl-c. Passing the right object makes > graceful ctrl-c event loop integration work properly, rather than causing > IPython to exit. > > This seems familiar, but I'm not finding anything when I search. > Apologies if this issue is old news :) > > Cheers, > Erik > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ice.rikh at gmail.com Fri May 8 20:58:55 2015 From: ice.rikh at gmail.com (Erik Hvatum) Date: Fri, 8 May 2015 19:58:55 -0500 Subject: [IPython-dev] make ctrl-c stop causing a crash exit with %gui and PyQt5 In-Reply-To: References: Message-ID: Pull request created: https://github.com/ipython/ipython/pull/8421 FYI, the inputhook.py file in question lives in the main IPython repo. This doesn't seem to impact qtconsole with IPython kernel running in a different thread, although it may actually come into play if one sends an interrupt signal directly to the kernel after causing the kernel to install Qt event loop integration. Regarding qtconsole itself, is it possible to use a style sheet to disable text antialiasing, set window opacity, and select theme? I currently do these things in a very hackish way: diff --git a/qtconsole/console/console_widget.py b/qtconsole/console/console_widget.py index c27c8de..5da0989 100644 --- a/qtconsole/console/console_widget.py +++ b/qtconsole/console/console_widget.py @@ -735,6 +735,7 @@ class ConsoleWidget(MetaQObjectHasTraits('NewBase', (LoggingConfigurable, QtGui. """ Sets the base font for the ConsoleWidget to the specified QFont. """ font_metrics = QtGui.QFontMetrics(font) + font.setStyleStrategy(QtGui.QFont.NoAntialias) self._control.setTabStopWidth(self.tab_width * font_metrics.width(' ')) self._completion_widget.setFont(font) diff --git a/qtconsole/console/ipython_widget.py b/qtconsole/console/ipython_widget.py index ead85d5..b37e148 100644 --- a/qtconsole/console/ipython_widget.py +++ b/qtconsole/console/ipython_widget.py @@ -439,7 +439,7 @@ class IPythonWidget(FrontendWidget): # 'IPythonWidget' interface #--------------------------------------------------------------------------- - def set_default_style(self, colors='lightbg'): + def set_default_style(self, colors='linux'): """ Sets the widget style to the class defaults. Parameters diff --git a/qtconsole/console/mainwindow.py b/qtconsole/console/mainwindow.py index 386a7f3..c7cbb20 100644 --- a/qtconsole/console/mainwindow.py +++ b/qtconsole/console/mainwindow.py @@ -61,6 +61,7 @@ class MainWindow(QtGui.QMainWindow): """ super(MainWindow, self).__init__() + self.setWindowOpacity(0.9) self._kernel_counter = 0 self._app = app self.confirm_exit = confirm_exit ipython qtconsole once accepted a --colors option that I could use to select theme, but that went away. This may really be a tech support question; feel free to point me towards appropriate docs :) Thanks, Erik PS: I like disabling text AA so that the 33 year old DOS console font, largely manually traced to make a truetype font , looks good on OS X, or Yosemite National Park, or whatever kids call it. It's distinctly possible that I am one of perhaps 20 people on the planet who actually want to disable text AA. On Fri, May 8, 2015 at 5:24 PM, Thomas Kluyver wrote: > Thanks Erik! Do you want to make a pull request with that change against > https://github.com/jupyter/qtconsole ? > > Best wishes, > Thomas > > On 8 May 2015 at 15:17, Erik Hvatum wrote: > >> Patch attached. I think I'm fixing a straightforward oversight; >> create_inputhook_qt4 wants a an InputHookManager object as its first >> argument, not an InputHookBase. However, we get away with supplying the >> wrong object until someone hits ctrl-c. Passing the right object makes >> graceful ctrl-c event loop integration work properly, rather than causing >> IPython to exit. >> >> This seems familiar, but I'm not finding anything when I search. >> Apologies if this issue is old news :) >> >> Cheers, >> Erik >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Fri May 8 21:16:22 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Fri, 8 May 2015 18:16:22 -0700 Subject: [IPython-dev] make ctrl-c stop causing a crash exit with %gui and PyQt5 In-Reply-To: References: Message-ID: On 8 May 2015 at 17:58, Erik Hvatum wrote: > Pull request created: https://github.com/ipython/ipython/pull/8421 > Thanks! > FYI, the inputhook.py file in question lives in the main IPython repo. > This doesn't seem to impact qtconsole with IPython kernel running in a > different thread, although it may actually come into play if one sends an > interrupt signal directly to the kernel after causing the kernel to install > Qt event loop integration. > My mistake, I was replying too quickly without thinking properly about which bit of code was involved. > Regarding qtconsole itself, is it possible to use a style sheet to disable > text antialiasing, set window opacity, and select theme? It looks like there are config options IPythonQtConsoleApp.stylesheet and IPythonWidget.style_sheet - I'm not sure what the difference is, but have a play around with them. http://ipython.org/ipython-doc/3/config/options/qtconsole.html Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From benjamin.ninassi at inria.fr Tue May 12 09:48:55 2015 From: benjamin.ninassi at inria.fr (Benjamin Ninassi) Date: Tue, 12 May 2015 15:48:55 +0200 (CEST) Subject: [IPython-dev] [jupyter]News from a French Mooc about Python with ipython In-Reply-To: References: <341582656.3823540.1427809064291.JavaMail.zimbra@inria.fr> Message-ID: <52038698.4675546.1431438535730.JavaMail.zimbra@inria.fr> Sorry I took so long to respond > I don't know how much you can share that, but it would be nice to compare the > workflow of your platform and yours too see where we can improve both. Maybe > it would be possible to at least share that in private ? Or get thoughts on > security or challenges you had ? I can absolutely share as much as possible, my only contraint is time for now :/ More than the code, I think that our workflow, the problems faced and the solutions used may be interesting. I don't think some of you may pass by the Rennes aera in France, maybe we can organize a call or a videoconference ? I warn you that my spoken english is even worse than my written one :) > As you have probably seen in Jess email, we are going release things > relatively soon (though they are already available on github) and we will > continue to develop and push things forward. we would really appreciate your > contribution, and listen to your needs to get something reusable. For the python mooc of 2016 the authors plans on using python3 instead of 2.7, it will be a good occasion I think to use jupyter instead of our home made solution, if it fulfill our needs (I didn't have time to check for now). > Have you talk to / hear of the mood of Lorena Barbara, i think they are also > integrating with EDX. No > Any chance you can share some feedback/analytics of how students are using > the notebooks ? We don't have much numbers collected, but the feedbacks on the forum were really positive. > We might develop a extension that collect some of students behavior like > which keyboard shortcut/button they use. > Would you be interested in using it ? Yes of course ! -------------- next part -------------- An HTML attachment was scrubbed... URL: From nathan12343 at gmail.com Thu May 14 17:36:28 2015 From: nathan12343 at gmail.com (Nathan Goldbaum) Date: Thu, 14 May 2015 14:36:28 -0700 Subject: [IPython-dev] "dev" docs for IPython stuck on 3.0b1 build Message-ID: Hi all, Is there a reason why the "dev" build of the IPython docs ( http://ipython.org/ipython-doc/dev/) is for the 3.0-b1 tag? This puts users in a possibly confusing situation, since the most up-to-date docs build is actually for the 3.0 branch (http://ipython.org/ipython-doc/3/), while I would expect the "dev" docs build to represent the state the current or relatively recent state of the master branch on IPython's github. -Nathan -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Thu May 14 17:49:31 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 14 May 2015 14:49:31 -0700 Subject: [IPython-dev] "dev" docs for IPython stuck on 3.0b1 build In-Reply-To: References: Message-ID: We haven't rebuilt them since the release because we're still working out where different bits of the docs belong post repo-split. We should make progress on this soon. Thomas On 14 May 2015 at 14:36, Nathan Goldbaum wrote: > Hi all, > > Is there a reason why the "dev" build of the IPython docs ( > http://ipython.org/ipython-doc/dev/) is for the 3.0-b1 tag? This puts > users in a possibly confusing situation, since the most up-to-date docs > build is actually for the 3.0 branch (http://ipython.org/ipython-doc/3/), > while I would expect the "dev" docs build to represent the state the > current or relatively recent state of the master branch on IPython's github. > > -Nathan > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ozancag at gmail.com Mon May 18 05:11:42 2015 From: ozancag at gmail.com (=?UTF-8?B?T3phbiDDh2HEn2xheWFu?=) Date: Mon, 18 May 2015 12:11:42 +0300 Subject: [IPython-dev] Best practice of deployment for university courses Message-ID: Hi, I installed jupyterhub on a server in my university. Here is my plan: 1. Create ~/notebooks folder in each home folder 2. Configure jupyterhub so that the logged-in users only see the ~/notebooks folder. The authentication will be through classical UNIX credentials. Now I want that each student has access to some course materials through their ~/notebooks folder, e.g.: ~/notebooks/courses/MATH101 - Lecture1.ipynb - Homework1.ipynb ~/notebooks/courses/PYTHON101 - Lecture1.ipynb - Homework1.ipynb etc. To be able to manage this, I thought that maybe I should create a system-wide ipynb folder like /opt/notebooks, put the very same hierarchy above inside it and make ~/notebooks/courses a symbolic link to that folder. The problem is that the /opt/notebooks will only have read permissions to regular users. Is there a mechanism to fork/clone/save_as a notebook inside ~/notebooks once a student opens a notebook from the read-only ~/notebooks/courses? Thanks. -- Ozan ?a?layan Research Assistant Galatasaray University - Computer Engineering Dept. http://www.ozancaglayan.com From steve at holdenweb.com Mon May 18 06:45:09 2015 From: steve at holdenweb.com (Steve Holden) Date: Mon, 18 May 2015 11:45:09 +0100 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: On May 18, 2015, at 10:11 AM, Ozan ?a?layan wrote: > Hi, > > I installed jupyterhub on a server in my university. Here is my plan: > 1. Create ~/notebooks folder in each home folder > 2. Configure jupyterhub so that the logged-in users only see the > ~/notebooks folder. The authentication will be through classical UNIX > credentials. > So far so good. > Now I want that each student has access to some course materials > through their ~/notebooks folder, e.g.: > > ~/notebooks/courses/MATH101 > - Lecture1.ipynb > - Homework1.ipynb > ~/notebooks/courses/PYTHON101 > - Lecture1.ipynb > - Homework1.ipynb > > etc. To be able to manage this, I thought that maybe I should create a > system-wide ipynb folder like /opt/notebooks, put the very same > hierarchy above inside it and make ~/notebooks/courses a symbolic link > to that folder. The problem is that the /opt/notebooks will only have > read permissions to regular users. Is there a mechanism to > fork/clone/save_as a notebook inside ~/notebooks once a student opens > a notebook from the read-only ~/notebooks/courses? > Had you thought about just copying a single "startup" notebook into each new user's home directory, whose sole purpose is to explain the structure of the course materials and establish a local copy for the student? That's what Jupyter's for, after all. I sometimes think of the Markdown bits as "code for humans" :). regards Steve > Thanks. > > -- > Ozan ?a?layan > Research Assistant > Galatasaray University - Computer Engineering Dept. > http://www.ozancaglayan.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev -- Steve Holden steve at holdenweb.com / +1 571 484 6266 / +44 113 320 2335 / @holdenweb -------------- next part -------------- An HTML attachment was scrubbed... URL: From doug.blank at gmail.com Mon May 18 07:12:10 2015 From: doug.blank at gmail.com (Doug Blank) Date: Mon, 18 May 2015 07:12:10 -0400 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: On Mon, May 18, 2015 at 5:11 AM, Ozan ?a?layan wrote: > Hi, > > I installed jupyterhub on a server in my university. Here is my plan: > 1. Create ~/notebooks folder in each home folder > 2. Configure jupyterhub so that the logged-in users only see the > ~/notebooks folder. The authentication will be through classical UNIX > credentials. > I considered doing something like that, but wanted to stay away from having to do system-level configuration requiring root. So, I just let the accounts be normal accounts, but created some special javascript buttons, and a special jupyterhub static nbviewer-like url handler. The buttons allow things like "Submit" (for homework) and "Publish" (for putting into their Public directory, for the nbviewer-like display). In the nbviewer-like url handler, it can list files (with a copy action for logged in users), example shown here: http://jupyter.cs.brynmawr.edu/hub/dblank/public/CS110%20Intro%20to%20Computing/2015/Lectures or it renders the notebook, with a download options, example shown here: http://jupyter.cs.brynmawr.edu/hub/dblank/public/CS110%20Intro%20to%20Computing/2015/Lectures/Robot%20Control.ipynb > > Now I want that each student has access to some course materials > through their ~/notebooks folder, e.g.: > > ~/notebooks/courses/MATH101 > - Lecture1.ipynb > - Homework1.ipynb > ~/notebooks/courses/PYTHON101 > - Lecture1.ipynb > - Homework1.ipynb > > etc. To be able to manage this, I thought that maybe I should create a > system-wide ipynb folder like /opt/notebooks, put the very same > hierarchy above inside it and make ~/notebooks/courses a symbolic link > to that folder. The problem is that the /opt/notebooks will only have > read permissions to regular users. Is there a mechanism to > fork/clone/save_as a notebook inside ~/notebooks once a student opens > a notebook from the read-only ~/notebooks/courses? > I would use a link rather than copies (if you go this route). But you could just link to something like /home/youraccount/Public/MATH101 That way, all you do is have to save your Public version, and it is instantly updated. (I found myself having to fix little typos the first time around). The code for for the publish and submit buttons is here: https://bitbucket.org/ipre/calico/raw/master/notebooks/nbextensions/ The code to inject the buttons into the template is here: https://github.com/dsblank/jupyter.brynmawr/blob/master/notebook/templates/notebook.html#L316 And the code for the new jupyterhub publichandler static view and browser is here (but has errors; will be updated later this summer): https://github.com/dsblank/jupyter.brynmawr/tree/master/jupyterhub Good luck! -Doug > > Thanks. > > -- > Ozan ?a?layan > Research Assistant > Galatasaray University - Computer Engineering Dept. > http://www.ozancaglayan.com > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Mon May 18 09:39:55 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Mon, 18 May 2015 06:39:55 -0700 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: Have a look at nbgrader: https://github.com/jupyter/nbgrader Jess is using it to teach a 200+ class and have command to distribute/gather homework. It is deployed on a Docker Swarm server on Rackspace, and it in part made exactly for that, distributing ipynb files on a filesystem with a particular layout. Read the following for more: https://developer.rackspace.com/blog/deploying-jupyterhub-for-education/ And come meet us at SciPy. -- M On Mon, May 18, 2015 at 4:12 AM, Doug Blank wrote: > On Mon, May 18, 2015 at 5:11 AM, Ozan ?a?layan wrote: >> >> Hi, >> >> I installed jupyterhub on a server in my university. Here is my plan: >> 1. Create ~/notebooks folder in each home folder >> 2. Configure jupyterhub so that the logged-in users only see the >> ~/notebooks folder. The authentication will be through classical UNIX >> credentials. > > > I considered doing something like that, but wanted to stay away from having > to do system-level configuration requiring root. > > So, I just let the accounts be normal accounts, but created some special > javascript buttons, and a special jupyterhub static nbviewer-like url > handler. The buttons allow things like "Submit" (for homework) and "Publish" > (for putting into their Public directory, for the nbviewer-like display). > > In the nbviewer-like url handler, it can list files (with a copy action for > logged in users), example shown here: > > http://jupyter.cs.brynmawr.edu/hub/dblank/public/CS110%20Intro%20to%20Computing/2015/Lectures > > or it renders the notebook, with a download options, example shown here: > > http://jupyter.cs.brynmawr.edu/hub/dblank/public/CS110%20Intro%20to%20Computing/2015/Lectures/Robot%20Control.ipynb > > >> >> >> Now I want that each student has access to some course materials >> through their ~/notebooks folder, e.g.: >> >> ~/notebooks/courses/MATH101 >> - Lecture1.ipynb >> - Homework1.ipynb >> ~/notebooks/courses/PYTHON101 >> - Lecture1.ipynb >> - Homework1.ipynb >> >> etc. To be able to manage this, I thought that maybe I should create a >> system-wide ipynb folder like /opt/notebooks, put the very same >> hierarchy above inside it and make ~/notebooks/courses a symbolic link >> to that folder. The problem is that the /opt/notebooks will only have >> read permissions to regular users. Is there a mechanism to >> fork/clone/save_as a notebook inside ~/notebooks once a student opens >> a notebook from the read-only ~/notebooks/courses? > > > I would use a link rather than copies (if you go this route). But you could > just link to something like /home/youraccount/Public/MATH101 > > That way, all you do is have to save your Public version, and it is > instantly updated. (I found myself having to fix little typos the first time > around). > > The code for for the publish and submit buttons is here: > > https://bitbucket.org/ipre/calico/raw/master/notebooks/nbextensions/ > > The code to inject the buttons into the template is here: > > https://github.com/dsblank/jupyter.brynmawr/blob/master/notebook/templates/notebook.html#L316 > > And the code for the new jupyterhub publichandler static view and browser is > here (but has errors; will be updated later this summer): > > https://github.com/dsblank/jupyter.brynmawr/tree/master/jupyterhub > > Good luck! > > -Doug > >> >> >> Thanks. >> >> -- >> Ozan ?a?layan >> Research Assistant >> Galatasaray University - Computer Engineering Dept. >> http://www.ozancaglayan.com >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From ozancag at gmail.com Mon May 18 09:57:51 2015 From: ozancag at gmail.com (=?UTF-8?B?T3phbiDDh2HEn2xheWFu?=) Date: Mon, 18 May 2015 16:57:51 +0300 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: Hello all, Thanks for your fast replies :) I am aware of the Jess' mechanism but it was too over-engineered for us as we only have a quite outdated dual cpu Xeon server. So that's why I didn't choose to use docker based deployment. I am also aware of nbgrader but grading is currently a future task as I am just trying to setup a working environment. I installed a symbolic link to a system folder containing a git checkout of some scientific python lecture into ~/notebooks to see what happens. It was nice to see that a read-only file is detected and even represented with an icon in the web interface :) A read-only notebook also allows changing and running cells which maybe sufficient for a live lab session to teach a programming language for example. But once the user clicks "make a copy" the interface doesn't ask where to create a copy and tries creating it in the same read-only folder which fails. I really want to create a global repository of notebooks for being able to for example do a "git pull" in that folder and get latest versions of course materials and students will find the up-to-date versions once they click refresh on the web interface. Installing a startup notebook for telling people how to use stuff is also a good idea. I'll continue to explore and experiment :) From bussonniermatthias at gmail.com Mon May 18 10:08:13 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Mon, 18 May 2015 07:08:13 -0700 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: Well nbgrader, beyond the deployment, is also a set of command that will push notebooks to students home directory, and have a read-only and read-write version, so that student can modify things, but then still get a copy of the original in just in case. You might want to only use this part. -- M On Mon, May 18, 2015 at 6:57 AM, Ozan ?a?layan wrote: > Hello all, > > Thanks for your fast replies :) > > I am aware of the Jess' mechanism but it was too over-engineered for > us as we only have a quite outdated dual cpu Xeon server. So that's > why I didn't choose to use docker based deployment. I am also aware of > nbgrader but grading is currently a future task as I am just trying to > setup a working environment. > > I installed a symbolic link to a system folder containing a git > checkout of some scientific python lecture into ~/notebooks to see > what happens. It was nice to see that a read-only file is detected and > even represented with an icon in the web interface :) A read-only > notebook also allows changing and running cells which maybe sufficient > for a live lab session to teach a programming language for example. > But once the user clicks "make a copy" the interface doesn't ask where > to create a copy and tries creating it in the same read-only folder > which fails. I really want to create a global repository of notebooks > for being able to for example do a "git pull" in that folder and get > latest versions of course materials and students will find the > up-to-date versions once they click refresh on the web interface. > > Installing a startup notebook for telling people how to use stuff is > also a good idea. > > I'll continue to explore and experiment :) > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From ozancag at gmail.com Mon May 18 10:13:59 2015 From: ozancag at gmail.com (=?UTF-8?B?T3phbiDDh2HEn2xheWFu?=) Date: Mon, 18 May 2015 17:13:59 +0300 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: aah, well i didn't know about that! So I'll recheck it. Meanwhile I have another question :) Once everything seems ok, I'll create UNIX user accounts automatically with a script but currently I do not know whether I need some precreated jupyter/ipython related configuration folders or files in user's home directories. For example I just installed a Py2.7 environment with conda globally and did run "ipython kernelspec install-self" as root. Now when I login through jupyterhub, my regular user can benefit from both the default Python3 environment and the newly installed Python2 one. Do you think that at some point, I will need to modify/copy stuff into each user's home directory in order to add a feature or change a behaviour in the jupyter stack? I hope the question is clear :/ From steve at holdenweb.com Mon May 18 10:23:30 2015 From: steve at holdenweb.com (Steve Holden) Date: Mon, 18 May 2015 15:23:30 +0100 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: On May 18, 2015, at 2:57 PM, Ozan ?a?layan wrote: > Installing a startup notebook for telling people how to use stuff is > also a good idea. It sure is. I'm pretty sure I got it from Fernando Perez ? S -- Steve Holden steve at holdenweb.com / +1 571 484 6266 / +44 113 320 2335 / @holdenweb -------------- next part -------------- An HTML attachment was scrubbed... URL: From wstein at gmail.com Mon May 18 10:23:44 2015 From: wstein at gmail.com (William Stein) Date: Mon, 18 May 2015 07:23:44 -0700 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: On Mon, May 18, 2015 at 7:13 AM, Ozan ?a?layan wrote: > aah, well i didn't know about that! So I'll recheck it. > > Meanwhile I have another question :) > > Once everything seems ok, I'll create UNIX user accounts automatically > with a script but currently I do not know whether I need some > precreated jupyter/ipython related configuration folders or files in > user's home directories. For example I just installed a Py2.7 > environment with conda globally and did run "ipython kernelspec > install-self" as root. Now when I login through jupyterhub, my regular > user can benefit from both the default Python3 environment and the > newly installed Python2 one. Do you think that at some point, I will > need to modify/copy stuff into each user's home directory in order to > add a feature or change a behaviour in the jupyter stack? > > I hope the question is clear :/ You can alternatively create a directory "/usr/local/share/jupyter/" and it will apply to all Jupyter notebooks run by users, I think. For example, for SageMathCloud, I have the following: salvus at compute1-us:/usr$ ls -lht /usr/local/share/jupyter/kernels/ total 12K drwxr-xr-x 2 root root 4.0K May 7 11:40 ir drwxr-xr-x 2 root root 4.0K Apr 8 22:38 julia 0.3 drwxr-xr-x 2 root root 4.0K Apr 8 22:31 python3 The directories ir, julia 0.3, and python3 each enable additional backends... -- William (http://wstein.org) From ozancag at gmail.com Mon May 18 10:26:40 2015 From: ozancag at gmail.com (=?UTF-8?B?T3phbiDDh2HEn2xheWFu?=) Date: Mon, 18 May 2015 17:26:40 +0300 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: This was automatically created once I called ipython kernelspec install-self I think: # ls /usr/local/share/jupyter/kernels/ -lah total 16K drwxr-xr-x 4 root root 4.0K May 18 16:43 . drwxr-xr-x 4 root root 4.0K May 18 17:18 .. drwxr-xr-x 2 root root 4.0K May 15 18:31 bash drwxr-xr-x 2 root root 4.0K May 18 16:43 python2 From ozancag at gmail.com Mon May 18 10:42:47 2015 From: ozancag at gmail.com (=?UTF-8?B?T3phbiDDh2HEn2xheWFu?=) Date: Mon, 18 May 2015 17:42:47 +0300 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: n Mon, May 18, 2015 at 5:13 PM, Ozan ?a?layan wrote: > aah, well i didn't know about that! So I'll recheck it. > > Meanwhile I have another question :) > > Once everything seems ok, I'll create UNIX user accounts automatically > with a script but currently I do not know whether I need some > precreated jupyter/ipython related configuration folders or files in > user's home directories. For example I just installed a Py2.7 > environment with conda globally and did run "ipython kernelspec > install-self" as root. Now when I login through jupyterhub, my regular > user can benefit from both the default Python3 environment and the > newly installed Python2 one. Do you think that at some point, I will > need to modify/copy stuff into each user's home directory in order to > add a feature or change a behaviour in the jupyter stack? > > I hope the question is clear :/ To clarify now, I just installed and activated nbgrader as root but apparently I should do this for each user on the system who would like to use nbgrader as the activation happens inside ~/.ipython. That was a case for the question above I think. Or maybe it is possible to create a system-wide ipython profile which will get inherited by regular users. I don't know, I'm confused :) From bussonniermatthias at gmail.com Mon May 18 12:02:56 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Mon, 18 May 2015 09:02:56 -0700 Subject: [IPython-dev] Best practice of deployment for university courses In-Reply-To: References: Message-ID: Hum, I'm not sure about nbgrader either. But on the other hand you 1) probably don't want all user to use nbgrader. 2) need to mess with each nbgrader-admin-user permissions if you want them to be able to distribute notebooks in students homes. So I'm not 100% sure a systemwide install/configration of nbgrader is wise or doable. On Mon, May 18, 2015 at 7:42 AM, Ozan ?a?layan wrote: > n Mon, May 18, 2015 at 5:13 PM, Ozan ?a?layan wrote: >> aah, well i didn't know about that! So I'll recheck it. >> >> Meanwhile I have another question :) >> >> Once everything seems ok, I'll create UNIX user accounts automatically >> with a script but currently I do not know whether I need some >> precreated jupyter/ipython related configuration folders or files in >> user's home directories. For example I just installed a Py2.7 >> environment with conda globally and did run "ipython kernelspec >> install-self" as root. Now when I login through jupyterhub, my regular >> user can benefit from both the default Python3 environment and the >> newly installed Python2 one. Do you think that at some point, I will >> need to modify/copy stuff into each user's home directory in order to >> add a feature or change a behaviour in the jupyter stack? >> >> I hope the question is clear :/ > > To clarify now, > > I just installed and activated nbgrader as root but apparently I > should do this for each user on the system who would like to use > nbgrader as the activation happens inside ~/.ipython. That was a case > for the question above I think. Or maybe it is possible to create a > system-wide ipython profile which will get inherited by regular users. > I don't know, I'm confused :) > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From ellisonbg at gmail.com Mon May 18 13:13:19 2015 From: ellisonbg at gmail.com (Brian Granger) Date: Mon, 18 May 2015 10:13:19 -0700 Subject: [IPython-dev] [jupyter] Re: Best practice of deployment for university courses In-Reply-To: References: Message-ID: Actually I think that nbgrader would be a fantastic solution for this. I have been using it this quarter to distribute/collect content to students and it is working great - even if you don't use the rest of it. The setup required is super minimal as well. I have to run now, but will post more details on this later. Cheers, Brian On Mon, May 18, 2015 at 9:02 AM, Matthias Bussonnier < bussonniermatthias at gmail.com> wrote: > Hum, I'm not sure about nbgrader either. But on the other hand you > > 1) probably don't want all user to use nbgrader. > 2) need to mess with each nbgrader-admin-user permissions if you want > them to be able to distribute notebooks in students homes. > > So I'm not 100% sure a systemwide install/configration of nbgrader is > wise or doable. > > On Mon, May 18, 2015 at 7:42 AM, Ozan ?a?layan wrote: > > n Mon, May 18, 2015 at 5:13 PM, Ozan ?a?layan wrote: > >> aah, well i didn't know about that! So I'll recheck it. > >> > >> Meanwhile I have another question :) > >> > >> Once everything seems ok, I'll create UNIX user accounts automatically > >> with a script but currently I do not know whether I need some > >> precreated jupyter/ipython related configuration folders or files in > >> user's home directories. For example I just installed a Py2.7 > >> environment with conda globally and did run "ipython kernelspec > >> install-self" as root. Now when I login through jupyterhub, my regular > >> user can benefit from both the default Python3 environment and the > >> newly installed Python2 one. Do you think that at some point, I will > >> need to modify/copy stuff into each user's home directory in order to > >> add a feature or change a behaviour in the jupyter stack? > >> > >> I hope the question is clear :/ > > > > To clarify now, > > > > I just installed and activated nbgrader as root but apparently I > > should do this for each user on the system who would like to use > > nbgrader as the activation happens inside ~/.ipython. That was a case > > for the question above I think. Or maybe it is possible to create a > > system-wide ipython profile which will get inherited by regular users. > > I don't know, I'm confused :) > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -- > You received this message because you are subscribed to the Google Groups > "Project Jupyter" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to jupyter+unsubscribe at googlegroups.com. > To post to this group, send email to jupyter at googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/jupyter/CANJQusUcfzBkQXNn2TmFU5ADHhwN1exb0uDpzSBvhn4UHdJEtQ%40mail.gmail.com > . > For more options, visit https://groups.google.com/d/optout. > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From tabor at broadinstitute.org Tue May 19 16:30:29 2015 From: tabor at broadinstitute.org (Thorin Tabor) Date: Tue, 19 May 2015 16:30:29 -0400 Subject: [IPython-dev] Best way to package extension JS/CSS In-Reply-To: References: Message-ID: <555B9D65.1030205@broadinstitute.org> Hello, I have a Jupyter extension that I've written that includes several magics and a handful of custom widgets. These widgets have a sizable amount of JavaScript and some CSS that they depend on. Currently I have the code working with all the necessary JS and CSS in custom.js and custom.css, respectively. However, I want to be able to distribute my extension for other people to install in such a way that it plays nicely with other extensions, and without them having to manually merge my code into their custom.* files. What is the recommended way to do this? Thorin From nick.bollweg at gmail.com Tue May 19 16:46:23 2015 From: nick.bollweg at gmail.com (Nicholas Bollweg) Date: Tue, 19 May 2015 20:46:23 +0000 Subject: [IPython-dev] Best way to package extension JS/CSS In-Reply-To: <555B9D65.1030205@broadinstitute.org> References: <555B9D65.1030205@broadinstitute.org> Message-ID: Jupyter-pip is your best bet right now. It helps you work effectively with the whole nbextensions thing. Basically, you build a setup.py (and MANIFEST.in, etc), add the jupyter-pip magic, and then you go. Here's an example from bitjet: https://github.com/rgbkrk/bitjet/blob/master/setup.py Since you have more than one file, I recommend building out your repo like: - setup.py - yourmodule/ - __init__.py (and whatever else) - static/ - yourmodule/ - yourmodule.js (or whatever) - yourmodule.css then, in the setup.py, you can can say cmdclass(path="yourmodule/static/yourmodule") and it will copy the whole directory. Don't forget the MANIFEST.in! On Tue, May 19, 2015 at 4:30 PM Thorin Tabor wrote: > Hello, > > I have a Jupyter extension that I've written that includes several > magics and a handful of custom widgets. These widgets have a sizable > amount of JavaScript and some CSS that they depend on. > > Currently I have the code working with all the necessary JS and CSS in > custom.js and custom.css, respectively. However, I want to be able to > distribute my extension for other people to install in such a way that > it plays nicely with other extensions, and without them having to > manually merge my code into their custom.* files. > > What is the recommended way to do this? > > Thorin > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ellisonbg at gmail.com Tue May 19 17:59:45 2015 From: ellisonbg at gmail.com (Brian Granger) Date: Tue, 19 May 2015 14:59:45 -0700 Subject: [IPython-dev] [jupyter] Re: Best practice of deployment for university courses In-Reply-To: References: Message-ID: Thanks Jess for filling in the details of this. The most important thing is that this approach works really well, even if you are not using nbgrader to do the actual grading. Also, if you simply make sure the default exchange directory is created on the system ("/srv/nbgrader/exchange"), then you and the students won't have to pass that as an argument to the commands. Cheers, Brian On Tue, May 19, 2015 at 2:54 PM, Jessica B. Hamrick < jessica.b.hamrick at gmail.com> wrote: > Hi Ozan, > > You probably don't want to activate nbgrader for all students -- > activating it just gives access to the Create Assignment toolbar (which > really is better if only instructors have). As long as nbgrader is > importable by anyone in the system, though, then that should be what you > want in order to use nbgrader for releasing and collecting assignments. > This isn't really documented well yet, but essentially, as an instructor, > you can release assignments like this (this is what Brian was referring to > in his email): > > # looks in the release/ directory for an assignment called "Problem Set 1" > and copies it to the exchange > nbgrader release > --ReleaseApp.exchange_directory=/opt/notebooks --course=MATH101 "Problem > Set 1" > > Then students can do: > > # copy the assignment locally to a directory called "Problem Set 1" > nbgrader fetch MATH101 "Problem Set 1" > --FetchApp.exchange_directory=/opt/notebooks > > # submit completed version of the assignment back to the exchange > nbgrader submit "Problem Set 1" MATH101 > --SubmitApp.exchange_directory=/opt/notebooks > > And then the instructor can download the assignments like this: > > # will copy submissions to the submitted/ directory > nbgrader collect > --CollectApp.exchange_directory=/opt/notebooks --course=MATH101 "Problem > Set 1" > > So it's pretty similar to the setup you described in your initial email. > Hopefully I'll have some time soon to document this a bit better; in the > meantime, please feel free to ask me any questions. > > Cheers, > Jess > > On Mon, May 18, 2015 at 10:13 AM Brian Granger > wrote: > >> Actually I think that nbgrader would be a fantastic solution for this. I >> have been using it this quarter to distribute/collect content to students >> and it is working great - even if you don't use the rest of it. The setup >> required is super minimal as well. I have to run now, but will post more >> details on this later. >> >> Cheers, >> >> Brian >> >> >> On Mon, May 18, 2015 at 9:02 AM, Matthias Bussonnier < >> bussonniermatthias at gmail.com> wrote: >> >>> Hum, I'm not sure about nbgrader either. But on the other hand you >>> >>> 1) probably don't want all user to use nbgrader. >>> 2) need to mess with each nbgrader-admin-user permissions if you want >>> them to be able to distribute notebooks in students homes. >>> >>> So I'm not 100% sure a systemwide install/configration of nbgrader is >>> wise or doable. >>> >>> On Mon, May 18, 2015 at 7:42 AM, Ozan ?a?layan >>> wrote: >>> > n Mon, May 18, 2015 at 5:13 PM, Ozan ?a?layan >>> wrote: >>> >> aah, well i didn't know about that! So I'll recheck it. >>> >> >>> >> Meanwhile I have another question :) >>> >> >>> >> Once everything seems ok, I'll create UNIX user accounts automatically >>> >> with a script but currently I do not know whether I need some >>> >> precreated jupyter/ipython related configuration folders or files in >>> >> user's home directories. For example I just installed a Py2.7 >>> >> environment with conda globally and did run "ipython kernelspec >>> >> install-self" as root. Now when I login through jupyterhub, my regular >>> >> user can benefit from both the default Python3 environment and the >>> >> newly installed Python2 one. Do you think that at some point, I will >>> >> need to modify/copy stuff into each user's home directory in order to >>> >> add a feature or change a behaviour in the jupyter stack? >>> >> >>> >> I hope the question is clear :/ >>> > >>> > To clarify now, >>> > >>> > I just installed and activated nbgrader as root but apparently I >>> > should do this for each user on the system who would like to use >>> > nbgrader as the activation happens inside ~/.ipython. That was a case >>> > for the question above I think. Or maybe it is possible to create a >>> > system-wide ipython profile which will get inherited by regular users. >>> > I don't know, I'm confused :) >>> > _______________________________________________ >>> > IPython-dev mailing list >>> > IPython-dev at scipy.org >>> > http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "Project Jupyter" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to jupyter+unsubscribe at googlegroups.com. >>> To post to this group, send email to jupyter at googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/jupyter/CANJQusUcfzBkQXNn2TmFU5ADHhwN1exb0uDpzSBvhn4UHdJEtQ%40mail.gmail.com >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> >> >> -- >> Brian E. Granger >> Cal Poly State University, San Luis Obispo >> @ellisonbg on Twitter and GitHub >> bgranger at calpoly.edu and ellisonbg at gmail.com >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Project Jupyter" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to jupyter+unsubscribe at googlegroups.com. >> To post to this group, send email to jupyter at googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/jupyter/CAH4pYpRgLz0qdKMzwrU8PgdZWzvLKVjF08eX8k9mcYxh0%2B4yZw%40mail.gmail.com >> >> . >> For more options, visit https://groups.google.com/d/optout. >> > -- > You received this message because you are subscribed to the Google Groups > "Project Jupyter" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to jupyter+unsubscribe at googlegroups.com. > To post to this group, send email to jupyter at googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/jupyter/CALUXcBzNVq_Q5h3O0346V3m7Q_dAHqt2sYL-xzpCqU-f_qRM_g%40mail.gmail.com > > . > > For more options, visit https://groups.google.com/d/optout. > -- Brian E. Granger Cal Poly State University, San Luis Obispo @ellisonbg on Twitter and GitHub bgranger at calpoly.edu and ellisonbg at gmail.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Tue May 19 19:12:28 2015 From: fperez.net at gmail.com (Fernando Perez) Date: Tue, 19 May 2015 16:12:28 -0700 Subject: [IPython-dev] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: <20150519214724.GL14001@mistral> References: <20150519214724.GL14001@mistral> Message-ID: Hi all, congrats to the OpenDreamKit team, who did an amazing job with an insanely competitive grant application. We're delighted to be able to collaborate with them, and look forward to having our EU-based operation grow :) Cheers, f ---------- Forwarded message ---------- From: Nicolas M. Thiery Date: Tue, May 19, 2015 at 2:47 PM Subject: [sage-devel] European Horizon 2020 project OpenDreamKit accepted To: sage-devel at googlegroups.com, sage-combinat-devel at googlegroups.com Dear Sage developers, We are delighted to announce that the Horizon 2020 research proposal OpenDreamKit was accepted by the European commission: opendreamkit.org Starting next Fall and for four years, this project will provide substantial funding to the open source computational mathematics ecosystem, and in particular popular tools such as LinBox, MPIR, SageMath, GAP, Pari/GP, LMFDB, Singular, and the IPython/Jupyter interactive computing environment. The total budget is about 7.6 million euros. The largest portion of that will be devoted to employing an average of 11 researchers and developers working full time on the project in Europe. We will announce job openings in the coming weeks; stay tuned! Additionally, the participants will contribute the equivalent of six other people working full time. Altogether the project involves about 50 people spread over 15 sites in Europe. This is a formidable recognition of the strength and maturity of this ecosystem, of the power of open source development models, and of the amazing hard work of many communities over the last decades. The writing of the proposal itself was open and collaborative. It grew out of a reflection on the long term needs of the community. It benefited considerably from the feedback of many; we would like to thank all those who helped shape this proposal and make it happen. It is our hope that this financial support will help push forward critical technical tasks. We tried hard in the proposal to make a worthwhile selection of such tasks, within some constraints imposed by the specific call. We are now legally committed to treat those tasks in priority. This kind of long term prediction work is tough: one of them has actually already been completed by the community in the mean time! This is great; whenever this will happen we will be able reprioritize the resources to whatever emerging needs that will arise. Ultimately, this project belongs to the community. Get involved! Cheers, Nicolas -- Nicolas M. Thi?ry "Isil" http://Nicolas.Thiery.name/ -- You received this message because you are subscribed to the Google Groups "sage-devel" group. To unsubscribe from this group and stop receiving emails from it, send an email to sage-devel+unsubscribe at googlegroups.com. To post to this group, send email to sage-devel at googlegroups.com. Visit this group at http://groups.google.com/group/sage-devel. For more options, visit https://groups.google.com/d/optout. -- Fernando Perez (@fperez_org; http://fperez.org) fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) fernando.perez-at-berkeley: contact me here for any direct mail -------------- next part -------------- An HTML attachment was scrubbed... URL: From rgbkrk at gmail.com Tue May 19 19:36:29 2015 From: rgbkrk at gmail.com (Kyle Kelley) Date: Tue, 19 May 2015 18:36:29 -0500 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> Message-ID: That is so exciting! Congrats Nicolas and team! Might we ask what the IPython/Jupyter bits were? On Tue, May 19, 2015 at 6:12 PM, Fernando Perez wrote: > Hi all, > > congrats to the OpenDreamKit team, who did an amazing job with an insanely > competitive grant application. We're delighted to be able to collaborate > with them, and look forward to having our EU-based operation grow :) > > Cheers, > > f > > > ---------- Forwarded message ---------- > From: Nicolas M. Thiery > Date: Tue, May 19, 2015 at 2:47 PM > Subject: [sage-devel] European Horizon 2020 project OpenDreamKit accepted > To: sage-devel at googlegroups.com, sage-combinat-devel at googlegroups.com > > > Dear Sage developers, > > We are delighted to announce that the Horizon 2020 research proposal > OpenDreamKit was accepted by the European commission: > > opendreamkit.org > > Starting next Fall and for four years, this project will provide > substantial funding to the open source computational mathematics > ecosystem, and in particular popular tools such as LinBox, MPIR, > SageMath, GAP, Pari/GP, LMFDB, Singular, and the IPython/Jupyter > interactive computing environment. > > The total budget is about 7.6 million euros. The largest portion of > that will be devoted to employing an average of 11 researchers and > developers working full time on the project in Europe. We will > announce job openings in the coming weeks; stay tuned! > > Additionally, the participants will contribute the equivalent of six > other people working full time. Altogether the project involves about > 50 people spread over 15 sites in Europe. > > This is a formidable recognition of the strength and maturity of this > ecosystem, of the power of open source development models, and of the > amazing hard work of many communities over the last decades. > > The writing of the proposal itself was open and collaborative. It grew > out of a reflection on the long term needs of the community. It > benefited considerably from the feedback of many; we would like to > thank all those who helped shape this proposal and make it happen. > > It is our hope that this financial support will help push forward > critical technical tasks. We tried hard in the proposal to make a > worthwhile selection of such tasks, within some constraints imposed by > the specific call. We are now legally committed to treat those tasks > in priority. This kind of long term prediction work is tough: one of > them has actually already been completed by the community in the mean > time! This is great; whenever this will happen we will be able > reprioritize the resources to whatever emerging needs that will arise. > > Ultimately, this project belongs to the community. Get involved! > > Cheers, > Nicolas > -- > Nicolas M. Thi?ry "Isil" > http://Nicolas.Thiery.name/ > > -- > You received this message because you are subscribed to the Google Groups > "sage-devel" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to sage-devel+unsubscribe at googlegroups.com. > To post to this group, send email to sage-devel at googlegroups.com. > Visit this group at http://groups.google.com/group/sage-devel. > For more options, visit https://groups.google.com/d/optout. > > > > -- > Fernando Perez (@fperez_org; http://fperez.org) > fperez.net-at-gmail: mailing lists only (I ignore this when swamped!) > fernando.perez-at-berkeley: contact me here for any direct mail > > -- > You received this message because you are subscribed to the Google Groups > "Project Jupyter" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to jupyter+unsubscribe at googlegroups.com. > To post to this group, send email to jupyter at googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/jupyter/CAHAreOqGkVpMm%2Buapmwq3-cAZEMPUVem68wDEh6zvwYz4WTCUA%40mail.gmail.com > > . > For more options, visit https://groups.google.com/d/optout. > -- Kyle Kelley (@rgbkrk ; lambdaops.com, developer.rackspace.com) -------------- next part -------------- An HTML attachment was scrubbed... URL: From fperez.net at gmail.com Tue May 19 19:46:29 2015 From: fperez.net at gmail.com (Fernando Perez) Date: Tue, 19 May 2015 16:46:29 -0700 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> Message-ID: On Tue, May 19, 2015 at 4:36 PM, Kyle Kelley wrote: > That is so exciting! Congrats Nicolas and team! > > Might we ask what the IPython/Jupyter bits were? > There are teams at Simula (led by Hans Petter Langtangen, where Min will be in the future), Southampton (Hans Fangohr, where Thomas will be) and Sheffield (Neil Lawrence) who will all participate. If you want to read the full proposal, it's all on github: https://github.com/sagemath/grant-europe/ they also wrote a nice post about the process (which I witnessed, and I have to take my hat off to Nicholas for an incredible leadership in producing a very coherent document under crazy constraints, something that is really, really hard): http://inverseprobability.com/2015/01/14/open-collaborative-grant-writing/ We really look forward to the opportunities this will open up on the EU side, and again, congrats to Nicholas and the entire ODK team. Now the real work starts :) Cheers f -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Tue May 19 19:51:21 2015 From: takowl at gmail.com (Thomas Kluyver) Date: Tue, 19 May 2015 16:51:21 -0700 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> Message-ID: On 19 May 2015 at 16:36, Kyle Kelley wrote: > That is so exciting! Congrats Nicolas and team! > > Might we ask what the IPython/Jupyter bits were? > There's a user interfaces 'work package', which includes: - Full convergence of Jupyter and Sage notebooks - Collaboration with notebooks (both version control improvements and support for Matthias' live collaboration work - Reproducible notebooks with testing of output - Documentation and introspection for dynamically defined objects - Structured semantic documents, possibly building on notebooks - 3D visualisations in the notebook - A case study building a virtual research environment for the micromagnetic field, based on Jupyter, along with notebook resources for this, and a tmpnb instance for people to play with it. This is just a summary, for the details, see page 44 and onwards in the PDF available on opendreamkit.org. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From marcinofulus at gmail.com Wed May 20 04:10:11 2015 From: marcinofulus at gmail.com (Marcin Kostur) Date: Wed, 20 May 2015 10:10:11 +0200 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> Message-ID: Dear ipython-developers, Since I will have a small contribution in 3d visualization in this grant (T4.9 in the grant proposal - see repo;-), I would like to ask if there exists any ongoing effort in this topic? Our contribution will be focused in visualization of computational fluid dynamics fields. Certainly it can be fully distinct project from typical "plot3d" routines, but the optimal solution would of course be to have as much of the architecture in common as possible. Some very preliminary draft of our visualization architecture is at: https://github.com/mjanusz/sailfish/blob/master/doc/visualizer_design.md and we think that the idea of some kind of generalized proxy server would do the job for both large datasets as well as for surface plotting of f(x,y). The other opportunity is that I have some funding for subcontracting from another source which have to be spend this year. It has to go through our University and a public tender procedure, and I plan to write specs for some pre0.1 version of our concepts as soon as possible. In this action I would deeply appreciate you expertise and help. the best Marcin Kostur -- Department of Theoretical Physics Institute of Physics University of Silesia 40-007 Katowice, Poland tel. +48 32 3497 612 http://zft.us.edu.pl/kostur http://icse.us.edu.pl http://twing.us.edu.pl --------------------------- Linux: because rebooting is for adding new hardware. -------------- next part -------------- An HTML attachment was scrubbed... URL: From cyrille.rossant at gmail.com Wed May 20 04:23:25 2015 From: cyrille.rossant at gmail.com (Cyrille Rossant) Date: Wed, 20 May 2015 10:23:25 +0200 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> Message-ID: Hi Marcin VisPy (http://vispy.org/) has a distributed architecture very close to what you describe. You can write your visualization in pure Python/GLSL (the GPU language in OpenGL) and see it either on the desktop or in the browser with WebGL, in real time. It can scale well to huge datasets, since you can stream only a subset of the data in real-time. It works in the Jupyter notebook out of the box. You could also export your Python visualization to a standalone HTML/JS interactive document. The architecture is relatively general and modular. It's still a bit experimental, and there is not much documentation, but it would be great if we could work together on a common system. Let me know if you want more details about the architecture. Cyrille 2015-05-20 10:10 GMT+02:00 Marcin Kostur : > Dear ipython-developers, > > Since I will have a small contribution in 3d visualization in this grant > (T4.9 in the grant proposal - see repo;-), > I would like to ask if there exists any ongoing effort in this topic? > > Our contribution will be focused in visualization of computational fluid > dynamics fields. > Certainly it can be fully distinct project from typical "plot3d" routines, > but the optimal solution would of course be to have as much of the > architecture in common as possible. > > Some very preliminary draft of our visualization architecture is at: > https://github.com/mjanusz/sailfish/blob/master/doc/visualizer_design.md and > we think that the idea of some kind of generalized proxy server would do the > job for both large datasets as well as for surface plotting of f(x,y). > > The other opportunity is that I have some funding for subcontracting from > another source which have to be spend this year. It has to go through our > University and a public tender procedure, and I plan to write specs for some > pre0.1 version of our concepts as soon as possible. In this action I would > deeply appreciate you expertise and help. > > the best > > Marcin Kostur > > > -- > Department of Theoretical Physics > Institute of Physics > University of Silesia > 40-007 Katowice, Poland > tel. +48 32 3497 612 > http://zft.us.edu.pl/kostur > http://icse.us.edu.pl > http://twing.us.edu.pl > --------------------------- > Linux: because rebooting is for adding new hardware. > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From Nicolas.Rougier at inria.fr Wed May 20 04:23:43 2015 From: Nicolas.Rougier at inria.fr (Nicolas P. Rougier) Date: Wed, 20 May 2015 10:23:43 +0200 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> Message-ID: <40009D57-3649-4BD5-A73A-6178ACD4F6A2@inria.fr> Hi Marcin, You might want to have a look at vispy (vispy.org) which has a notebook backend (but still WIP). Cyrille Rossant is the main developper on this part. Concerning surface rendering, you can find a lot of example on http://glumpy.github.io/gallery.html. A lot of computation (elevation, interpolation, gridding, coloring, texturing, lighting) can be done at the browser level, minimizing data transfer. Nicolas > On 20 May 2015, at 10:10, Marcin Kostur wrote: > > Dear ipython-developers, > > Since I will have a small contribution in 3d visualization in this grant (T4.9 in the grant proposal - see repo;-), > I would like to ask if there exists any ongoing effort in this topic? > > Our contribution will be focused in visualization of computational fluid dynamics fields. > Certainly it can be fully distinct project from typical "plot3d" routines, but the optimal solution would of course be to have as much of the architecture in common as possible. > > Some very preliminary draft of our visualization architecture is at: https://github.com/mjanusz/sailfish/blob/master/doc/visualizer_design.md and we think that the idea of some kind of generalized proxy server would do the job for both large datasets as well as for surface plotting of f(x,y). > > The other opportunity is that I have some funding for subcontracting from another source which have to be spend this year. It has to go through our University and a public tender procedure, and I plan to write specs for some pre0.1 version of our concepts as soon as possible. In this action I would deeply appreciate you expertise and help. > > the best > > Marcin Kostur > > > -- > Department of Theoretical Physics > Institute of Physics > University of Silesia > 40-007 Katowice, Poland > tel. +48 32 3497 612 > http://zft.us.edu.pl/kostur > http://icse.us.edu.pl > http://twing.us.edu.pl > --------------------------- > Linux: because rebooting is for adding new hardware. > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From sylvain.corlay at gmail.com Wed May 20 05:01:03 2015 From: sylvain.corlay at gmail.com (Sylvain Corlay) Date: Wed, 20 May 2015 05:01:03 -0400 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: <40009D57-3649-4BD5-A73A-6178ACD4F6A2@inria.fr> References: <20150519214724.GL14001@mistral> <40009D57-3649-4BD5-A73A-6178ACD4F6A2@inria.fr> Message-ID: Hi Marcin, You can also have a look at Pythreejs https://github.com/jasongrout/pythreejs by Jason Grout, which is a wrapper to threejs based on IPython widgets. Best, Sylvain On May 20, 2015 10:23 AM, "Nicolas P. Rougier" wrote: > > Hi Marcin, > > You might want to have a look at vispy (vispy.org) which has a notebook > backend (but still WIP). > Cyrille Rossant is the main developper on this part. > > Concerning surface rendering, you can find a lot of example on > http://glumpy.github.io/gallery.html. > A lot of computation (elevation, interpolation, gridding, coloring, > texturing, lighting) can be done at the browser level, minimizing data > transfer. > > > Nicolas > > > > On 20 May 2015, at 10:10, Marcin Kostur wrote: > > > > Dear ipython-developers, > > > > Since I will have a small contribution in 3d visualization in this grant > (T4.9 in the grant proposal - see repo;-), > > I would like to ask if there exists any ongoing effort in this topic? > > > > Our contribution will be focused in visualization of computational fluid > dynamics fields. > > Certainly it can be fully distinct project from typical "plot3d" > routines, but the optimal solution would of course be to have as much of > the architecture in common as possible. > > > > Some very preliminary draft of our visualization architecture is at: > https://github.com/mjanusz/sailfish/blob/master/doc/visualizer_design.md > and we think that the idea of some kind of generalized proxy server would > do the job for both large datasets as well as for surface plotting of > f(x,y). > > > > The other opportunity is that I have some funding for subcontracting > from another source which have to be spend this year. It has to go through > our University and a public tender procedure, and I plan to write specs for > some pre0.1 version of our concepts as soon as possible. In this action I > would deeply appreciate you expertise and help. > > > > the best > > > > Marcin Kostur > > > > > > -- > > Department of Theoretical Physics > > Institute of Physics > > University of Silesia > > 40-007 Katowice, Poland > > tel. +48 32 3497 612 > > http://zft.us.edu.pl/kostur > > http://icse.us.edu.pl > > http://twing.us.edu.pl > > --------------------------- > > Linux: because rebooting is for adding new hardware. > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From DavidAnthonyPowell+python at gmail.com Wed May 20 05:15:05 2015 From: DavidAnthonyPowell+python at gmail.com (David Powell) Date: Wed, 20 May 2015 19:15:05 +1000 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> <40009D57-3649-4BD5-A73A-6178ACD4F6A2@inria.fr> Message-ID: Hello Marcin, While it's very rudimentary, and may not count as an ongoing effort, I've had some success in producing three.js output from an IPython notebook (not based on pythreejs). See previous discussion http://mail.scipy.org/pipermail/ipython-dev/2015-January/015731.html My application is electromagnetism, so I imagine there is some overlap with the requirements of CFD plots. I'm very interested in this proposal and would love to help out somehow (time permitting!). regards David On 20 May 2015 at 19:01, Sylvain Corlay wrote: > Hi Marcin, > > You can also have a look at Pythreejs > > https://github.com/jasongrout/pythreejs > > by Jason Grout, > > which is a wrapper to threejs based on IPython widgets. > > Best, > Sylvain > On May 20, 2015 10:23 AM, "Nicolas P. Rougier" > wrote: > >> >> Hi Marcin, >> >> You might want to have a look at vispy (vispy.org) which has a notebook >> backend (but still WIP). >> Cyrille Rossant is the main developper on this part. >> >> Concerning surface rendering, you can find a lot of example on >> http://glumpy.github.io/gallery.html. >> A lot of computation (elevation, interpolation, gridding, coloring, >> texturing, lighting) can be done at the browser level, minimizing data >> transfer. >> >> >> Nicolas >> >> >> > On 20 May 2015, at 10:10, Marcin Kostur wrote: >> > >> > Dear ipython-developers, >> > >> > Since I will have a small contribution in 3d visualization in this >> grant (T4.9 in the grant proposal - see repo;-), >> > I would like to ask if there exists any ongoing effort in this topic? >> > >> > Our contribution will be focused in visualization of computational >> fluid dynamics fields. >> > Certainly it can be fully distinct project from typical "plot3d" >> routines, but the optimal solution would of course be to have as much of >> the architecture in common as possible. >> > >> > Some very preliminary draft of our visualization architecture is at: >> https://github.com/mjanusz/sailfish/blob/master/doc/visualizer_design.md >> and we think that the idea of some kind of generalized proxy server would >> do the job for both large datasets as well as for surface plotting of >> f(x,y). >> > >> > The other opportunity is that I have some funding for subcontracting >> from another source which have to be spend this year. It has to go through >> our University and a public tender procedure, and I plan to write specs for >> some pre0.1 version of our concepts as soon as possible. In this action I >> would deeply appreciate you expertise and help. >> > >> > the best >> > >> > Marcin Kostur >> > >> > >> > -- >> > Department of Theoretical Physics >> > Institute of Physics >> > University of Silesia >> > 40-007 Katowice, Poland >> > tel. +48 32 3497 612 >> > http://zft.us.edu.pl/kostur >> > http://icse.us.edu.pl >> > http://twing.us.edu.pl >> > --------------------------- >> > Linux: because rebooting is for adding new hardware. >> > _______________________________________________ >> > IPython-dev mailing list >> > IPython-dev at scipy.org >> > http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ozancag at gmail.com Wed May 20 05:21:35 2015 From: ozancag at gmail.com (=?UTF-8?B?T3phbiDDh2HEn2xheWFu?=) Date: Wed, 20 May 2015 12:21:35 +0300 Subject: [IPython-dev] [jupyter] Re: Best practice of deployment for university courses In-Reply-To: References: Message-ID: Many thanks for all of your wonderful answers :) From moorepants at gmail.com Wed May 20 15:09:41 2015 From: moorepants at gmail.com (Jason Moore) Date: Wed, 20 May 2015 12:09:41 -0700 Subject: [IPython-dev] [jupyter] Fwd: [sage-devel] European Horizon 2020 project OpenDreamKit accepted In-Reply-To: References: <20150519214724.GL14001@mistral> <40009D57-3649-4BD5-A73A-6178ACD4F6A2@inria.fr> Message-ID: We have 3D viz in the notebook for visualizing mulitbody systems here: https://github.com/pydy/pydy. We use threejs for it. We'll have this going at a tutorial at SciPy this year. Jason moorepants.info +01 530-601-9791 On Wed, May 20, 2015 at 2:15 AM, David Powell < DavidAnthonyPowell+python at gmail.com> wrote: > Hello Marcin, > > While it's very rudimentary, and may not count as an ongoing effort, I've > had some success in producing three.js output from an IPython notebook (not > based on pythreejs). See previous discussion > http://mail.scipy.org/pipermail/ipython-dev/2015-January/015731.html > > My application is electromagnetism, so I imagine there is some overlap > with the requirements of CFD plots. I'm very interested in this proposal > and would love to help out somehow (time permitting!). > > regards > David > > On 20 May 2015 at 19:01, Sylvain Corlay wrote: > >> Hi Marcin, >> >> You can also have a look at Pythreejs >> >> https://github.com/jasongrout/pythreejs >> >> by Jason Grout, >> >> which is a wrapper to threejs based on IPython widgets. >> >> Best, >> Sylvain >> On May 20, 2015 10:23 AM, "Nicolas P. Rougier" >> wrote: >> >>> >>> Hi Marcin, >>> >>> You might want to have a look at vispy (vispy.org) which has a notebook >>> backend (but still WIP). >>> Cyrille Rossant is the main developper on this part. >>> >>> Concerning surface rendering, you can find a lot of example on >>> http://glumpy.github.io/gallery.html. >>> A lot of computation (elevation, interpolation, gridding, coloring, >>> texturing, lighting) can be done at the browser level, minimizing data >>> transfer. >>> >>> >>> Nicolas >>> >>> >>> > On 20 May 2015, at 10:10, Marcin Kostur >>> wrote: >>> > >>> > Dear ipython-developers, >>> > >>> > Since I will have a small contribution in 3d visualization in this >>> grant (T4.9 in the grant proposal - see repo;-), >>> > I would like to ask if there exists any ongoing effort in this topic? >>> > >>> > Our contribution will be focused in visualization of computational >>> fluid dynamics fields. >>> > Certainly it can be fully distinct project from typical "plot3d" >>> routines, but the optimal solution would of course be to have as much of >>> the architecture in common as possible. >>> > >>> > Some very preliminary draft of our visualization architecture is at: >>> https://github.com/mjanusz/sailfish/blob/master/doc/visualizer_design.md >>> and we think that the idea of some kind of generalized proxy server would >>> do the job for both large datasets as well as for surface plotting of >>> f(x,y). >>> > >>> > The other opportunity is that I have some funding for subcontracting >>> from another source which have to be spend this year. It has to go through >>> our University and a public tender procedure, and I plan to write specs for >>> some pre0.1 version of our concepts as soon as possible. In this action I >>> would deeply appreciate you expertise and help. >>> > >>> > the best >>> > >>> > Marcin Kostur >>> > >>> > >>> > -- >>> > Department of Theoretical Physics >>> > Institute of Physics >>> > University of Silesia >>> > 40-007 Katowice, Poland >>> > tel. +48 32 3497 612 >>> > http://zft.us.edu.pl/kostur >>> > http://icse.us.edu.pl >>> > http://twing.us.edu.pl >>> > --------------------------- >>> > Linux: because rebooting is for adding new hardware. >>> > _______________________________________________ >>> > IPython-dev mailing list >>> > IPython-dev at scipy.org >>> > http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hemant_tgm at rediffmail.com Wed May 27 02:06:44 2015 From: hemant_tgm at rediffmail.com (Hemant Mehta) Date: 27 May 2015 06:06:44 -0000 Subject: [IPython-dev] =?utf-8?q?Help_on_IPython_functional_dependency_pro?= =?utf-8?q?gram?= Message-ID: <20150527060644.16039.qmail@f4mail-235-225.rediffmail.com> Hello all, I am working on IPython dependency, I am able to develop the example program for after and follow as they were discussed in ipython documents and some books. I am looking for help on getting some example program on functional dependency using all, success etc. Kindly help!!!! Thanks, Hemant -------------- next part -------------- An HTML attachment was scrubbed... URL: From hemant_tgm at rediffmail.com Wed May 27 02:11:45 2015 From: hemant_tgm at rediffmail.com (Hemant Mehta) Date: 27 May 2015 06:11:45 -0000 Subject: [IPython-dev] =?utf-8?q?Help_on_IPython_functional_dependency_pro?= =?utf-8?q?gram?= In-Reply-To: <20150527060644.16039.qmail@f4mail-235-225.rediffmail.com> Message-ID: <1432706904.S.10310.14026.f4-234-222.1432707105.10169@webmail.rediffmail.com> sorry for the typing mistake, I need help on getting sample program for graph dependency using all, success etc. I got examples for after/follow in IPython documents and in a book. Thanks, Hemant. On Wed, 27 May 2015 11:38:24 +0530 "Hemant Mehta" wrote >Hello all, > > I am working on IPython dependency, I am able to develop the example program for after and follow as they > were discussed in ipython documents and some books. > > I am looking for help on getting some example program on functional dependency using all, success etc. > Kindly help!!!! > > Thanks, > Hemant Get your own FREE website, FREE domain & FREE mobile app with Company email. Know More > _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev Thanks and Regards, Hemant Kumar Mehta, web : http://www.hemantmehta.com Citations: http://scholar.google.co.in/citations?user=JtpjiaQAAAAJ -------------- next part -------------- An HTML attachment was scrubbed... URL: From j.davidgriffiths at gmail.com Wed May 27 05:04:23 2015 From: j.davidgriffiths at gmail.com (John Griffiths) Date: Wed, 27 May 2015 19:04:23 +1000 Subject: [IPython-dev] switching between iframes with static widgets? Message-ID: I was wondering if it is possible to use static html widgets to switch between iframes, so as to create a sort of interactive image viewer? Emphasis is on static and iframe (or otherwise non-embedded); I want this to work off line (e.g. via nbviewer), and don't want to be creating huge notebooks with multiple embedded images. Example gist of what I have in mind here ; but this isn't doing the job. Would this be possible? Cheers -- Dr. John Griffiths Post-Doctoral Research Fellow Rotman Research Institute, Baycrest Toronto, Canada and Visiting Research Fellow School of Physics University of Sydney -------------- next part -------------- An HTML attachment was scrubbed... URL: From paad.ruslan.korniichuk at gmail.com Wed May 27 07:27:57 2015 From: paad.ruslan.korniichuk at gmail.com (Ruslan Korniichuk) Date: Wed, 27 May 2015 13:27:57 +0200 Subject: [IPython-dev] Preview: the rk -- remote jupyter kernel/kernels administration utility Message-ID: Hi all, We are working on writing the *rk administration utility*. The rk is available from *PyPI* and *GitHub*. *Quickstart* and docs are available on a home page of a project. The last release of the rk 0.2, *helps*: - *show list* of remote jupyter kernels from kernels dict, - *install* and *uninstall *remote jupyter kernel/kernels. The kernels are run on remote machines using the rkscript. In the rk 0.3 we hope to fix communication of the rkscript with Jupyter Notebook: interrupt, restart and reconnect. Version of *Jupyter Notebook* for tests: *3.1.0* *Home Page*: https://github.com/korniichuk/rk Platform: Linux License: Public Domain --- Best regards, Ruslan Korniichuk -------------- next part -------------- An HTML attachment was scrubbed... URL: From wes.turner at gmail.com Wed May 27 09:38:30 2015 From: wes.turner at gmail.com (Wes Turner) Date: Wed, 27 May 2015 08:38:30 -0500 Subject: [IPython-dev] switching between iframes with static widgets? In-Reply-To: References: Message-ID: On Wed, May 27, 2015 at 4:04 AM, John Griffiths wrote: > > I was wondering if it is possible to use static html widgets to switch > between iframes, so as to create a sort of interactive image viewer? > > Emphasis is on static and iframe (or otherwise non-embedded); > > I want this to work off line (e.g. via nbviewer), and don't want to be > creating huge notebooks with multiple embedded images. > So, I put together a rough POC for something similar without IPython a few weeks ago. Limitations: * X-Frame-Options headers [1] * "Load Unsafe Scripts" [1] https://github.com/westurner/browenv/blob/master/scripts/mtmprx/mtmprx_headers.py > Example gist of what I have in mind here > > ; but this isn't doing the job. > * https://github.com/westurner/brw * https://westurner.org/brw/ > > Would this be possible? > > > Cheers > > > -- > > Dr. John Griffiths > > Post-Doctoral Research Fellow > > Rotman Research Institute, Baycrest > > Toronto, Canada > > and > > Visiting Research Fellow > > School of Physics > > University of Sydney > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wes.turner at gmail.com Wed May 27 10:01:38 2015 From: wes.turner at gmail.com (Wes Turner) Date: Wed, 27 May 2015 09:01:38 -0500 Subject: [IPython-dev] switching between iframes with static widgets? In-Reply-To: References: Message-ID: IDT a browser extension would need to IFrames. * https://github.com/yeoman/generator-chrome-extension * https://github.com/dgil/generator-firefox-extension * https://github.com/lanceli/generator-safari-extension On Wed, May 27, 2015 at 8:38 AM, Wes Turner wrote: > > > On Wed, May 27, 2015 at 4:04 AM, John Griffiths < > j.davidgriffiths at gmail.com> wrote: > >> >> I was wondering if it is possible to use static html widgets to switch >> between iframes, so as to create a sort of interactive image viewer? >> >> Emphasis is on static and iframe (or otherwise non-embedded); >> > > >> I want this to work off line (e.g. via nbviewer), and don't want to be >> creating huge notebooks with multiple embedded images. >> > > So, I put together a rough POC for something similar without IPython a few > weeks ago. > > Limitations: > > * X-Frame-Options headers [1] > * "Load Unsafe Scripts" > > [1] > https://github.com/westurner/browenv/blob/master/scripts/mtmprx/mtmprx_headers.py > > > >> Example gist of what I have in mind here >> >> ; but this isn't doing the job. >> > > * https://github.com/westurner/brw > * https://westurner.org/brw/ > > >> >> Would this be possible? >> >> >> Cheers >> >> >> -- >> >> Dr. John Griffiths >> >> Post-Doctoral Research Fellow >> >> Rotman Research Institute, Baycrest >> >> Toronto, Canada >> >> and >> >> Visiting Research Fellow >> >> School of Physics >> >> University of Sydney >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Wed May 27 11:32:43 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Wed, 27 May 2015 08:32:43 -0700 Subject: [IPython-dev] Help on IPython functional dependency program In-Reply-To: <1432706904.S.10310.14026.f4-234-222.1432707105.10169@webmail.rediffmail.com> References: <1432706904.S.10310.14026.f4-234-222.1432707105.10169@webmail.rediffmail.com> Message-ID: > On May 26, 2015, at 23:11, Hemant Mehta wrote: > > sorry for the typing mistake, I need help on getting sample program for graph dependency using all, > success etc. > I got examples for after/follow in IPython documents and in a book. > Thanks, > Hemant. Hi, If you don?t tell us, which example, which book, what does not work, what error you get, what Python version you are using, what you tried, it?s hard to help you. ? M From hemant_tgm at rediffmail.com Wed May 27 13:13:58 2015 From: hemant_tgm at rediffmail.com (Hemant Mehta) Date: 27 May 2015 17:13:58 -0000 Subject: [IPython-dev] =?utf-8?q?Help_on_IPython_functional_dependency_pro?= =?utf-8?q?gram?= In-Reply-To: Message-ID: <1432742180.S.5500.21323.f4-235-166.1432746838.18688@webmail.rediffmail.com> Dear Matthias Bussonnier, Thanks a lot for your reply and sorry for unclear question. I got following example of After/follow dependency in IPython documentation Release 0.11, on page 127, it is working fine. In [14]: client.block=False In [15]: ar = lview.apply(f, args, kwargs) In [16]: ar2 = lview.apply(f2) In [17]: ar3 = lview.apply_with_flags(f3, after=[ar,ar2]) In [17]: ar4 = lview.apply_with_flags(f3, follow=[ar], timeout=2.5) I am facing the problem that I am unable to create a simple example to demonstrate any|all, success [default: True], failure [default [False]]. I need a simple example demonstrating that task a1 will be dependent on the completion of all/ any of the tasks (a2,a3, a4) may be success/failure. If possible kindly give me some example of all/any dependency. Thanks, Hemant. On Wed, 27 May 2015 21:26:20 +0530 Matthias Bussonnier wrote > > On May 26, 2015, at 23:11, Hemant Mehta wrote: > > sorry for the typing mistake, I need help on getting sample program for graph dependency using all, > success etc. > I got examples for after/follow in IPython documents and in a book. > Thanks, > Hemant. Hi, If you don?t tell us, which example, which book, what does not work, what error you get, what Python version you are using, what you tried, it?s hard to help you. ? M _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev -------------- next part -------------- An HTML attachment was scrubbed... URL: From wes.turner at gmail.com Wed May 27 13:17:12 2015 From: wes.turner at gmail.com (Wes Turner) Date: Wed, 27 May 2015 12:17:12 -0500 Subject: [IPython-dev] Help on IPython functional dependency program In-Reply-To: <1432742180.S.5500.21323.f4-235-166.1432746838.18688@webmail.rediffmail.com> References: <1432742180.S.5500.21323.f4-235-166.1432746838.18688@webmail.rediffmail.com> Message-ID: Are these the docs for this feature? * http://ipython.org/ipython-doc/dev/parallel/dag_dependencies.html * http://ipython.org/ipython-doc/dev/parallel/ On May 27, 2015 12:14 PM, "Hemant Mehta" wrote: > Dear Matthias Bussonnier, > > Thanks a lot for your reply and sorry for unclear question. > I got following example of After/follow dependency in IPython > documentation Release 0.11, on page 127, > it is working fine. > In [14]: client.block=False > In [15]: ar = lview.apply(f, args, kwargs) > In [16]: ar2 = lview.apply(f2) > In [17]: ar3 = lview.apply_with_flags(f3, after=[ar,ar2]) > In [17]: ar4 = lview.apply_with_flags(f3, follow=[ar], timeout=2.5) > > I am facing the problem that I am unable to create a simple example to > demonstrate any|all, success > [default: True], failure [default [False]]. > > I need a simple example demonstrating that task a1 will be dependent on > the completion of all/ any of > the tasks (a2,a3, a4) may be success/failure. > If possible kindly give me some example of all/any dependency. > Thanks, > Hemant. > > On Wed, 27 May 2015 21:26:20 +0530 Matthias Bussonnier wrote > > > > > On May 26, 2015, at 23:11, Hemant Mehta wrote: > > > > > > sorry for the typing mistake, I need help on getting sample program for > graph dependency using all, > > > success etc. > > > I got examples for after/follow in IPython documents and in a book. > > > Thanks, > > > Hemant. > > > > Hi, > > > > If you don?t tell us, which example, which book, what does not work, what > error you get, > > what Python version you are using, what you tried, it?s hard to help you. > > ? > > M > > > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > > Get your own *FREE* website, *FREE* domain & *FREE* mobile app with > Company email. > *Know More >* > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From wes.turner at gmail.com Wed May 27 13:18:34 2015 From: wes.turner at gmail.com (Wes Turner) Date: Wed, 27 May 2015 12:18:34 -0500 Subject: [IPython-dev] Help on IPython functional dependency program In-Reply-To: References: <1432742180.S.5500.21323.f4-235-166.1432746838.18688@webmail.rediffmail.com> Message-ID: It sounds like you're looking for something similar to celery "chords" https://celery.readthedocs.org/en/latest/userguide/canvas.html#chords On May 27, 2015 12:17 PM, "Wes Turner" wrote: > Are these the docs for this feature? > > * http://ipython.org/ipython-doc/dev/parallel/dag_dependencies.html > * http://ipython.org/ipython-doc/dev/parallel/ > On May 27, 2015 12:14 PM, "Hemant Mehta" > wrote: > >> Dear Matthias Bussonnier, >> >> Thanks a lot for your reply and sorry for unclear question. >> I got following example of After/follow dependency in IPython >> documentation Release 0.11, on page 127, >> it is working fine. >> In [14]: client.block=False >> In [15]: ar = lview.apply(f, args, kwargs) >> In [16]: ar2 = lview.apply(f2) >> In [17]: ar3 = lview.apply_with_flags(f3, after=[ar,ar2]) >> In [17]: ar4 = lview.apply_with_flags(f3, follow=[ar], timeout=2.5) >> >> I am facing the problem that I am unable to create a simple example to >> demonstrate any|all, success >> [default: True], failure [default [False]]. >> >> I need a simple example demonstrating that task a1 will be dependent on >> the completion of all/ any of >> the tasks (a2,a3, a4) may be success/failure. >> If possible kindly give me some example of all/any dependency. >> Thanks, >> Hemant. >> >> On Wed, 27 May 2015 21:26:20 +0530 Matthias Bussonnier wrote >> > >> >> > On May 26, 2015, at 23:11, Hemant Mehta wrote: >> >> > >> >> > sorry for the typing mistake, I need help on getting sample program for >> graph dependency using all, >> >> > success etc. >> >> > I got examples for after/follow in IPython documents and in a book. >> >> > Thanks, >> >> > Hemant. >> >> >> >> Hi, >> >> >> >> If you don?t tell us, which example, which book, what does not work, what >> error you get, >> >> what Python version you are using, what you tried, it?s hard to help you. >> >> ? >> >> M >> >> >> >> >> >> _______________________________________________ >> >> IPython-dev mailing list >> >> IPython-dev at scipy.org >> >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> >> >> >> Get your own *FREE* website, *FREE* domain & *FREE* mobile app with >> Company email. >> *Know More >* >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> >> -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Wed May 27 13:22:12 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Wed, 27 May 2015 10:22:12 -0700 Subject: [IPython-dev] Help on IPython functional dependency program In-Reply-To: <1432742180.S.5500.21323.f4-235-166.1432746838.18688@webmail.rediffmail.com> References: <1432742180.S.5500.21323.f4-235-166.1432746838.18688@webmail.rediffmail.com> Message-ID: <1D60DB4F-D043-42BA-8866-BE9790AFEB8E@gmail.com> > On May 27, 2015, at 10:13, Hemant Mehta wrote: > > Dear Matthias Bussonnier, > > Thanks a lot for your reply and sorry for unclear question. > I got following example of After/follow dependency in IPython documentation Release 0.11, on page 127, > it is working fine. IPython 0.11 was release in 2011, current stable of IPython is 3.1 (3.2 soon, and 4.0 is on its way) There have been 0.12.x, 0.13.x, 1.x and 2.x in the meantime. which are not supported anymore . Please update to more recent IPython and look at more recent docs. Thanks, ? Matthias From hemant_tgm at rediffmail.com Wed May 27 14:43:12 2015 From: hemant_tgm at rediffmail.com (Hemant Mehta) Date: 27 May 2015 18:43:12 -0000 Subject: [IPython-dev] =?utf-8?q?Help_on_IPython_functional_dependency_pro?= =?utf-8?q?gram?= In-Reply-To: <1D60DB4F-D043-42BA-8866-BE9790AFEB8E@gmail.com> Message-ID: <1432749202.S.5652.24347.f4-234-161.1432752192.3570@webmail.rediffmail.com> On Wed, 27 May 2015 23:23:22 +0530 Matthias Bussonnier wrote > > On May 27, 2015, at 10:13, Hemant Mehta wrote: > > Dear Matthias Bussonnier, > > Thanks a lot for your reply and sorry for unclear question. > I got following example of After/follow dependency in IPython documentation Release 0.11, on page 127, > it is working fine. IPython 0.11 was release in 2011, current stable of IPython is 3.1 (3.2 soon, and 4.0 is on its way) There have been 0.12.x, 0.13.x, 1.x and 2.x in the meantime. which are not supported anymore . Please update to more recent IPython and look at more recent docs. Just now I checked the latest documentation available from https://ipython.org/ipython-doc/dev/ https://ipython.org/ipython-doc/dev/parallel/parallel_task.html#dependencies. It is also not having any example of all/any, success and failure. I am just looking for a simple example code may (2-3 line) that demonstrates that one task is dependent on success/failure of any/ all of two or three specified tasks. Thanks, Hemant. Thanks, ? Matthias _______________________________________________ IPython-dev mailing list IPython-dev at scipy.org http://mail.scipy.org/mailman/listinfo/ipython-dev Thanks and Regards, Hemant Kumar Mehta, web : http://www.hemantmehta.com Citations: http://scholar.google.co.in/citations?user=JtpjiaQAAAAJ -------------- next part -------------- An HTML attachment was scrubbed... URL: From benjaminrk at gmail.com Wed May 27 16:34:43 2015 From: benjaminrk at gmail.com (MinRK) Date: Wed, 27 May 2015 13:34:43 -0700 Subject: [IPython-dev] Help on IPython functional dependency program In-Reply-To: <1432749202.S.5652.24347.f4-234-161.1432752192.3570@webmail.rediffmail.com> References: <1D60DB4F-D043-42BA-8866-BE9790AFEB8E@gmail.com> <1432749202.S.5652.24347.f4-234-161.1432752192.3570@webmail.rediffmail.com> Message-ID: Can you describe what you are trying to do? Here?s a demo of the various options for dependencies. -MinRK ? On Wed, May 27, 2015 at 11:43 AM, Hemant Mehta wrote: > > > On Wed, 27 May 2015 23:23:22 +0530 Matthias Bussonnier wrote > > > > > On May 27, 2015, at 10:13, Hemant Mehta wrote: > > > > > > Dear Matthias Bussonnier, > > > > > > Thanks a lot for your reply and sorry for unclear question. > > > I got following example of After/follow dependency in IPython > documentation Release 0.11, on page > 127, > > > it is working fine. > > > > IPython 0.11 was release in 2011, current stable of IPython is 3.1 (3.2 > soon, and 4.0 is on its way) > > There have been 0.12.x, 0.13.x, 1.x and 2.x in the meantime. which are not > supported anymore . > > Please update to more recent IPython and look at more recent docs. > > > > Just now I checked the latest documentation available from > https://ipython.org/ipython-doc/dev/ > > > https://ipython.org/ipython-doc/dev/parallel/parallel_task.html#dependencies. > It is also not having any > example of all/any, success and failure. > > I am just looking for a simple example code may (2-3 line) that > demonstrates that one task is dependent > on success/failure of any/ all of two or three specified tasks. > > Thanks, > Hemant. > > Thanks, > > ? > > Matthias > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > Thanks and Regards, > Hemant Kumar Mehta, > web : http://www.hemantmehta.com > Citations: http://scholar.google.co.in/citations?user=JtpjiaQAAAAJ > > > Get your own *FREE* website, *FREE* domain & *FREE* mobile app with > Company email. > *Know More >* > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From hemant_tgm at rediffmail.com Fri May 29 05:27:48 2015 From: hemant_tgm at rediffmail.com (Hemant Mehta) Date: 29 May 2015 09:27:48 -0000 Subject: [IPython-dev] =?utf-8?q?Help_on_IPython_functional_dependency_pro?= =?utf-8?q?gram?= In-Reply-To: Message-ID: <1432764182.S.20318.20921.f4-234-198.1432891668.31852@webmail.rediffmail.com> Dear Benjaminrk, Thanks lot for ur reply and sending me that link of the demo program. The demo program has clarified my doubts. Thanks, Hemant Thanks and Regards,Hemant Kumar Mehta,web : http://www.hemantmehta.comCitations: http://scholar.google.co.in/citations?user=JtpjiaQAAAAJ From: "MinRK"benjaminrk at gmail.com Sent:Thu, 28 May 2015 03:33:02 +0530 To: IPython developers list ipython-dev at scipy.org Subject: Re: [IPython-dev] Help on IPython functional dependency program Can you describe what you are trying to do? Here?s a demo of the various options for dependencies. -MinRK ? >On Wed, May 27, 2015 at 11:43 AM, Hemant Mehta <hemant_tgm at rediffmail.com> wrote: > > > On Wed, 27 May 2015 23:23:22 +0530 Matthias Bussonnier wrote > > > > > On May 27, 2015, at 10:13, Hemant Mehta wrote: > > > > > > Dear Matthias Bussonnier, > > > > > > Thanks a lot for your reply and sorry for unclear question. > > > I got following example of After/follow dependency in IPython documentation Release 0.11, on page > 127, > > > it is working fine. > > > > IPython 0.11 was release in 2011, current stable of IPython is 3.1 (3.2 soon, and 4.0 is on its way) > > There have been 0.12.x, 0.13.x, 1.x and 2.x in the meantime. which are not supported anymore . > > Please update to more recent IPython and look at more recent docs. > > > > Just now I checked the latest documentation available from https://ipython.org/ipython-doc/dev/ > > https://ipython.org/ipython-doc/dev/parallel/parallel_task.html#dependencies. It is also not having any > example of all/any, success and failure. > > I am just looking for a simple example code may (2-3 line) that demonstrates that one task is dependent > on success/failure of any/ all of two or three specified tasks. > > Thanks, > Hemant. > > Thanks, > > ? > > Matthias > > > > _______________________________________________ > > IPython-dev mailing list > > IPython-dev at scipy.org > > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > >Thanks and Regards, > Hemant Kumar Mehta, > web : http://www.hemantmehta.com > Citations: http://scholar.google.co.in/citations?user=JtpjiaQAAAAJ >Get your own FREE website, FREE domain & FREE mobile app with Company email. ?Know More > >_______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From matthew.brett at gmail.com Fri May 29 11:16:41 2015 From: matthew.brett at gmail.com (Matthew Brett) Date: Fri, 29 May 2015 11:16:41 -0400 Subject: [IPython-dev] Github notebook viewer math problems Message-ID: Hi, I notice that the Github notebook viewer breaks on basic mathjax like `\\` for line continuation. Here's an example: https://github.com/practical-neuroimaging/pna-notebooks/blob/master/sum_of_cosines.ipynb Should these kind of reports to some special place on the Github tracks, or to nbviewer issues? Cheers, Matthew From bussonniermatthias at gmail.com Fri May 29 11:27:38 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Fri, 29 May 2015 08:27:38 -0700 Subject: [IPython-dev] Github notebook viewer math problems In-Reply-To: References: Message-ID: You can open a bug on jupyter/nbconvert we'll see if we can figure out something. Otherwise you can also contact a human [1] at github and reference the issue. -- M [1] https://github.com/contact Best access by going to the problematic page and click contact at the bottom, it will send more info to github to find the logs in the back if any. On Fri, May 29, 2015 at 8:16 AM, Matthew Brett wrote: > Hi, > > I notice that the Github notebook viewer breaks on basic mathjax like > `\\` for line continuation. Here's an example: > > https://github.com/practical-neuroimaging/pna-notebooks/blob/master/sum_of_cosines.ipynb > > Should these kind of reports to some special place on the Github > tracks, or to nbviewer issues? > > Cheers, > > Matthew > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev From matthew.brett at gmail.com Fri May 29 11:41:57 2015 From: matthew.brett at gmail.com (Matthew Brett) Date: Fri, 29 May 2015 11:41:57 -0400 Subject: [IPython-dev] Github notebook viewer math problems In-Reply-To: References: Message-ID: Hi, On Fri, May 29, 2015 at 11:27 AM, Matthias Bussonnier wrote: > You can open a bug on jupyter/nbconvert we'll see if we can figure out > something. > Otherwise you can also contact a human [1] at github and reference the issue. Thanks - I tried the Github contact page, if that doesn't help, I'll get back to you via the nbviewer issues, Cheers, Matthew From dongta.hds at gmail.com Sat May 30 01:57:28 2015 From: dongta.hds at gmail.com (Dong Ta) Date: Fri, 29 May 2015 22:57:28 -0700 Subject: [IPython-dev] How to display markdown text in DataFrame in Notebook Message-ID: I have DataFrames with url fields. Can I easily tweak IPython Notebook so that it displays hyperlink markdowns? Meaning it renders clickable title? -------------- next part -------------- An HTML attachment was scrubbed... URL: From anton.akhmerov at gmail.com Sat May 30 06:59:52 2015 From: anton.akhmerov at gmail.com (Anton Akhmerov) Date: Sat, 30 May 2015 12:59:52 +0200 Subject: [IPython-dev] How to display markdown text in DataFrame in Notebook In-Reply-To: References: Message-ID: Dear Dong Ta, On Sat, May 30, 2015, 07:58 Dong Ta wrote: > > I have DataFrames with url fields. > > Can I easily tweak IPython Notebook so that it displays hyperlink markdowns? Meaning it renders clickable title? Somewhat paradoxically, there's no easy way to display markdown programmatically in ipython. You can manually create HTML out of markdown by using markdown2html filters from IPython.nbconvert.filters. Now, the problem is that pandas doesn't use markdown at all, instead it has a _repr_html_ method used to show the dataframes. By default it sanitizes html, but you can turn it off by using e.g. this: IPython.display.HTML(dataframe.to_html(escape=False)) Of course this means you need to make the fields with html-formed URLs on your own. If you want a more systematic solution, I believe you could subclass the DataFrame and teach it to transform some columns before printing. Best, Anton From bussonniermatthias at gmail.com Sat May 30 12:48:49 2015 From: bussonniermatthias at gmail.com (Matthias Bussonnier) Date: Sat, 30 May 2015 09:48:49 -0700 Subject: [IPython-dev] How to display markdown text in DataFrame in Notebook In-Reply-To: References: Message-ID: <88384F20-027A-4C24-BC94-4EA106EE59B9@gmail.com> > On May 30, 2015, at 03:59, Anton Akhmerov wrote: > > Somewhat paradoxically, there's no easy way to display markdown > programmatically in ipython. You can manually create HTML out of > markdown by using markdown2html filters from > IPython.nbconvert.filters. For some reason people don?t try, or don?t read the doc: class o: def _repr_markdown_(self): return '[try it](https://try.jupyter.org)' o() And we support arbitrary mime type, the _repr_*_ that exist are here just for convenience. > If you want a more systematic solution, I believe you could subclass > the DataFrame Which is the bad solution also, register a display_formatter for a specific object type: https://nbviewer.jupyter.org/github/ipython/ipython-in-depth/blob/bigsplit/examples/IPython%20Kernel/Custom%20Display%20Logic.ipynb#Adding-IPython-display-support-to-existing-objects ? M > > Best, > Anton > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev ? M -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Screen Shot 2015-05-30 at 09.42.04.png Type: image/png Size: 37416 bytes Desc: not available URL: From moorepants at gmail.com Sun May 31 21:35:09 2015 From: moorepants at gmail.com (Jason Moore) Date: Sun, 31 May 2015 18:35:09 -0700 Subject: [IPython-dev] Is there a way to open a notebook via one click in tmpnb.org? Message-ID: I'd like to provide a url in a lecture that the audience can enter in their browser opening tmpnb.org with a particular notebook (i.e. without downloading the notebook, uploading, and then opening it). Is that possible? Jason moorepants.info +01 530-601-9791 -------------- next part -------------- An HTML attachment was scrubbed... URL: From patrick.surry at gmail.com Sat May 30 20:40:36 2015 From: patrick.surry at gmail.com (Patrick Surry) Date: Sat, 30 May 2015 20:40:36 -0400 Subject: [IPython-dev] How to display markdown text in DataFrame in Notebook Message-ID: Another simple option is to use Pandas to_html() with the formatters option to specify column-specific formatting and generate custom HTML, which could easily start as markdown. Here's an example where one column has raw markdown, and another where it builds markdown => HTML on the fly. Cheers, Patrick from markdown import markdown from IPython.display import display, HTML # Be careful that Pandas doesn't truncate your long HTML strings... pd.set_option('display.max_colwidth', 256) df = pd.DataFrame( [ ['GOOG', 532, '[Google](http://www.google.com)'], ['IBM', 170, '[IBM](http://www.ibm.com)'], ['AAPL', 130, '[Apple](http://www.apple.com)'] ], columns=['Symbol', 'Price', 'Company'] ) HTML(df.to_html( formatters=dict( Price='${:,.0f}'.format, Symbol=lambda s: markdown('[{sym:s}]( http://finance.yahoo.com/q?s={sym:s})'.format(sym=s)), Company=markdown ), escape=False, index=False )) SymbolPriceCompany GOOG $532 Google IBM $170 IBM AAPL $130 Apple > I have DataFrames with url fields. > > Can I easily tweak IPython Notebook so that it displays hyperlink > markdowns? Meaning it renders clickable title? > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jgomezdans at gmail.com Sun May 31 14:17:50 2015 From: jgomezdans at gmail.com (Jose Gomez-Dans) Date: Sun, 31 May 2015 19:17:50 +0100 Subject: [IPython-dev] IPython 3.1.0 headings pop-up Message-ID: Hi, In the latest IPython version, there's a pop up that jumps out whenever you select a cell and indicate that it will be a heading, and telling you to indicate the hierarchy of the heading using markdown syntax. Now, after a while this gets quite annoying. Is there some way to turn this off? Also, shouldn't it turn itself off by default after the first N times? Thanks! Jose -------------- next part -------------- An HTML attachment was scrubbed... URL: From anton.akhmerov at gmail.com Sat May 30 14:08:00 2015 From: anton.akhmerov at gmail.com (Anton Akhmerov) Date: Sat, 30 May 2015 20:08:00 +0200 Subject: [IPython-dev] How to display markdown text in DataFrame in Notebook In-Reply-To: <88384F20-027A-4C24-BC94-4EA106EE59B9@gmail.com> References: <88384F20-027A-4C24-BC94-4EA106EE59B9@gmail.com> Message-ID: Hi Matthias, On Sat, May 30, 2015 at 6:48 PM, Matthias Bussonnier < bussonniermatthias at gmail.com> wrote: > > > For some reason people don?t try, or don?t read the doc: > Thanks for the explanation, and my apologies for the incorrect reply. I did read the docs and asked on gitter, only I didn't recheck since v2, and _repr_markdown_ as well as IPython.display.Markdown were introduced in v3. > > Which is the bad solution also, register a display_formatter for a > specific object type: > > > https://nbviewer.jupyter.org/github/ipython/ipython-in-depth/blob/bigsplit/examples/IPython%20Kernel/Custom%20Display%20Logic.ipynb#Adding-IPython-display-support-to-existing-objects > > Thanks for sharing the ipython-in-depth link. May I suggest to also refer to it from http://ipython.org/documentation.html, it seems to have useful explanations that are not contained in the rest of the docs (at least as far as I could tell). Anton > ? > M > > > > Best, > Anton > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > ? > M > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From dongta.hds at gmail.com Sat May 30 16:00:19 2015 From: dongta.hds at gmail.com (Dong Ta) Date: Sat, 30 May 2015 13:00:19 -0700 Subject: [IPython-dev] How to display markdown text in DataFrame in Notebook In-Reply-To: <88384F20-027A-4C24-BC94-4EA106EE59B9@gmail.com> References: <88384F20-027A-4C24-BC94-4EA106EE59B9@gmail.com> Message-ID: Hi Matthias, After reading your answer and the notebook, I still can't figure out how to properly display markdown columns in a DataFrame. Can you be more specific? Thanks a lot. -DT On Sat, May 30, 2015 at 9:48 AM, Matthias Bussonnier < bussonniermatthias at gmail.com> wrote: > > On May 30, 2015, at 03:59, Anton Akhmerov > wrote: > > Somewhat paradoxically, there's no easy way to display markdown > programmatically in ipython. You can manually create HTML out of > markdown by using markdown2html filters from > IPython.nbconvert.filters. > > > > > For some reason people don?t try, or don?t read the doc: > > class o: > def _repr_markdown_(self): > return '[try it](https://try.jupyter.org)' > > o() > > And we support arbitrary mime type, the _repr_*_ that exist are here just > for convenience. > > If you want a more systematic solution, I believe you could subclass > the DataFrame > > > Which is the bad solution also, register a display_formatter for a > specific object type: > > > https://nbviewer.jupyter.org/github/ipython/ipython-in-depth/blob/bigsplit/examples/IPython%20Kernel/Custom%20Display%20Logic.ipynb#Adding-IPython-display-support-to-existing-objects > > ? > M > > > > Best, > Anton > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > > > ? > M > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Screen Shot 2015-05-30 at 09.42.04.png Type: image/png Size: 37416 bytes Desc: not available URL: