From carl.input at gmail.com Thu Nov 1 15:49:16 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 1 Nov 2012 19:49:16 +0000 Subject: [IPython-dev] IPython on Android In-Reply-To: <5090AC9E.6080900@creativetrax.com> References:

<5090AC9E.6080900@creativetrax.com> Message-ID: Thanks for your help. I have been struggling to embed IPython in a regular Python script, so I need to figure out how many problems there are with this before I try an get the Notebook running. I just wanted thanks for all your help. I've been offline last couple of days. On Oct 31, 2012 4:44 AM, "Jason Grout" wrote: > On 10/30/12 7:07 PM, Thomas Kluyver wrote: > > On 30 October 2012 20:14, Carl Smith > > wrote: > > > > That's what I thought too. I can sort pyzmq, but not zmq itself, so > > I'm probably shot > > > > > > Is Python4Android running on top of the Java runtime, or is it CPython > > ported to Android? If it's possible to get pyzmq, maybe zmq can be > > compiled in as a static library? > > Isn't zmq support on android? http://www.zeromq.org/build:android > > See also https://github.com/zeromq/libzmq/pull/393 > > Thanks, > > Jason > > > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Mon Nov 5 16:14:10 2012 From: carl.input at gmail.com (Carl Smith) Date: Mon, 5 Nov 2012 21:14:10 +0000 Subject: [IPython-dev] Thoughts on Cloud Services Message-ID: Hi all To cut a long story short, I've not been doing much on NotebookCloud for a while now. I'm really happy with how things have gone so far, but have reached the point where I've taken it pretty much as far as I can. I will keep everything running so long as people still use it and wanted to say thanks to everyone who's supported me with this, it's been a lot of fun. I'm happy for anyone to take over nbcloud, or just ransack it to create new stuff, and I'm happy to contribute to those efforts. The thing is, as IPython's cloud features mature, the need for something like NotebookCloud will continue to diminish. Besides, it doesn't really solve many of the problems that users suffer with. If I started again, I'd be more focussed on building a library that wraps boto and StartCluster and includes the IPython code needed to create IPython setups on AWS. You'd still need to publish and maintain at least one core AMI for it to work, but users could use the library to derive and share new AMIs from the core one, so that may take care of itself before long. The feature that's requested more than anything else is the ability to create and share custom, self-configuring AMIs. That's the killer feature going forward, and it should really be available within a regular IPython session. It's nice to only need a browser to manage servers, but that's way down the list of priorities for most users. If IPython had a library that could manage IPython AWS instances, AMIs and everything else, no doubt someone would wrap that in a web app before too long anyway :) Thanks again everyone Carl From takowl at gmail.com Mon Nov 5 18:48:00 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Mon, 5 Nov 2012 23:48:00 +0000 Subject: [IPython-dev] Thoughts on Cloud Services In-Reply-To: References: Message-ID: On 5 November 2012 21:14, Carl Smith wrote: > To cut a long story short, I've not been doing much on NotebookCloud > for a while now. I'm really happy with how things have gone so far, > but have reached the point where I've taken it pretty much as far as I > can. I will keep everything running so long as people still use it and > wanted to say thanks to everyone who's supported me with this, it's > been a lot of fun. I'm happy for anyone to take over nbcloud, or just > ransack it to create new stuff, and I'm happy to contribute to those > efforts. > Thanks, Carl, for the time you've put in with NotebookCloud. It's really great to be able to tell people that setting up the IPython Notebook on a dedicated Amazon cloud is as easy as a few clicks. And it's especially good to have had that available so soon after the Notebook was released. I hope someone picks it up and takes it forward in whatever form. And of course we hope you'll stick around and build us more cool stuff ;-) Best wishes, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Mon Nov 5 20:46:29 2012 From: carl.input at gmail.com (Carl Smith) Date: Tue, 6 Nov 2012 01:46:29 +0000 Subject: [IPython-dev] Thoughts on Cloud Services In-Reply-To: References: Message-ID: Thanks Thomas. Of course. On Nov 5, 2012 11:48 PM, "Thomas Kluyver" wrote: > On 5 November 2012 21:14, Carl Smith wrote: > >> To cut a long story short, I've not been doing much on NotebookCloud >> for a while now. I'm really happy with how things have gone so far, >> but have reached the point where I've taken it pretty much as far as I >> can. I will keep everything running so long as people still use it and >> wanted to say thanks to everyone who's supported me with this, it's >> been a lot of fun. I'm happy for anyone to take over nbcloud, or just >> ransack it to create new stuff, and I'm happy to contribute to those >> efforts. >> > > Thanks, Carl, for the time you've put in with NotebookCloud. It's really > great to be able to tell people that setting up the IPython Notebook on a > dedicated Amazon cloud is as easy as a few clicks. And it's especially good > to have had that available so soon after the Notebook was released. I hope > someone picks it up and takes it forward in whatever form. > > And of course we hope you'll stick around and build us more cool stuff ;-) > > Best wishes, > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From klonuo at gmail.com Tue Nov 6 12:11:50 2012 From: klonuo at gmail.com (klo uo) Date: Tue, 6 Nov 2012 18:11:50 +0100 Subject: [IPython-dev] IPEP 6: Qt console additional pane Message-ID: Hi, I opened new IPEP as suggested by Thomas: https://github.com/ipython/ipython/wiki/IPEP-6:-Qt-console---additional-pane Please take a look and provide your POV and suggestions Cheers -------------- next part -------------- An HTML attachment was scrubbed... URL: From takowl at gmail.com Tue Nov 6 13:13:14 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Tue, 6 Nov 2012 18:13:14 +0000 Subject: [IPython-dev] IPEP 6: Qt console additional pane In-Reply-To: References: Message-ID: On 6 November 2012 17:11, klo uo wrote: > I opened new IPEP as suggested by Thomas: > https://github.com/ipython/ipython/wiki/IPEP-6:-Qt-console---additional-pane Thanks! I've added some messy thoughts on my 'sidecar' idea. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Tue Nov 6 20:43:31 2012 From: carl.input at gmail.com (Carl Smith) Date: Wed, 7 Nov 2012 01:43:31 +0000 Subject: [IPython-dev] A couple of odd behaviours... Message-ID: Hi all I've been playing with IPython and Android and have come across a couple of issues. In order to connect the droid to my PC, I have to run the following two commands. adb forward tcp:9999 tcp:45001 export AP_PORT=9999 For the record, adb is the Android Debug Bridge, which enables the connection. If I do the above commands in a regular shell, then launch IPython, Classic or Notebook, it all works as expected, but if I run the above commands in IPython, it fails with an adb specific error. For completeness... # SESSION !adb forward tcp:9999 tcp:45001 !export AP_PORT=9999 import android d = android.Android() # TRACEBACK gaierror Traceback (most recent call last) in () ----> 1 d = android.Android() /home/carl/droidbridge/android.pyc in __init__(self, addr) 32 if addr is None: 33 addr = HOST, PORT ---> 34 self.conn = socket.create_connection(addr) 35 self.client = self.conn.makefile() 36 self.id = 0 /usr/lib/python2.7/socket.pyc in create_connection(address, timeout, source_address) 551 host, port = address 552 err = None --> 553 for res in getaddrinfo(host, port, 0, SOCK_STREAM): 554 af, socktype, proto, canonname, sa = res 555 sock = None gaierror: [Errno -2] Name or service not known Any thoughts on this would be appreciated. Also, once I have the Notebook running, and the above problem dealt with, there's an issue with output. You can use adb to issue shell commands using `adb shell `, so `adb shell ls` runs `ls` on the droid. When I do this in the notebook, the output is blank. The page moves to show the list, so if there's three files, it renders three lines, if there five files, it renders five lines, but the lines are blank. If you drag select them with a mouse, each line is just a newline character. If you do `a = !adb shell ls`, you can eval or print `a` and get a list of the files, as you'd expect. I appreciate there's not many people around IPython Dev that will have adb to hand, but if anyone would like more details, just let me know. I'm really just hoping someone might have some idea of why this would happen. Note: In IPython Classic, `!abd shell ls` works fine. The blank lines are in the Notebook only. Cheers Carl From zvoros at gmail.com Wed Nov 7 05:39:12 2012 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Wed, 07 Nov 2012 11:39:12 +0100 Subject: [IPython-dev] comment on autosave Message-ID: <509A3A50.4050403@gmail.com> Hi all, I might be poking into a hornets' nest, but I was wondering whether configurably linking saving the notebook to the cell execution could appease all those who complain about autosave. My idea is that one could simply have a flag in the profile, and if that flag is set, then that.save_notebook() could be executed at the end of execute_selected_cell(). This solution should be safe in the sense that as long as the function save_notebook works, there should be absolutely no problems with using it in execute_selected_cell, and we wouldn't have to tamper with the javascript base. In any case, if you think this could be a viable option, I could try to implement it. Cheers, Zolt?n From takowl at gmail.com Wed Nov 7 06:44:54 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 7 Nov 2012 11:44:54 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References: Message-ID: On 7 November 2012 01:43, Carl Smith wrote: > !adb forward tcp:9999 tcp:45001 > !export AP_PORT=9999 > My suspicion would be that !export doesn't propagate environment variables back to the Python process. I'd try modifying os.environ directly. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Wed Nov 7 06:47:09 2012 From: carl.input at gmail.com (Carl Smith) Date: Wed, 7 Nov 2012 11:47:09 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Nice one. I'll look at that. Cheers Thomas. On Nov 7, 2012 11:45 AM, "Thomas Kluyver" wrote: > On 7 November 2012 01:43, Carl Smith wrote: > >> !adb forward tcp:9999 tcp:45001 >> !export AP_PORT=9999 >> > > My suspicion would be that !export doesn't propagate environment variables > back to the Python process. I'd try modifying os.environ directly. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From bussonniermatthias at gmail.com Wed Nov 7 09:28:52 2012 From: bussonniermatthias at gmail.com (Matthias BUSSONNIER) Date: Wed, 7 Nov 2012 15:28:52 +0100 Subject: [IPython-dev] comment on autosave In-Reply-To: <509A3A50.4050403@gmail.com> References: <509A3A50.4050403@gmail.com> Message-ID: <9EB0D161-2D68-41CC-B00C-B75D1860533B@gmail.com> Hi Zolt?n, Le 7 nov. 2012 ? 11:39, Zolt?n V?r?s a ?crit : > Hi all, > > I might be poking into a hornets' nest, but I was wondering whether > configurably linking saving the notebook to the cell execution could > appease all those who complain about autosave. My idea is that one could > simply have a flag in the profile, and if that flag is set, then > that.save_notebook() could be executed at the end of > execute_selected_cell(). This solution should be safe in the sense that > as long as the function save_notebook works, there should be absolutely > no problems with using it in execute_selected_cell, and we wouldn't have > to tamper with the javascript base. > > In any case, if you think this could be a viable option, I could try to > implement it. Thanks for the suggestion, It is a good idea, but the problem is there is no good way yet to propagate configuration to the JS side except from the custom.js in user profile. you could listen to event 'execution_request.Kernel' and 'shell_reply.Kernel' for code execution. I don't remember the name of the event for MD cell rendering or even if there is one. (this could be added) This should be a one liner in custom.js like : $([IPython.event]).on('shell_reply.Kernel',IPython.notebook.save_notebook); I would just warn you that it does overwrite the current version of the file, whereas what you might wish is a secondary file with another name. save can take a name parameter, but then it renames the notebook instead of doing a copy so be carefull. We'll be really happy if you find a good way of propagating option from profile/command line to the browser side, or at least open an IPep about that :-) If you came up with anything you can add it to the wiki :-) -- Matthias From zvoros at gmail.com Wed Nov 7 09:31:26 2012 From: zvoros at gmail.com (=?ISO-8859-1?Q?Zolt=E1n_V=F6r=F6s?=) Date: Wed, 07 Nov 2012 15:31:26 +0100 Subject: [IPython-dev] comment on autosave In-Reply-To: <9EB0D161-2D68-41CC-B00C-B75D1860533B@gmail.com> References: <509A3A50.4050403@gmail.com> <9EB0D161-2D68-41CC-B00C-B75D1860533B@gmail.com> Message-ID: <509A70BE.5060909@gmail.com> Hi Matthias, Thanks for the comments, and I see the problems. As for overwriting the file, I had the impression that the problem was that some people don't want to bother about pressing Cntr-S. In that case, the file is overwritten anyway, so my suggestion was really just to make this mechanism automatic, without having to explicitly hit Cntr-S. But since you have already proposed a solution in your mail on the user list, I wonder there would still be any point in implementing "write-to-disc-when-executing-cell". Cheers, Zolt?n On 11/07/2012 03:28 PM, Matthias BUSSONNIER wrote: > Hi Zolt?n, > Le 7 nov. 2012 ? 11:39, Zolt?n V?r?s a ?crit : > >> Hi all, >> >> I might be poking into a hornets' nest, but I was wondering whether >> configurably linking saving the notebook to the cell execution could >> appease all those who complain about autosave. My idea is that one could >> simply have a flag in the profile, and if that flag is set, then >> that.save_notebook() could be executed at the end of >> execute_selected_cell(). This solution should be safe in the sense that >> as long as the function save_notebook works, there should be absolutely >> no problems with using it in execute_selected_cell, and we wouldn't have >> to tamper with the javascript base. >> >> In any case, if you think this could be a viable option, I could try to >> implement it. > Thanks for the suggestion, > It is a good idea, but the problem is there is no good way yet to propagate configuration to the JS side except from the custom.js in user profile. > > you could listen to event 'execution_request.Kernel' and 'shell_reply.Kernel' for code execution. > I don't remember the name of the event for MD cell rendering or even if there is one. > (this could be added) > > > This should be a one liner in custom.js like : > > $([IPython.event]).on('shell_reply.Kernel',IPython.notebook.save_notebook); > > I would just warn you that it does overwrite the current version of the file, whereas what you might wish is a secondary file with another name. > save can take a name parameter, but then it renames the notebook instead of doing a copy so be carefull. > > We'll be really happy if you find a good way of propagating option from profile/command line to the browser side, or at least open an IPep about that :-) > > If you came up with anything you can add it to the wiki :-) From carl.input at gmail.com Wed Nov 7 10:32:10 2012 From: carl.input at gmail.com (Carl Smith) Date: Wed, 7 Nov 2012 15:32:10 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Thanks Thomas. That was what I was missing. It's working perfectly now. I'm still lost as to why `adb shell ls` is printing blank lines, but you've cheered me up no end :) On 7 November 2012 11:47, Carl Smith wrote: > Nice one. I'll look at that. Cheers Thomas. > > On Nov 7, 2012 11:45 AM, "Thomas Kluyver" wrote: >> >> On 7 November 2012 01:43, Carl Smith wrote: >>> >>> !adb forward tcp:9999 tcp:45001 >>> !export AP_PORT=9999 >> >> >> My suspicion would be that !export doesn't propagate environment variables >> back to the Python process. I'd try modifying os.environ directly. >> >> Thomas >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> > From takowl at gmail.com Wed Nov 7 10:35:15 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Wed, 7 Nov 2012 15:35:15 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: On 7 November 2012 15:32, Carl Smith wrote: > Thanks Thomas. That was what I was missing. It's working perfectly > now. I'm still lost as to why `adb shell ls` is printing blank lines, > but you've cheered me up no end :) > Great. That one mystifies me as well. Do you see anything in the controlling terminal where you started the notebook? Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Wed Nov 7 10:54:00 2012 From: carl.input at gmail.com (Carl Smith) Date: Wed, 7 Nov 2012 15:54:00 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Nah. Nothing unusual in the terminal. I'm going to try a few other commands, see if it sheds any light. -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Wed Nov 7 21:42:33 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 02:42:33 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Sorry Thomas, I was wrong. I had a bug in my code that was causing things to fail silently. The answer to your question should have been "Yes, it prints everything in the terminal". I tried `pwd` and so on, and get the same behaviour. Everything printed by `!abd shell ` ends up in the terminal, not in the Notebook, though I still get a newline in the Notebook for each line that should be there. Any thoughts? On 7 November 2012 15:54, Carl Smith wrote: > Nah. Nothing unusual in the terminal. > > I'm going to try a few other commands, see if it sheds any light. From takowl at gmail.com Thu Nov 8 09:23:40 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 8 Nov 2012 14:23:40 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: On 8 November 2012 02:42, Carl Smith wrote: > I tried `pwd` and so on, and get the same behaviour. Everything > printed by `!abd shell ` ends up in the terminal, not in the > Notebook, though I still get a newline in the Notebook for each line > that should be there. > > Any thoughts? > You don't have anything in config or startup files that could be setting ip.system to ip.system_raw? Can you check that ip.system is ip.system_piped, just before an offending command? We fail to redirect C-level stdout from within the kernel process (issue #1230), but the subprocess when you run a system command should be run in a new pseudoterminal controlled by IPython, so I'm mystified why the output is going to the wrong place. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Thu Nov 8 11:03:16 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 16:03:16 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: I don't have anything in config or startup files at all. I was using nbcloud for ages, and reformatted this machine not so long back, so my local Notebook installation is brand new. I'm still using the default config IPython created for me, and have nothing in startup. I'm not sure how to check ip.system is ip.system_piped, but tried the following with the same result. ip = get_ipython() ip.system = ip.system_piped !adb shell ls I've noticed that it doesn't always print everything to the terminal. It seems to do it sometimes and not others, so I need to figure out what's causing the change and maybe work it out from there. If I do `ip.system = ip.system_raw`, then it always goes to the terminal, so that works. If I do `ip.system = ip.system_piped` it goes bank to printing blank lines, with nothing in the terminal. Because the printing to the terminal thing is happening on and off, well, I've only seen it happen once, I need to find out why. It can't literally be random. I did just try creating a new directory on my main machine, then launching the Notebook from that empty directory, then just running `!adb shell ls` in a new notebook. Same problem. I also tried running the three lines above to explicitly demand that my output gets piped, but to no avail. I tried using os.system, which sends stdout to the terminal, and ip.system, which prints blank lines. P.S. Why does ip.system return None? Shouldn't it return an int? On 8 November 2012 14:23, Thomas Kluyver wrote: > On 8 November 2012 02:42, Carl Smith wrote: >> >> I tried `pwd` and so on, and get the same behaviour. Everything >> printed by `!abd shell ` ends up in the terminal, not in the >> Notebook, though I still get a newline in the Notebook for each line >> that should be there. >> >> Any thoughts? > > > You don't have anything in config or startup files that could be setting > ip.system to ip.system_raw? Can you check that ip.system is ip.system_piped, > just before an offending command? > > We fail to redirect C-level stdout from within the kernel process (issue > #1230), but the subprocess when you run a system command should be run in a > new pseudoterminal controlled by IPython, so I'm mystified why the output is > going to the wrong place. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From carl.input at gmail.com Thu Nov 8 11:13:33 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 16:13:33 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: On reflection, I think I may have caused stdout to go to the terminal the one time I saw that it had, by messing around trying to fix things. I'm really unsure on that one now. I may have been playing with os.system at the time. None of this is a massive problem for me as it stands. I'll probably want to return the output of all adb shell commands anyway. I've made my Android object callable, with it's args being the adb shell commands, so I can just do `a = droid('ls')`. It's pure curiosity that's got me now. On 8 November 2012 16:03, Carl Smith wrote: > I don't have anything in config or startup files at all. I was using > nbcloud for ages, and reformatted this machine not so long back, so my > local Notebook installation is brand new. I'm still using the default > config IPython created for me, and have nothing in startup. > > I'm not sure how to check ip.system is ip.system_piped, but tried the > following with the same result. > > ip = get_ipython() > ip.system = ip.system_piped > !adb shell ls > > I've noticed that it doesn't always print everything to the terminal. > It seems to do it sometimes and not others, so I need to figure out > what's causing the change and maybe work it out from there. > > If I do `ip.system = ip.system_raw`, then it always goes to the > terminal, so that works. If I do `ip.system = ip.system_piped` it goes > bank to printing blank lines, with nothing in the terminal. Because > the printing to the terminal thing is happening on and off, well, I've > only seen it happen once, I need to find out why. It can't literally > be random. > > I did just try creating a new directory on my main machine, then > launching the Notebook from that empty directory, then just running > `!adb shell ls` in a new notebook. Same problem. I also tried running > the three lines above to explicitly demand that my output gets piped, > but to no avail. > > I tried using os.system, which sends stdout to the terminal, and > ip.system, which prints blank lines. > > P.S. Why does ip.system return None? Shouldn't it return an int? > > On 8 November 2012 14:23, Thomas Kluyver wrote: >> On 8 November 2012 02:42, Carl Smith wrote: >>> >>> I tried `pwd` and so on, and get the same behaviour. Everything >>> printed by `!abd shell ` ends up in the terminal, not in the >>> Notebook, though I still get a newline in the Notebook for each line >>> that should be there. >>> >>> Any thoughts? >> >> >> You don't have anything in config or startup files that could be setting >> ip.system to ip.system_raw? Can you check that ip.system is ip.system_piped, >> just before an offending command? >> >> We fail to redirect C-level stdout from within the kernel process (issue >> #1230), but the subprocess when you run a system command should be run in a >> new pseudoterminal controlled by IPython, so I'm mystified why the output is >> going to the wrong place. >> >> Thomas >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> From carl.input at gmail.com Thu Nov 8 11:20:37 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 16:20:37 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Thanks again for your time on this Thomas. It's really kind of you to give the users so much attention, but honestly, focus on your studies mate. I don't want to think that you fell behind to deal with my obscure issues :) On 8 November 2012 16:13, Carl Smith wrote: > On reflection, I think I may have caused stdout to go to the terminal > the one time I saw that it had, by messing around trying to fix > things. I'm really unsure on that one now. I may have been playing > with os.system at the time. > > None of this is a massive problem for me as it stands. I'll probably > want to return the output of all adb shell commands anyway. I've made > my Android object callable, with it's args being the adb shell > commands, so I can just do `a = droid('ls')`. It's pure curiosity > that's got me now. > > On 8 November 2012 16:03, Carl Smith wrote: >> I don't have anything in config or startup files at all. I was using >> nbcloud for ages, and reformatted this machine not so long back, so my >> local Notebook installation is brand new. I'm still using the default >> config IPython created for me, and have nothing in startup. >> >> I'm not sure how to check ip.system is ip.system_piped, but tried the >> following with the same result. >> >> ip = get_ipython() >> ip.system = ip.system_piped >> !adb shell ls >> >> I've noticed that it doesn't always print everything to the terminal. >> It seems to do it sometimes and not others, so I need to figure out >> what's causing the change and maybe work it out from there. >> >> If I do `ip.system = ip.system_raw`, then it always goes to the >> terminal, so that works. If I do `ip.system = ip.system_piped` it goes >> bank to printing blank lines, with nothing in the terminal. Because >> the printing to the terminal thing is happening on and off, well, I've >> only seen it happen once, I need to find out why. It can't literally >> be random. >> >> I did just try creating a new directory on my main machine, then >> launching the Notebook from that empty directory, then just running >> `!adb shell ls` in a new notebook. Same problem. I also tried running >> the three lines above to explicitly demand that my output gets piped, >> but to no avail. >> >> I tried using os.system, which sends stdout to the terminal, and >> ip.system, which prints blank lines. >> >> P.S. Why does ip.system return None? Shouldn't it return an int? >> >> On 8 November 2012 14:23, Thomas Kluyver wrote: >>> On 8 November 2012 02:42, Carl Smith wrote: >>>> >>>> I tried `pwd` and so on, and get the same behaviour. Everything >>>> printed by `!abd shell ` ends up in the terminal, not in the >>>> Notebook, though I still get a newline in the Notebook for each line >>>> that should be there. >>>> >>>> Any thoughts? >>> >>> >>> You don't have anything in config or startup files that could be setting >>> ip.system to ip.system_raw? Can you check that ip.system is ip.system_piped, >>> just before an offending command? >>> >>> We fail to redirect C-level stdout from within the kernel process (issue >>> #1230), but the subprocess when you run a system command should be run in a >>> new pseudoterminal controlled by IPython, so I'm mystified why the output is >>> going to the wrong place. >>> >>> Thomas >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> From takowl at gmail.com Thu Nov 8 11:40:00 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 8 Nov 2012 16:40:00 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: On 8 November 2012 16:20, Carl Smith wrote: > Thanks again for your time on this Thomas. It's really kind of you to > give the users so much attention, but honestly, focus on your studies > mate. I don't want to think that you fell behind to deal with my > obscure issues :) > Intellectual curiosity and all that ;-). I confess I'm mystified, though. Does the same thing happen in the Qt console? Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Thu Nov 8 12:00:37 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:00:37 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: I had to quickly set things up, but yeah, everything works according to spec in the console. It's just the Notebook. I'd ask on the adb list if there's anything unusual about how it works, but I think it was done in house by Google. I'm not sure. I'll have to look into it. Anyway, it works in On 8 November 2012 16:40, Thomas Kluyver wrote: > On 8 November 2012 16:20, Carl Smith wrote: >> >> Thanks again for your time on this Thomas. It's really kind of you to >> give the users so much attention, but honestly, focus on your studies >> mate. I don't want to think that you fell behind to deal with my >> obscure issues :) > > > Intellectual curiosity and all that ;-). I confess I'm mystified, though. > Does the same thing happen in the Qt console? > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From carl.input at gmail.com Thu Nov 8 12:01:37 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:01:37 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: ... the Qt console. On 8 November 2012 17:00, Carl Smith wrote: > I had to quickly set things up, but yeah, everything works according > to spec in the console. It's just the Notebook. I'd ask on the adb > list if there's anything unusual about how it works, but I think it > was done in house by Google. I'm not sure. I'll have to look into it. > > Anyway, it works in > > On 8 November 2012 16:40, Thomas Kluyver wrote: >> On 8 November 2012 16:20, Carl Smith wrote: >>> >>> Thanks again for your time on this Thomas. It's really kind of you to >>> give the users so much attention, but honestly, focus on your studies >>> mate. I don't want to think that you fell behind to deal with my >>> obscure issues :) >> >> >> Intellectual curiosity and all that ;-). I confess I'm mystified, though. >> Does the same thing happen in the Qt console? >> >> Thomas >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> From takowl at gmail.com Thu Nov 8 12:10:17 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 8 Nov 2012 17:10:17 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: On 8 November 2012 17:00, Carl Smith wrote: > I had to quickly set things up, but yeah, everything works according > to spec in the console. It's just the Notebook. I'd ask on the adb > list if there's anything unusual about how it works, but I think it > was done in house by Google. I'm not sure. I'll have to look into it. > Hmm, that's really weird, because the Qt console and the notebook use the same kernel. Can you try starting with "ipython qtconsole --debug", and finding the lines that look like this: [IPKernelApp] Content: {'user_variables': [], 'code': '!pwd\n', 'silent': False, 'allow_stdin': True, 'store_history': True, 'user_expressions': {}} ---> [IPythonQtConsoleApp] stream: {'data': '/home/thomas/Code/ubuntu/unattended-upgrades\r\n', 'name': 'stdout'} Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Thu Nov 8 12:21:38 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:21:38 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: I've got this line... [IPKernelApp] Content: {'user_variables': [], 'allow_stdin': True, 'code': "try:\n _usage\nexcept:\n from IPython.core import usage as _usage\n get_ipython().register_magic_function(_usage.page_guiref, 'line', 'guiref')\n del _usage", 'user_expressions': {}, 'silent': True} ---> There's this similar looking one too... [IPKernelApp] Content: {'user_variables': [], 'allow_stdin': True, 'code': '', 'user_expressions': {'1264bcb0-29c8-11e2-8c4f-0019d1474c91': 'get_ipython().magics_manager.lsmagic_info()'}, 'silent': True} ---> On 8 November 2012 17:10, Thomas Kluyver wrote: > On 8 November 2012 17:00, Carl Smith wrote: >> >> I had to quickly set things up, but yeah, everything works according >> to spec in the console. It's just the Notebook. I'd ask on the adb >> list if there's anything unusual about how it works, but I think it >> was done in house by Google. I'm not sure. I'll have to look into it. > > > Hmm, that's really weird, because the Qt console and the notebook use the > same kernel. Can you try starting with "ipython qtconsole --debug", and > finding the lines that look like this: > > [IPKernelApp] Content: {'user_variables': [], 'code': '!pwd\n', 'silent': > False, 'allow_stdin': True, 'store_history': True, 'user_expressions': {}} > ---> > > [IPythonQtConsoleApp] stream: {'data': > '/home/thomas/Code/ubuntu/unattended-upgrades\r\n', 'name': 'stdout'} > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From carl.input at gmail.com Thu Nov 8 12:24:10 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:24:10 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: I don't have a line from [IPythonQtConsoleApp] with `stream:` in. The closest I have is... [IPythonQtConsoleApp] execute: {'status': 'ok', 'execution_count': 0, 'user_variables': {}, 'payload': [], 'user_expressions': {}} On 8 November 2012 17:21, Carl Smith wrote: > I've got this line... > > [IPKernelApp] Content: {'user_variables': [], 'allow_stdin': True, > 'code': "try:\n _usage\nexcept:\n from IPython.core import usage > as _usage\n get_ipython().register_magic_function(_usage.page_guiref, > 'line', 'guiref')\n del _usage", 'user_expressions': {}, 'silent': > True} > ---> > > There's this similar looking one too... > > [IPKernelApp] Content: {'user_variables': [], 'allow_stdin': True, > 'code': '', 'user_expressions': > {'1264bcb0-29c8-11e2-8c4f-0019d1474c91': > 'get_ipython().magics_manager.lsmagic_info()'}, 'silent': True} > ---> > > > > On 8 November 2012 17:10, Thomas Kluyver wrote: >> On 8 November 2012 17:00, Carl Smith wrote: >>> >>> I had to quickly set things up, but yeah, everything works according >>> to spec in the console. It's just the Notebook. I'd ask on the adb >>> list if there's anything unusual about how it works, but I think it >>> was done in house by Google. I'm not sure. I'll have to look into it. >> >> >> Hmm, that's really weird, because the Qt console and the notebook use the >> same kernel. Can you try starting with "ipython qtconsole --debug", and >> finding the lines that look like this: >> >> [IPKernelApp] Content: {'user_variables': [], 'code': '!pwd\n', 'silent': >> False, 'allow_stdin': True, 'store_history': True, 'user_expressions': {}} >> ---> >> >> [IPythonQtConsoleApp] stream: {'data': >> '/home/thomas/Code/ubuntu/unattended-upgrades\r\n', 'name': 'stdout'} >> >> Thomas >> >> _______________________________________________ >> IPython-dev mailing list >> IPython-dev at scipy.org >> http://mail.scipy.org/mailman/listinfo/ipython-dev >> From takowl at gmail.com Thu Nov 8 12:24:59 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 8 Nov 2012 17:24:59 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Sorry, I should have been clearer: start the Qt console like that, then execute !adb shell ls (or any command that shows the problem). -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Thu Nov 8 12:26:52 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:26:52 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Got it; I needed to enter something first. This appeared after I entered `!ls` in the console. [IPythonQtConsoleApp] stream: {'data': 'Untitled0.ipynb\r\n', 'name': 'stdout'} On 8 November 2012 17:24, Carl Smith wrote: > I don't have a line from [IPythonQtConsoleApp] with `stream:` in. The > closest I have is... > > [IPythonQtConsoleApp] execute: {'status': 'ok', 'execution_count': 0, > 'user_variables': {}, 'payload': [], 'user_expressions': {}} > > On 8 November 2012 17:21, Carl Smith wrote: >> I've got this line... >> >> [IPKernelApp] Content: {'user_variables': [], 'allow_stdin': True, >> 'code': "try:\n _usage\nexcept:\n from IPython.core import usage >> as _usage\n get_ipython().register_magic_function(_usage.page_guiref, >> 'line', 'guiref')\n del _usage", 'user_expressions': {}, 'silent': >> True} >> ---> >> >> There's this similar looking one too... >> >> [IPKernelApp] Content: {'user_variables': [], 'allow_stdin': True, >> 'code': '', 'user_expressions': >> {'1264bcb0-29c8-11e2-8c4f-0019d1474c91': >> 'get_ipython().magics_manager.lsmagic_info()'}, 'silent': True} >> ---> >> >> >> >> On 8 November 2012 17:10, Thomas Kluyver wrote: >>> On 8 November 2012 17:00, Carl Smith wrote: >>>> >>>> I had to quickly set things up, but yeah, everything works according >>>> to spec in the console. It's just the Notebook. I'd ask on the adb >>>> list if there's anything unusual about how it works, but I think it >>>> was done in house by Google. I'm not sure. I'll have to look into it. >>> >>> >>> Hmm, that's really weird, because the Qt console and the notebook use the >>> same kernel. Can you try starting with "ipython qtconsole --debug", and >>> finding the lines that look like this: >>> >>> [IPKernelApp] Content: {'user_variables': [], 'code': '!pwd\n', 'silent': >>> False, 'allow_stdin': True, 'store_history': True, 'user_expressions': {}} >>> ---> >>> >>> [IPythonQtConsoleApp] stream: {'data': >>> '/home/thomas/Code/ubuntu/unattended-upgrades\r\n', 'name': 'stdout'} >>> >>> Thomas >>> >>> _______________________________________________ >>> IPython-dev mailing list >>> IPython-dev at scipy.org >>> http://mail.scipy.org/mailman/listinfo/ipython-dev >>> From carl.input at gmail.com Thu Nov 8 12:28:29 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:28:29 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: When I did `!adb shell ls`, I got the following... [IPythonQtConsoleApp] stream: {'data': 'acct\r\r\ncache\r\r\nconfig\r\r\nd\r\r\ndata\r\r\ndefault.prop\r\r\ndev\r\r\nefs\r\r\netc\r\r\nfota.rc\r\r\ninit\r\r\ninit.goldfish.rc\r\r\ninit.rc\r\r\ninit.smdk4210.rc\r\r\ninit.smdk4210.usb.rc\r\r\nlib\r\r\nlpm.rc\r\r\nmnt\r\r\npreload\r\r\nproc\r\r\nrecovery.rc\r\r\nres\r\r\nsbin\r\r\nsdcard\r\r\nsys\r\r\nsystem\r\r\ntmp\r\r\nueventd.goldfish.rc\r\r\nueventd.rc\r\r\nueventd.smdk4210.rc\r\r\nvendor\r\r\n', 'name': 'stdout'} [IPKernelApp] {'parent_header': {'date': datetime.datetime(2012, 11, 8, 17, 27, 24, 738194), 'username': 'carl', 'session': '44bb1c02-4a19-437f-b2c4-869ee195a00b', 'msg_id': 'b4a34377-54e0-4714-bd82-e85c562682f7', 'msg_type': 'execute_request'}, 'msg_type': u'execute_reply', 'msg_id': '5d6e64a5-5007-483d-8b47-b46d6eb7d6ad', 'content': {'status': u'ok', 'execution_count': 1, 'user_variables': {}, 'payload': [], 'user_expressions': {}}, 'header': {'date': datetime.datetime(2012, 11, 8, 17, 27, 24, 973465), 'username': u'kernel', 'session': u'03382175-eff5-4e65-b5b7-d0bc0473e7a1', 'msg_id': '5d6e64a5-5007-483d-8b47-b46d6eb7d6ad', 'msg_type': u'execute_reply'}, 'tracker': , 'metadata': {'dependencies_met': True, 'engine': u'77619da4-0319-499d-90c3-43d269935d5d', 'status': u'ok', 'started': datetime.datetime(2012, 11, 8, 17, 27, 24, 742003)}} [IPythonQtConsoleApp] execute: {'status': 'ok', 'execution_count': 1, 'user_variables': {}, 'payload': [], 'user_expressions': {}} On 8 November 2012 17:24, Thomas Kluyver wrote: > Sorry, I should have been clearer: start the Qt console like that, then > execute !adb shell ls (or any command that shows the problem). > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From takowl at gmail.com Thu Nov 8 12:32:37 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 8 Nov 2012 17:32:37 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: On 8 November 2012 17:28, Carl Smith wrote: > > 'acct\r\r\ncache\r\r\nconfig\r\r\nd\r\r\ndata\r\r\ndefault.prop\r\r\ndev\r\r\nefs\r\r\netc\r\r\nfota.rc\r\r\ninit\r\r\ninit.goldfish.rc\r\r\ninit.rc\r\r\ninit.smdk4210.rc\r\r\ninit.smdk4210.usb.rc\r\r\nlib\r\r\nlpm.rc\r\r\nmnt\r\r\npreload\r\r\nproc\r\r\nrecovery.rc\r\r\nres\r\r\nsbin\r\r\nsdcard\r\r\nsys\r\r\nsystem\r\r\ntmp\r\r\nueventd.goldfish.rc\r\r\nueventd.rc\r\r\nueventd.smdk4210.rc\r\r\nvendor\r\r\n', > I bet this is the problem. Not content with Unix line endings \n, Windows \r\n or classic Mac \r, adb appears to have decided on \r\r\n. I bet the Javascript in the notebook is handling that differently to the terminal and the Qt console, so the first \r is blanking the line. Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Thu Nov 8 12:37:37 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:37:37 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: You're a genius Thomas. I'll be back in ten. I'm at home and my kids are kicking off :/ On 8 November 2012 17:32, Thomas Kluyver wrote: > On 8 November 2012 17:28, Carl Smith wrote: >> >> >> 'acct\r\r\ncache\r\r\nconfig\r\r\nd\r\r\ndata\r\r\ndefault.prop\r\r\ndev\r\r\nefs\r\r\netc\r\r\nfota.rc\r\r\ninit\r\r\ninit.goldfish.rc\r\r\ninit.rc\r\r\ninit.smdk4210.rc\r\r\ninit.smdk4210.usb.rc\r\r\nlib\r\r\nlpm.rc\r\r\nmnt\r\r\npreload\r\r\nproc\r\r\nrecovery.rc\r\r\nres\r\r\nsbin\r\r\nsdcard\r\r\nsys\r\r\nsystem\r\r\ntmp\r\r\nueventd.goldfish.rc\r\r\nueventd.rc\r\r\nueventd.smdk4210.rc\r\r\nvendor\r\r\n', > > > I bet this is the problem. Not content with Unix line endings \n, Windows > \r\n or classic Mac \r, adb appears to have decided on \r\r\n. I bet the > Javascript in the notebook is handling that differently to the terminal and > the Qt console, so the first \r is blanking the line. > > Thomas > > _______________________________________________ > IPython-dev mailing list > IPython-dev at scipy.org > http://mail.scipy.org/mailman/listinfo/ipython-dev > From carl.input at gmail.com Thu Nov 8 12:54:21 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 17:54:21 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: Sorry. Just had to do the old din-dins routine. What do you think can be done about this then? Shall I open a bug report? I'd have a go at fixing it, but wouldn't know where to start. From takowl at gmail.com Thu Nov 8 13:00:02 2012 From: takowl at gmail.com (Thomas Kluyver) Date: Thu, 8 Nov 2012 18:00:02 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References:

Message-ID: On 8 November 2012 17:54, Carl Smith wrote: > What do you think can be done about this then? Shall I open a bug > report? I'd have a go at fixing it, but wouldn't know where to start. > Yes, do open a bug report. If you're willing to dig into the notebook javascript, it will be somewhere in there, but I don't know where. Or if you're busy, I'm sure someone will get onto it before long. Thanks, Thomas -------------- next part -------------- An HTML attachment was scrubbed... URL: From carl.input at gmail.com Thu Nov 8 13:07:58 2012 From: carl.input at gmail.com (Carl Smith) Date: Thu, 8 Nov 2012 18:07:58 +0000 Subject: [IPython-dev] A couple of odd behaviours... In-Reply-To: References: