From bn121rajesh at gmail.com  Wed Mar 23 02:58:08 2016
From: bn121rajesh at gmail.com (Rajesh Bondugula)
Date: Tue, 22 Mar 2016 23:58:08 -0700
Subject: [IPython-dev] pyspark with jupyter
Message-ID: <CA+LCnPDE3yokxP=UmkBL-ZjTycR+3-8c7iYE+n350179cZ-xoA@mail.gmail.com>

hi all,


I am trying to integrate pyspark with jupyter notebook.
most of the online resources are for ipython.
please guide me in setting up pyspark with ju[yter.

Thanks
Rajesh
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20160322/79cb6c44/attachment.html>

From kikocorreoso at gmail.com  Wed Mar 23 03:09:33 2016
From: kikocorreoso at gmail.com (Kiko)
Date: Wed, 23 Mar 2016 08:09:33 +0100
Subject: [IPython-dev] pyspark with jupyter
In-Reply-To: <CA+LCnPDE3yokxP=UmkBL-ZjTycR+3-8c7iYE+n350179cZ-xoA@mail.gmail.com>
References: <CA+LCnPDE3yokxP=UmkBL-ZjTycR+3-8c7iYE+n350179cZ-xoA@mail.gmail.com>
Message-ID: <CAB-sx61TE_B5sz3=j+zoWVfYXAP8jttyk_=A7kAy+Me2b5C-Yw@mail.gmail.com>

2016-03-23 7:58 GMT+01:00 Rajesh Bondugula <bn121rajesh at gmail.com>:

> hi all,
>
>
> I am trying to integrate pyspark with jupyter notebook.
> most of the online resources are for ipython.
> please guide me in setting up pyspark with ju[yter.
>

There are some resources out there if you look for jupyter and pyspark on
ddg:
https://github.com/jupyter/notebook/issues/309#issuecomment-134540424
http://thepowerofdata.io/configuring-jupyteripython-notebook-to-work-with-pyspark-1-4-0/
http://npatta01.github.io/2015/08/01/pyspark_jupyter/
https://duckduckgo.com/?q=pyspark+jupyter&t=ffsb


> Thanks
> Rajesh
>
> _______________________________________________
> IPython-dev mailing list
> IPython-dev at scipy.org
> https://mail.scipy.org/mailman/listinfo/ipython-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20160323/0a155d55/attachment.html>

From denis.pinsard at dichotomies.fr  Thu Mar 24 17:39:37 2016
From: denis.pinsard at dichotomies.fr (Denis Pinsard)
Date: Thu, 24 Mar 2016 22:39:37 +0100
Subject: [IPython-dev] IOCaml codemirror
In-Reply-To: <CA+tbMaV0=WzCJ=rbGc66=dzdaUY_zNUUd++T8ygKRkA52_C7ng@mail.gmail.com>
References: <CAHNn8BVSa_eMsH0HgsXmL5VKfJSUjhE6bE4Uh_mzc-eEjOYviA@mail.gmail.com>
 <CAH4pYpQVc4G_ZHr8FuxiZrh3k25C-SdAiozWKoWL-u9L4W9WPA@mail.gmail.com>
 <CAHAreOopfFx2m+WJcoKoygNSKHEMDJzT7Smcbu21gtu+pWp2gg@mail.gmail.com>
 <9B14741F-7E88-42C5-A42B-88108B46A53C@gmail.com>
 <CA+tbMaV0=WzCJ=rbGc66=dzdaUY_zNUUd++T8ygKRkA52_C7ng@mail.gmail.com>
Message-ID: <56F45E99.3010509@dichotomies.fr>

Hello,

I am using the  dev version of Jupyter with the IOcaml kernel.
Every thing works well except that there is no syntax highlighting.
The metadata of the notebook is

{
   "kernelspec": {
     "name": "ocaml",
     "display_name": "OCaml",
     "language": "ocaml"
   },
   "language_info": {
     "version": "4.1.0",
     "name": "ocaml"
   }
}

What should I do to activate codemirror ?

When I add
"codemirror_mode" : "mllike"
in the metadata, this information is removed when the page and reloaded.

Thank you for your help.

Denis Pinsard


From takowl at gmail.com  Thu Mar 24 17:56:13 2016
From: takowl at gmail.com (Thomas Kluyver)
Date: Thu, 24 Mar 2016 21:56:13 +0000
Subject: [IPython-dev] IOCaml codemirror
In-Reply-To: <56F45E99.3010509@dichotomies.fr>
References: <CAHNn8BVSa_eMsH0HgsXmL5VKfJSUjhE6bE4Uh_mzc-eEjOYviA@mail.gmail.com>
 <CAH4pYpQVc4G_ZHr8FuxiZrh3k25C-SdAiozWKoWL-u9L4W9WPA@mail.gmail.com>
 <CAHAreOopfFx2m+WJcoKoygNSKHEMDJzT7Smcbu21gtu+pWp2gg@mail.gmail.com>
 <9B14741F-7E88-42C5-A42B-88108B46A53C@gmail.com>
 <CA+tbMaV0=WzCJ=rbGc66=dzdaUY_zNUUd++T8ygKRkA52_C7ng@mail.gmail.com>
 <56F45E99.3010509@dichotomies.fr>
Message-ID: <CAOvn4qhcok1CLpP2SYYV2ArqDfDdH6VwJeyHNTnJGW0Qg0=ikw@mail.gmail.com>

On 24 March 2016 at 21:39, Denis Pinsard <denis.pinsard at dichotomies.fr>
wrote:

> When I add
> "codemirror_mode" : "mllike"
> in the metadata, this information is removed when the page and reloaded.
>

I think you need to get the IOcaml kernel authors to include that in the
language info in the kernel.

Thomas
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20160324/aba627ff/attachment.html>

From sylvain.corlay at gmail.com  Fri Mar 25 07:34:55 2016
From: sylvain.corlay at gmail.com (Sylvain Corlay)
Date: Fri, 25 Mar 2016 07:34:55 -0400
Subject: [IPython-dev] IOCaml codemirror
In-Reply-To: <CAOvn4qhcok1CLpP2SYYV2ArqDfDdH6VwJeyHNTnJGW0Qg0=ikw@mail.gmail.com>
References: <CAHNn8BVSa_eMsH0HgsXmL5VKfJSUjhE6bE4Uh_mzc-eEjOYviA@mail.gmail.com>
 <CAH4pYpQVc4G_ZHr8FuxiZrh3k25C-SdAiozWKoWL-u9L4W9WPA@mail.gmail.com>
 <CAHAreOopfFx2m+WJcoKoygNSKHEMDJzT7Smcbu21gtu+pWp2gg@mail.gmail.com>
 <9B14741F-7E88-42C5-A42B-88108B46A53C@gmail.com>
 <CA+tbMaV0=WzCJ=rbGc66=dzdaUY_zNUUd++T8ygKRkA52_C7ng@mail.gmail.com>
 <56F45E99.3010509@dichotomies.fr>
 <CAOvn4qhcok1CLpP2SYYV2ArqDfDdH6VwJeyHNTnJGW0Qg0=ikw@mail.gmail.com>
Message-ID: <CAK=Phk5m-+shOwiunZqLTf=XHMhiem6cQLAUbs7h=+qEm137Wg@mail.gmail.com>

One must specify the mimetype 'text/x-ocaml', or specify the codemirror
mode 'ocaml'.

The mode overrides the mimetype if both are specified.

It is probably cleaner to specify the mimetype.
On Mar 24, 2016 9:56 PM, "Thomas Kluyver" <takowl at gmail.com> wrote:

> On 24 March 2016 at 21:39, Denis Pinsard <denis.pinsard at dichotomies.fr>
> wrote:
>
>> When I add
>> "codemirror_mode" : "mllike"
>> in the metadata, this information is removed when the page and reloaded.
>>
>
> I think you need to get the IOcaml kernel authors to include that in the
> language info in the kernel.
>
> Thomas
>
> _______________________________________________
> IPython-dev mailing list
> IPython-dev at scipy.org
> https://mail.scipy.org/mailman/listinfo/ipython-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20160325/74107481/attachment.html>

From jonathan.taylor at stanford.edu  Sat Mar 26 03:32:09 2016
From: jonathan.taylor at stanford.edu (Jonathan Taylor)
Date: Sat, 26 Mar 2016 00:32:09 -0700
Subject: [IPython-dev] round-tripping md -> ipynb -> md
In-Reply-To: <CANmCCuQ9NwY-unrHDDaGa8JoGH95xPUqxMb0_5HwgwddW1QviQ@mail.gmail.com>
References: <CANmCCuSOcJoNyw6WBUNtJx1-9yKxemgq953DdMrwMm2qayXP3g@mail.gmail.com>
 <CANmCCuQ9NwY-unrHDDaGa8JoGH95xPUqxMb0_5HwgwddW1QviQ@mail.gmail.com>
Message-ID: <CANmCCuSJhi4wpXUKFzV=EHs05mEV1WCnC5AF2U1s=q3o56Kbgw@mail.gmail.com>

The .md is not as good as carefully written .rst but it is a nice way to
"edit" notebooks in which the only distinction is code or not code.

If you want to decorate the cells with metadata as in a slideshow, this is
not going to do it, but at least it provides usual text editing for simple
notebooks where metadata is not an issue.  (I always harp on making slides
because a lot of what I need for teaching and talks is being able to have a
slideshow.)

Since notedown can read .Rmd maybe it can be tricked into slideshows as one
can compile slideshows from .Rmd using knitr so .Rmd files have the logic
of slide breaks.

(Cc'ed the jupyter google group in case this is known and/or there is
something better out there)


On Sat, Mar 26, 2016 at 12:13 AM, Jonathan Taylor <
jonathan.taylor at stanford.edu> wrote:

> For example, Group_LASSO.md is clean with no outputs (
> https://raw.githubusercontent.com/jonathan-taylor/regreg/consolidate_docs/doc/markdown/Group_LASSO.md
> )
>
> *~/git-repos/regreg/doc/markdown **(consolidate_docs) *$ notedown
> Group_LASSO.md > tmp.ipynb;
>
> *~/git-repos/regreg/doc/markdown **(consolidate_docs) *$ jupyter
> nbconvert --to markdown tmp.ipynb
>
> [NbConvertApp] Converting notebook tmp.ipynb to markdown
>
> [NbConvertApp] Writing 8767 bytes to tmp.md
>
>
> Now, let's do the round trip:
>
>
> *~/git-repos/regreg/doc/markdown **(consolidate_docs) *$ notedown tmp.md
> > tmp2.ipynb
>
> *~/git-repos/regreg/doc/markdown **(consolidate_docs) *$ jupyter
> nbconvert --to markdown tmp2.ipynb
>
> [NbConvertApp] Converting notebook tmp2.ipynb to markdown
>
> [NbConvertApp] Writing 8767 bytes to tmp2.md
>
> *~/git-repos/regreg/doc/markdown **(consolidate_docs) *$ diff tmp.md
> tmp2.md
>
> *~/git-repos/regreg/doc/markdown **(consolidate_docs) *$
>
>
> Of course, if you edit tmp2.ipynb in the notebook, then of course tmp2.md
> will be different, but if you save it having cleared outputs the diff will
> be readable....
>
> On Fri, Mar 25, 2016 at 11:13 PM, Jonathan Taylor <
> jonathan.taylor at stanford.edu> wrote:
>
>> Hi all,
>>
>> Just wanted to say that round-tripping loop for writing and interacting
>> with docs seems to work fairly well. Brett's make system produces .md
>> __with output__ but if you save the .ipynb after having cleared the output
>> then the resulting .md is actually pretty good in limited attempts so far.
>>
>> So, one can write .md in an editor, fire up jupyter to interactively work
>> with the code and then get back to pretty clean .md rather easily.
>>
>> The .md saved with output is less usable for further editing as Brett
>> noted.
>>
>> --
>> Jonathan Taylor
>> Dept. of Statistics
>> Sequoia Hall, 137
>> 390 Serra Mall
>> Stanford, CA 94305
>> Tel:   650.723.9230
>> Fax:   650.725.8977
>> Web: http://www-stat.stanford.edu/~jtaylo
>>
>
>
>
> --
> Jonathan Taylor
> Dept. of Statistics
> Sequoia Hall, 137
> 390 Serra Mall
> Stanford, CA 94305
> Tel:   650.723.9230
> Fax:   650.725.8977
> Web: http://www-stat.stanford.edu/~jtaylo
>



-- 
Jonathan Taylor
Dept. of Statistics
Sequoia Hall, 137
390 Serra Mall
Stanford, CA 94305
Tel:   650.723.9230
Fax:   650.725.8977
Web: http://www-stat.stanford.edu/~jtaylo
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/ipython-dev/attachments/20160326/14832d90/attachment.html>