[Pandas-dev] New website infrastructure

[Marc Garcia]

Hi,

An update on the new website infrastructure. We need to finish discussing
the details, but OVH is happy to provide the hosting for the pandas
infrastructure we need.

My initial idea is to credit them in the page with the rest of the sponsors
in the new website:
https://datapythonista.github.io/pandas-web/community/team.html#institutional-partners
and
also in the top right corner of the runnable code widgets (see for example
where Binder is credited here: https://spacy.io/).

What I'd like to ask is:

1. For the production website and docs (static content only, for the
traffic we need):
https://us.ovhcloud.com/products/public-cloud/object-storage
2. For our tools and processes, like the benchmarks, builds, CI stuff
(temporary publish the docs for every PR,...):
https://www.ovh.co.uk/vps/vps-ssd.xml (VPS SSD 3)
3. For BinderHub (runnable code in our docs, launch tutorials on
Binder...): https://www.ovh.co.uk/public-cloud/kubernetes/

For the BinderHub, QuantStack offered help with the set up (which is great,
because I don't know much about Binder myself, and I'm not sure if anyone
else does or wants to take care of this). I don't think it'll be easy to
estimate how big is the cluster we need beforehand, but I guess we can add
things to Binder iteratively, and have more info as we grow.

OVH gave us a 200 euros voucher to experiment with the different services.
Let me know how all this sounds, and if there are no objections, I'll
create an account and buy those services with the voucher, and I'll start
to prototype and see how everything works.

Cheers!

On Tue, Aug 20, 2019 at 11:06 PM Marc Garcia <garcia.marc at gmail.com> wrote:

> Somehow related to the work on the new website (
> https://github.com/pandas-dev/pandas/pull/28014), I've been discussing
> with the Binder team, and looks like should be quite easy soon (with a
> Sphinx extension) to make all the documentation pages runnable with Binder,
> directly from the website (without opening the page as a Jupyter in
> mybinder).
>
> While they are very happy with the idea of having this is pandas, it's
> uncertain if the current infrastructure Binder has got, is able to handle
> all the traffic we would send. And scikit-learn is working on it too (today
> they added to the dev docs a link to mybinder to run the examples).
>
> I'm discussing with OVH (their infrastructure provider) on whether they'd
> be happy to provide a dedicated BinderHub specific to pandas (or may be we
> can have one for all NumFOCUS projects). We'll see how it goes, but wanted
> to let you know, so you're updated, and in case anyone is interested in
> participating in the discussions. Of course before any decision is made
> I'll open a discussion here or on GitHub.
>
> As part of the discussion I'm also trying to get a server for the website,
> and one for development stuff. Specfically for the dev docs (including
> rendered docs of every PR) and the GitHub app that will generate them. I
> guess it should be very easy to find a sponsor for these two servers (in
> exchange of a small note in the footer of the website, or something like
> that).
>
> Let me know if you have any comment, want to be involved or whatever.
>
> Cheers!
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/pandas-dev/attachments/20190918/2db23e80/attachment.html>