[Python-ideas] Asynchronous IO ideas for Python

[Guido van Rossum]

Trent,

Can you post source for the regular and pyparallel HTTP servers you used?

On Wed, Nov 26, 2014 at 12:56 PM, Trent Nelson <trent at snakebite.org> wrote:

> Relevant part of the video with the normal Python stats on the left and
> PyParallel on the right:
>
> https://www.youtube.com/watch?v=4L4Ww3ROuro#t=838
>
> Transcribed stats:
>
> Regular Python HTTP server:
>
> Thread Stats    Avg     Stdev   Max
>  Latency        4.93ms  714us   10ms
>  Req/Seq        552     154     1.1k
> 10,480 requests in 10s, 69MB
> 1048 reqs/sec, 6.9MB/s
>
> PyParallel (4 core Windows VM):
>
> Thread Stats    Avg     Stdev   Max
>  Latency        2.41ms  531us   10ms
>  Req/Seq        1.74k   183     2.33k
> 32,831 requests in 10s, 216MB
> 3263 reqs/sec, 21MB/s
>
> So basically a bit less than linear scaling with more cores, which isn't
> too bad for a full debug build running on a VM.
>
> -----Original Message-----
> From: Trent Nelson
> Sent: Wednesday, November 26, 2014 3:36 PM
> To: 'Paul Colomiets'; python-ideas
> Subject: RE: [Python-ideas] Asynchronous IO ideas for Python
>
> Have you seen this?:
>
>
> https://speakerdeck.com/trent/pyparallel-how-we-removed-the-gil-and-exploited-all-cores
>
> I spend the first 80-ish slides on async I/O.
>
> (That was a year ago.  I've done 2-3 sprints on it since then and have
> gotten it to a point where I can back up the claims with hard numbers on
> load testing benchmarks, demonstrated in the most recent video:
> https://www.youtube.com/watch?v=4L4Ww3ROuro.)
>
>
>         Trent.
>
> -----Original Message-----
> From: Python-ideas [mailto:python-ideas-bounces+trent=
> snakebite.org at python.org] On Behalf Of Paul Colomiets
> Sent: Wednesday, November 26, 2014 12:35 PM
> To: python-ideas
> Subject: [Python-ideas] Asynchronous IO ideas for Python
>
> Hi,
>
> I've written an article about how I perceive the future of asynchronous
> I/O in Python. It's not something that should directly be incorporated into
> python now, but I believe it's useful for python-ideas list.
>
>
> https://medium.com/@paulcolomiets/the-future-of-asynchronous-io-in-python-ce200536d847
>
> And a place for comments at Hacker News:
>
> https://news.ycombinator.com/item?id=8662782
>
> I hope being helpful with this writeup :)
>
> --
> Paul
> _______________________________________________
> Python-ideas mailing list
> Python-ideas at python.org
> https://mail.python.org/mailman/listinfo/python-ideas
> Code of Conduct: http://python.org/psf/codeofconduct/
> _______________________________________________
> Python-ideas mailing list
> Python-ideas at python.org
> https://mail.python.org/mailman/listinfo/python-ideas
> Code of Conduct: http://python.org/psf/codeofconduct/
>



-- 
--Guido van Rossum (python.org/~guido)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/python-ideas/attachments/20141126/53c2e48c/attachment-0001.html>