scaling problems

James A. Donald jamesd at echeque.com
Tue May 20 00:00:19 EDT 2008


> > 2.  It is not clear to me how a python web application scales.  Python
> > is inherently single threaded, so one will need lots of python
> > processes on lots of computers, with the database software handling
> > parallel accesses to the same or related data.  One could organize it
> > as one python program for each url, and one python process for each
> > http request, but that involves a lot of overhead starting up and
> > shutting down python processes.  Or one could organize it as one
> > python program for each url, but if one gets a lot of http requests
> > for one url, a small number of python processes will each sequentially
> > handle a large number of those requests.  What I am really asking is:
> > Are there python web frameworks that scale with hardware and how do
> > they handle scaling?

Reid Priedhorsky 
> This sounds like a good match for Apache with mod_python.

I would hope that it is, but the question that I would like to know is
how does mod_python handle the problem - how do python programs and
processes relate to web pages and http requests when one is using
mod_python, and what happens when one has quite a lot of web pages and
a very large number of http requests?
--
  ----------------------
We have the right to defend ourselves and our property, because 
of the kind of animals that we are. True law derives from this 
right, not from the arbitrary power of the omnipotent state.

http://www.jim.com/      James A. Donald



More information about the Python-list mailing list