Py2.7/FreeBSD: maximum number of open files

Jon Clements joncle at googlemail.com
Mon Nov 14 12:33:48 EST 2011


On Nov 14, 5:03 pm, Tobias Oberstein <tobias.oberst... at tavendo.de>
wrote:
> > > I need 50k sockets + 100 files.
>
> > > Thus, this is even more strange: the Python (a Twisted service) will
> > > happily accept 50k sockets, but as soon as you do open() a file, it'll bail out.
>
> > A limit of 32k smells like a overflow in a signed int. Perhaps your system is
> > able and configured to handle more than 32k FDs but you hit an artificial limit
> > because some C code or API has a overflow. This seems to be a known bug in
> > FreeBSDhttp://lists.freebsd.org/pipermail/freebsd-bugs/2010-
> > July/040689.html
>
> This is unbelievable.
>
> I've just tested: the bug (in libc) is still there on FreeBSD 8.2 p3 ... both on i386
> _and_ amd64.
>
> Now I'm f***d;(
>
> A last chance: is it possible to compile Python for not using libc fopen(),
> but the Posix open()?
>
> Thanks anyway for this hint!

Have you tried/or is it possible to get your 100 or whatever files
first, before your sockets?

hth

Jon



More information about the Python-list mailing list