HTTP Proxy : receive call on local socket takes a lot of time

[Rémi]

Hi all,

I am currently working on a HTTP Proxy. For maximum flexibility, I am 
implementing the proxy at a low level : I am using the SocketServer library.

The server itself is very simple:

class MyTCPServer(SocketServer.TCPServer):
     allow_reuse_address = 1

and the handler looks like:

class MyTCPHandler(SocketServer.BaseRequestHandler):

     def handle(self):
         # Prints ip and port
         print "\n####  " + str(self.client_address) + " ####"

         requestParser = HTTPRequestParser()

         while True:
             # Get packet
             data = self.request.recv(4096)

             if data == '':
                 break

             # Parse request packet
             if requestParser.got_new_chunk(data):
                 break

         someStuff = ""
         self.request.send(someStuff)


This is working fine, but I have a small performance issue.
The proxy is targeted by Firefox. Sometimes the first receive call on 
the input socket takes a lot of time (up to 20s sometimes), which should 
not be as this is a communication of two local sockets. This is 
occurring maybe every 30 requests or so.

When looking at the logs I noticed that this weird behavior happens when 
the client port is not contiguous to the previous ones. For example, 
handling the fourth request takes a lot of time:

####  ('127.0.0.1', 49704) ####
####  ('127.0.0.1', 49705) ####
####  ('127.0.0.1', 49706) ####
####  ('127.0.0.1', 49674) ####


Do you have any idea what the problem could be ? I tried to manually 
close self.request request, but I still have the problem. Is it related 
to "allow_reuse_address = 1" ?

Thanks for your help !

Rémi