Fastest way to write huge files

Larry Bates larry.bates at vitalEsafe.com
Sat Aug 30 08:28:02 EDT 2008


Mohamed Yousef wrote:
> Thanks all ,
> but there is still something i forget to state -sorry - all
> communication will be via Http with a server
> so data is received via Http
> so local network solutions won't work
> the problem really starts after receiving data in storing them without
> much of a CPU/Memory usage and with a good speed
> 
> @James Mills : didn't understand fully what you mean and how it will
> improve writting effciency
> 
> Thanks,
> 
> Regards,
> Mohamed Yousef
> 
> 2008/8/29 Tim Golden <mail at timgolden.me.uk>:
>> Terry Reedy wrote:
>>>
>>> Mohamed Yousef wrote:
>>>> let's say , I'm moving large files through network between devices
>>>> what is the fastest way to do this ?
>>>> what i came up with :-
>>> Use your OS's network copy command.  On unix, that was once uucp.  On
>>> Windows, I drag-and-drop to/from a Network Neighborhood location, including
>>> to a printer, so I don't know whether you can use copy and if so how.
>> For completeness' sake, on Windows you could use any of the following
>> techniques with a UNC as the destination (and/or source):
>>
>> http://timgolden.me.uk/python/win32_how_do_i/copy-a-file.html
>>
>> TJG
>> --
>> http://mail.python.org/mailman/listinfo/python-list
>>

If connection is over Internet via HTTP the connection speed is so slow in 
relation to the speed of your CPU that it doesn't really matter.  You are 
prematurely optimizing your application.  Get it working first and then see if 
the file writing is the bottleneck (it probably won't be).

-Larry



More information about the Python-list mailing list