Fastest way to write huge files

James Mills prologic at shortcircuit.net.au
Thu Aug 28 21:57:02 EDT 2008


Hi,

You could use generators connected
via a pipe or tcp socket ...

cheers
James

On Fri, Aug 29, 2008 at 10:35 AM, Mohamed Yousef <harrrrpo at gmail.com> wrote:
> Hello ,
>
> let's say , I'm moving large files through network between devices
> what is the fastest way to do this ?
> what i came up with :-
>
> 1) using regular file operations with an in memory limit of 4MB which
> when filled written to disk and re-filled again
>
> 2) using memory mapped files in the following way , map first 20MB of
> file and after finishing them flush and map next 20MB
> ------
> which of them should be faster in writting to disk ? and less memory consuming
>
> or is there faster ways ?
>
> Thanks,
>
> Regards ,
> Mohamed Yousef
> --
> http://mail.python.org/mailman/listinfo/python-list
>



-- 
--
-- "Problems are solved by method"



More information about the Python-list mailing list