How to safely maintain a status file

Laszlo Nagy gandalf at shopzeus.com
Thu Jul 12 08:31:50 EDT 2012


>     Renaming files is the wrong way to synchronize a
> crawler.  Use a database that has ACID properties, such as
> SQLite.  Far fewer I/O operations are required for small updates.
> It's not the 1980s any more.
I agree with this approach. However, the OP specifically asked about 
"how to update status file".



More information about the Python-list mailing list