[Baypiggies] urllib2 query

[Damon McCormick]

Vikram,

Glen's suggestion would definitely be the way to go.  You wouldn't want to
use ftp if they provide an rsync server that mirrors the contents of the ftp
server. With rsync you get efficient, compressed transfers of only the files
that have changed (and only the *parts* of those files that have changed),
automatically, and without relying on time stamps.

-Damon


On Thu, Nov 18, 2010 at 5:51 PM, Glen Jarvis <glen at glenjarvis.com> wrote:

> Vikrim,
>
>     Although there don't seem to be a shortage of alternative (even some
> non-python suggestions), I want yo throw one more out there.
>
>     We do this automatic downloading and updating on bioinformatics data a
> lot. We started using rsync for pdb data from their FTP site and it has made
> a world of difference. We can update more often and each update takes less
> resources -- and finishes very quickly.
>
> Cheers,
>
>
>
> Glen
>
> El Nov 18, 2010, a las 11:06 AM, Vikram K <kpguy1975 at gmail.com> escribió:
>
> consider the following ftp site:
> <ftp://ftp.ncbi.nih.gov/refseq/H_sapiens/>
> ftp://ftp.ncbi.nih.gov/refseq/H_sapiens/
>
> I wish to write a program using urllib2 which can automatically download
> all the contents of one of the folders in this site (say, for example,
> mRNA_Prot) into a folder in my computer. Subsequently i want my program to
> be able to automatically update the downloaded folder in my computer in
> accordance with any changes made in future in the folder in the ftp site.
> Any suggestions on how i should proceed?
> I am using a windows 7 computer. Will i also have to use the scheduled
> tasks option in system tools for solving this problem?
>
> _______________________________________________
>
> Baypiggies mailing list
> Baypiggies at python.org
> To change your subscription options or unsubscribe:
> http://mail.python.org/mailman/listinfo/baypiggies
>
>
> _______________________________________________
> Baypiggies mailing list
> Baypiggies at python.org
> To change your subscription options or unsubscribe:
> http://mail.python.org/mailman/listinfo/baypiggies
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.python.org/pipermail/baypiggies/attachments/20101118/dbdebb05/attachment.html>