Any python scripts to do parallel downloading?

Jean-Paul Calderone exarkun at divmod.com
Wed Jan 31 17:20:16 EST 2007


On Wed, 31 Jan 2007 13:52:35 -0800, "Carl J. Van Arsdall" <cvanarsdall at mvista.com> wrote:
>Jean-Paul Calderone wrote:
>> On 31 Jan 2007 12:24:21 -0800, Carl Banks <pavlovevidence at gmail.com> wrote:
>>
>>> Michele Simionato wrote:
>>>
>>>> On Jan 31, 5:23 pm, "Frank Potter" <could.... at gmail.com> wrote:
>>>>
>>>>> I want to find a multithreaded downloading lib in python,
>>>>> can someone recommend one for me, please?
>>>>> Thanks~
>>>>>
>>>> Why do you want to use threads for that? Twisted is the
>>>> obvious solution for your problem,
>>>>
>>> Overkill?  Just to download a few web pages?  You've got to be
>>> kidding.
>>>
>>
>> Better "overkill" (whatever that is) than wasting time re-implementing
>> the same boring thing over and over for no reason.
>>
>
>How is that a waste of time?  I wrote the script to do it in 10 lines.
>What is a waste of time is learning a whole new technology/framework to
>do a simple task that can be scripted in 4 minutes.
>

You're right.  Learning new things is bad.  My mistake.

Jean-Paul



More information about the Python-list mailing list