[Catalog-sig] PyPI mirrors are all up to date

Tarek Ziadé tarek at ziade.org
Mon Apr 16 23:05:53 CEST 2012


On 4/16/12 10:57 PM, ken cochrane wrote:
> That would be nice, you could include other stats information as well
> (not sure what yet).
sounds like a nice "checksum" addition to PEP 381- that'd avoid 
client-side parsing just to get the number of mirrored packages.

>
> Ken
>
>
> On Mon, Apr 16, 2012 at 4:48 PM, Tarek Ziadé<tarek at ziade.org>  wrote:
>> On 4/16/12 9:58 PM, ken cochrane wrote:
>>> Ouch, does that take a while to gather the number of files?
>>> Is there any open source code that already does this, that I can look at?
>>> I'm thinking packages might be find for now.
>> the other option would be to change the mirroring protocol to have that
>> total in a static page, like the timestamp
>>
>>
>>> Thanks,
>>> Ken
>>>
>>>
>>> On Mon, Apr 16, 2012 at 3:52 PM, Donald Stufft<donald.stufft at gmail.com>
>>>   wrote:
>>>> On Monday, April 16, 2012 at 3:46 PM, ken cochrane wrote:
>>>>
>>>> Is it possible to get the number of packages on each mirror? If so,
>>>> can you let me know and I'll look into adding it.
>>>>
>>>> Not without parsing the simple api. If you just want to know the total
>>>> number of
>>>> names, you can parse the index page for number of links. If you want the
>>>> total number
>>>> of files then you'll need to descend into all 20kish pages as well and
>>>> pull
>>>> links out of there.
>>>>
>>>>
>>>> On Mon, Apr 16, 2012 at 5:15 AM, Sebastien Douche<sdouche at gmail.com>
>>>>   wrote:
>>>>
>>>> Nice! Thanks Ken. Missing only an information imho: the number of
>>>> packages on each mirror (to known if the mirror is really up to date).
>>>>
>>>> _______________________________________________
>>>> Catalog-SIG mailing list
>>>> Catalog-SIG at python.org
>>>> http://mail.python.org/mailman/listinfo/catalog-sig
>>>>
>>>>
>>> _______________________________________________
>>> Catalog-SIG mailing list
>>> Catalog-SIG at python.org
>>> http://mail.python.org/mailman/listinfo/catalog-sig
>>
>> _______________________________________________
>> Catalog-SIG mailing list
>> Catalog-SIG at python.org
>> http://mail.python.org/mailman/listinfo/catalog-sig



More information about the Catalog-SIG mailing list