From doug.hellmann at gmail.com Tue Jan 1 23:48:03 2013 From: doug.hellmann at gmail.com (Doug Hellmann) Date: Tue, 1 Jan 2013 17:48:03 -0500 Subject: [Catalog-sig] setting up a "full" mirror In-Reply-To: References: <976B18CD-4B80-494D-AE40-3C5E62329D51@gmail.com> Message-ID: Thanks, Donald, that gives us an idea of what we would be getting into. Doug On Dec 27, 2012, at 3:51 PM, Donald Stufft wrote: > When I started Crate.io in February 2012 a full mirror was 27GB, When I did a fresh sync the other day it was 38GB. > On Thursday, December 27, 2012 at 3:43 PM, Doug Hellmann wrote: > >> DreamHost is considering setting up a mirror of PyPI. Before we commit to doing so, we would like to find out how much space is currently required and how fast that space requirement has been growing over the past few months. >> >> Are those stats available easily? >> >> Doug >> >> _______________________________________________ >> Catalog-SIG mailing list >> Catalog-SIG at python.org >> http://mail.python.org/mailman/listinfo/catalog-sig > -------------- next part -------------- An HTML attachment was scrubbed... URL: From tschouns at gmail.com Sat Jan 5 12:53:15 2013 From: tschouns at gmail.com (Jonas Baumann) Date: Sat, 5 Jan 2013 12:53:15 +0100 Subject: [Catalog-sig] Pypi mirrors are inconsistent Message-ID: Hey there, Last month the pypi mirrors got inconsistent regarding the dists of the package plone.testing. On the mirrors a and e there is a plone.testing==4.0.7, but on the mirrors b, c, d, f and g this version is missing. See: http://a.pypi.python.org/simple/plone.testing/ http://b.pypi.python.org/simple/plone.testing/ http://c.pypi.python.org/simple/plone.testing/ http://d.pypi.python.org/simple/plone.testing/ http://e.pypi.python.org/simple/plone.testing/ http://f.pypi.python.org/simple/plone.testing/ http://g.pypi.python.org/simple/plone.testing/ https://pypi.crate.io/simple/plone.testing/ http://www.pypi-mirrors.org/ says the mirrors are mostly fresh and seems not to be able to detect such inconsistencies. How could that happen? How can it be fixed? Cheers, Jonas -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at zopyx.com Sat Jan 5 14:30:56 2013 From: lists at zopyx.com (Andreas Jung) Date: Sat, 05 Jan 2013 14:30:56 +0100 Subject: [Catalog-sig] Pypi mirrors are inconsistent In-Reply-To: References: Message-ID: <50E82B10.3040802@zopyx.com> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 I assume that the pep381client implementation might need something like "mix-missing packages" option. - -aj Jonas Baumann wrote: > Hey there, > > Last month the pypi mirrors got inconsistent regarding the dists of > the package plone.testing. > > On the mirrors a and e there is a plone.testing==4.0.7, but on the > mirrors b, c, d, f and g this version is missing. > > See: http://a.pypi.python.org/simple/plone.testing/ > http://b.pypi.python.org/simple/plone.testing/ > http://c.pypi.python.org/simple/plone.testing/ > http://d.pypi.python.org/simple/plone.testing/ > http://e.pypi.python.org/simple/plone.testing/ > http://f.pypi.python.org/simple/plone.testing/ > http://g.pypi.python.org/simple/plone.testing/ > https://pypi.crate.io/simple/plone.testing/ > > http://www.pypi-mirrors.org/ says the mirrors are mostly fresh and > seems not to be able to detect such inconsistencies. > > How could that happen? How can it be fixed? > > Cheers, Jonas > > _______________________________________________ Catalog-SIG mailing > list Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig - -- ZOPYX Limited | Python | Zope | Plone | MongoDB Hundskapfklinge 33 | Consulting & Development D-72074 T?bingen | Electronic Publishing Solutions www.zopyx.com | Scalable Web Solutions - -------------------------------------------------- Produce & Publish - www.produce-and-publish.com -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iQGUBAEBAgAGBQJQ6CsQAAoJEADcfz7u4AZjVrgLv34X5CYsyaDK7Q65yT4VBVIE NP9EELgEFU/QqZo/vEHyDH3XldVVN6eO6RvuHC8kZbTFbRiidHXRSQKg+zRuw38/ 2juAaSSRYazJS+UvhFVqHh0LClK/Re84AtzuwQHZcqLRZGD81bwWnTuhGTZgx2Rk /f1GeMqUUbkNpYilCL9eQjw/qL/Wo1l7jhyD9oNJDRVjjseL4tJFsvgdcsJ/RNWv VwAOaspq5ITkkff+NHDma7nlCgTNI5nEs4sFjvmzLBrBpK8Rj+wWDQzLYp7v6YuF EOmE3CxL/l67A0kRIPOEnZqwVDUv+Da3zEdDiqDd7kWmQfIHLL6DCSJOEwykz7bC J18uqYHBev+0MO/IQEdDoIFCHOpslHNnnAoZBIZJRcAgljFMxx7wreTGKLZ3rUXH QgOtmgibKilMKGtVw4NHX+Qg2JcM/ApgEy2j63JckNxI6rhhmS5uZibs7pcqWttl N+4XhuZB1n+1Hk8v5isvr5omHnVI4H4= =JQak -----END PGP SIGNATURE----- -------------- next part -------------- A non-text attachment was scrubbed... Name: lists.vcf Type: text/x-vcard Size: 353 bytes Desc: not available URL: From holger.krekel at gmail.com Mon Jan 7 13:07:37 2013 From: holger.krekel at gmail.com (Holger Krekel) Date: Mon, 7 Jan 2013 13:07:37 +0100 Subject: [Catalog-sig] fresh pep381run pypi-mirroring fails since >1 week Message-ID: Hi all, During the last 7 days i tried running "pep381run" with a fresh directory on two different hosts. They both failed while trying to copy "azb_nester-1.2.0.tar.gz", see here for the traceback: http://bpaste.net/show/SoMoyjdJEIGvm99dH6gG/ It seems that azb_nester does not have any files anymore on pypi.python.org, they probably got deleted. Is that a bug in the pep381run software or in the pep381 mirroring protocol or ...? best, holger -------------- next part -------------- An HTML attachment was scrubbed... URL: From tarek at ziade.org Mon Jan 7 14:42:27 2013 From: tarek at ziade.org (=?ISO-8859-1?Q?Tarek_Ziad=E9?=) Date: Mon, 07 Jan 2013 14:42:27 +0100 Subject: [Catalog-sig] fresh pep381run pypi-mirroring fails since >1 week In-Reply-To: References: Message-ID: <50EAD0C3.6020800@ziade.org> On 1/7/13 1:07 PM, Holger Krekel wrote: > Hi all, > > During the last 7 days i tried running "pep381run" with a fresh > directory on two different hosts. They both failed while trying to > copy "azb_nester-1.2.0.tar.gz", see here for the traceback: > http://bpaste.net/show/SoMoyjdJEIGvm99dH6gG/ It seems that azb_nester > does not have any files anymore on pypi.python.org > , they probably got deleted. > > Is that a bug in the pep381run software or in the pep381 mirroring > protocol or ...? > > best, > holger This is not a fix, but maybe try with my version: https://bitbucket.org/tarek/pep381client I ran into a lot of issues on the first run, and that fork tries to make sure the mirroring continues until the end > > > > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig -- Tarek Ziad? ? http://ziade.org ? @tarek_ziade -------------- next part -------------- An HTML attachment was scrubbed... URL: From kencochrane at gmail.com Tue Jan 15 14:42:48 2013 From: kencochrane at gmail.com (ken cochrane) Date: Tue, 15 Jan 2013 08:42:48 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape Message-ID: According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape right now. We only have one mirror (f.pypi.python.org) that isn't more then 8 hours out of date. We have one server e.pypi.python.org I can't even connect to anymore, and I'm not sure if is even online. Anyone know why? c.pypi.python.org and d.pypi.python.org are both over 1 day old g.pypi.python.org is over 11 days old b.pypi.python.org is about 8 hours old at this point, I looked at the logs on this server and it looks like it is getting stuck trying to download packages for QSTK. Hopefully it resolves itself. Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz > Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz Even pypi.crate.io is over 4 hours out of date, and that one is usually pretty reliable. I'm guessing there was something that was recently added to pypi, that broke the mirror replication, and each of these servers needs to be looked at to make sure they can get back in sync. If I don't see any improvements in these mirrors by the end of the day, I'll start emailing the owners individually. Ken -------------- next part -------------- An HTML attachment was scrubbed... URL: From donald.stufft at gmail.com Tue Jan 15 16:04:51 2013 From: donald.stufft at gmail.com (Donald Stufft) Date: Tue, 15 Jan 2013 10:04:51 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: Message-ID: On Tuesday, January 15, 2013 at 8:42 AM, ken cochrane wrote: > > Even pypi.crate.io (http://pypi.crate.io/) is over 4 hours out of date, and that one is usually pretty reliable. > Fixed. Crate's issue will be unrelated to the issue(s) seen by the other mirrors. -------------- next part -------------- An HTML attachment was scrubbed... URL: From lists at zopyx.com Tue Jan 15 18:04:11 2013 From: lists at zopyx.com (Andreas Jung) Date: Tue, 15 Jan 2013 18:04:11 +0100 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: Message-ID: <50F58C0B.2030807@zopyx.com> ken cochrane wrote: > > c.pypi.python.org and d.pypi.python.org > are both over 1 day old Up & running again - pep381client was hanging for unknown reasons. Does it make sense to limit the max. execution time of pep381client. -aj -------------- next part -------------- A non-text attachment was scrubbed... Name: lists.vcf Type: text/x-vcard Size: 367 bytes Desc: not available URL: From kencochrane at gmail.com Tue Jan 15 18:13:02 2013 From: kencochrane at gmail.com (ken cochrane) Date: Tue, 15 Jan 2013 12:13:02 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: <50F58C0B.2030807@zopyx.com> References: <50F58C0B.2030807@zopyx.com> Message-ID: Thank you, Andreas and Donald. Ken On Tue, Jan 15, 2013 at 12:04 PM, Andreas Jung wrote: > > > ken cochrane wrote: > > > > > c.pypi.python.org and d.pypi.python.org > > are both over 1 day old > > Up & running again - pep381client was hanging for unknown reasons. > > Does it make sense to limit the max. execution time of pep381client. > > -aj > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ralph.bean at gmail.com Tue Jan 15 18:50:45 2013 From: ralph.bean at gmail.com (Ralph Bean) Date: Tue, 15 Jan 2013 12:50:45 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: <50F58C0B.2030807@zopyx.com> References: <50F58C0B.2030807@zopyx.com> Message-ID: <20130115175045.GB2257@radek> On Tue, Jan 15, 2013 at 06:04:11PM +0100, Andreas Jung wrote: > ken cochrane wrote: > > > > > c.pypi.python.org and d.pypi.python.org > > are both over 1 day old > > Up & running again - pep381client was hanging for unknown reasons. g.pypi.python.org is syncing again now too (not finished yet). It had been hanging since January 4th. > Does it make sense to limit the max. execution time of pep381client. That would be helpful. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 490 bytes Desc: not available URL: From happyaron.xu at gmail.com Wed Jan 16 04:03:00 2013 From: happyaron.xu at gmail.com (Aron Xu) Date: Wed, 16 Jan 2013 11:03:00 +0800 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: Message-ID: On Tue, Jan 15, 2013 at 9:42 PM, ken cochrane wrote: > According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape > right now. We only have one mirror (f.pypi.python.org) that isn't more then > 8 hours out of date. > > We have one server e.pypi.python.org I can't even connect to anymore, and > I'm not sure if is even online. Anyone know why? e.pypi.python.org is experiencing some problem with its uplink switch and will hopefully be fixed today. Sorry for the inconvenience. -- Regards, Aron Xu From kencochrane at gmail.com Wed Jan 16 04:18:06 2013 From: kencochrane at gmail.com (ken cochrane) Date: Tue, 15 Jan 2013 22:18:06 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: Message-ID: Aron, Thanks for the update, and good luck with the switch fix. Ken On Tue, Jan 15, 2013 at 10:03 PM, Aron Xu wrote: > On Tue, Jan 15, 2013 at 9:42 PM, ken cochrane > wrote: > > According to http://www.pypi-mirrors.org the pypi mirrors are in bad > shape > > right now. We only have one mirror (f.pypi.python.org) that isn't more > then > > 8 hours out of date. > > > > We have one server e.pypi.python.org I can't even connect to anymore, > and > > I'm not sure if is even online. Anyone know why? > > e.pypi.python.org is experiencing some problem with its uplink switch > and will hopefully be fixed today. Sorry for the inconvenience. > > > > -- > Regards, > Aron Xu > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jannis at leidel.info Wed Jan 16 10:43:37 2013 From: jannis at leidel.info (Jannis Leidel) Date: Wed, 16 Jan 2013 10:43:37 +0100 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: Message-ID: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> On 15.01.2013, at 14:42, ken cochrane wrote: > According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape right now. We only have one mirror (f.pypi.python.org) that isn't more then 8 hours out of date. > > We have one server e.pypi.python.org I can't even connect to anymore, and I'm not sure if is even online. Anyone know why? > > c.pypi.python.org and d.pypi.python.org are both over 1 day old > > g.pypi.python.org is over 11 days old > > b.pypi.python.org is about 8 hours old at this point, I looked at the logs on this server and it looks like it is getting stuck trying to download packages for QSTK. Hopefully it resolves itself. > > Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz > Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz > > > Even pypi.crate.io is over 4 hours out of date, and that one is usually pretty reliable. > > I'm guessing there was something that was recently added to pypi, that broke the mirror replication, and each of these servers needs to be looked at to make sure they can get back in sync. > > If I don't see any improvements in these mirrors by the end of the day, I'll start emailing the owners individually. Sigh. The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x? I've now started a manual sync and hope to see d being up-to-date soonish. Jannis From donald.stufft at gmail.com Wed Jan 16 16:41:00 2013 From: donald.stufft at gmail.com (Donald Stufft) Date: Wed, 16 Jan 2013 10:41:00 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> References: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> Message-ID: <19C11217545F4CB893B52B62113F71A1@gmail.com> On Wednesday, January 16, 2013 at 4:43 AM, Jannis Leidel wrote: > The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x? > > Should be able to use the timeout command. timeout -k HARD_LIMIT SOFT_LIMIT /path/pep381client/pep381run -q /var/pypi I haven't actually tested this but It should work, IIRC it'll send a SIGTERM after SOFT_LIMIT and a SIGQUIT after HARD_LIMIT. -------------- next part -------------- An HTML attachment was scrubbed... URL: From happyaron.xu at gmail.com Thu Jan 17 01:33:46 2013 From: happyaron.xu at gmail.com (Aron Xu) Date: Thu, 17 Jan 2013 08:33:46 +0800 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> References: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> Message-ID: On Wed, Jan 16, 2013 at 5:43 PM, Jannis Leidel wrote: > > On 15.01.2013, at 14:42, ken cochrane wrote: > >> According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape right now. We only have one mirror (f.pypi.python.org) that isn't more then 8 hours out of date. >> >> We have one server e.pypi.python.org I can't even connect to anymore, and I'm not sure if is even online. Anyone know why? >> >> c.pypi.python.org and d.pypi.python.org are both over 1 day old >> >> g.pypi.python.org is over 11 days old >> >> b.pypi.python.org is about 8 hours old at this point, I looked at the logs on this server and it looks like it is getting stuck trying to download packages for QSTK. Hopefully it resolves itself. >> >> Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz >> Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz >> >> >> Even pypi.crate.io is over 4 hours out of date, and that one is usually pretty reliable. >> >> I'm guessing there was something that was recently added to pypi, that broke the mirror replication, and each of these servers needs to be looked at to make sure they can get back in sync. >> >> If I don't see any improvements in these mirrors by the end of the day, I'll start emailing the owners individually. > > Sigh. > > The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x? > > I've now started a manual sync and hope to see d being up-to-date soonish. > Why not just use something based on rsync? I see no problem syncing Debian mirrors for years, which have lots of small files and update frequently. The script of Debian ftpsync cannot be used directly for pypi, but it's an example that worth considering: http://ftp.debian.org/debian/project/ftpsync/ftpsync-current.tar.gz -- Regards, Aron Xu From happyaron.xu at gmail.com Thu Jan 17 01:36:31 2013 From: happyaron.xu at gmail.com (Aron Xu) Date: Thu, 17 Jan 2013 08:36:31 +0800 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: Message-ID: On Wed, Jan 16, 2013 at 11:18 AM, ken cochrane wrote: > Aron, > > Thanks for the update, and good luck with the switch fix. > > Ken > e is back - the connection is ok, and the mirror is fresh, but we cannot guarantee the link speed right now. We'll have to wait for more time for some changes in our IDC network. -- Regards, Aron Xu From donald.stufft at gmail.com Thu Jan 17 01:40:27 2013 From: donald.stufft at gmail.com (Donald Stufft) Date: Wed, 16 Jan 2013 19:40:27 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> Message-ID: PyPI could use rsync for mirroring. You can setup anonymous rsync. It would require PyPI the software to write it's simple API files out to disk and then expose that via RSync. Neither of those are terribly hard and would improve the mirroring infrastructure IMO. On Wednesday, January 16, 2013 at 7:33 PM, Aron Xu wrote: > On Wed, Jan 16, 2013 at 5:43 PM, Jannis Leidel wrote: > > > > On 15.01.2013, at 14:42, ken cochrane wrote: > > > > > According to http://www.pypi-mirrors.org the pypi mirrors are in bad shape right now. We only have one mirror (f.pypi.python.org (http://f.pypi.python.org)) that isn't more then 8 hours out of date. > > > > > > We have one server e.pypi.python.org (http://e.pypi.python.org) I can't even connect to anymore, and I'm not sure if is even online. Anyone know why? > > > > > > c.pypi.python.org (http://c.pypi.python.org) and d.pypi.python.org (http://d.pypi.python.org) are both over 1 day old > > > > > > g.pypi.python.org (http://g.pypi.python.org) is over 11 days old > > > > > > b.pypi.python.org (http://b.pypi.python.org) is about 8 hours old at this point, I looked at the logs on this server and it looks like it is getting stuck trying to download packages for QSTK. Hopefully it resolves itself. > > > > > > Restarting download of source/Q/QSTK/QSTK-0.2.1.tar.gz > > > Restarting download of source/Q/QSTK/QSTK-0.2.0.tar.gz > > > > > > > > > Even pypi.crate.io (http://pypi.crate.io) is over 4 hours out of date, and that one is usually pretty reliable. > > > > > > I'm guessing there was something that was recently added to pypi, that broke the mirror replication, and each of these servers needs to be looked at to make sure they can get back in sync. > > > > > > If I don't see any improvements in these mirrors by the end of the day, I'll start emailing the owners individually. > > > > Sigh. > > > > The mirror script was hanging on d, too. Since I've had to fix the mirror every other month now I wonder if the pep381client is up to the task. Does anyone have recommendations for fixing the situation? Is there an easy way to monitor the client and kill it if it runs longer than x? > > > > I've now started a manual sync and hope to see d being up-to-date soonish. > > Why not just use something based on rsync? I see no problem syncing > Debian mirrors for years, which have lots of small files and update > frequently. The script of Debian ftpsync cannot be used directly for > pypi, but it's an example that worth considering: > > http://ftp.debian.org/debian/project/ftpsync/ftpsync-current.tar.gz > > > > -- > Regards, > Aron Xu > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org (mailto:Catalog-SIG at python.org) > http://mail.python.org/mailman/listinfo/catalog-sig > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From richard at python.org Wed Jan 23 04:41:26 2013 From: richard at python.org (Richard Jones) Date: Wed, 23 Jan 2013 14:41:26 +1100 Subject: [Catalog-sig] Traceback when removing SSH key In-Reply-To: References: Message-ID: Sorry for the long delay but this is now fixed. Richard On 7 November 2012 01:14, Pior Bastida wrote: > The same when I tried to import my ssh key. > > > On Sat, Nov 3, 2012 at 11:26 AM, anatoly techtonik > wrote: >> >> I thought you'd be interested to know >> >> Error processing form >> >> Key processing failed. Please contact the administrator. Detail: Traceback >> (most recent call last): >> File "/data/pypi/sshkeys_update.py", line 4, in >> c = config.Config("config.ini") >> File "/data/pypi/config.py", line 10, in __init__ >> self.database_name = c.get('database', 'name') >> File "/usr/lib/python2.7/ConfigParser.py", line 607, in get >> raise NoSectionError(section) >> ConfigParser.NoSectionError: No section: 'database' >> >> Please, CC. >> -- >> anatoly t. >> >> _______________________________________________ >> Catalog-SIG mailing list >> Catalog-SIG at python.org >> http://mail.python.org/mailman/listinfo/catalog-sig >> > > > > -- > Pior Bastida > pior at mtlpy.org > Org Montr?al-Python > > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig > From noah at coderanger.net Wed Jan 23 09:23:10 2013 From: noah at coderanger.net (Noah Kantrowitz) Date: Wed, 23 Jan 2013 00:23:10 -0800 Subject: [Catalog-sig] PyPI (and others) speed degraded Message-ID: <5BE2A39F-D64D-4FDB-AE38-433163A21969@coderanger.net> Hitting both lists because I am fading and need to sleep before an early flight. Can someone with appropriate access post something to Twitter et al that PyPI speeds will be degraded for the moment and that we are investigating? Other PyPI mirrors should be unaffected so now would be a good time to use one if you have PyPI in your deployment path until we get this sorted out in the morning. Thanks to Antoine for the initial report! OSU is now aware there is problem (we think it is a friendly DoS elsewhere on their network, read: someone is doing a full copy of one of their distro mirrors) and should be handled shortly, just probably won't be fully cleaned up until morning PST. --Noah -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 203 bytes Desc: Message signed with OpenPGP using GPGMail URL: From ct at gocept.com Wed Jan 23 22:18:10 2013 From: ct at gocept.com (Christian Theune) Date: Wed, 23 Jan 2013 22:18:10 +0100 Subject: [Catalog-sig] Pypi mirrors are inconsistent References: Message-ID: On 2013-01-05 11:53:15 +0000, Jonas Baumann said: > Hey there, > > Last month?the pypi mirrors got inconsistent regarding the dists of the > package plone.testing. > > On the mirrors a and e there is a plone.testing==4.0.7, > but on the mirrors b, c, d, f and g?this version is missing. Right. I saw that one reported for my mirror (f) which triggered me reinitialising the whole thing after looking around for a bit ? which turns me to the other posts I'll send in a minute ? From ct at gocept.com Wed Jan 23 22:48:05 2013 From: ct at gocept.com (Christian Theune) Date: Wed, 23 Jan 2013 22:48:05 +0100 Subject: [Catalog-sig] Mirror page References: <50864EA0.8010505@ziade.org> Message-ID: On 2012-10-23 08:00:32 +0000, Tarek Ziad? said: > Hey > > Looking at http://pypi.python.org/mirrors > > and Looking at http://www.pypi-mirrors.org/ > > I find the later much more appealing :) > > If the Ken agrees and think it's a good idea, I'd like to propose to > have a big link to http://www.pypi-mirrors.org/ on > http://pypi.python.org/mirrors > and also on the index page. +1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks like from somewhere "neutral". :) From ct at gocept.com Wed Jan 23 22:52:32 2013 From: ct at gocept.com (Christian Theune) Date: Wed, 23 Jan 2013 22:52:32 +0100 Subject: [Catalog-sig] pypi mirrors in bad shape References: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> <19C11217545F4CB893B52B62113F71A1@gmail.com> Message-ID: On 2013-01-16 15:41:00 +0000, Donald Stufft said: > On Wednesday, January 16, 2013 at 4:43 AM, Jannis Leidel wrote: > The mirror script was hanging on d, too. Since I've had to fix the > mirror every other month now I wonder if the pep381client is up to the > task. Does anyone have recommendations for fixing the situation? Is > there an easy way to monitor the client and kill it if it runs longer > than x? > Should be able to use the timeout command. > > timeout -k HARD_LIMIT SOFT_LIMIT /path/pep381client/pep381run -q /var/pypi I used to run this with "timeout 5m pep381run" but it seems that the client really didn't like getting a SIGTERM. Looking at the code there seems to be something special going on regarding handling KeyboardInterrupt so I switched to using "timeout -2 5m ?". Still, I saw a weird problem and I'm suspicious that the client really doesn't always manage to write a consistent status file when being terminated. For some reason I'm reinitializing my whole mirror after only a day. I think I'm happy running Tarek's branch on the f mirror for now, but I'm not super sure about that ? My proposal would be to sit down at PyCon to dig a bit more into the code to make it more robust. My feeling is that the current client tries way to hard on a very low-level API (httplib) for a lot of mechanics. I'd be happy to refactor and provide tests, I think. Also, a script to determine internal consistency and consistency compared to PyPI would be nice. Then again, the rsync idea might not be that far off regarding the amount of work and the problems we're dealing with ? Christian From donald.stufft at gmail.com Wed Jan 23 22:59:28 2013 From: donald.stufft at gmail.com (Donald Stufft) Date: Wed, 23 Jan 2013 16:59:28 -0500 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> <19C11217545F4CB893B52B62113F71A1@gmail.com> Message-ID: On Wednesday, January 23, 2013 at 4:52 PM, Christian Theune wrote: > > My proposal would be to sit down at PyCon to dig a bit more into the > code to make it more robust. My feeling is that the current client > tries way to hard on a very low-level API (httplib) for a lot of > mechanics. I'd be happy to refactor and provide tests, I think. > > Also, a script to determine internal consistency and consistency > compared to PyPI would be nice. Then again, the rsync idea might not be > that far off regarding the amount of work and the problems we're > dealing with ? > Crate.io uses it's own mirroring code that seems to handle things a bit better than pep381client does (infact I originally wrote it because of that). However it creates a full mirror with metadata and all and is currently being refactored to be a ton simpler. I still think for the "dumb" mirrors that setting up PyPI mirroring protocol to work via rsync is the right direction to go in. Rsync has way more manhours invested into it and a lot more testing for what pep381client essentially boils down to which is "keep these files and those files in sync". -------------- next part -------------- An HTML attachment was scrubbed... URL: From kencochrane at gmail.com Wed Jan 23 23:25:39 2013 From: kencochrane at gmail.com (Ken Cochrane) Date: Wed, 23 Jan 2013 17:25:39 -0500 Subject: [Catalog-sig] Mirror page In-Reply-To: References: <50864EA0.8010505@ziade.org> Message-ID: <27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com> I'm fine with a link to pypi-mirrors.org from the pypi site. If we find it useful, lets make it easier to find. If you would like anything to change about it, let me know. It is also open source and I accept pull requests :) Ken Sent from my iPhone On Jan 23, 2013, at 4:48 PM, Christian Theune wrote: > On 2012-10-23 08:00:32 +0000, Tarek Ziad? said: > >> Hey >> Looking at http://pypi.python.org/mirrors >> and Looking at http://www.pypi-mirrors.org/ >> I find the later much more appealing :) >> If the Ken agrees and think it's a good idea, I'd like to propose to >> have a big link to http://www.pypi-mirrors.org/ on >> http://pypi.python.org/mirrors >> and also on the index page. > > +1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks like from somewhere "neutral". :) > > > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig From richard at python.org Thu Jan 24 00:31:58 2013 From: richard at python.org (Richard Jones) Date: Thu, 24 Jan 2013 10:31:58 +1100 Subject: [Catalog-sig] Mirror page In-Reply-To: <27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com> References: <50864EA0.8010505@ziade.org> <27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com> Message-ID: Great, thanks. Link added! (and thanks for the great page!) Richard On 24 January 2013 09:25, Ken Cochrane wrote: > I'm fine with a link to pypi-mirrors.org from the pypi site. If we find it useful, lets make it easier to find. > > If you would like anything to change about it, let me know. It is also open source and I accept pull requests :) > > Ken > > Sent from my iPhone > > On Jan 23, 2013, at 4:48 PM, Christian Theune wrote: > >> On 2012-10-23 08:00:32 +0000, Tarek Ziad? said: >> >>> Hey >>> Looking at http://pypi.python.org/mirrors >>> and Looking at http://www.pypi-mirrors.org/ >>> I find the later much more appealing :) >>> If the Ken agrees and think it's a good idea, I'd like to propose to >>> have a big link to http://www.pypi-mirrors.org/ on >>> http://pypi.python.org/mirrors >>> and also on the index page. >> >> +1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks like from somewhere "neutral". :) >> >> >> _______________________________________________ >> Catalog-SIG mailing list >> Catalog-SIG at python.org >> http://mail.python.org/mailman/listinfo/catalog-sig > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig > From kencochrane at gmail.com Thu Jan 24 00:32:56 2013 From: kencochrane at gmail.com (ken cochrane) Date: Wed, 23 Jan 2013 18:32:56 -0500 Subject: [Catalog-sig] Mirror page In-Reply-To: References: <50864EA0.8010505@ziade.org> <27E58A4E-2F3C-42C6-B3E5-38CFF8635B50@gmail.com> Message-ID: Sweet! Thanks. Ken On Wed, Jan 23, 2013 at 6:31 PM, Richard Jones wrote: > Great, thanks. Link added! > > (and thanks for the great page!) > > > Richard > > > On 24 January 2013 09:25, Ken Cochrane wrote: > > I'm fine with a link to pypi-mirrors.org from the pypi site. If we find > it useful, lets make it easier to find. > > > > If you would like anything to change about it, let me know. It is also > open source and I accept pull requests :) > > > > Ken > > > > Sent from my iPhone > > > > On Jan 23, 2013, at 4:48 PM, Christian Theune wrote: > > > >> On 2012-10-23 08:00:32 +0000, Tarek Ziad? said: > >> > >>> Hey > >>> Looking at http://pypi.python.org/mirrors > >>> and Looking at http://www.pypi-mirrors.org/ > >>> I find the later much more appealing :) > >>> If the Ken agrees and think it's a good idea, I'd like to propose to > >>> have a big link to http://www.pypi-mirrors.org/ on > >>> http://pypi.python.org/mirrors > >>> and also on the index page. > >> > >> +1 I look at pypi-mirrors.org a lot to figure out how my mirrors looks > like from somewhere "neutral". :) > >> > >> > >> _______________________________________________ > >> Catalog-SIG mailing list > >> Catalog-SIG at python.org > >> http://mail.python.org/mailman/listinfo/catalog-sig > > _______________________________________________ > > Catalog-SIG mailing list > > Catalog-SIG at python.org > > http://mail.python.org/mailman/listinfo/catalog-sig > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From jannis at leidel.info Thu Jan 24 15:28:18 2013 From: jannis at leidel.info (Jannis Leidel) Date: Thu, 24 Jan 2013 15:28:18 +0100 Subject: [Catalog-sig] pypi mirrors in bad shape In-Reply-To: References: <49B8590A-DC94-4281-B422-10E9F40EE143@leidel.info> <19C11217545F4CB893B52B62113F71A1@gmail.com> Message-ID: On Wed, Jan 23, 2013 at 10:59 PM, Donald Stufft wrote: > On Wednesday, January 23, 2013 at 4:52 PM, Christian Theune wrote: > > > My proposal would be to sit down at PyCon to dig a bit more into the > code to make it more robust. My feeling is that the current client > tries way to hard on a very low-level API (httplib) for a lot of > mechanics. I'd be happy to refactor and provide tests, I think. > > Also, a script to determine internal consistency and consistency > compared to PyPI would be nice. Then again, the rsync idea might not be > that far off regarding the amount of work and the problems we're > dealing with ? > > Crate.io uses it's own mirroring code that seems to handle things > a bit better than pep381client does (infact I originally wrote it because > of that). However it creates a full mirror with metadata and all and is > currently being refactored to be a ton simpler. > > I still think for the "dumb" mirrors that setting up PyPI mirroring > protocol to work via rsync is the right direction to go in. Rsync > has way more manhours invested into it and a lot more testing > for what pep381client essentially boils down to which is "keep > these files and those files in sync". > Agreed. But till that rsync API is set up, does anyone know what changed on PyPI (or wherever) recently so that the mirrors so often go AWOL? Jannis -------------- next part -------------- An HTML attachment was scrubbed... URL: From chris at simplistix.co.uk Sat Jan 26 10:33:00 2013 From: chris at simplistix.co.uk (Chris Withers) Date: Sat, 26 Jan 2013 09:33:00 +0000 Subject: [Catalog-sig] test pypi server? Message-ID: <5103A2CC.4090600@simplistix.co.uk> Hi All, I remember mention of a test PyPI server that had been set up. Where can I find it? I'm doing some automated release testing... Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk From holger.krekel at gmail.com Sat Jan 26 11:00:14 2013 From: holger.krekel at gmail.com (Holger Krekel) Date: Sat, 26 Jan 2013 11:00:14 +0100 Subject: [Catalog-sig] test pypi server? In-Reply-To: <5103A2CC.4090600@simplistix.co.uk> References: <5103A2CC.4090600@simplistix.co.uk> Message-ID: Hey Chris, according to http://pypi.python.org there should be a test pypi server at http://testpypi.python.org/pypi but at the moment it gives 502 Bad Gateway. cheers, holger On Sat, Jan 26, 2013 at 10:33 AM, Chris Withers wrote: > Hi All, > > I remember mention of a test PyPI server that had been set up. > Where can I find it? > > I'm doing some automated release testing... > > Chris > > -- > Simplistix - Content Management, Batch Processing & Python Consulting > - http://www.simplistix.co.uk > ______________________________**_________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/**mailman/listinfo/catalog-sig > -------------- next part -------------- An HTML attachment was scrubbed... URL: From chris at simplistix.co.uk Sat Jan 26 12:10:06 2013 From: chris at simplistix.co.uk (Chris Withers) Date: Sat, 26 Jan 2013 11:10:06 +0000 Subject: [Catalog-sig] test pypi server? In-Reply-To: References: <5103A2CC.4090600@simplistix.co.uk> Message-ID: <5103B98E.4020508@simplistix.co.uk> Hi Holger, On 26/01/2013 10:00, Holger Krekel wrote: > according to http://pypi.python.org there should be a test pypi server > at http://testpypi.python.org/pypi but at the moment it gives 502 Bad > Gateway. Indeed :-( Anyone know when it will be fixed? Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk From richard at python.org Sat Jan 26 12:43:37 2013 From: richard at python.org (Richard Jones) Date: Sat, 26 Jan 2013 22:43:37 +1100 Subject: [Catalog-sig] test pypi server? In-Reply-To: <5103B98E.4020508@simplistix.co.uk> References: <5103A2CC.4090600@simplistix.co.uk> <5103B98E.4020508@simplistix.co.uk> Message-ID: On 26 January 2013 22:10, Chris Withers wrote: > On 26/01/2013 10:00, Holger Krekel wrote: >> according to http://pypi.python.org there should be a test pypi server >> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad >> Gateway. > > > Indeed :-( > > Anyone know when it will be fixed? It looks like it's working now. I'm not sure why it occasionally goes into 502 hell. Richard From aclark at aclark.net Sat Jan 26 14:30:55 2013 From: aclark at aclark.net (Alex Clark) Date: Sat, 26 Jan 2013 08:30:55 -0500 Subject: [Catalog-sig] test pypi server? References: <5103A2CC.4090600@simplistix.co.uk> <5103B98E.4020508@simplistix.co.uk> Message-ID: On 2013-01-26 11:43:37 +0000, Richard Jones said: > On 26 January 2013 22:10, Chris Withers wrote: >> On 26/01/2013 10:00, Holger Krekel wrote: >>> according to http://pypi.python.org there should be a test pypi server >>> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad >>> Gateway. >> >> >> Indeed :-( >> >> Anyone know when it will be fixed? > > It looks like it's working now. I'm not sure why it occasionally goes > into 502 hell. There is also: - http://index.pythonpackages.com for your test releasing pleasure. No credentials required :-) > > > Richard -- Alex Clark ? https://www.gittip.com/aclark4life/ From chris at simplistix.co.uk Mon Jan 28 08:10:27 2013 From: chris at simplistix.co.uk (Chris Withers) Date: Mon, 28 Jan 2013 07:10:27 +0000 Subject: [Catalog-sig] test pypi server? In-Reply-To: References: <5103A2CC.4090600@simplistix.co.uk> <5103B98E.4020508@simplistix.co.uk> Message-ID: <51062463.2010500@simplistix.co.uk> On 26/01/2013 11:43, Richard Jones wrote: > On 26 January 2013 22:10, Chris Withers wrote: >> On 26/01/2013 10:00, Holger Krekel wrote: >>> according to http://pypi.python.org there should be a test pypi server >>> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad >>> Gateway. >> >> >> Indeed :-( >> >> Anyone know when it will be fixed? > > It looks like it's working now. I'm not sure why it occasionally goes > into 502 hell. When I checked shortly after you sent this, it was back to 502s on most, but not all, requests... Any ideas? Chris -- Simplistix - Content Management, Batch Processing & Python Consulting - http://www.simplistix.co.uk From noah at coderanger.net Mon Jan 28 10:05:25 2013 From: noah at coderanger.net (Noah Kantrowitz) Date: Mon, 28 Jan 2013 01:05:25 -0800 Subject: [Catalog-sig] test pypi server? In-Reply-To: <51062463.2010500@simplistix.co.uk> References: <5103A2CC.4090600@simplistix.co.uk> <5103B98E.4020508@simplistix.co.uk> <51062463.2010500@simplistix.co.uk> Message-ID: On Jan 27, 2013, at 11:10 PM, Chris Withers wrote: > On 26/01/2013 11:43, Richard Jones wrote: >> On 26 January 2013 22:10, Chris Withers wrote: >>> On 26/01/2013 10:00, Holger Krekel wrote: >>>> according to http://pypi.python.org there should be a test pypi server >>>> at http://testpypi.python.org/pypi but at the moment it gives 502 Bad >>>> Gateway. >>> >>> >>> Indeed :-( >>> >>> Anyone know when it will be fixed? >> >> It looks like it's working now. I'm not sure why it occasionally goes >> into 502 hell. > > When I checked shortly after you sent this, it was back to 502s on most, but not all, requests... > > Any ideas? Just for the hell of it (though it is going to annihilate all my overall reports) I added testpypi to our monitoring, no point in making it alert at this point though. Someone let me know when this is sorted and I'll make it email places. --Noah -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 203 bytes Desc: Message signed with OpenPGP using GPGMail URL: From noah at coderanger.net Thu Jan 31 19:11:54 2013 From: noah at coderanger.net (Noah Kantrowitz) Date: Thu, 31 Jan 2013 10:11:54 -0800 Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage In-Reply-To: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com> References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com> Message-ID: <3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net> Alas this, and all other PyPI mirrors, are run independently so not much we can do except encourage people to check the mirror status page at pypi-mirrors.org. The catalog-sig team I think has contact info for each mirror, so thats another option to try and reach out, and as a last resort we could revoke the DNS alias. --Noah On Jan 31, 2013, at 9:00 AM, Steve Holden wrote: > Is this known about? Being worked on? Someone else's problem? According to http://bit.ly/WAG99u we've had a (mirror?) host down for four days with no action. Shouldn't there be regular automated functionality checks on this? Isn't it wonderful being a volunteer? ;-) > > Is there anything we can do abut this situation, or is the host not under our control? Don't want to make trouble as you are probably busy enough already, so not copying the board on this. > > S > > Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb > -- > Python classes (and much more) through the web http://oreillyschool.com/ > Conferences and technical event management at http://theopenbastion.com/ > > Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ > Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 > > > ________________________________________________ > Infrastructure mailing list > Infrastructure at python.org > http://mail.python.org/mailman/listinfo/infrastructure > Unsubscribe: http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 203 bytes Desc: Message signed with OpenPGP using GPGMail URL: From steve at holdenweb.com Thu Jan 31 19:25:48 2013 From: steve at holdenweb.com (Steve Holden) Date: Thu, 31 Jan 2013 10:25:48 -0800 Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage In-Reply-To: <3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net> References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com> <3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net> Message-ID: I think we may have reached that stage. S On Jan 31, 2013, at 10:11 AM, Noah Kantrowitz wrote: > Alas this, and all other PyPI mirrors, are run independently so not much we can do except encourage people to check the mirror status page at pypi-mirrors.org. The catalog-sig team I think has contact info for each mirror, so thats another option to try and reach out, and as a last resort we could revoke the DNS alias. > > --Noah > > On Jan 31, 2013, at 9:00 AM, Steve Holden wrote: > >> Is this known about? Being worked on? Someone else's problem? According to http://bit.ly/WAG99u we've had a (mirror?) host down for four days with no action. Shouldn't there be regular automated functionality checks on this? Isn't it wonderful being a volunteer? ;-) >> >> Is there anything we can do abut this situation, or is the host not under our control? Don't want to make trouble as you are probably busy enough already, so not copying the board on this. >> >> S >> >> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb >> -- >> Python classes (and much more) through the web http://oreillyschool.com/ >> Conferences and technical event management at http://theopenbastion.com/ >> >> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ >> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 >> >> >> ________________________________________________ >> Infrastructure mailing list >> Infrastructure at python.org >> http://mail.python.org/mailman/listinfo/infrastructure >> Unsubscribe: http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net > Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb -- Python classes (and much more) through the web http://oreillyschool.com/ Conferences and technical event management at http://theopenbastion.com/ Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 -------------- next part -------------- An HTML attachment was scrubbed... URL: From kencochrane at gmail.com Thu Jan 31 19:36:21 2013 From: kencochrane at gmail.com (ken cochrane) Date: Thu, 31 Jan 2013 13:36:21 -0500 Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage In-Reply-To: References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com> <3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net> Message-ID: FYI d.pypi.python.org is run by Jannis Leidel, the person who sent the tweet. so he knows about the issues. Ken On Thu, Jan 31, 2013 at 1:25 PM, Steve Holden wrote: > I think we may have reached that stage. > > S > > On Jan 31, 2013, at 10:11 AM, Noah Kantrowitz wrote: > > Alas this, and all other PyPI mirrors, are run independently so not much > we can do except encourage people to check the mirror status page at > pypi-mirrors.org. The catalog-sig team I think has contact info for each > mirror, so thats another option to try and reach out, and as a last resort > we could revoke the DNS alias. > > --Noah > > On Jan 31, 2013, at 9:00 AM, Steve Holden wrote: > > Is this known about? Being worked on? Someone else's problem? According to > http://bit.ly/WAG99u we've had a (mirror?) host down for four days with > no action. Shouldn't there be regular automated functionality checks on > this? Isn't it wonderful being a volunteer? ;-) > > > Is there anything we can do abut this situation, or is the host not under > our control? Don't want to make trouble as you are probably busy enough > already, so not copying the board on this. > > > S > > > Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb > > -- > > Python classes (and much more) through the web http://oreillyschool.com/ > > Conferences and technical event management at http://theopenbastion.com/ > > > Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ > > Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 > > > > ________________________________________________ > > Infrastructure mailing list > > Infrastructure at python.org > > http://mail.python.org/mailman/listinfo/infrastructure > > Unsubscribe: > http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net > > > > Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb > -- > Python classes (and much more) through the web http://oreillyschool.com/ > Conferences and technical event management at http://theopenbastion.com/ > > Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ > Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 > > > > > > > > > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From steve at holdenweb.com Thu Jan 31 20:32:55 2013 From: steve at holdenweb.com (Steve Holden) Date: Thu, 31 Jan 2013 11:32:55 -0800 Subject: [Catalog-sig] [Infrastructure] PyPi "D" host outage In-Reply-To: References: <84C4DFC8-6751-4B0E-849C-6AADB58FDB09@holdenweb.com> <3CBAC5BF-AD27-43EC-A806-3CE162BDB092@coderanger.net> Message-ID: Thanks Ken. I sent Jannis a DM asking him if he knew who it was, but have had no response yet :) regards Steve On Jan 31, 2013, at 10:36 AM, ken cochrane wrote: > FYI d.pypi.python.org is run by Jannis Leidel, the person who sent the tweet. so he knows about the issues. > > Ken > > > On Thu, Jan 31, 2013 at 1:25 PM, Steve Holden wrote: > I think we may have reached that stage. > > S > > On Jan 31, 2013, at 10:11 AM, Noah Kantrowitz wrote: > >> Alas this, and all other PyPI mirrors, are run independently so not much we can do except encourage people to check the mirror status page at pypi-mirrors.org. The catalog-sig team I think has contact info for each mirror, so thats another option to try and reach out, and as a last resort we could revoke the DNS alias. >> >> --Noah >> >> On Jan 31, 2013, at 9:00 AM, Steve Holden wrote: >> >>> Is this known about? Being worked on? Someone else's problem? According to http://bit.ly/WAG99u we've had a (mirror?) host down for four days with no action. Shouldn't there be regular automated functionality checks on this? Isn't it wonderful being a volunteer? ;-) >>> >>> Is there anything we can do abut this situation, or is the host not under our control? Don't want to make trouble as you are probably busy enough already, so not copying the board on this. >>> >>> S >>> >>> Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb >>> -- >>> Python classes (and much more) through the web http://oreillyschool.com/ >>> Conferences and technical event management at http://theopenbastion.com/ >>> >>> Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ >>> Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 >>> >>> >>> ________________________________________________ >>> Infrastructure mailing list >>> Infrastructure at python.org >>> http://mail.python.org/mailman/listinfo/infrastructure >>> Unsubscribe: http://mail.python.org/mailman/options/infrastructure/noah%40coderanger.net >> > > Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb > -- > Python classes (and much more) through the web http://oreillyschool.com/ > Conferences and technical event management at http://theopenbastion.com/ > > Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ > Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 > > > > > > > > > _______________________________________________ > Catalog-SIG mailing list > Catalog-SIG at python.org > http://mail.python.org/mailman/listinfo/catalog-sig > > Steve Holden steve at holdenweb.com +1 571 484 6266 @holdenweb -- Python classes (and much more) through the web http://oreillyschool.com/ Conferences and technical event management at http://theopenbastion.com/ Next event: ApacheCon NA 2013: Feb 26-28 http://na.apachecon.com/ Community events: Barcamp Feb 24 Hackathon Feb 25 Development Mar 1/2 -------------- next part -------------- An HTML attachment was scrubbed... URL: