[Moin-user] File download throttling based on file size?

Geoff Mayes gmayes at vmware.com
Fri Jul 20 10:55:01 EDT 2007


Thank you Rick for sharing your take on this and a nice workaround.  Based on
your use of fastcgi and another Moin user kindly letting me know that he is
able to download large files at speeds ~500KB/s, I believe this is a fastcgi
issue and not a Moin issue (we're using fastcgi), unless someone
knows/believes otherwise?

Another finding I forgot to mention is that while the download speeds
directly correlate to file size when all are downloaded at the same time,
this direct correlation between file size and download speed also occurs when
files are downloaded individually as well.  For example, the 270, 140, and
40MB files download at 8, 16, and 33KB/s when downloaded individually.

I'm going to bark up the fastcgi tree for a while.

Thanks again.  Best, Geoff


-----Original Message-----
From: Rick VanDerveer [mailto:rickvanderveer at yahoo.com]
Sent: Thu 7/19/2007 8:35 PM
To: moin-user at lists.sourceforge.net; Geoff Mayes
Subject: RE: [Moin-user] File download throttling based on file size?
 
Geoff,
I've observed similar cases with our organization's internal wiki.

I'm using FastCGI for our wiki.  I can be COMPLETELY wrong here, but my
hypothesis is that FastCGI is only a single process, and therefore isn't able
to adequately juggle multiple large downloads. I have one download in
particular that nearly causes the wiki to non-responsive for any other users.

One silly little work-around I've been using is to set up a Apache alias to a
directory outside the moin folders, where I keep large downloads. I then link
to those files, Moin treats it as a link to an outside server, and Apache can
handle the transfer load easily.  Ultimately, it's coming from the same box,
but moin isn't serving it and remains as responsive as ever.

-Rick



-----Original Message-----
From: moin-user-bounces at lists.sourceforge.net on behalf of Geoff Mayes
Sent: Thu 7/19/2007 9:04 PM
To: moin-user at lists.sourceforge.net
Subject: [Moin-user] File download throttling based on file size?
 
Howdy Moin users!

Anyone know if there is some sort of download speed throttling built into
MoinMoin?

A user just pointed out that large files (> 100MB) are very slow to download
whereas small files (< 2MB) download instantaneously.  Our Moin instance is
only used internally on our intranet.  I tested this a bit more and
discovered the following:

- When downloading 270MB, 140MB, and 40MB files at the same time, they
download at 3, 6, and 20KB/s, respectively.  This makes me think that Moin is
somehow throttling download speed based on file size (e.g. slowing down big
files).

- It doesn't look like Apache 2.2.3 is the problem because when I move one of
these large files directly to webroot (/var/www/html) from the /wiki/data
directory, this same file downloads at 1.5MB/s.

- I've changed the extension of the filename from .wmv to .ppt, but the same
download speeds are observed.

- Uploading the 270MB file occurred in less than 4 minutes (~1.5MB/s).

Thank you in advance for any further information about this or solutions to
configure/disable throttling.

Regards, Geoff

-------------------------------------------------------------------------
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2005.
http://clk.atdmt.com/MRT/go/vse0120000070mrt/direct/01/
_______________________________________________
Moin-user mailing list
Moin-user at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/moin-user








       
_____________________________________________________________________________
_______
Building a website is a piece of cake. Yahoo! Small Business gives you all
the tools to get online.
http://smallbusiness.yahoo.com/webhosting 





More information about the Moin-user mailing list