[Moin-user] search.live.com errors

[Gnarlodious]

The decrepit 'bot sends a malformed search URL,
To illustrate, go to this page:
<http://etc.gnarlodious.com/awstats/awstats.pl?config=Gnarlodious&update=1>
Scroll down to te bottom where it says:

Search Keyphrases (Top 10)

Notice that the most searched-for word is "WINFLA". There is really no
such word on my site. The msnbot sends a URL like this:

"http://search.live.com/results.aspx?q=vanagon&mrt=en-us&FORM=WINFLA"

which the Wiki site interprets as a referrer URL.

It's likely the error won't last long, since many webmasters will be
complaining.

-- 
Gnarlie
http://Gnarlodious.com/Gnarlodious


On 11/26/07, Jim Popovitch wrote:
> I'm starting to see a bunch of errors but only from an IP belonging to
> search.live.com (msnbot).
>
> The apache hit:
>   "GET /WikiSandkasten HTTP/1.0" 500 10403 "-" "msnbot/1.0
> (+http://search.msn.com/msnbot.htm)" (deflated -%)
>
>   NOTE: the above page does not exist, and is not referenced on any
>   pages although it exists inside of:
>     data/underlay/pages/SystemPagesSetup/attachments/German.zip
>
> The apache errors:
>   PythonHandler moinmodpy: Traceback (most recent call last):
>   PythonHandler moinmodpy:   File
> "/usr/lib/python2.4/site-packages/mod_python/apache.py", line 299, in
> HandlerDispatch\n    result = object(req)
>   PythonHandler moinmodpy:   File "/var/www/$SITE/moinmodpy.py", line 61, in
> handler\n    return moinreq.run(request)
>   PythonHandler moinmodpy:   File
> "/var/lib/python-support/python2.4/MoinMoin/request.py", line 1918, in run\n
>    return RequestBase.run(self)
>   PythonHandler moinmodpy:   File
> "/var/lib/python-support/python2.4/MoinMoin/request.py", line 1178, in run\n
>    self.fail(err)
>   PythonHandler moinmodpy:   File
> "/var/lib/python-support/python2.4/MoinMoin/request.py", line 1212, in
> fail\n    failure.handle(self)
>   PythonHandler moinmodpy:   File
> "/var/lib/python-support/python2.4/MoinMoin/failure.py", line 148, in
> handle\n    request.write('<pre>\\n')
>   PythonHandler moinmodpy:   File
> "/var/lib/python-support/python2.4/MoinMoin/request.py", line 1931, in
> write\n    self.mpyreq.write(self.encode(data))
>   PythonHandler moinmodpy: IOError: Write failed, client closed connection.
>
> MoinMoin v1.5.3-1.2 (Debian Etch)
> mod-python v3.2.10-4 (Debian Etch)
>
> Any ideas on what could be causing this.  Other than this one blip
> everything is working fine.
>
> Thanks!
>
> -Jim P.
>