[spambayes-bugs] [ spambayes-Support Requests-1110985 ] Slow speed when scoring email

[SourceForge.net]

Support Requests item #1110985, was opened at 2005-01-27 14:50
Message generated for change (Comment added) made by mphacker
You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=498104&aid=1110985&group_id=61702

Category: None
Group: None
Status: Open
Priority: 5
Submitted By: Mike Hacker (mphacker)
Assigned to: Nobody/Anonymous (nobody)
Summary: Slow speed when scoring email

Initial Comment:
I am running version 1.0.1 of Spambayes plug-in for
Outlook on Windows XP Professional with 1GB of ram.

When I open Outlook and it connects to my pop server it
seems to take a very long time to download and score
the email messages.   During this time I notice that
the hard drive is working very hard and Outlook becomes
unresponsive.

I usually have about 60 - 70 email messages on the pop
server when I connect to download.   My database has
923 good and 458 spam messages.   The accurace rate is
about perfect, but the speed really makes checking my
email a long process.

I have tired using both with and without the background
filter.   I prefer to not use the background filter.

If I leave Outlook open, it seems to process the
incoming messages fine.   I only see the slowdown when
Outlook is downloading several emails at once.

I have seen some references to using alternate
databases.  Would that help increase the speed?  If so,
what databases are supported on Windows and how do I
change the database it uses?



----------------------------------------------------------------------

>Comment By: Mike Hacker (mphacker)
Date: 2005-02-02 23:00

Message:
Logged In: YES 
user_id=197513

I haven't timed the exact speed, but it just seems like when
running the plugin Outlook and the whole computer comes to a
crawl when it does the scoring after Outlook is first
started.   This is when I usualy have 50+ email messages
coming in.   The speed of scoring the individual messages
that come in after that seem to happen really quick.   I am
probably just seening the multipled effect of the time it
takes to score.

I did grab the latest (as of last 2/1/05) from CVS and
noticed the code for the mysql database.   Does the CVS
version support the mysql?   If so, what are the keys that
needs to be added to the INI to specify the dbtype,
database, login and password?

 I was trying to figure out if adding support for Microsoft
SQL Server / MSDE could be easily added.  The code looks
pretty easy to extend for other databases.  I don't think it
would be a big deal since you are using standard SQL.   The
only problem I saw was that Python really doesn't seem to
have an interface into Microsoft SQL.   I would imagine that
MS SQL support would be simple to add if anyone has a
library for connecting to MS SQL.

Anyways, thanks for an excellent product!   I couldn't
survive a day without it.  :-)

----------------------------------------------------------------------

Comment By: Tony Meyer (anadelonbrin)
Date: 2005-02-02 21:11

Message:
Logged In: YES 
user_id=552329

Users of the 1.0.x binaries cannot change which database
type is used, sorry.  (1.1, when it is out, will allow this).

The database types that are supported are: bsddb (the
default), pickle, mySQL, postgreSQL, ZODB, and ZOE (not
fully tested yet).

A pickle will take more memory, and will be slower to
load/store the database, but will be faster in scoring.  I
have no idea whether the SQL/ZODB database backends would be
faster than bsddb or not.

However, it really shouldn't be that slow.  What do you call
a "very long time"?  Does the log have any error messages?

----------------------------------------------------------------------

You can respond by visiting: 
https://sourceforge.net/tracker/?func=detail&atid=498104&aid=1110985&group_id=61702