[spambayes-bugs] [ spambayes-Bugs-797739 ] Still does not read all
headers
SourceForge.net
noreply at sourceforge.net
Sun Aug 31 21:12:01 EDT 2003
Bugs item #797739, was opened at 2003-08-31 00:16
Message generated for change (Settings changed) made by anadelonbrin
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=498103&aid=797739&group_id=61702
Category: Outlook
Group: None
>Status: Closed
>Resolution: Invalid
Priority: 5
Submitted By: Tim Pearce (tcp1)
Assigned to: Nobody/Anonymous (nobody)
Summary: Still does not read all headers
Initial Comment:
I thought the new version of outlook spam bayes had
rectified the problem of not accessing all headers in
messages. But it seems not. I have just retrained my
spam and ham using version 007 and it still ignores the
server generated header spam report which will be very
useful to spambayes for finding spam. Example message
below (generated by spambayes) and here is the part of
the header I would like spambayes to interpret (none of
the these items ever seem to be interpreted by
spambayes):
X-Spam-Score: (+++++++++++++++) 15.3
X-Spam-Report: 15.3/5.0
NO_REAL_NAME (0.7 points) From: does
not include a real name
FROM_ENDS_IN_NUMS (0.7 points) From:
ends in numbers
TRACKER_ID (4.3 points) BODY: Incorporates a
tracking ID number
OFFER (0.1 points) BODY: Free Offer
HTML_30_40 (0.8 points) BODY:
Message is 30% to 40% HTML
HTML_FONT_COLOR_NAME (0.2 points) BODY:
HTML font color has unusual
name
HTML_FONT_COLOR_RED (0.1 points) BODY:
HTML font color is red
HTML_MESSAGE (0.1 points) BODY: HTML
included in message
HTML_FONT_BIG (0.1 points) BODY: FONT Size
+2 and up or 3 and up
HTML_FONT_COLOR_BLUE (0.1 points) BODY:
HTML font color is blue
HTML_LINK_CLICK_HERE (0.1 points) BODY:
HTML link text says "click
here"
HTML_SHOUTING3 (0.8 points) BODY: HTML
has very strong "shouting"
markup
SUBJ_HAS_UNIQ_ID (0.8 points) Subject
contains a unique ID
DATE_IN_FUTURE_12_24 (2.8 points) Date: is
12 to 24 hours after
Received: date
FORGED_MUA_IMS (2.8 points) Forged mail
pretending to be from IMS
MIME_HTML_ONLY (0.1 points) Message only
has text/html MIME parts
CLICK_BELOW (0.1 points) Asks you to
click below
FROM_ALL_NUMS (0.6 points) From an address
that is all numbers
(non-phone)
===============
Spam Score: 1
word spamprob #ham
#spam
'*H*' 0 - -
'*S*' 1 - -
'x-mailer:internet mail service (5.5.2653.19)'
0.0493829 56 3
'url:info' 0.0681493 52 4
'copying' 0.16448 42 9
'original' 0.198828 160 44
'able' 0.282561 192 84
'copy' 0.300619 155 74
'swedish' 0.313233 18 9
'format' 0.354496 46 28
'computer' 0.355363 142 87
'spend' 0.641237 18 36
'standard' 0.648117 36 74
'home' 0.654816 70 148
'heard' 0.658648 12 26
'(i.e.' 0.659267 5 11
'immediate' 0.660244 17 37
'create' 0.667571 33 74
'without' 0.68148 57 136
'our' 0.682849 325 779
'price:' 0.689351 10 25
'own' 0.689898 54 134
"subject:'" 0.696123 34 87
'******' 0.696864 3 8
"you've" 0.697367 26 67
'special' 0.702608 98 258
'header:Message-Id:1' 0.703421 392
1035
'upgraded' 0.705258 4 11
'everything' 0.710206 27 74
'here' 0.715414 155 434
'film' 0.717526 8 23
'learn' 0.719277 43 123
'buying' 0.719934 10 29
'*****' 0.720474 3 9
'play' 0.724933 21 62
'video' 0.725325 23 68
'header:Received:3' 0.725418 307
903
'right' 0.728689 38 114
'news.' 0.739192 10 32
'***' 0.740209 9 29
'cd.' 0.740672 3 10
"it's" 0.750199 57 191
'step' 0.750624 10 34
'keep' 0.753278 49 167
'free' 0.75815 134 468
"you'll" 0.769174 26 97
'minutes' 0.772264 38 144
'reply-to:no real name:2**0' 0.78037 101
400
'transfer' 0.781323 27 108
'__________' 0.793875 1 5
'games' 0.795149 4 18
'****' 0.798819 3 14
'*******' 0.798819 3 14
'skip:_ 10' 0.798819 3 14
'easy' 0.800081 27 121
'instructions' 0.803521 24 110
'sony' 0.819613 2 11
'header:Reply-To:1' 0.820402 181
921
'___' 0.820948 1 6
'stay' 0.825333 8 43
'instantly' 0.837602 4 24
'view' 0.83792 65 375
'subject:copy' 0.841735 1 7
'offers' 0.841987 44 262
'to:addr:t.c.pearce' 0.843817 153
921
'click' 0.851061 97 618
'save' 0.852853 24 156
'computer,' 0.857315 4 28
'skip:* 10' 0.860358 9 63
'time!' 0.861106 3 22
'pro' 0.861942 6 43
'player' 0.866281 3 23
'simple,' 0.867776 2 16
'***********' 0.871558 1
9
'skip:1 40' 0.871558 1 9
'burn' 0.874479 2 17
'dvd,' 0.882618 1 10
'english,' 0.882618 1 10
'too!' 0.886034 2 19
'now!' 0.8948 11 106
'movies' 0.903754 2 23
'blank' 0.920269 17 221
'retail' 0.926516 3 45
'burning' 0.926761 1 17
'______' 0.944367 0 4
'_______' 0.954481 0 5
'subject:Now' 0.959444 1 32
'dvd' 0.961145 2 61
'reply-to:addr:msn.com' 0.961483 0
6
'subject:Languages' 0.961483 0 6
"dvd's" 0.963757 1 36
'skip:a 40' 0.966618 0 7
'from:addr:delphi.com' 0.970545 0 8
'favorite' 0.973588 1 50
'$39.95!' 0.973645 0 9
'$69.95' 0.973645 0 9
'4.0!' 0.973645 0 9
'600mb' 0.973645 0 9
'another!' 0.973645 0 9
'burner.' 0.973645 0 9
'cd-r.' 0.973645 0 9
'cd;' 0.973645 0 9
'cdr!' 0.973645 0 9
'condition!' 0.973645 0 9
'download!!' 0.973645 0 9
'dutch,' 0.973645 0 9
'encodings' 0.973645 0 9
'etc...)' 0.973645 0 9
'extras!' 0.973645 0 9
'finnish,' 0.973645 0 9
'french,' 0.973645 0 9
'games!' 0.973645 0 9
'greek,' 0.973645 0 9
'hungarian,' 0.973645 0 9
'italian,' 0.973645 0 9
'languages!' 0.973645 0 9
'packet' 0.973645 0 9
'polish,' 0.973645 0 9
'portuguese,' 0.973645 0 9
'recorder?' 0.973645 0 9
'ripper' 0.973645 0 9
'russian,' 0.973645 0 9
'spanish,' 0.973645 0 9
'tapes?' 0.973645 0 9
'urdu!' 0.973645 0 9
'vhs' 0.973645 0 9
'message-id:@artemis.le.ac.uk' 0.974931 9
399
'divx' 0.976155 0 10
'german,' 0.976155 0 10
'hurry!' 0.976155 0 10
'playstation' 0.976155 0 10
'skip:7 40' 0.976155 0 10
'television,' 0.976155 0 10
'worry!' 0.976155 0 10
'$1000' 0.978228 0 11
'tapes' 0.978228 0 11
'anytime!' 0.981454 0 13
'payment!' 0.981454 0 13
'single,' 0.981454 0 13
'yes!' 0.981454 0 13
'product.' 0.985693 0 17
'skip:2 40' 0.98716 0 19
'backups' 0.987786 0 20
'download!' 0.990181 0 25
'magick' 0.990181 0 25
'url:dvd' 0.990181 0 25
'url:adv166' 0.990552 0 26
'pc!' 0.992051 0 31
'dvds' 0.992296 0 32
'burner' 0.992742 0 34
'subject:DVD' 0.992947 0 35
'subject:! ' 0.994942 0 49
Message Stream:
Received: from SUMAC.cfs.le.ac.uk ([143.210.35.10]) by
saffron.cfs.le.ac.uk
with Microsoft SMTPSVC(5.0.2195.5329);
Sat, 30 Aug 2003 13:01:41 +0100
Received: from artemis.le.ac.uk ([143.210.16.126]) by
SUMAC.cfs.le.ac.uk with
Microsoft SMTPSVC(5.0.2195.5329); Sat, 30
Aug 2003 13:01:41 +0100
Received: from ca-glendora-cuda1-c3a-a-
110.arcdca.adelphia.net ([68.68.4.110]
helo=68.68.4.110) by artemis.le.ac.uk with
smtp (Exim 4.21)
id 19t4QF-0002dP-87
for t.c.pearce at leicester.ac.uk; Sat, 30 Aug
2003 13:01:40 +0100
Date: Sat, 30 Aug 2003 20:05:29 -0500
From: 239039 at delphi.com
X-Mailer: Internet Mail Service (5.5.2653.19)
Reply-To: 239039 at msn.com
Organization: 2050690133
X-Priority: 3 (Normal)
To: t.c.pearce at leicester.ac.uk
Subject: Now copy DVD's in 14 Languages! 239039
MIME-Version: 1.0
Content-Type: text/html; charset=iso-8859-1
Content-Transfer-Encoding: 8bit
Message-Id: <E19t4QF-0002dP-87 at artemis.le.ac.uk>
X-Spam-Score: (+++++++++++++++) 15.3
X-Spam-Report: 15.3/5.0
NO_REAL_NAME (0.7 points) From: does
not include a real name
FROM_ENDS_IN_NUMS (0.7 points) From:
ends in numbers
TRACKER_ID (4.3 points) BODY: Incorporates a
tracking ID number
OFFER (0.1 points) BODY: Free Offer
HTML_30_40 (0.8 points) BODY:
Message is 30% to 40% HTML
HTML_FONT_COLOR_NAME (0.2 points) BODY:
HTML font color has unusual
name
HTML_FONT_COLOR_RED (0.1 points) BODY:
HTML font color is red
HTML_MESSAGE (0.1 points) BODY: HTML
included in message
HTML_FONT_BIG (0.1 points) BODY: FONT Size
+2 and up or 3 and up
HTML_FONT_COLOR_BLUE (0.1 points) BODY:
HTML font color is blue
HTML_LINK_CLICK_HERE (0.1 points) BODY:
HTML link text says "click
here"
HTML_SHOUTING3 (0.8 points) BODY: HTML
has very strong "shouting"
markup
SUBJ_HAS_UNIQ_ID (0.8 points) Subject
contains a unique ID
DATE_IN_FUTURE_12_24 (2.8 points) Date: is
12 to 24 hours after
Received: date
FORGED_MUA_IMS (2.8 points) Forged mail
pretending to be from IMS
MIME_HTML_ONLY (0.1 points) Message only
has text/html MIME parts
CLICK_BELOW (0.1 points) Asks you to
click below
FROM_ALL_NUMS (0.6 points) From an address
that is all numbers
(non-phone)
Return-Path: be99naj at bigfoot.com
X-OriginalArrivalTime: 30 Aug 2003 12:01:41.0489 (UTC)
FILETIME=[796BDE10:01C36EEE]
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=iso-8859-1">
<title>DVD Magick Pro - A Revolutionary Way to Create
DVDs in Your Own Home</title>
</head>
<body bgcolor="#3A6EA5">
<center>
<table border="0" width="600" cellspacing="0"
cellpadding="14">
<tr>
<td bgcolor="#FF6600" height="10" valign="middle"
align="center">
<font size="5">Copy your favorite DVD's to a standard
CD - without a DVD Burner. Free extras! It's easy to
use. Retail Price: <font
color="white"><s>$69.95</s></font> and For a limited
time it is Only <a href="http://www.ultra-
software.info/dvd/adv166/"><font color="white">$39.95!
</a></font></font></td>
</tr>
<tr>
<td bgcolor="#FFFFFF">
<b> <center><a href="http://www.ultra-
software.info/dvd/adv166/"><font color="blue">DVD
Magick Pro - A Revolutionary Way to Create DVDs in
Your Own Home</font></a></center><br>
Don't spend $1000 on a DVD Burner. Get our all-inclusive
software right now and within minutes you will be on
your way to copying any DVD video to a single, standard
CD. You've seen us in the news. You've heard so much
about our product. Now available for download! Get your
software instantly following payment!<br>
<font color="#FFFFFF" size="1">***************
7875F88C-6E1E6ADF-1AD8F189-35BFF8F1-1B5129E
************ </font><br>
<center><a href="http://www.ultra-
software.info/dvd/adv166/"><font color="blue">DVD
Copying Features</font></a></center><br>
<ul>
<li>No DVD Burner Required</li><font color="#FFFFFF"
size="1">***
239039
*****</font>
<li>Simple, Convenient Step by Step
Instructions</li><font color="#FFFFFF" size="1">___
195790194
_______</font>
<li>Burn to any standard CD; play on any standard DVD
player (i.e. Television, Computer, etc...) OR computer
CD Drive</li><font color="#FFFFFF" size="1">*
1202620547
*************</font>
<li>Don't have a CD recorder? Don't worry! You can save
your favorite movies to your computer and view anytime!
</li><font color="#FFFFFF" size="1">_____________
239039
_______</font>
<li>Yes! They will play on your CD and DVD
player</li><font color="#FFFFFF"
size="1">***************
239039
****</font>
<li>Now you can copy movies from DVD to the new DiVX
format. One standard film will take 600mb of your space,
that means you can keep around 70 films at the same
time on your PC!</li><font color="#FFFFFF"
size="1">______
1778882172
_______</font>
<li>Create your new video collection now!</li><font
color="#FFFFFF" size="1">******
6280745
***</font>
<li>After buying our packet you will learn how to work
with digital video in no time! Our packet includes easy
instructions on how to work with encodings + copying
from one format to another!</li><font color="#FFFFFF"
size="1">_________________
647574259
__________</font><br><br>
</ul>
<center><a href="http://www.ultra-
software.info/dvd/adv166/"><font color="blue">Copy
VHS tapes to CD too!</font></a></center><br>
Just upgraded to a DVD and have a library of video
tapes? With your software not only can you copy & burn
ANY DVD, you'll also be able to transfer all your VHS
tapes to DVD format on CD using CDR!<br>
<font color="#FFFFFF" size="1">****************
1ECBCA09-6ADDE12B-34A18763-30AD5F2A-5004EFA2
*******</font><br>
<center><a href="http://www.ultra-
software.info/dvd/adv166/"><font color="blue">Back up
your favorite Playstation 2 Games!
</font></a></center><br>
Order the DVD PRO 4.0! ripper NOW and included will be
directions for burning Sony Playstation 2 games!
Everything you need to make a working copy on a
standard, blank CD-R. Use these as backups so that
your original PlayStation 2 games stay in the best
condition!<br>
<font color="#FFFFFF" size="1">***
AF51DD2-6E5E3DB4-2F48D28B-7D8A3F57-62B2B842
***</font><br>
<center><a href="http://www.ultra-
software.info/dvd/adv166/"><font color="blue">Now
copy DVD's in 14 Languages!</font></a></center><br>
Dutch, English, Finnish, French, German, Greek,
Hungarian, Italian, Polish, Portuguese, Russian, Spanish,
Swedish and Urdu!<br>
<font color="#FFFFFF" size="1">************
20AF94B0-298F8D05-3B268F5B-1C0417CA-1A9A6214
***********</font><br><br>
<center><font size="4"><a href="http://www.ultra-
software.info/dvd/adv166/"><font color="red">Hurry!
Limited Time Special Offers Immediate download!!<br>
Click Here for More Info or Order Online Now!
</font></font></a></b><br><br><br><br><br><br>
<font color="#FFFFFF" size="1">
239039
2C5AD477-4C272EF3-171BE48D-1AA57190-258DFC00
1258863973
</font>
</td>
</tr>
</table>
</center>
</body>
</html>
Copy your favorite DVD's to a standard CD - without a
DVD Burner. Free
extras! It's easy to use. Retail Price: $69.95 and For a
limited time it
is Only $39.95! <http://www.ultra-
software.info/dvd/adv166/>
DVD Magick Pro - A Revolutionary Way to Create DVDs in
Your Own Home
<http://www.ultra-software.info/dvd/adv166/>
Don't spend $1000 on a DVD Burner. Get our all-inclusive
software right
now and within minutes you will be on your way to
copying any DVD video
to a single, standard CD. You've seen us in the news.
You've heard so
much about our product. Now available for download!
Get your software
instantly following payment!
*************** 7875F88C-6E1E6ADF-1AD8F189-
35BFF8F1-1B5129E
************
DVD Copying Features <http://www.ultra-
software.info/dvd/adv166/>
* No DVD Burner Required
*** 239039 *****
* Simple, Convenient Step by Step Instructions
___ 195790194 _______
* Burn to any standard CD; play on any standard
DVD player (i.e.
Television, Computer, etc...) OR computer CD Drive
* 1202620547 *************
* Don't have a CD recorder? Don't worry! You
can save your
favorite movies to your computer and view anytime!
_____________ 239039 _______
* Yes! They will play on your CD and DVD player
*************** 239039 ****
* Now you can copy movies from DVD to the
new DiVX format. One
standard film will take 600mb of your space, that means
you can keep
around 70 films at the same time on your PC!
______ 1778882172 _______
* Create your new video collection now!
****** 6280745 ***
* After buying our packet you will learn how to
work with digital
video in no time! Our packet includes easy instructions
on how to work
with encodings + copying from one format to another!
_________________ 647574259 __________
Copy VHS tapes to CD too! <http://www.ultra-
software.info/dvd/adv166/>
Just upgraded to a DVD and have a library of video
tapes? With your
software not only can you copy & burn ANY DVD, you'll
also be able to
transfer all your VHS tapes to DVD format on CD using
CDR!
**************** 1ECBCA09-6ADDE12B-34A18763-
30AD5F2A-5004EFA2 *******
Back up your favorite Playstation 2 Games!
<http://www.ultra-software.info/dvd/adv166/>
Order the DVD PRO 4.0! ripper NOW and included will be
directions for
burning Sony Playstation 2 games! Everything you need
to make a working
copy on a standard, blank CD-R. Use these as backups
so that your
original PlayStation 2 games stay in the best condition!
*** AF51DD2-6E5E3DB4-2F48D28B-7D8A3F57-62B2B842
***
Now copy DVD's in 14 Languages!
<http://www.ultra-software.info/dvd/adv166/>
Dutch, English, Finnish, French, German, Greek,
Hungarian, Italian,
Polish, Portuguese, Russian, Spanish, Swedish and Urdu!
************ 20AF94B0-298F8D05-3B268F5B-
1C0417CA-1A9A6214 ***********
Hurry! Limited Time Special Offers Immediate download!!
Click Here for More Info or Order Online Now!
<http://www.ultra-software.info/dvd/adv166/>
239039 2C5AD477-4C272EF3-171BE48D-1AA57190-
258DFC00 1258863973
Message Tokens:
254 unique tokens
'$1000'
'$39.95!'
'$69.95'
'(i.e.'
'***'
'****'
'*****'
'******'
'*******'
'***********'
'1202620547'
'1258863973'
'1778882172'
'195790194'
'239039'
'4.0!'
'600mb'
'6280745'
'647574259'
'___'
'______'
'_______'
'__________'
'able'
'about'
'after'
'all'
'also'
'and'
'another!'
'any'
'anytime!'
'around'
'available'
'back'
'backups'
'best'
'blank'
'burn'
'burner'
'burner.'
'burning'
'buying'
'can'
'cc:none'
'cd-r.'
'cd.'
'cd;'
'cdr!'
'click'
'collection'
'computer'
'computer,'
'condition!'
'content-type:text/plain'
'convenient'
'copy'
'copying'
'create'
'digital'
'directions'
'divx'
"don't"
'download!'
'download!!'
'drive'
'drive*'
'dutch,'
'dvd'
"dvd's"
'dvd,'
'dvds'
'easy'
'encodings'
'english,'
'etc...)'
'everything'
'extras!'
'favorite'
'features'
'film'
'films'
'finnish,'
'following'
'for'
'format'
'format.'
'free'
'french,'
'from'
'from:addr:239039'
'from:addr:delphi.com'
'from:no real name:2**0'
'games'
'games!'
'german,'
'get'
'greek,'
'have'
'header:Date:1'
'header:From:1'
'header:MIME-Version:1'
'header:Message-Id:1'
'header:Organization:1'
'header:Received:3'
'header:Reply-To:1'
'header:Return-Path:1'
'header:Subject:1'
'header:To:1'
'heard'
'here'
'home'
'how'
'hungarian,'
'hurry!'
'immediate'
'included'
'includes'
'info'
'instantly'
'instructions'
"it's"
'italian,'
'just'
'keep'
'languages!'
'learn'
'library'
'limited'
'magick'
'make'
'means'
'message-id:@artemis.le.ac.uk'
'minutes'
'more'
'movies'
'much'
'need'
'new'
'news.'
'not'
'now'
'now!'
'now!******'
'offers'
'one'
'online'
'only'
'order'
'original'
'our'
'own'
'packet'
'payment!'
'pc!'
'pc!______'
'play'
'player'
'playstation'
'polish,'
'portuguese,'
'price:'
'pro'
'product.'
'proto:http'
'recorder?'
'reply-to:addr:239039'
'reply-to:addr:msn.com'
'reply-to:no real name:2**0'
'required'
'required***'
'retail'
'right'
'ripper'
'russian,'
'same'
'save'
'seen'
'sender:none'
'simple,'
'single,'
'skip:* 10'
'skip:1 40'
'skip:2 40'
'skip:7 40'
'skip:_ 10'
'skip:a 10'
'skip:a 20'
'skip:a 40'
'skip:i 10'
'skip:p 20'
'skip:r 10'
'software'
'sony'
'space,'
'spanish,'
'special'
'spend'
'standard'
'standard,'
'stay'
'step'
'subject: '
'subject:! '
"subject:'"
'subject:239039'
'subject:DVD'
'subject:Languages'
'subject:Now'
'subject:copy'
'swedish'
'take'
'tapes'
'tapes?'
'television,'
'that'
'the'
'these'
'they'
'time'
'time!'
'to:2**0'
'to:addr:leicester.ac.uk'
'to:addr:t.c.pearce'
'to:no real name:2**0'
'too!'
'transfer'
'upgraded'
'urdu!'
'url:adv166'
'url:dvd'
'url:info'
'url:ultra-software'
'url:www'
'use'
'use.'
'using'
'vhs'
'video'
'view'
'way'
'will'
'with'
'within'
'without'
'work'
'working'
'worry!'
'x-mailer:internet mail service (5.5.2653.19)'
'yes!'
'you'
"you'll"
"you've"
'your'
----------------------------------------------------------------------
Comment By: Tim Peters (tim_one)
Date: 2003-08-31 13:03
Message:
Logged In: YES
user_id=31435
By design (due to testing results), spambayes ignores most
headers. Note that the example you gave here supplies no
reason for change: it showed that spambayes nailed the
email in question perfectly (internal *H* score of 0 and
internal *S* score of 1 -- it's impossible to get a stronger
outcome than that!).
There are two specific reasons for continuing to ignore
SpamAssassin-like header decorations: (1) spammers can
spoof them, supplying tons of bogus clues; and, (2) because
many people use spambayes on their own box after some
server uses a SpamAssassin-like system first to inject
headers, getting a spambayes judgment independent of what
a rule-based system thought truly helps to recover from
mistakes made by the rule-based system. If spambayes
counted what the rule-based system thought, it would act to
reinfiorce the rule-based system's mistakes.
----------------------------------------------------------------------
You can respond by visiting:
https://sourceforge.net/tracker/?func=detail&atid=498103&aid=797739&group_id=61702
More information about the Spambayes-bugs
mailing list