[Spambayes] full o' spaces

Neil Schemenauer nas at python.ca
Sun Mar 9 09:58:16 EST 2003


Tim Peters wrote:
> One run with True, and another with False.  If you have the same # of ham
> and spam in your training data, it shouldn't make any difference.

Okay, I tested with a natural inbalance.  Looks like it doesn't hurt or
help me.

out/unbalanced-bases.txt -> out/unbalanced-adjusts.txt
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams
-> <stat> tested 547 hams & 389 spams against 2188 hams & 1556 spams

false positive percentages
    0.731  0.731  tied          
    0.366  0.366  tied          
    0.183  0.548  lost  +199.45%
    0.183  0.183  tied          
    0.183  0.183  tied          

won   0 times
tied  4 times
lost  1 times

total unique fp went from 9 to 11 lost   +22.22%
mean fp % went from 0.329067641682 to 0.402193784278 lost   +22.22%

false negative percentages
    0.000  0.000  tied          
    0.000  0.000  tied          
    0.000  0.000  tied          
    0.000  0.000  tied          
    0.257  0.257  tied          

won   0 times
tied  5 times
lost  0 times

total unique fn went from 1 to 1 tied          
mean fn % went from 0.051413881748 to 0.051413881748 tied          

ham mean                     ham sdev
   2.61    2.94  +12.64%       11.66   12.40   +6.35%
   2.66    2.94  +10.53%       11.20   11.87   +5.98%
   2.42    2.71  +11.98%       11.25   12.20   +8.44%
   1.78    2.00  +12.36%        9.05    9.81   +8.40%
   1.92    2.15  +11.98%        9.00    9.68   +7.56%

ham mean and sdev for all runs
   2.28    2.55  +11.84%       10.50   11.26   +7.24%

spam mean                    spam sdev
  99.56   99.63   +0.07%        3.29    2.50  -24.01%
  99.22   99.30   +0.08%        5.03    4.68   -6.96%
  99.63   99.68   +0.05%        2.82    2.55   -9.57%
  99.46   99.55   +0.09%        3.96    3.20  -19.19%
  99.17   99.22   +0.05%        6.41    6.12   -4.52%

spam mean and sdev for all runs
  99.41   99.48   +0.07%        4.50    4.06   -9.78%

ham/spam mean difference: 97.13 96.93 -0.20
547 389



More information about the Spambayes mailing list