[Spambayes-checkins] spambayes tokenizer.py,1.27,1.28

[Tim Peters]

Update of /cvsroot/spambayes/spambayes
In directory usw-pr-cvs1:/tmp/cvs-serv27328

Modified Files:
	tokenizer.py 
Log Message:
tokenize_body():  Brought the docstring into line with current reality.


Index: tokenizer.py
===================================================================
RCS file: /cvsroot/spambayes/spambayes/tokenizer.py,v
retrieving revision 1.27
retrieving revision 1.28
diff -C2 -d -r1.27 -r1.28
*** tokenizer.py	20 Sep 2002 06:03:12 -0000	1.27
--- tokenizer.py	20 Sep 2002 06:06:13 -0000	1.28
***************
*** 965,976 ****
          """Generate a stream of tokens from an email Message.
  
-         If a multipart/alternative section has both text/plain and text/html
-         sections, the text/html section is ignored.  This may not be a good
-         idea (e.g., the sections may have different content).
- 
          HTML tags are always stripped from text/plain sections.
- 
          options.retain_pure_html_tags controls whether HTML tags are
!         also stripped from text/html sections.
          """
  
--- 965,977 ----
          """Generate a stream of tokens from an email Message.
  
          HTML tags are always stripped from text/plain sections.
          options.retain_pure_html_tags controls whether HTML tags are
!         also stripped from text/html sections.  Except in special cases,
!         it's recommended to leave that at its default of false.
! 
!         If a multipart/alternative section has both text/plain and text/html
!         sections, options.ignore_redundant_html controls whether the HTML
!         part is ignored.  Except in special cases, it's recommended to
!         leave that at its default of false.
          """