Package org.jasen.core.token

Class Summary

CountTokenErrorReport	Simple report which counts occurrances of token errors.
EmailTokenizer	Converts the subject, text and html parts of a MimeMessage into discrete String "tokens".
ObfuscatedCharacterTokenErrorRecorder	Records occurrances of misused characters.
SimpleWordTokenizer	Used to parse text which has already been semi formatted.
SpamTokenizer	This class is used exlusively by the EmailTokenizer.
StopWordList	Maintains a hard-coded list of English stopwords.