Uses of Interface
gov.sandia.cognition.text.token.Token

Packages that use Token
gov.sandia.cognition.text.term Provides term representing text content in documents. 
gov.sandia.cognition.text.token Provides text tokenization algorithms. 
 

Uses of Token in gov.sandia.cognition.text.term
 

Methods in gov.sandia.cognition.text.term with parameters of type Token
 Term TermFactory.createTerm(Token token)
          Creates a new term from the given token.
 

Uses of Token in gov.sandia.cognition.text.token
 

Classes in gov.sandia.cognition.text.token that implement Token
 class DefaultToken
          A default implementation of the Token interface.
 

Methods in gov.sandia.cognition.text.token that return types with arguments of type Token
 Iterable<Token> AbstractCharacterBasedTokenizer.tokenize(Reader reader)
           
 Iterable<Token> Tokenizer.tokenize(Reader reader)
          Converts the string from the given reader into an ordered list of tokens.
 Iterable<Token> AbstractTokenizer.tokenize(String s)
           
 Iterable<Token> Tokenizer.tokenize(String s)
          Convert the given string into a corresponding ordered list of tokens.
 Iterable<Token> AbstractTokenizer.tokenize(Textual textual)
           
 Iterable<Token> Tokenizer.tokenize(Textual textual)
          Convert the given string into a corresponding ordered list of tokens.