# Package opennlp.uima.tokenize

package opennlp.uima.tokenize
Package related to finding tokens or word segments.

- Class
  Description
  AbstractTokenizer
  SimpleTokenizer
  OpenNLP Simple Tokenizer annotator.
  Tokenizer
  OpenNLP Tokenizer annotator.
  TokenizerModelResource
  A `TokenizerModel` which can be shared between `AnalysisEngine`s and loaded via the UIMA resource model.
  TokenizerModelResourceImpl
  WhitespaceTokenizer
  OpenNLP Whitespace Tokenizer annotator.