# Package opennlp.tools.cmdline.tokenizer

package opennlp.tools.cmdline.tokenizer

- Classes
  Class
  Description
  DetokenEvaluationErrorListener
  A default implementation of `EvaluationMonitor` that prints to an output stream.
  DictionaryDetokenizerTool
  SimpleTokenizerTool
  TokenEvaluationErrorListener
  A default implementation of `EvaluationMonitor` that prints to an output stream.
  TokenizerConverterTool
  Tool to convert multiple data formats into native OpenNLP sentence detector training format.
  TokenizerCrossValidatorTool
  TokenizerMEEvaluatorTool
  A default `TokenSample`-centric implementation of `AbstractEvaluatorTool` that prints to an output stream.
  TokenizerMETool
  TokenizerModelLoader
  Loads a `TokenizerModel` for the command line tools.
  TokenizerTrainerTool