# Uses of Interface
opennlp.tools.tokenize.Detokenizer

Packages that use Detokenizer
Package
Description
opennlp.tools.formats
Experimental package related to converting various corpora to OpenNLP Format.
opennlp.tools.formats.convert
opennlp.tools.formats.letsmt
Experimental package related to the `letsmt` corpus format.
opennlp.tools.sentdetect
Package related to identifying sentence boundaries.
opennlp.tools.tokenize
Contains classes related to finding token or words in a string.

- ## Uses of Detokenizer in opennlp.tools.formats

  Methods in opennlp.tools.formats that return Detokenizer
  Modifier and Type
  Method
  Description
  `protected Detokenizer`
  DetokenizerSampleStreamFactory.`createDetokenizer(DetokenizerParameter p)`

- ## Uses of Detokenizer in opennlp.tools.formats.convert

  Constructors in opennlp.tools.formats.convert with parameters of type Detokenizer
  Modifier
  Constructor
  Description
  ``
  `NameToSentenceSampleStream(Detokenizer detokenizer, ObjectStream<NameSample> samples, int chunkSize)`
  Initializes a `NameToSentenceSampleStream`.
  ``
  `NameToTokenSampleStream(Detokenizer detokenizer, ObjectStream<NameSample> samples)`
  Initializes a `NameToTokenSampleStream`.
  ``
  `POSToSentenceSampleStream(Detokenizer detokenizer, ObjectStream<POSSample> samples, int chunkSize)`
  Initializes a `POSToSentenceSampleStream`.
  ``
  `POSToTokenSampleStream(Detokenizer detokenizer, ObjectStream<POSSample> samples)`
  Initializes a `POSToTokenSampleStream`.

- ## Uses of Detokenizer in opennlp.tools.formats.letsmt

  Constructors in opennlp.tools.formats.letsmt with parameters of type Detokenizer
  Modifier
  Constructor
  Description
  ``
  `DetokenizeSentenceSampleStream(Detokenizer detokenizer, ObjectStream<SentenceSample> samples)`
  Initializes a `DetokenizeSentenceSampleStream`.

- ## Uses of Detokenizer in opennlp.tools.sentdetect

  Constructors in opennlp.tools.sentdetect with parameters of type Detokenizer
  Modifier
  Constructor
  Description
  ``
  `SentenceSample(Detokenizer detokenizer, String[][] sentences)`

- ## Uses of Detokenizer in opennlp.tools.tokenize

  Classes in opennlp.tools.tokenize that implement Detokenizer
  Modifier and Type
  Class
  Description
  `class`
  `DictionaryDetokenizer`
  A rule based detokenizer.
  Constructors in opennlp.tools.tokenize with parameters of type Detokenizer
  Modifier
  Constructor
  Description
  ``
  `DetokenizerEvaluator(Detokenizer detokenizer, DetokenEvaluationErrorListener... listeners)`
  Initializes the current instance with the given `Detokenizer`.
  ``
  `TokenSample(Detokenizer detokenizer, String[] tokens)`
  Initializes a `instance` via a `Detokenizer`.