Uses of Interface
opennlp.tools.tokenize.TokenContextGenerator
-
Packages that use TokenContextGenerator Package Description opennlp.tools.tokenize Contains classes related to finding token or words in a string.opennlp.tools.tokenize.lang -
-
Uses of TokenContextGenerator in opennlp.tools.tokenize
Classes in opennlp.tools.tokenize that implement TokenContextGenerator Modifier and Type Class Description class
DefaultTokenContextGenerator
Generate events for maxent decisions for tokenization.Methods in opennlp.tools.tokenize that return TokenContextGenerator Modifier and Type Method Description TokenContextGenerator
TokenizerFactory. getContextGenerator()
Gets the context generatorConstructors in opennlp.tools.tokenize with parameters of type TokenContextGenerator Constructor Description TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, Pattern alphaNumeric, TokenContextGenerator cg)
Initializes the current instance.TokSpanEventStream(ObjectStream<TokenSample> tokenSamples, boolean skipAlphaNumerics, TokenContextGenerator cg)
Initializes the current instance. -
Uses of TokenContextGenerator in opennlp.tools.tokenize.lang
Methods in opennlp.tools.tokenize.lang that return TokenContextGenerator Modifier and Type Method Description TokenContextGenerator
Factory. createTokenContextGenerator(String languageCode, Set<String> abbreviations)
-