## Uses of Class
org.apache.lucene.analysis.Tokenizer

- Packages that use Tokenizer
  Package | Description
  --- | ---
  org.apache.lucene.analysis | API and code to convert text into indexable/searchable tokens.

- - ### Uses of Tokenizer in org.apache.lucene.analysis

    Fields in org.apache.lucene.analysis declared as Tokenizer
    Modifier and Type | Field and Description
    --- | ---
    `protected Tokenizer` | Analyzer.TokenStreamComponents.`source` Original source of the tokens.

    Methods in org.apache.lucene.analysis that return Tokenizer
    Modifier and Type | Method and Description
    --- | ---
    `Tokenizer` | Analyzer.TokenStreamComponents.`getTokenizer()` Returns the component's `Tokenizer`

    Constructors in org.apache.lucene.analysis with parameters of type Tokenizer
    Constructor and Description
    `Analyzer.TokenStreamComponents(Tokenizer source)` Creates a new `Analyzer.TokenStreamComponents` instance.
    `Analyzer.TokenStreamComponents(Tokenizer source, TokenStream result)` Creates a new `Analyzer.TokenStreamComponents` instance.

Copyright © 2000-2013 Apache Software Foundation. All Rights Reserved.