Overview | Package | Class | Use | Tree | Deprecated | Index | Help
PREV NEXT | FRAMES NO FRAMES

## Uses of Class
org.apache.lucene.analysis.TokenFilter

Packages that use TokenFilter
org.apache.lucene.analysis | API and code to convert text into indexable/searchable tokens.
org.apache.lucene.analysis.standard | Standards-based analyzers implemented with JFlex.
org.apache.lucene.collation | `CollationKeyFilter` converts each token into its binary `CollationKey` using the provided `Collator`, and then encode the `CollationKey` as a String using `IndexableBinaryStringTools`, to allow it to be stored as an index term.

Uses of TokenFilter in org.apache.lucene.analysis

Subclasses of TokenFilter in org.apache.lucene.analysis
`class` | `ASCIIFoldingFilter` This class converts alphabetic, numeric, and symbolic Unicode characters which are not in the first 127 ASCII characters (the "Basic Latin" Unicode block) into their ASCII equivalents, if one exists.
`class` | `CachingTokenFilter` This class can be used if the token attributes of a TokenStream are intended to be consumed more than once.
`class` | `FilteringTokenFilter` Abstract base class for TokenFilters that may remove tokens.
`class` | `ISOLatin1AccentFilter` Deprecated. If you build a new index, use `ASCIIFoldingFilter` which covers a superset of Latin 1. This class is included for use with existing indexes and will be removed in a future release (possibly Lucene 4.0).
`class` | `KeywordMarkerFilter` Marks terms as keywords via the `KeywordAttribute`.
`class` | `LengthFilter` Removes words that are too long or too short from the stream.
`class` | `LimitTokenCountFilter` This TokenFilter limits the number of tokens while indexing.
`class` | `LowerCaseFilter` Normalizes token text to lower case.
`class` | `PorterStemFilter` Transforms the token stream as per the Porter stemming algorithm.
`class` | `StopFilter` Removes stop words from a token stream.
`class` | `TeeSinkTokenFilter` This TokenFilter provides the ability to set aside attribute states that have already been analyzed.
`class` | `TypeTokenFilter` Removes tokens whose types appear in a set of blocked types from a token stream.

Uses of TokenFilter in org.apache.lucene.analysis.standard

Subclasses of TokenFilter in org.apache.lucene.analysis.standard
`class` | `ClassicFilter` Normalizes tokens extracted with `ClassicTokenizer`.
`class` | `StandardFilter` Normalizes tokens extracted with `StandardTokenizer`.

Uses of TokenFilter in org.apache.lucene.collation

Subclasses of TokenFilter in org.apache.lucene.collation
`class` | `CollationKeyFilter` Converts each token into its `CollationKey`, and then encodes the CollationKey with `IndexableBinaryStringTools`, to allow it to be stored as an index term.

Overview | Package | Class | Use | Tree | Deprecated | Index | Help
PREV NEXT | FRAMES NO FRAMES