Uses of Package
org.apache.lucene.analysis.tokenattributes
-
Packages that use org.apache.lucene.analysis.tokenattributes Package Description org.apache.lucene.analysis Text analysis.org.apache.lucene.analysis.ar Analyzer for Arabic.org.apache.lucene.analysis.bg Analyzer for Bulgarian.org.apache.lucene.analysis.bn Analyzer for Bengali Language.org.apache.lucene.analysis.boost Provides various convenience classes for creating boosts on Tokens.org.apache.lucene.analysis.br Analyzer for Brazilian Portuguese.org.apache.lucene.analysis.cjk Analyzer for Chinese, Japanese, and Korean, which indexes bigrams.org.apache.lucene.analysis.ckb Analyzer for Sorani Kurdish.org.apache.lucene.analysis.classic Fast, general-purpose grammar-based tokenizers.org.apache.lucene.analysis.cn.smart Analyzer for Simplified Chinese, which indexes words.org.apache.lucene.analysis.commongrams Construct n-grams for frequently occurring terms and phrases.org.apache.lucene.analysis.compound A filter that decomposes compound words you find in many Germanic languages into the word parts.org.apache.lucene.analysis.core Basic, general-purpose analysis components.org.apache.lucene.analysis.cz Analyzer for Czech.org.apache.lucene.analysis.de Analyzer for German.org.apache.lucene.analysis.el Analyzer for Greek.org.apache.lucene.analysis.email Fast, general-purpose URLs and email addresses tokenizers.org.apache.lucene.analysis.en Analyzer for English.org.apache.lucene.analysis.es Analyzer for Spanish.org.apache.lucene.analysis.fa Analyzer for Persian.org.apache.lucene.analysis.fi Analyzer for Finnish.org.apache.lucene.analysis.fr Analyzer for French.org.apache.lucene.analysis.ga Analyzer for Irish.org.apache.lucene.analysis.gl Analyzer for Galician.org.apache.lucene.analysis.hi Analyzer for Hindi.org.apache.lucene.analysis.hu Analyzer for Hungarian.org.apache.lucene.analysis.hunspell A Java implementation of Hunspell stemming and spell-checking algorithms (Hunspell
), and a stemming TokenFilter (HunspellStemFilter
) based on it.org.apache.lucene.analysis.icu Analysis components based on ICUorg.apache.lucene.analysis.icu.segmentation Tokenizer that breaks text into words with the Unicode Text Segmentation algorithm.org.apache.lucene.analysis.icu.tokenattributes Additional ICU-specific Attributes for text analysis.org.apache.lucene.analysis.id Analyzer for Indonesian.org.apache.lucene.analysis.in Analyzer for Indian languages.org.apache.lucene.analysis.it Analyzer for Italian.org.apache.lucene.analysis.ja Analyzer for Japanese.org.apache.lucene.analysis.ko Analyzer for Korean.org.apache.lucene.analysis.lv Analyzer for Latvian.org.apache.lucene.analysis.minhash MinHash filtering (for LSH).org.apache.lucene.analysis.miscellaneous Miscellaneous Tokenstreams.org.apache.lucene.analysis.ngram Character n-gram tokenizers and filters.org.apache.lucene.analysis.no Analyzer for Norwegian.org.apache.lucene.analysis.path Analysis components for path-like strings such as filenames.org.apache.lucene.analysis.pattern Set of components for pattern-based (regex) analysis.org.apache.lucene.analysis.payloads Provides various convenience classes for creating payloads on Tokens.org.apache.lucene.analysis.phonetic Analysis components for phonetic search.org.apache.lucene.analysis.pt Analyzer for Portuguese.org.apache.lucene.analysis.reverse Filter to reverse token text.org.apache.lucene.analysis.ru Analyzer for Russian.org.apache.lucene.analysis.shingle Word n-gram filters.org.apache.lucene.analysis.snowball org.apache.lucene.analysis.sr Analyzer for Serbian.org.apache.lucene.analysis.standard Fast, general-purpose grammar-based tokenizerStandardTokenizer
implements the Word Break rules from the Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.org.apache.lucene.analysis.stempel Stempel: Algorithmic Stemmerorg.apache.lucene.analysis.sv Analyzer for Swedish.org.apache.lucene.analysis.synonym Analysis components for Synonyms.org.apache.lucene.analysis.te Analyzer for Telugu Language.org.apache.lucene.analysis.th Analyzer for Thai.org.apache.lucene.analysis.tokenattributes General-purpose attributes for text analysis.org.apache.lucene.analysis.tr Analyzer for Turkish.org.apache.lucene.analysis.util Utility functions for text analysis.org.apache.lucene.analysis.wikipedia Tokenizer that is aware of Wikipedia syntax.org.apache.lucene.collation.tokenattributes CustomAttributeImpl
for indexing collation keys as index terms.org.apache.lucene.document The logical representation of aDocument
for indexing and searching.org.apache.lucene.index Code to maintain and access indices.org.apache.lucene.monitor Monitoring frameworkorg.apache.lucene.search.highlight Highlighting search terms.org.apache.lucene.search.suggest.analyzing Analyzer based autosuggest.org.apache.lucene.search.suggest.document Support for document suggestionorg.apache.lucene.search.uhighlight The UnifiedHighlighter -- a flexible highlighter that can get offsets from postings, term vectors, or analysis. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.ar Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.bg Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.bn Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.boost Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.br Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.cjk Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.ckb Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.classic Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.cn.smart Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.commongrams Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.compound Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.core Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.cz Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.de Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.el Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.email Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.en Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.es Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.fa Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.fi Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.fr Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.ga Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.gl Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.hi Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.hu Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.hunspell Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.icu Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.icu.segmentation Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.icu.tokenattributes Class Description CharTermAttribute The term text of a Token.CharTermAttributeImpl Default implementation ofCharTermAttribute
.TermToBytesRefAttribute This attribute is requested by TermsHashPerField to index the contents. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.id Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.in Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.it Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.ja Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.ko Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.lv Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.minhash Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.miscellaneous Class Description CharTermAttribute The term text of a Token.FlagsAttribute This attribute can be used to pass different flags down theTokenizer
chain, e.g.KeywordAttribute This attribute can be used to mark a token as a keyword.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TermFrequencyAttribute Sets the custom term frequency of a term within one document.TermToBytesRefAttribute This attribute is requested by TermsHashPerField to index the contents.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.ngram Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.no Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.path Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.pattern Class Description CharTermAttribute The term text of a Token.FlagsAttribute This attribute can be used to pass different flags down theTokenizer
chain, e.g.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.payloads Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PayloadAttribute The payload of a Token.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.phonetic Class Description CharTermAttribute The term text of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.pt Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.reverse Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.ru Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.shingle Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.snowball Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.sr Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.standard Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.stempel Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.sv Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.synonym Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.te Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.th Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.tokenattributes Class Description BytesTermAttribute This attribute can be used if you have the raw term bytes to be indexed.CharTermAttribute The term text of a Token.CharTermAttributeImpl Default implementation ofCharTermAttribute
.FlagsAttribute This attribute can be used to pass different flags down theTokenizer
chain, e.g.KeywordAttribute This attribute can be used to mark a token as a keyword.OffsetAttribute The start and end character offset of a Token.PackedTokenAttributeImpl Default implementation of the common attributes used by Lucene:CharTermAttribute
TypeAttribute
PositionIncrementAttribute
PositionLengthAttribute
OffsetAttribute
TermFrequencyAttribute
PayloadAttribute The payload of a Token.PayloadAttributeImpl Default implementation ofPayloadAttribute
.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans.TermFrequencyAttribute Sets the custom term frequency of a term within one document.TermToBytesRefAttribute This attribute is requested by TermsHashPerField to index the contents.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.tr Class Description CharTermAttribute The term text of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.util Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.analysis.wikipedia Class Description CharTermAttribute The term text of a Token.FlagsAttribute This attribute can be used to pass different flags down theTokenizer
chain, e.g.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.TypeAttribute A Token's lexical type. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.collation.tokenattributes Class Description CharTermAttribute The term text of a Token.CharTermAttributeImpl Default implementation ofCharTermAttribute
.TermToBytesRefAttribute This attribute is requested by TermsHashPerField to index the contents. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.document Class Description BytesTermAttribute This attribute can be used if you have the raw term bytes to be indexed.CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.TermFrequencyAttribute Sets the custom term frequency of a term within one document. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.index Class Description OffsetAttribute The start and end character offset of a Token.PayloadAttribute The payload of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.TermFrequencyAttribute Sets the custom term frequency of a term within one document.TermToBytesRefAttribute This attribute is requested by TermsHashPerField to index the contents. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.monitor Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.PositionLengthAttribute Determines how many positions this token spans. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.search.highlight Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PayloadAttribute The payload of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.search.suggest.analyzing Class Description CharTermAttribute The term text of a Token.KeywordAttribute This attribute can be used to mark a token as a keyword.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.search.suggest.document Class Description CharTermAttribute The term text of a Token.PayloadAttribute The payload of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching. -
Classes in org.apache.lucene.analysis.tokenattributes used by org.apache.lucene.search.uhighlight Class Description CharTermAttribute The term text of a Token.OffsetAttribute The start and end character offset of a Token.PositionIncrementAttribute Determines the position of this token relative to the previous Token in a TokenStream, used in phrase searching.