Package org.apache.lucene.analysis.cz
Class CzechAnalyzer
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer
-
- org.apache.lucene.analysis.StopwordAnalyzerBase
-
- org.apache.lucene.analysis.cz.CzechAnalyzer
-
- All Implemented Interfaces:
java.io.Closeable
,java.lang.AutoCloseable
public final class CzechAnalyzer extends StopwordAnalyzerBase
Analyzer
for Czech language.Supports an external list of stopwords (words that will not be indexed at all). A default set of stopwords is used unless an alternative list is specified.
- Since:
- 3.1
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description private static class
CzechAnalyzer.DefaultSetHolder
-
Nested classes/interfaces inherited from class org.apache.lucene.analysis.Analyzer
Analyzer.ReuseStrategy, Analyzer.TokenStreamComponents
-
-
Field Summary
Fields Modifier and Type Field Description static java.lang.String
DEFAULT_STOPWORD_FILE
File containing default Czech stopwords.private CharArraySet
stemExclusionTable
-
Fields inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
stopwords
-
Fields inherited from class org.apache.lucene.analysis.Analyzer
GLOBAL_REUSE_STRATEGY, PER_FIELD_REUSE_STRATEGY
-
-
Constructor Summary
Constructors Constructor Description CzechAnalyzer()
Builds an analyzer with the default stop words (getDefaultStopSet()
).CzechAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.CzechAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionTable)
Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter
.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description protected Analyzer.TokenStreamComponents
createComponents(java.lang.String fieldName)
CreatesAnalyzer.TokenStreamComponents
used to tokenize all the text in the providedReader
.static CharArraySet
getDefaultStopSet()
Returns a set of default Czech-stopwordsprotected TokenStream
normalize(java.lang.String fieldName, TokenStream in)
Wrap the givenTokenStream
in order to apply normalization filters.-
Methods inherited from class org.apache.lucene.analysis.StopwordAnalyzerBase
getStopwordSet, loadStopwordSet, loadStopwordSet, loadStopwordSet
-
Methods inherited from class org.apache.lucene.analysis.Analyzer
attributeFactory, close, getOffsetGap, getPositionIncrementGap, getReuseStrategy, initReader, initReaderForNormalization, normalize, tokenStream, tokenStream
-
-
-
-
Field Detail
-
DEFAULT_STOPWORD_FILE
public static final java.lang.String DEFAULT_STOPWORD_FILE
File containing default Czech stopwords.- See Also:
- Constant Field Values
-
stemExclusionTable
private final CharArraySet stemExclusionTable
-
-
Constructor Detail
-
CzechAnalyzer
public CzechAnalyzer()
Builds an analyzer with the default stop words (getDefaultStopSet()
).
-
CzechAnalyzer
public CzechAnalyzer(CharArraySet stopwords)
Builds an analyzer with the given stop words.- Parameters:
stopwords
- a stopword set
-
CzechAnalyzer
public CzechAnalyzer(CharArraySet stopwords, CharArraySet stemExclusionTable)
Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter
.- Parameters:
stopwords
- a stopword setstemExclusionTable
- a stemming exclusion set
-
-
Method Detail
-
getDefaultStopSet
public static final CharArraySet getDefaultStopSet()
Returns a set of default Czech-stopwords- Returns:
- a set of default Czech-stopwords
-
createComponents
protected Analyzer.TokenStreamComponents createComponents(java.lang.String fieldName)
CreatesAnalyzer.TokenStreamComponents
used to tokenize all the text in the providedReader
.- Specified by:
createComponents
in classAnalyzer
- Parameters:
fieldName
- the name of the fields content passed to theAnalyzer.TokenStreamComponents
sink as a reader- Returns:
Analyzer.TokenStreamComponents
built from aStandardTokenizer
filtered withLowerCaseFilter
,StopFilter
, andCzechStemFilter
(only if version is >= LUCENE_31). If a stem exclusion set is provided viaCzechAnalyzer(CharArraySet, CharArraySet)
aSetKeywordMarkerFilter
is added beforeCzechStemFilter
.
-
normalize
protected TokenStream normalize(java.lang.String fieldName, TokenStream in)
Description copied from class:Analyzer
Wrap the givenTokenStream
in order to apply normalization filters. The default implementation returns theTokenStream
as-is. This is used byAnalyzer.normalize(String, String)
.
-
-