Class StandardAnalyzer

    • Field Detail

      • DEFAULT_MAX_TOKEN_LENGTH

        public static final int DEFAULT_MAX_TOKEN_LENGTH
        Default maximum allowed token length
        See Also:
        Constant Field Values
      • maxTokenLength

        private int maxTokenLength
    • Constructor Detail

      • StandardAnalyzer

        public StandardAnalyzer​(CharArraySet stopWords)
        Builds an analyzer with the given stop words.
        Parameters:
        stopWords - stop words
      • StandardAnalyzer

        public StandardAnalyzer()
        Builds an analyzer with no stop words.
      • StandardAnalyzer

        public StandardAnalyzer​(java.io.Reader stopwords)
                         throws java.io.IOException
        Builds an analyzer with the stop words from the given reader.
        Parameters:
        stopwords - Reader to read stop words from
        Throws:
        java.io.IOException
        See Also:
        WordlistLoader.getWordSet(Reader)