Class SegToken
- java.lang.Object
-
- org.apache.lucene.analysis.cn.smart.hhmm.SegToken
-
public class SegToken extends java.lang.Object
SmartChineseAnalyzer internal token
-
-
Field Summary
Fields Modifier and Type Field Description char[]
charArray
Character array containing token textint
endOffset
end offset into original sentenceint
index
during segmentation, this is used to store the index of the token in the token list tableint
startOffset
start offset into original sentenceint
weight
word frequencyint
wordType
WordType
of the text
-
Constructor Summary
Constructors Constructor Description SegToken(char[] idArray, int start, int end, int wordType, int weight)
Create a new SegToken from a character array.
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description boolean
equals(java.lang.Object obj)
int
hashCode()
-
-
-
Field Detail
-
charArray
public char[] charArray
Character array containing token text
-
startOffset
public int startOffset
start offset into original sentence
-
endOffset
public int endOffset
end offset into original sentence
-
wordType
public int wordType
WordType
of the text
-
weight
public int weight
word frequency
-
index
public int index
during segmentation, this is used to store the index of the token in the token list table
-
-
Constructor Detail
-
SegToken
public SegToken(char[] idArray, int start, int end, int wordType, int weight)
Create a new SegToken from a character array.- Parameters:
idArray
- character array containing textstart
- start offset of SegToken in original sentenceend
- end offset of SegToken in original sentencewordType
-WordType
of the textweight
- word frequency
-
-