org.tinygroup.chineseanalyzer

Class ChineseTokenStream

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.Tokenizer

org.tinygroup.chineseanalyzer.ChineseTokenStream

All Implemented Interfaces:

Closeable, AutoCloseable

public class ChineseTokenStream
extends org.apache.lucene.analysis.Tokenizer

基于TinySeg的Lucene的令牌流扩展

Author:

yancheng11334

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State

Field Summary

Fields inherited from class org.apache.lucene.analysis.Tokenizer

input

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	ChineseTokenStream(Reader input)

Method Summary

Modifier and Type	Method and Description
boolean	incrementToken()
void	reset()

Methods inherited from class org.apache.lucene.analysis.Tokenizer

close, correctOffset, setReader

Methods inherited from class org.apache.lucene.analysis.TokenStream

end

Methods inherited from class org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, restoreState, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ChineseTokenStream

protected ChineseTokenStream(Reader input)

Method Detail

reset

public void reset()
           throws IOException

Overrides:

reset in class org.apache.lucene.analysis.Tokenizer

Throws:

IOException

incrementToken

public final boolean incrementToken()
                             throws IOException

Specified by:

incrementToken in class org.apache.lucene.analysis.TokenStream

Throws:

IOException