org.tinygroup.chinese.batch

Class BatchWordInputStreamParser

java.lang.Object

org.tinygroup.chinese.batch.BatchWordInputStreamParser

All Implemented Interfaces:

WordParser<BatchToken,InputStream>

public class BatchWordInputStreamParser
extends Object
implements WordParser<BatchToken,InputStream>

Created by luog on 15/4/13.

Constructor Summary

Constructors

Constructor and Description
BatchWordInputStreamParser()
BatchWordInputStreamParser(String charset)

Method Summary

Modifier and Type	Method and Description
List<BatchToken>	nextSentenceTokens() 返回下一个句子中的Token列表
BatchToken	nextToken() 返回下一个Token，如果返回值为空，表示已经以结尾
void	parse(WordParserManager manager, InputStream inputStream, WordParserType wordParserType, WordParserMode wordParserMode) 解析资源，调用此方法时，会清空缓冲
Collection<BatchToken>	tokens() 返回所有解析出来的Token列表，调用时，会把nextToken置为开头

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BatchWordInputStreamParser

public BatchWordInputStreamParser()

BatchWordInputStreamParser

public BatchWordInputStreamParser(String charset)

Method Detail

parse

public void parse(WordParserManager manager,
                  InputStream inputStream,
                  WordParserType wordParserType,
                  WordParserMode wordParserMode)
           throws IOException

Description copied from interface: WordParser

解析资源，调用此方法时，会清空缓冲

Specified by:

parse in interface WordParser<BatchToken,InputStream>

inputStream - 表示来源

Throws:

IOException

tokens

public Collection<BatchToken> tokens()

Description copied from interface: WordParser

返回所有解析出来的Token列表，调用时，会把nextToken置为开头

Specified by:

tokens in interface WordParser<BatchToken,InputStream>

Returns:

nextToken

public BatchToken nextToken()

Description copied from interface: WordParser

返回下一个Token，如果返回值为空，表示已经以结尾

Specified by:

nextToken in interface WordParser<BatchToken,InputStream>

Returns:

nextSentenceTokens

public List<BatchToken> nextSentenceTokens()
                                    throws IOException

Description copied from interface: WordParser

返回下一个句子中的Token列表

Specified by:

nextSentenceTokens in interface WordParser<BatchToken,InputStream>

Returns:

Throws:

IOException