org.tinygroup.chinese

Interface WordParser<T extends Token,Source>

All Known Implementing Classes:

BatchWordInputStreamParser, BatchWordReaderParser, BatchWordStringParser, SingleWordInputStreamParser, SingleWordReaderParser, SingleWordStringParser

public interface WordParser<T extends Token,Source>

Created by luog on 15/4/13.

Method Summary

Modifier and Type	Method and Description
List<T>	nextSentenceTokens() 返回下一个句子中的Token列表
T	nextToken() 返回下一个Token，如果返回值为空，表示已经以结尾
void	parse(WordParserManager manager, Source source, WordParserType wordParserType, WordParserMode wordParserMode) 解析资源，调用此方法时，会清空缓冲
Collection<T>	tokens() 返回所有解析出来的Token列表，调用时，会把nextToken置为开头

Method Detail

parse

void parse(WordParserManager manager,
           Source source,
           WordParserType wordParserType,
           WordParserMode wordParserMode)
    throws IOException

解析资源，调用此方法时，会清空缓冲

Parameters:

manager -

source - 表示来源

Throws:

IOException

tokens

Collection<T> tokens()
              throws IOException

返回所有解析出来的Token列表，调用时，会把nextToken置为开头

Returns:

Throws:

IOException

nextToken

T nextToken()
     throws IOException

返回下一个Token，如果返回值为空，表示已经以结尾

Returns:

Throws:

IOException

nextSentenceTokens

List<T> nextSentenceTokens()
                    throws IOException

返回下一个句子中的Token列表

Returns:

Throws:

IOException