com.yishuifengxiao.common.crawler.extractor.content

Class AbstractContentExtractor

java.lang.Object

com.yishuifengxiao.common.crawler.extractor.content.AbstractContentExtractor

All Implemented Interfaces:

ContentExtractor

Direct Known Subclasses:

SimpleContentExtractor

public abstract class AbstractContentExtractor
extends Object
implements ContentExtractor

抽象内容提取器

Version:

1.0.0

Author:

yishui

Field Summary

Fields

Modifier and Type	Field and Description
protected ExtractRule	contentRule

Constructor Summary

Constructors

Constructor and Description
AbstractContentExtractor(ExtractRule contentRule)

Method Summary

Modifier and Type	Method and Description
Object	extract(Page page) 提取数据
protected abstract Object	extract(Page page, List<ExtractFieldRule> fieldExtractRules) 根据提取规则对输入数据进行提取
String	getName() 获取内容提取器的名字

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

contentRule

protected ExtractRule contentRule

Constructor Detail

AbstractContentExtractor

public AbstractContentExtractor(ExtractRule contentRule)

Method Detail

extract

public Object extract(Page page)

提取数据

Specified by:

extract in interface ContentExtractor

Parameters:

page - 下载后的网页对象

Returns:

提取后的数据

extract

protected abstract Object extract(Page page,
                                  List<ExtractFieldRule> fieldExtractRules)

根据提取规则对输入数据进行提取

Parameters:

page - 下载后的网页对象

fieldExtractRules - 已经按照从小到大排列好的提取规则

Returns:

提取后的数据

getName

public String getName()

Description copied from interface: ContentExtractor

获取内容提取器的名字

Specified by:

getName in interface ContentExtractor

Returns: