com.yishuifengxiao.common.crawler.simulator

Class SimpleSimulator

java.lang.Object

com.yishuifengxiao.common.crawler.simulator.SimpleSimulator

All Implemented Interfaces:

Simulator

public class SimpleSimulator
extends Object
implements Simulator

简单的模拟提取器

Version:

1.0.0

Author:

yishui

Field Summary

Fields

Modifier and Type	Field and Description
protected ContentMatcher	contentMatcher 内容匹配器

Constructor Summary

Constructors

Constructor and Description
SimpleSimulator()

Method Summary

Modifier and Type	Method and Description
SimulatorData	down(String url, SiteRule siteRule, Downloader downloader) 测试网页下载功能
SimulatorData	extract(String url, SiteRule siteRule, ExtractRule contentExtractRule, Downloader downloader) 提取测试
SimulatorData	link(String url, SiteRule siteRule, LinkRule linkRule, Downloader downloader) 测试链接提取
SimulatorData	match(String url, SiteRule siteRule, ContentRule content, Downloader downloader) 测试内容匹配

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

contentMatcher

protected ContentMatcher contentMatcher

内容匹配器

Constructor Detail

SimpleSimulator

public SimpleSimulator()

Method Detail

down

public SimulatorData down(String url,
                          SiteRule siteRule,
                          Downloader downloader)

Description copied from interface: Simulator

测试网页下载功能

Specified by:

down in interface Simulator

Parameters:

url - 测试目标地址

siteRule - 站点规则

downloader - 下载器

Returns:

下载的网页数据

link

public SimulatorData link(String url,
                          SiteRule siteRule,
                          LinkRule linkRule,
                          Downloader downloader)

Description copied from interface: Simulator

测试链接提取

Specified by:

link in interface Simulator

Parameters:

url - 测试目标地址

siteRule - 站点规则

linkRule - 链接提取规则

downloader - 下载器

Returns:

模拟结果数据

match

public SimulatorData match(String url,
                           SiteRule siteRule,
                           ContentRule content,
                           Downloader downloader)

Description copied from interface: Simulator

测试内容匹配

Specified by:

match in interface Simulator

Parameters:

url - 测试目标地址

siteRule - 站点规则

content - 内容解析规则

downloader - 下载器

Returns:

模拟结果数据

extract

public SimulatorData extract(String url,
                             SiteRule siteRule,
                             ExtractRule contentExtractRule,
                             Downloader downloader)

Description copied from interface: Simulator

提取测试

Specified by:

extract in interface Simulator

Parameters:

url - 测试目标地址

siteRule - 站点规则

contentExtractRule - 内容提取规则

downloader - 下载器

Returns:

模拟结果数据