com.yishuifengxiao.common.crawler.simulator

Interface Simulator

All Known Implementing Classes:

SimpleSimulator

public interface Simulator

提取测试器
用于测试风铃虫规则是否配置正确，请勿将此作为正式的批量抓取工具

Version:

1.0.0

Author:

yishui

Method Summary

Modifier and Type	Method and Description
SimulatorData	down(String url, SiteRule siteRule, Downloader downloader) 测试网页下载功能
SimulatorData	extract(String url, SiteRule siteRule, ExtractRule contentExtractRule, Downloader downloader) 提取测试
SimulatorData	link(String url, SiteRule siteRule, LinkRule linkRule, Downloader downloader) 测试链接提取
SimulatorData	match(String url, SiteRule siteRule, ContentRule content, Downloader downloader) 测试内容匹配

Method Detail

down

SimulatorData down(String url,
                   SiteRule siteRule,
                   Downloader downloader)

测试网页下载功能

Parameters:

url - 测试目标地址

siteRule - 站点规则

downloader - 下载器

Returns:

下载的网页数据

link

SimulatorData link(String url,
                   SiteRule siteRule,
                   LinkRule linkRule,
                   Downloader downloader)

测试链接提取

Parameters:

url - 测试目标地址

siteRule - 站点规则

linkRule - 链接提取规则

downloader - 下载器

Returns:

模拟结果数据

match

SimulatorData match(String url,
                    SiteRule siteRule,
                    ContentRule content,
                    Downloader downloader)

测试内容匹配

Parameters:

url - 测试目标地址

siteRule - 站点规则

content - 内容解析规则

downloader - 下载器

Returns:

模拟结果数据

extract

SimulatorData extract(String url,
                      SiteRule siteRule,
                      ExtractRule contentExtractRule,
                      Downloader downloader)

提取测试

Parameters:

url - 测试目标地址

siteRule - 站点规则

contentExtractRule - 内容提取规则

downloader - 下载器

Returns:

模拟结果数据