Package | Description |
---|---|
com.yishuifengxiao.common.crawler | |
com.yishuifengxiao.common.crawler.link | |
com.yishuifengxiao.common.crawler.simulator |
Modifier and Type | Method and Description |
---|---|
LinkRule |
CrawlerBuilder.link()
获取链接解析规则
|
Modifier and Type | Method and Description |
---|---|
CrawlerBuilder |
CrawlerBuilder.link(LinkRule link)
设置链接解析规则
|
static SimulatorData |
Crawler.testLink(String url,
SiteRule siteRule,
LinkRule linkRule)
测试链接提取规则
使用默认下载器 |
static SimulatorData |
Crawler.testLink(String url,
SiteRule siteRule,
LinkRule linkRule,
Downloader downloader)
测试链接提取规则
使用自定义下载器 |
Modifier and Type | Method and Description |
---|---|
void |
LinkExtractDecorator.extract(LinkRule linkRule,
Page page) |
void |
LinkExtract.extract(LinkRule linkRule,
Page page)
提取出网页里所有的链接
|
Modifier and Type | Method and Description |
---|---|
SimulatorData |
Simulator.link(String url,
SiteRule siteRule,
LinkRule linkRule,
Downloader downloader)
测试链接提取
|
SimulatorData |
SimpleSimulator.link(String url,
SiteRule siteRule,
LinkRule linkRule,
Downloader downloader) |
Copyright © 2020 Pivotal Software, Inc.. All rights reserved.