Uses of Interface
com.yishuifengxiao.common.crawler.scheduler.remover.DuplicateRemover

Packages that use DuplicateRemover

Package	Description
com.yishuifengxiao.common.crawler
com.yishuifengxiao.common.crawler.scheduler
com.yishuifengxiao.common.crawler.scheduler.remover

Uses of DuplicateRemover in com.yishuifengxiao.common.crawler

Methods in com.yishuifengxiao.common.crawler that return DuplicateRemover

Modifier and Type	Method and Description
DuplicateRemover	Crawler.getDuplicateRemover() 获取请求去重器

Methods in com.yishuifengxiao.common.crawler with parameters of type DuplicateRemover

Modifier and Type	Method and Description
Crawler	Crawler.setDuplicateRemover(DuplicateRemover duplicateRemover) 设置请求去重器

Uses of DuplicateRemover in com.yishuifengxiao.common.crawler.scheduler

Constructors in com.yishuifengxiao.common.crawler.scheduler with parameters of type DuplicateRemover

Constructor and Description
SchedulerDecorator(RequestCache requestCache, Scheduler scheduler, DuplicateRemover duplicateRemover)

Uses of DuplicateRemover in com.yishuifengxiao.common.crawler.scheduler.remover

Classes in com.yishuifengxiao.common.crawler.scheduler.remover that implement DuplicateRemover

Modifier and Type	Class and Description
class	HostDuplicateRemover 无查询参数去重器 去除URL上所有的查询参数的简单去重器
class	SimpleDuplicateRemover 全路径去重器 简单实现的请求去重器