Uses of Interface
com.yishuifengxiao.common.crawler.cache.RequestCache

Packages that use RequestCache

Package	Description
com.yishuifengxiao.common.crawler
com.yishuifengxiao.common.crawler.cache
com.yishuifengxiao.common.crawler.scheduler
com.yishuifengxiao.common.crawler.scheduler.remover

Uses of RequestCache in com.yishuifengxiao.common.crawler

Methods in com.yishuifengxiao.common.crawler that return RequestCache

Modifier and Type	Method and Description
RequestCache	Crawler.getRequestCache() 设置资源缓存器

Methods in com.yishuifengxiao.common.crawler with parameters of type RequestCache

Modifier and Type	Method and Description
Crawler	Crawler.setRequestCache(RequestCache requestCache) 设置资源缓存器

Uses of RequestCache in com.yishuifengxiao.common.crawler.cache

Classes in com.yishuifengxiao.common.crawler.cache that implement RequestCache

Modifier and Type	Class and Description
class	InMemoryRequestCache 基于内存实现的请求任务缓存器
class	RedisRequestCache 基于redis实现的请求记录器

Uses of RequestCache in com.yishuifengxiao.common.crawler.scheduler

Constructors in com.yishuifengxiao.common.crawler.scheduler with parameters of type RequestCache

Constructor and Description
SchedulerDecorator(RequestCache requestCache, Scheduler scheduler, DuplicateRemover duplicateRemover)

Uses of RequestCache in com.yishuifengxiao.common.crawler.scheduler.remover

Methods in com.yishuifengxiao.common.crawler.scheduler.remover with parameters of type RequestCache

Modifier and Type	Method and Description
void	SimpleDuplicateRemover.doWhenNoDuplicate(Task task, RequestCache requestCache, Request request)
void	DuplicateRemover.doWhenNoDuplicate(Task task, RequestCache requestCache, Request request) 当前请求没有重复时需要进行的操作，一般来说，只需将该请求存入请求任务缓存器即可
void	HostDuplicateRemover.doWhenNoDuplicate(Task task, RequestCache requestCache, Request request)
boolean	SimpleDuplicateRemover.noDuplicate(Task task, RequestCache requestCache, Request request)
boolean	DuplicateRemover.noDuplicate(Task task, RequestCache requestCache, Request request) 判断当前请求是否重复
boolean	HostDuplicateRemover.noDuplicate(Task task, RequestCache requestCache, Request request)