com.yishuifengxiao.common.crawler.scheduler

Class SchedulerDecorator

java.lang.Object

com.yishuifengxiao.common.crawler.scheduler.SchedulerDecorator

All Implemented Interfaces:

Scheduler

public class SchedulerDecorator
extends Object
implements Scheduler

资源调度器装饰者
负责资源的调度管理工作
功能如下：
1. 接收所有未过滤的链接并存储起来
2. 从资源池中获取一个链接
3. 判断资源是否需要存储

Version:

1.0.0

Author:

yishui

Constructor Summary

Constructors

Constructor and Description
SchedulerDecorator(RequestCache requestCache, Scheduler scheduler, DuplicateRemover duplicateRemover)

Method Summary

Modifier and Type	Method and Description
void	clear(Task task) 清空任务
Request	poll(Task task) 从资源调度器里获取一个请求任务
void	push(Task task, Request request) 接收所有的请求任并存储起来

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SchedulerDecorator

public SchedulerDecorator(RequestCache requestCache,
                          Scheduler scheduler,
                          DuplicateRemover duplicateRemover)

Method Detail

push

public void push(Task task,
                 Request request)

Description copied from interface: Scheduler

接收所有的请求任并存储起来

Specified by:

push in interface Scheduler

Parameters:

task - 当前任务的任务信息

poll

public Request poll(Task task)

Description copied from interface: Scheduler

从资源调度器里获取一个请求任务

Specified by:

poll in interface Scheduler

Parameters:

task - 当前任务的任务信息

Returns:

需要执行的请求任务

clear

public void clear(Task task)

Description copied from interface: Scheduler

清空任务

Specified by:

clear in interface Scheduler

Parameters:

task - 当前任务的任务信息