com.yishuifengxiao.common.crawler.downloader

Class BaseDownloader

java.lang.Object

com.yishuifengxiao.common.crawler.downloader.BaseDownloader

All Implemented Interfaces:

Downloader, Cloneable

Direct Known Subclasses:

SeleniumDownloader

public abstract class BaseDownloader
extends Object
implements Downloader

selenium下载器基类
所有基于selenium的下载器最好根据此基类完成

Version:

1.0.0

Author:

yishui

Constructor Summary

Constructors

Constructor and Description
BaseDownloader(String driverPath) 构造函数 必须传入浏览器驱动文件geckodriver所在地址的路径 geckodriver文件的下载路径为 https://github.com/mozilla/geckodriver/releases 请根据运行环境的信息配置好此参数

Method Summary

Modifier and Type	Method and Description
void	close() 关闭下载器以释放资源
Page	down(Request request) 下载对应的请求资源
protected abstract Page	down(org.openqa.selenium.WebDriver driver, Request request) 执行真正的下载操作
protected abstract void	preHandle(Request request, org.openqa.selenium.WebDriver driver) 正式下载前的前置操作 可以在此操作中修改 Web浏览器对象，进行属性设置

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

BaseDownloader

public BaseDownloader(String driverPath)
               throws com.yishuifengxiao.common.tool.exception.ServiceException

构造函数
必须传入浏览器驱动文件geckodriver所在地址的路径
geckodriver文件的下载路径为 https://github.com/mozilla/geckodriver/releases
请根据运行环境的信息配置好此参数

Parameters:

driverPath - 浏览器驱动文件geckodriver的地址

Throws:

com.yishuifengxiao.common.tool.exception.ServiceException - 创建浏览器对象时出现的问题

Method Detail

preHandle

protected abstract void preHandle(Request request,
                                  org.openqa.selenium.WebDriver driver)

正式下载前的前置操作
可以在此操作中修改 Web浏览器对象，进行属性设置

Parameters:

request - 当前的下载请求任务

driver - Web浏览器对象

down

protected abstract Page down(org.openqa.selenium.WebDriver driver,
                             Request request)
                      throws com.yishuifengxiao.common.tool.exception.ServiceException

执行真正的下载操作

Parameters:

driver - Web浏览器对象

request - 当前的下载请求任务

Returns:

Throws:

com.yishuifengxiao.common.tool.exception.ServiceException

down

public Page down(Request request)
          throws com.yishuifengxiao.common.tool.exception.ServiceException

Description copied from interface: Downloader

下载对应的请求资源

Specified by:

down in interface Downloader

Parameters:

request - 当前的下载请求

Returns:

网页对象

Throws:

com.yishuifengxiao.common.tool.exception.ServiceException

close

public void close()

Description copied from interface: Downloader

关闭下载器以释放资源

Specified by:

close in interface Downloader