com.yishuifengxiao.common.crawler.downloader.impl

Class SeleniumDownloader

java.lang.Object

com.yishuifengxiao.common.crawler.downloader.BaseDownloader

com.yishuifengxiao.common.crawler.downloader.impl.SeleniumDownloader

All Implemented Interfaces:

Downloader, Cloneable

public class SeleniumDownloader
extends BaseDownloader

基于Firefox的下载器
使用selenium-java实现

Version:

1.0.0

Author:

yishui

Constructor Summary

Constructors

Constructor and Description
SeleniumDownloader(String driverPath, long waitRender) 构造函数 必须传入浏览器驱动文件geckodriver所在地址的路径 geckodriver文件的下载路径为 https://github.com/mozilla/geckodriver/releases 请根据运行环境的信息配置好此参数

Method Summary

Modifier and Type	Method and Description
Page	down(org.openqa.selenium.WebDriver driver, Request request) 执行真正的下载操作
protected void	preHandle(Request request, org.openqa.selenium.WebDriver driver) 正式下载前的前置操作 可以在此操作中修改 Web浏览器对象，进行属性设置

Methods inherited from class com.yishuifengxiao.common.crawler.downloader.BaseDownloader

close, down

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SeleniumDownloader

public SeleniumDownloader(String driverPath,
                          long waitRender)
                   throws com.yishuifengxiao.common.tool.exception.ServiceException

构造函数
必须传入浏览器驱动文件geckodriver所在地址的路径
geckodriver文件的下载路径为 https://github.com/mozilla/geckodriver/releases
请根据运行环境的信息配置好此参数

Parameters:

driverPath - 浏览器驱动文件geckodriver的地址

waitRender - 等待一段时间，以便在下载需要前端渲染的网站时让浏览器有时间完成前端渲染，单位为毫秒，如果此值不大于0表示不开启此功能

Throws:

com.yishuifengxiao.common.tool.exception.ServiceException - 创建浏览器对象时出现的问题

Method Detail

down

public Page down(org.openqa.selenium.WebDriver driver,
                 Request request)
          throws com.yishuifengxiao.common.tool.exception.ServiceException

Description copied from class: BaseDownloader

执行真正的下载操作

Specified by:

down in class BaseDownloader

Parameters:

driver - Web浏览器对象

request - 当前的下载请求任务

Returns:

Throws:

com.yishuifengxiao.common.tool.exception.ServiceException

preHandle

protected void preHandle(Request request,
                         org.openqa.selenium.WebDriver driver)

Description copied from class: BaseDownloader

正式下载前的前置操作
可以在此操作中修改 Web浏览器对象，进行属性设置

Specified by:

preHandle in class BaseDownloader

Parameters:

request - 当前的下载请求任务

driver - Web浏览器对象