com.yishuifengxiao.common.crawler.downloader.impl

Class SimpleDownloader

java.lang.Object

com.yishuifengxiao.common.crawler.downloader.impl.SimpleDownloader

All Implemented Interfaces:

Downloader, Cloneable

public class SimpleDownloader
extends Object
implements Downloader

基于JSOUP实现的网页下载器
特性如下:
1. 支持下载https网站
2. 支持设置cookie
3. 支持设置user-agent

Version:

1.0.0

Author:

yishui

Constructor Summary

Constructors

Constructor and Description
SimpleDownloader()

Method Summary

Modifier and Type	Method and Description
void	close() 关闭下载器以释放资源
Page	down(Request request) 下载对应的请求资源

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SimpleDownloader

public SimpleDownloader()

Method Detail

down

public Page down(Request request)
          throws com.yishuifengxiao.common.tool.exception.ServiceException

Description copied from interface: Downloader

下载对应的请求资源

Specified by:

down in interface Downloader

Parameters:

request - 当前的下载请求

Returns:

网页对象

Throws:

com.yishuifengxiao.common.tool.exception.ServiceException

close

public void close()

Description copied from interface: Downloader

关闭下载器以释放资源

Specified by:

close in interface Downloader