org.wandora.piccolo.utils.crawler.handlers

Class HTMLSaveHandler

java.lang.Object

org.wandora.piccolo.utils.crawler.handlers.HTMLSaveHandler

All Implemented Interfaces:

Handler

public class HTMLSaveHandler
extends java.lang.Object
implements Handler

Author:

olli

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String[]	contentTypes
private OutputMapper	fileNameMapper
private java.lang.String	inencoding
private OutputMapper[]	mappers
private gnu.regexp.RE[]	matchers
private java.lang.String	outencoding
private java.lang.String[]	substitutes

Constructor Summary

Constructors

Constructor and Description
HTMLSaveHandler()
HTMLSaveHandler(java.lang.Object[] o)
HTMLSaveHandler(gnu.regexp.RE[] matchers, OutputMapper[] mappers, OutputMapper fileNameMapper)
HTMLSaveHandler(gnu.regexp.RE[] matchers, java.lang.String[] substitutes, OutputMapper[] mappers, OutputMapper fileNameMapper, java.lang.String inencoding, java.lang.String outencoding)

Method Summary

Modifier and Type	Method and Description
java.lang.String[]	getContentTypes() Returns an array of String containing the content-types this ContentHandler can process.
void	handle(CrawlerAccess crawler, java.io.InputStream in, int depth, java.net.URL page) Processes the given page.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

matchers

private gnu.regexp.RE[] matchers

mappers

private OutputMapper[] mappers

substitutes

private java.lang.String[] substitutes

fileNameMapper

private OutputMapper fileNameMapper

inencoding

private java.lang.String inencoding

outencoding

private java.lang.String outencoding

contentTypes

public static final java.lang.String[] contentTypes

Constructor Detail

HTMLSaveHandler

public HTMLSaveHandler()

HTMLSaveHandler

public HTMLSaveHandler(java.lang.Object[] o)

HTMLSaveHandler

public HTMLSaveHandler(gnu.regexp.RE[] matchers,
                       OutputMapper[] mappers,
                       OutputMapper fileNameMapper)

HTMLSaveHandler

public HTMLSaveHandler(gnu.regexp.RE[] matchers,
                       java.lang.String[] substitutes,
                       OutputMapper[] mappers,
                       OutputMapper fileNameMapper,
                       java.lang.String inencoding,
                       java.lang.String outencoding)

Method Detail

handle

public void handle(CrawlerAccess crawler,
                   java.io.InputStream in,
                   int depth,
                   java.net.URL page)

Description copied from interface: Handler

Processes the given page. The given InputStream contains the data of an object that is of the content-type this content handler accepts. May use the given CrawlerAccess object to add further pages to the queue of the WebCrawler that asked to process the page.

Specified by:

handle in interface Handler

Parameters:

crawler - The call back object for the handler. Any objects built from the content of the page can be sent to this.

in - The InputStream of the page.

depth - The depth remaining depth. When reporting another page to the queue, the depth of that page should be set to this depth-1.

page - The URL of the page.

getContentTypes

public java.lang.String[] getContentTypes()

Description copied from interface: Handler

Returns an array of String containing the content-types this ContentHandler can process.

Specified by:

getContentTypes in interface Handler

Returns:

String array representing content types.