org.wandora.piccolo.utils.crawler.handlers

Class HTMLSurfer

java.lang.Object

org.wandora.piccolo.utils.crawler.handlers.HTMLSurfer

All Implemented Interfaces:

Handler

public class HTMLSurfer
extends java.lang.Object
implements Handler

Author:

olli

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String[]	contentTypes
private java.lang.String[]	linkTypes
private java.lang.String	regexAll
private java.lang.String	regexOneOf
private java.lang.String	startURL

Constructor Summary

Constructors

Constructor and Description
HTMLSurfer(java.lang.String[] linkTypes, java.lang.String regexAll, java.lang.String regexOneOf, java.lang.String startURL) Creates new CrawlerParser

Method Summary

Modifier and Type	Method and Description
java.lang.String[]	getContentTypes() Returns an array of String containing the content-types this ContentHandler can process.
void	handle(CrawlerAccess crawler, java.io.InputStream in, int depth, java.net.URL page) Processes the given page.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

linkTypes

private java.lang.String[] linkTypes

regexAll

private java.lang.String regexAll

regexOneOf

private java.lang.String regexOneOf

startURL

private java.lang.String startURL

contentTypes

public static final java.lang.String[] contentTypes

Constructor Detail

HTMLSurfer

public HTMLSurfer(java.lang.String[] linkTypes,
                  java.lang.String regexAll,
                  java.lang.String regexOneOf,
                  java.lang.String startURL)

Creates new CrawlerParser

Method Detail

handle

public void handle(CrawlerAccess crawler,
                   java.io.InputStream in,
                   int depth,
                   java.net.URL page)

Description copied from interface: Handler

Processes the given page. The given InputStream contains the data of an object that is of the content-type this content handler accepts. May use the given CrawlerAccess object to add further pages to the queue of the WebCrawler that asked to process the page.

Specified by:

handle in interface Handler

Parameters:

crawler - The call back object for the handler. Any objects built from the content of the page can be sent to this.

in - The InputStream of the page.

depth - The depth remaining depth. When reporting another page to the queue, the depth of that page should be set to this depth-1.

page - The URL of the page.

getContentTypes

public java.lang.String[] getContentTypes()

Description copied from interface: Handler

Returns an array of String containing the content-types this ContentHandler can process.

Specified by:

getContentTypes in interface Handler

Returns:

String array representing content types.