org.wandora.application.tools.extractors

Class AbstractJsoupExtractor

java.lang.Object

org.wandora.application.tools.AbstractWandoraTool

org.wandora.application.tools.extractors.AbstractExtractor

org.wandora.application.tools.extractors.AbstractJsoupExtractor

All Implemented Interfaces:

java.io.Serializable, java.lang.Runnable, BrowserPluginExtractor, DropExtractor, WandoraTool, WandoraToolLogger, Handler, InterruptHandler, TopicMapLogger

Direct Known Subclasses:

AbstractJsoupMicroformatExtractor, JsoupAssociationRowTableExtractor, JsoupDefinitionListExtractor, JsoupHTMLLinkStructureExtractor, JsoupInstanceListExtractor, JsoupPropertyTableExtractor, JsoupSuperSubClassListExtractor

public abstract class AbstractJsoupExtractor
extends AbstractExtractor

Author:

Eero

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
private java.lang.String[]	contentTypes
private static java.lang.String	LANG_SI

Fields inherited from class org.wandora.application.tools.extractors.AbstractExtractor

CUSTOM_EXTRACTOR, DONE_FAILED, DONE_MANY, DONE_ONE, EXACTLY_GIVEN_URLS, FILE_EXTRACTOR, FILE_PATTERN, GIVEN_URLS_AND_ALL_CRAWLED_DOCUMENTS, GIVEN_URLS_AND_CRAWLED_DOCUMENTS_IN_URL_DOMAIN, GIVEN_URLS_AND_LINKED_DOCUMENTS, GIVEN_URLS_AND_URL_BELOW, INFO_WAIT_WHILE_WORKING, LOG_TITLE, POINT_START_URL_TEXT, RAW_EXTRACTOR, SELECT_DIALOG_TITLE, STRING_EXTRACTOR_NOT_SUPPORTED_MESSAGE, URL_EXTRACTOR

Fields inherited from interface org.wandora.application.WandoraToolLogger

CLOSE, EXECUTE, INVISIBLE, VISIBLE, WAIT

Fields inherited from interface org.wandora.application.tools.browserextractors.BrowserPluginExtractor

RETURN_ERROR, RETURN_INFO

Constructor Summary

Constructors

Constructor and Description
AbstractJsoupExtractor()

Method Summary

Modifier and Type	Method and Description
boolean	_extractTopicsFrom(java.io.File f, TopicMap t)
boolean	_extractTopicsFrom(java.lang.String str, TopicMap t)
boolean	_extractTopicsFrom(java.net.URL u, TopicMap t)
abstract boolean	extractTopicsFrom(org.jsoup.nodes.Document d, java.lang.String u, TopicMap t)
java.lang.String[]	getContentTypes() Returns an array of String containing the content-types this ContentHandler can process.
javax.swing.Icon	getIcon() All tools may have identifying graphic icon used within tool GUI elements.
protected static Topic	getLangTopic(TopicMap tm)
protected static Topic	getOrCreateTopic(TopicMap tm, java.lang.String si)
protected static Topic	getOrCreateTopic(TopicMap tm, java.lang.String si, java.lang.String bn)
protected static Topic	getWandoraClassTopic(TopicMap tm)
protected static void	makeSubclassOf(TopicMap tm, Topic t, Topic superclass)

Methods inherited from class org.wandora.application.tools.extractors.AbstractExtractor

acceptBrowserExtractRequest, addCrawlerUrl, browserExtractorConsumesPlainText, buildSI, buildSL, clearMasterSubject, createAssociation, createAssociation, createTopic, createTopic, createTopic, createTopic, createTopic, createTopic, createTopic, croppedFilename, croppedFilename, croppedUrlString, croppedUrlString, doBrowserExtract, dropExtract, dropExtract, dropExtract, execute, extractTopicsFrom, extractTopicsFrom, extractTopicsFrom, extractTopicsFrom, extractTopicsFromText, getBrowserExtractorName, getCrawlerMode, getDescription, getExtractorType, getForceContent, getForceFiles, getForceUrls, getGUIText, getGUIText, getInterruptsHandled, getMasterSubject, getName, getType, getWandora, handle, handleContent, handleCustomType, handleFiles, handleForcedContent, handleInterrupt, handleStringContent, handleUrls, initializeCustomType, instantDropHandle, makeSubclassOfWandoraClass, runInOwnThread, setData, setDisplayName, setForceContent, setForceFiles, setForceUrls, setMasterSubject, setMasterSubject, setTopicMap, setupCrawler, setWandora, takeNap, urlEncode, useTempTopicMap, useURLCrawler

Methods inherited from class org.wandora.application.tools.AbstractWandoraTool

addUndoMarker, addUndoMarker, allowMultipleInvocations, clearAllThreads, clearThreads, clearThreads, clearToolLock, clearToolLock, clearToolLocks, configure, execute, execute, forceStop, forceStop, getContext, getCurrentLogger, getDefaultLogger, getHistory, getLastLogger, getState, getThreads, getThreads, getToolMenuItem, getToolMenuItem, getTopicName, hlog, initialize, interruptAllThreads, interruptThreads, interruptThreads, isConfigurable, isRunning, isRunning, lockLog, log, log, log, log, requiresRefresh, run, setContext, setDefaultLogger, setLogTitle, setProgress, setProgressMax, setState, setToolLogger, singleLog, singleLog, singleLog, solveContextTopicMap, solveNameForTopicMap, writeOptions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.wandora.application.WandoraTool

configure, execute, execute, getContext, getToolMenuItem, hlog, initialize, isConfigurable, isRunning, log, log, log, log, requiresRefresh, setContext, setToolLogger, writeOptions

Methods inherited from interface org.wandora.application.WandoraToolLogger

forceStop, getHistory, getState, lockLog, setLogTitle, setProgress, setProgressMax, setState

Methods inherited from interface java.lang.Runnable

run

Field Detail

LANG_SI

private static final java.lang.String LANG_SI

See Also:

Constant Field Values

contentTypes

private final java.lang.String[] contentTypes

Constructor Detail

AbstractJsoupExtractor

public AbstractJsoupExtractor()

Method Detail

getIcon

public javax.swing.Icon getIcon()

Description copied from class: AbstractWandoraTool

All tools may have identifying graphic icon used within tool GUI elements. getIcon should return Icon object of the tool.

Specified by:

getIcon in interface WandoraTool

Overrides:

getIcon in class AbstractExtractor

Returns:

icon for the tool.

getContentTypes

public java.lang.String[] getContentTypes()

Description copied from interface: Handler

Returns an array of String containing the content-types this ContentHandler can process.

Specified by:

getContentTypes in interface Handler

Overrides:

getContentTypes in class AbstractExtractor

Returns:

String array representing content types.

_extractTopicsFrom

public boolean _extractTopicsFrom(java.io.File f,
                                  TopicMap t)
                           throws java.lang.Exception

Specified by:

_extractTopicsFrom in class AbstractExtractor

Throws:

java.lang.Exception

_extractTopicsFrom

public boolean _extractTopicsFrom(java.net.URL u,
                                  TopicMap t)
                           throws java.lang.Exception

Specified by:

_extractTopicsFrom in class AbstractExtractor

Throws:

java.lang.Exception

_extractTopicsFrom

public boolean _extractTopicsFrom(java.lang.String str,
                                  TopicMap t)
                           throws java.lang.Exception

Specified by:

_extractTopicsFrom in class AbstractExtractor

Throws:

java.lang.Exception

getWandoraClassTopic

protected static Topic getWandoraClassTopic(TopicMap tm)
                                     throws TopicMapException

Throws:

TopicMapException

getOrCreateTopic

protected static Topic getOrCreateTopic(TopicMap tm,
                                        java.lang.String si)
                                 throws TopicMapException

Throws:

TopicMapException

getOrCreateTopic

protected static Topic getOrCreateTopic(TopicMap tm,
                                        java.lang.String si,
                                        java.lang.String bn)
                                 throws TopicMapException

Throws:

TopicMapException

makeSubclassOf

protected static void makeSubclassOf(TopicMap tm,
                                     Topic t,
                                     Topic superclass)
                              throws TopicMapException

Throws:

TopicMapException

getLangTopic

protected static Topic getLangTopic(TopicMap tm)
                             throws TopicMapException

Throws:

TopicMapException

extractTopicsFrom

public abstract boolean extractTopicsFrom(org.jsoup.nodes.Document d,
                                          java.lang.String u,
                                          TopicMap t)
                                   throws java.lang.Exception

Throws:

java.lang.Exception