org.wandora.application.tools.extractors.britishlibrary

Class AbstractMillionFirstStepsExtractor

java.lang.Object

org.wandora.application.tools.AbstractWandoraTool

org.wandora.application.tools.extractors.AbstractExtractor

org.wandora.application.tools.extractors.britishlibrary.AbstractMillionFirstStepsExtractor

All Implemented Interfaces:

java.io.Serializable, java.lang.Runnable, BrowserPluginExtractor, DropExtractor, WandoraTool, WandoraToolLogger, Handler, InterruptHandler, TopicMapLogger

Direct Known Subclasses:

MillionFirstStepsBookMetadataJSONExtractor, MillionFirstStepsBookTSVExtractor

public abstract class AbstractMillionFirstStepsExtractor
extends AbstractExtractor

Author:

akivela

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	ARKID_SI
static java.lang.String	AUTHOR_SI
static java.lang.String	BASE_SI
static java.lang.String	BL_DLS_SI
static java.lang.String	BOOK_SI
static java.lang.String	BRITISH_LIBRARY_SI
static java.lang.String	CORPORATE_SI
static java.lang.String	DATE_SI
static java.lang.String	DATEFIELD_SI
protected static java.lang.String	defaultEncoding
protected static java.lang.String	defaultLang
static java.lang.String	EDITION_SI
static java.lang.String	IMAGE_SI
static java.lang.String	IMAGEIDX_SI
static java.lang.String	ISSUANCE_SI
static java.lang.String	LANG_SI
static java.lang.String	ORDER_SI
static java.lang.String	PAGE_SI
static java.lang.String	PDF_SI
static java.lang.String	PLACE_SI
static java.lang.String	PUBLISHER_SI
static java.lang.String	ROLE_SI
static java.lang.String	SHELFMARK_SI
static java.lang.String	TITLE_SI
static java.lang.String	VOLUME_SI

Fields inherited from class org.wandora.application.tools.extractors.AbstractExtractor

CUSTOM_EXTRACTOR, DONE_FAILED, DONE_MANY, DONE_ONE, EXACTLY_GIVEN_URLS, FILE_EXTRACTOR, FILE_PATTERN, GIVEN_URLS_AND_ALL_CRAWLED_DOCUMENTS, GIVEN_URLS_AND_CRAWLED_DOCUMENTS_IN_URL_DOMAIN, GIVEN_URLS_AND_LINKED_DOCUMENTS, GIVEN_URLS_AND_URL_BELOW, INFO_WAIT_WHILE_WORKING, LOG_TITLE, POINT_START_URL_TEXT, RAW_EXTRACTOR, SELECT_DIALOG_TITLE, STRING_EXTRACTOR_NOT_SUPPORTED_MESSAGE, URL_EXTRACTOR

Fields inherited from interface org.wandora.application.WandoraToolLogger

CLOSE, EXECUTE, INVISIBLE, VISIBLE, WAIT

Fields inherited from interface org.wandora.application.tools.browserextractors.BrowserPluginExtractor

RETURN_ERROR, RETURN_INFO

Constructor Summary

Constructors

Constructor and Description
AbstractMillionFirstStepsExtractor()

Method Summary

Modifier and Type	Method and Description
protected java.lang.String	doUrl(java.net.URL url)
static Topic	getArkIdTypeTopic(TopicMap tm)
static Topic	getATopic(java.lang.String str, java.lang.String si, java.lang.String type, TopicMap tm)
static Topic	getATypeTopic(java.lang.String si, java.lang.String type, TopicMap tm)
static Topic	getAuthorTopic(java.lang.String author, TopicMap tm)
static Topic	getAuthorTypeTopic(TopicMap tm)
static Topic	getBLDLSIdTypeTopic(TopicMap tm)
static Topic	getBookTopic(java.lang.String book, TopicMap tm)
static Topic	getBookTypeTopic(TopicMap tm)
static Topic	getBritishLibraryTypeTopic(TopicMap tm)
static Topic	getCorporateTopic(java.lang.String str, TopicMap tm)
static Topic	getCorporateTypeTopic(TopicMap tm)
static Topic	getDatefieldTopic(java.lang.String str, TopicMap tm)
static Topic	getDatefieldTypeTopic(TopicMap tm)
static Topic	getDateTopic(java.lang.String str, TopicMap tm)
static Topic	getDateTypeTopic(TopicMap tm)
java.lang.String	getDescription() AdminToolManager views tool descriptions while user browses available tools and build user customizable GUI elements such as Tools menu.
static Topic	getEditionTopic(java.lang.String str, TopicMap tm)
static Topic	getEditionTypeTopic(TopicMap tm)
javax.swing.Icon	getIcon() All tools may have identifying graphic icon used within tool GUI elements.
static Topic	getImageIdxTypeTopic(TopicMap tm)
static Topic	getImageTopic(java.lang.String str, java.lang.String sl, TopicMap tm)
static Topic	getImageTopic(java.lang.String str, TopicMap tm)
static Topic	getImageTypeTopic(TopicMap tm)
static Topic	getIssuanceTopic(java.lang.String str, TopicMap tm)
static Topic	getIssuanceTypeTopic(TopicMap tm)
protected static Topic	getLangTopic(TopicMap tm)
java.lang.String	getName() Tools name represent the tool in UI unless the tool has been given explicitly another GUI name.
protected static Topic	getOrCreateTopic(TopicMap tm, java.lang.String si)
protected static Topic	getOrCreateTopic(TopicMap tm, java.lang.String si, java.lang.String bn)
static Topic	getOrderTopic(java.lang.String str, TopicMap tm)
static Topic	getOrderTypeTopic(TopicMap tm)
static Topic	getPageTopic(java.lang.String str, TopicMap tm)
static Topic	getPageTypeTopic(TopicMap tm)
static Topic	getPDFTypeTopic(TopicMap tm)
static Topic	getPlaceTopic(java.lang.String str, TopicMap tm)
static Topic	getPlaceTypeTopic(TopicMap tm)
static Topic	getPublisherTopic(java.lang.String str, TopicMap tm)
static Topic	getPublisherTypeTopic(TopicMap tm)
static Topic	getRoleTopic(java.lang.String str, TopicMap tm)
static Topic	getRoleTypeTopic(TopicMap tm)
static Topic	getShelfmarkTopic(java.lang.String str, TopicMap tm)
static Topic	getShelfmarkTypeTopic(TopicMap tm)
static Topic	getTitleTopic(java.lang.String str, TopicMap tm)
static Topic	getTitleTypeTopic(TopicMap tm)
static Topic	getVolumeTopic(java.lang.String str, TopicMap tm)
static Topic	getVolumeTypeTopic(TopicMap tm)
protected static Topic	getWandoraClassTopic(TopicMap tm)
protected static void	makeSubclassOf(TopicMap tm, Topic t, Topic superclass)
boolean	runInOwnThread() Whether or not this tool should fork own thread.
boolean	useTempTopicMap()
boolean	useURLCrawler()

Methods inherited from class org.wandora.application.tools.extractors.AbstractExtractor

_extractTopicsFrom, _extractTopicsFrom, _extractTopicsFrom, acceptBrowserExtractRequest, addCrawlerUrl, browserExtractorConsumesPlainText, buildSI, buildSL, clearMasterSubject, createAssociation, createAssociation, createTopic, createTopic, createTopic, createTopic, createTopic, createTopic, createTopic, croppedFilename, croppedFilename, croppedUrlString, croppedUrlString, doBrowserExtract, dropExtract, dropExtract, dropExtract, execute, extractTopicsFrom, extractTopicsFrom, extractTopicsFrom, extractTopicsFrom, extractTopicsFromText, getBrowserExtractorName, getContentTypes, getCrawlerMode, getExtractorType, getForceContent, getForceFiles, getForceUrls, getGUIText, getGUIText, getInterruptsHandled, getMasterSubject, getType, getWandora, handle, handleContent, handleCustomType, handleFiles, handleForcedContent, handleInterrupt, handleStringContent, handleUrls, initializeCustomType, instantDropHandle, makeSubclassOfWandoraClass, setData, setDisplayName, setForceContent, setForceFiles, setForceUrls, setMasterSubject, setMasterSubject, setTopicMap, setupCrawler, setWandora, takeNap, urlEncode

Methods inherited from class org.wandora.application.tools.AbstractWandoraTool

addUndoMarker, addUndoMarker, allowMultipleInvocations, clearAllThreads, clearThreads, clearThreads, clearToolLock, clearToolLock, clearToolLocks, configure, execute, execute, forceStop, forceStop, getContext, getCurrentLogger, getDefaultLogger, getHistory, getLastLogger, getState, getThreads, getThreads, getToolMenuItem, getToolMenuItem, getTopicName, hlog, initialize, interruptAllThreads, interruptThreads, interruptThreads, isConfigurable, isRunning, isRunning, lockLog, log, log, log, log, requiresRefresh, run, setContext, setDefaultLogger, setLogTitle, setProgress, setProgressMax, setState, setToolLogger, singleLog, singleLog, singleLog, solveContextTopicMap, solveNameForTopicMap, writeOptions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.wandora.application.WandoraTool

configure, execute, execute, getContext, getToolMenuItem, hlog, initialize, isConfigurable, isRunning, log, log, log, log, requiresRefresh, setContext, setToolLogger, writeOptions

Methods inherited from interface org.wandora.application.WandoraToolLogger

forceStop, getHistory, getState, lockLog, setLogTitle, setProgress, setProgressMax, setState

Methods inherited from interface java.lang.Runnable

run

Field Detail

defaultEncoding

protected static java.lang.String defaultEncoding

defaultLang

protected static java.lang.String defaultLang

LANG_SI

public static final java.lang.String LANG_SI

BRITISH_LIBRARY_SI

public static final java.lang.String BRITISH_LIBRARY_SI

See Also:

Constant Field Values

BASE_SI

public static final java.lang.String BASE_SI

See Also:

Constant Field Values

BOOK_SI

public static final java.lang.String BOOK_SI

See Also:

Constant Field Values

AUTHOR_SI

public static final java.lang.String AUTHOR_SI

See Also:

Constant Field Values

CORPORATE_SI

public static final java.lang.String CORPORATE_SI

See Also:

Constant Field Values

TITLE_SI

public static final java.lang.String TITLE_SI

See Also:

Constant Field Values

PLACE_SI

public static final java.lang.String PLACE_SI

See Also:

Constant Field Values

DATE_SI

public static final java.lang.String DATE_SI

See Also:

Constant Field Values

DATEFIELD_SI

public static final java.lang.String DATEFIELD_SI

See Also:

Constant Field Values

PUBLISHER_SI

public static final java.lang.String PUBLISHER_SI

See Also:

Constant Field Values

EDITION_SI

public static final java.lang.String EDITION_SI

See Also:

Constant Field Values

ISSUANCE_SI

public static final java.lang.String ISSUANCE_SI

See Also:

Constant Field Values

SHELFMARK_SI

public static final java.lang.String SHELFMARK_SI

See Also:

Constant Field Values

IMAGE_SI

public static final java.lang.String IMAGE_SI

See Also:

Constant Field Values

IMAGEIDX_SI

public static final java.lang.String IMAGEIDX_SI

See Also:

Constant Field Values

ROLE_SI

public static final java.lang.String ROLE_SI

See Also:

Constant Field Values

ORDER_SI

public static final java.lang.String ORDER_SI

See Also:

Constant Field Values

ARKID_SI

public static final java.lang.String ARKID_SI

See Also:

Constant Field Values

BL_DLS_SI

public static final java.lang.String BL_DLS_SI

See Also:

Constant Field Values

PAGE_SI

public static final java.lang.String PAGE_SI

See Also:

Constant Field Values

VOLUME_SI

public static final java.lang.String VOLUME_SI

See Also:

Constant Field Values

PDF_SI

public static final java.lang.String PDF_SI

See Also:

Constant Field Values

Constructor Detail

AbstractMillionFirstStepsExtractor

public AbstractMillionFirstStepsExtractor()

Method Detail

getLangTopic

protected static Topic getLangTopic(TopicMap tm)
                             throws TopicMapException

Throws:

TopicMapException

getWandoraClassTopic

protected static Topic getWandoraClassTopic(TopicMap tm)
                                     throws TopicMapException

Throws:

TopicMapException

getOrCreateTopic

protected static Topic getOrCreateTopic(TopicMap tm,
                                        java.lang.String si)
                                 throws TopicMapException

Throws:

TopicMapException

getOrCreateTopic

protected static Topic getOrCreateTopic(TopicMap tm,
                                        java.lang.String si,
                                        java.lang.String bn)
                                 throws TopicMapException

Throws:

TopicMapException

makeSubclassOf

protected static void makeSubclassOf(TopicMap tm,
                                     Topic t,
                                     Topic superclass)
                              throws TopicMapException

Throws:

TopicMapException

getBritishLibraryTypeTopic

public static Topic getBritishLibraryTypeTopic(TopicMap tm)
                                        throws TopicMapException

Throws:

TopicMapException

getATopic

public static Topic getATopic(java.lang.String str,
                              java.lang.String si,
                              java.lang.String type,
                              TopicMap tm)
                       throws TopicMapException

Throws:

TopicMapException

getATypeTopic

public static Topic getATypeTopic(java.lang.String si,
                                  java.lang.String type,
                                  TopicMap tm)
                           throws TopicMapException

Throws:

TopicMapException

getBookTopic

public static Topic getBookTopic(java.lang.String book,
                                 TopicMap tm)
                          throws TopicMapException

Throws:

TopicMapException

getBookTypeTopic

public static Topic getBookTypeTopic(TopicMap tm)
                              throws TopicMapException

Throws:

TopicMapException

getArkIdTypeTopic

public static Topic getArkIdTypeTopic(TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getBLDLSIdTypeTopic

public static Topic getBLDLSIdTypeTopic(TopicMap tm)
                                 throws TopicMapException

Throws:

TopicMapException

getPDFTypeTopic

public static Topic getPDFTypeTopic(TopicMap tm)
                             throws TopicMapException

Throws:

TopicMapException

getImageIdxTypeTopic

public static Topic getImageIdxTypeTopic(TopicMap tm)
                                  throws TopicMapException

Throws:

TopicMapException

getAuthorTopic

public static Topic getAuthorTopic(java.lang.String author,
                                   TopicMap tm)
                            throws TopicMapException

Throws:

TopicMapException

getAuthorTypeTopic

public static Topic getAuthorTypeTopic(TopicMap tm)
                                throws TopicMapException

Throws:

TopicMapException

getCorporateTopic

public static Topic getCorporateTopic(java.lang.String str,
                                      TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getCorporateTypeTopic

public static Topic getCorporateTypeTopic(TopicMap tm)
                                   throws TopicMapException

Throws:

TopicMapException

getTitleTopic

public static Topic getTitleTopic(java.lang.String str,
                                  TopicMap tm)
                           throws TopicMapException

Throws:

TopicMapException

getTitleTypeTopic

public static Topic getTitleTypeTopic(TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getPageTopic

public static Topic getPageTopic(java.lang.String str,
                                 TopicMap tm)
                          throws TopicMapException

Throws:

TopicMapException

getPageTypeTopic

public static Topic getPageTypeTopic(TopicMap tm)
                              throws TopicMapException

Throws:

TopicMapException

getVolumeTopic

public static Topic getVolumeTopic(java.lang.String str,
                                   TopicMap tm)
                            throws TopicMapException

Throws:

TopicMapException

getVolumeTypeTopic

public static Topic getVolumeTypeTopic(TopicMap tm)
                                throws TopicMapException

Throws:

TopicMapException

getPlaceTopic

public static Topic getPlaceTopic(java.lang.String str,
                                  TopicMap tm)
                           throws TopicMapException

Throws:

TopicMapException

getPlaceTypeTopic

public static Topic getPlaceTypeTopic(TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getDatefieldTopic

public static Topic getDatefieldTopic(java.lang.String str,
                                      TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getDatefieldTypeTopic

public static Topic getDatefieldTypeTopic(TopicMap tm)
                                   throws TopicMapException

Throws:

TopicMapException

getDateTopic

public static Topic getDateTopic(java.lang.String str,
                                 TopicMap tm)
                          throws TopicMapException

Throws:

TopicMapException

getDateTypeTopic

public static Topic getDateTypeTopic(TopicMap tm)
                              throws TopicMapException

Throws:

TopicMapException

getPublisherTopic

public static Topic getPublisherTopic(java.lang.String str,
                                      TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getPublisherTypeTopic

public static Topic getPublisherTypeTopic(TopicMap tm)
                                   throws TopicMapException

Throws:

TopicMapException

getEditionTopic

public static Topic getEditionTopic(java.lang.String str,
                                    TopicMap tm)
                             throws TopicMapException

Throws:

TopicMapException

getEditionTypeTopic

public static Topic getEditionTypeTopic(TopicMap tm)
                                 throws TopicMapException

Throws:

TopicMapException

getIssuanceTopic

public static Topic getIssuanceTopic(java.lang.String str,
                                     TopicMap tm)
                              throws TopicMapException

Throws:

TopicMapException

getIssuanceTypeTopic

public static Topic getIssuanceTypeTopic(TopicMap tm)
                                  throws TopicMapException

Throws:

TopicMapException

getShelfmarkTopic

public static Topic getShelfmarkTopic(java.lang.String str,
                                      TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getShelfmarkTypeTopic

public static Topic getShelfmarkTypeTopic(TopicMap tm)
                                   throws TopicMapException

Throws:

TopicMapException

getImageTopic

public static Topic getImageTopic(java.lang.String str,
                                  java.lang.String sl,
                                  TopicMap tm)
                           throws TopicMapException

Throws:

TopicMapException

getImageTopic

public static Topic getImageTopic(java.lang.String str,
                                  TopicMap tm)
                           throws TopicMapException

Throws:

TopicMapException

getImageTypeTopic

public static Topic getImageTypeTopic(TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getOrderTopic

public static Topic getOrderTopic(java.lang.String str,
                                  TopicMap tm)
                           throws TopicMapException

Throws:

TopicMapException

getOrderTypeTopic

public static Topic getOrderTypeTopic(TopicMap tm)
                               throws TopicMapException

Throws:

TopicMapException

getRoleTopic

public static Topic getRoleTopic(java.lang.String str,
                                 TopicMap tm)
                          throws TopicMapException

Throws:

TopicMapException

getRoleTypeTopic

public static Topic getRoleTypeTopic(TopicMap tm)
                              throws TopicMapException

Throws:

TopicMapException

getName

public java.lang.String getName()

Description copied from class: AbstractWandoraTool

Tools name represent the tool in UI unless the tool has been given explicitly another GUI name. All tools should override this method and return a valid string representing name of the tool.

Specified by:

getName in interface WandoraTool

Overrides:

getName in class AbstractExtractor

Returns:

String representing tool's name.

getDescription

public java.lang.String getDescription()

Description copied from class: AbstractWandoraTool

AdminToolManager views tool descriptions while user browses available tools and build user customizable GUI elements such as Tools menu. By default description equals the tool name. All tools should override this method.

Specified by:

getDescription in interface WandoraTool

Overrides:

getDescription in class AbstractExtractor

Returns:

String representing tool's description.

getIcon

public javax.swing.Icon getIcon()

Description copied from class: AbstractWandoraTool

All tools may have identifying graphic icon used within tool GUI elements. getIcon should return Icon object of the tool.

Specified by:

getIcon in interface WandoraTool

Overrides:

getIcon in class AbstractExtractor

Returns:

icon for the tool.

runInOwnThread

public boolean runInOwnThread()

Description copied from class: AbstractWandoraTool

Whether or not this tool should fork own thread. If own thread is allowed, the execution of the tool return immediately. If own thread is not allowed the thread entering initial execute method is used. Extending classes should override this method.

Overrides:

runInOwnThread in class AbstractExtractor

Returns:

true if the tool should should be ran in separate thread.

useTempTopicMap

public boolean useTempTopicMap()

Overrides:

useTempTopicMap in class AbstractExtractor

useURLCrawler

public boolean useURLCrawler()

Overrides:

useURLCrawler in class AbstractExtractor

doUrl

protected java.lang.String doUrl(java.net.URL url)
                          throws java.io.IOException

Throws:

java.io.IOException