org.wandora.application.tools.extractors

Class MobyThesaurusExtractor

java.lang.Object

org.wandora.application.tools.AbstractWandoraTool

org.wandora.application.tools.extractors.AbstractExtractor

org.wandora.application.tools.extractors.MobyThesaurusExtractor

All Implemented Interfaces:

java.io.Serializable, java.lang.Runnable, BrowserPluginExtractor, DropExtractor, WandoraTool, WandoraToolLogger, Handler, InterruptHandler, TopicMapLogger

public class MobyThesaurusExtractor
extends AbstractExtractor
implements WandoraTool

Tool reads Moby thesaurus file and converts if to a topic map. Moby thesaurus file is a simple text file where each line defines single word and related words. For example:

word1 relatedWord1 relatedWord2 relatedWord3 relatedWord4 ...
word2 relatedWord1 relatedWord2 relatedWord3 relatedWord4 ...

This extractor creates a topic for each word (including related words) and a binary association for each word-relatedWord pair. If word has four related words then extractor creates four associations. Notice the word may be a related word for some other word, increasing the overall number of associations one word eventually gets.

Moby thesaurus is public domain and can be acquired from http://www.gutenberg.org/etext/3202

As the Moby thesaurus contains hundreds of thousands words Wandora requires at least 2G of memory to extract complete thesaurus.

Author:

akivela

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
boolean	ANTISYMMETRIC_ASSOCIATIONS
java.lang.String	locatorPrefix
boolean	REMOVE_RARE_WORDS

Fields inherited from class org.wandora.application.tools.extractors.AbstractExtractor

CUSTOM_EXTRACTOR, DONE_FAILED, DONE_MANY, DONE_ONE, EXACTLY_GIVEN_URLS, FILE_EXTRACTOR, FILE_PATTERN, GIVEN_URLS_AND_ALL_CRAWLED_DOCUMENTS, GIVEN_URLS_AND_CRAWLED_DOCUMENTS_IN_URL_DOMAIN, GIVEN_URLS_AND_LINKED_DOCUMENTS, GIVEN_URLS_AND_URL_BELOW, INFO_WAIT_WHILE_WORKING, LOG_TITLE, POINT_START_URL_TEXT, RAW_EXTRACTOR, SELECT_DIALOG_TITLE, STRING_EXTRACTOR_NOT_SUPPORTED_MESSAGE, URL_EXTRACTOR

Fields inherited from interface org.wandora.application.WandoraToolLogger

CLOSE, EXECUTE, INVISIBLE, VISIBLE, WAIT

Fields inherited from interface org.wandora.application.tools.browserextractors.BrowserPluginExtractor

RETURN_ERROR, RETURN_INFO

Constructor Summary

Constructors

Constructor and Description
MobyThesaurusExtractor() Creates a new instance of MobyThesaurusExtractor

Method Summary

Modifier and Type	Method and Description
boolean	_extractTopicsFrom(java.io.BufferedReader breader, TopicMap topicMap)
boolean	_extractTopicsFrom(java.io.File thesaurusFile, TopicMap topicMap)
boolean	_extractTopicsFrom(java.lang.String str, TopicMap topicMap)
boolean	_extractTopicsFrom(java.net.URL url, TopicMap topicMap)
boolean	associationExists(Topic t1, Topic t2, Topic at)
boolean	browserExtractorConsumesPlainText()
java.lang.String	getDescription() AdminToolManager views tool descriptions while user browses available tools and build user customizable GUI elements such as Tools menu.
java.lang.String	getGUIText(int textType)
java.lang.String	getName() Tools name represent the tool in UI unless the tool has been given explicitly another GUI name.
Topic	getOrCreateTopic(TopicMap topicmap, Locator si, java.lang.String baseName, java.lang.String displayName)
Topic	getOrCreateTopic(TopicMap topicmap, Locator si, java.lang.String baseName, java.lang.String displayName, Topic typeTopic)
Topic	getOrCreateTopic(TopicMap topicmap, java.lang.String si, java.lang.String baseName, java.lang.String displayName)
Locator	makeSI(java.lang.String str)
boolean	useTempTopicMap()

Methods inherited from class org.wandora.application.tools.extractors.AbstractExtractor

acceptBrowserExtractRequest, addCrawlerUrl, buildSI, buildSL, clearMasterSubject, createAssociation, createAssociation, createTopic, createTopic, createTopic, createTopic, createTopic, createTopic, createTopic, croppedFilename, croppedFilename, croppedUrlString, croppedUrlString, doBrowserExtract, dropExtract, dropExtract, dropExtract, execute, extractTopicsFrom, extractTopicsFrom, extractTopicsFrom, extractTopicsFrom, extractTopicsFromText, getBrowserExtractorName, getContentTypes, getCrawlerMode, getExtractorType, getForceContent, getForceFiles, getForceUrls, getGUIText, getIcon, getInterruptsHandled, getMasterSubject, getType, getWandora, handle, handleContent, handleCustomType, handleFiles, handleForcedContent, handleInterrupt, handleStringContent, handleUrls, initializeCustomType, instantDropHandle, makeSubclassOfWandoraClass, runInOwnThread, setData, setDisplayName, setForceContent, setForceFiles, setForceUrls, setMasterSubject, setMasterSubject, setTopicMap, setupCrawler, setWandora, takeNap, urlEncode, useURLCrawler

Methods inherited from class org.wandora.application.tools.AbstractWandoraTool

addUndoMarker, addUndoMarker, allowMultipleInvocations, clearAllThreads, clearThreads, clearThreads, clearToolLock, clearToolLock, clearToolLocks, configure, execute, execute, forceStop, forceStop, getContext, getCurrentLogger, getDefaultLogger, getHistory, getLastLogger, getState, getThreads, getThreads, getToolMenuItem, getToolMenuItem, getTopicName, hlog, initialize, interruptAllThreads, interruptThreads, interruptThreads, isConfigurable, isRunning, isRunning, lockLog, log, log, log, log, requiresRefresh, run, setContext, setDefaultLogger, setLogTitle, setProgress, setProgressMax, setState, setToolLogger, singleLog, singleLog, singleLog, solveContextTopicMap, solveNameForTopicMap, writeOptions

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.wandora.application.WandoraTool

configure, execute, execute, execute, getContext, getIcon, getToolMenuItem, getType, hlog, initialize, isConfigurable, isRunning, log, log, log, log, requiresRefresh, setContext, setToolLogger, writeOptions

Methods inherited from interface org.wandora.application.WandoraToolLogger

forceStop, getHistory, getState, lockLog, setLogTitle, setProgress, setProgressMax, setState

Methods inherited from interface java.lang.Runnable

run

Field Detail

locatorPrefix

public java.lang.String locatorPrefix

ANTISYMMETRIC_ASSOCIATIONS

public boolean ANTISYMMETRIC_ASSOCIATIONS

REMOVE_RARE_WORDS

public boolean REMOVE_RARE_WORDS

Constructor Detail

MobyThesaurusExtractor

public MobyThesaurusExtractor()

Creates a new instance of MobyThesaurusExtractor

Method Detail

getName

public java.lang.String getName()

Description copied from class: AbstractWandoraTool

Tools name represent the tool in UI unless the tool has been given explicitly another GUI name. All tools should override this method and return a valid string representing name of the tool.

Specified by:

getName in interface WandoraTool

Overrides:

getName in class AbstractExtractor

Returns:

String representing tool's name.

getDescription

public java.lang.String getDescription()

Description copied from class: AbstractWandoraTool

AdminToolManager views tool descriptions while user browses available tools and build user customizable GUI elements such as Tools menu. By default description equals the tool name. All tools should override this method.

Specified by:

getDescription in interface WandoraTool

Overrides:

getDescription in class AbstractExtractor

Returns:

String representing tool's description.

getGUIText

public java.lang.String getGUIText(int textType)

Overrides:

getGUIText in class AbstractExtractor

browserExtractorConsumesPlainText

public boolean browserExtractorConsumesPlainText()

Overrides:

browserExtractorConsumesPlainText in class AbstractExtractor

_extractTopicsFrom

public boolean _extractTopicsFrom(java.net.URL url,
                                  TopicMap topicMap)
                           throws java.lang.Exception

Specified by:

_extractTopicsFrom in class AbstractExtractor

Throws:

java.lang.Exception

_extractTopicsFrom

public boolean _extractTopicsFrom(java.io.File thesaurusFile,
                                  TopicMap topicMap)
                           throws java.lang.Exception

Specified by:

_extractTopicsFrom in class AbstractExtractor

Throws:

java.lang.Exception

_extractTopicsFrom

public boolean _extractTopicsFrom(java.lang.String str,
                                  TopicMap topicMap)
                           throws java.lang.Exception

Specified by:

_extractTopicsFrom in class AbstractExtractor

Throws:

java.lang.Exception

_extractTopicsFrom

public boolean _extractTopicsFrom(java.io.BufferedReader breader,
                                  TopicMap topicMap)
                           throws java.lang.Exception

Throws:

java.lang.Exception

associationExists

public boolean associationExists(Topic t1,
                                 Topic t2,
                                 Topic at)

getOrCreateTopic

public Topic getOrCreateTopic(TopicMap topicmap,
                              java.lang.String si,
                              java.lang.String baseName,
                              java.lang.String displayName)

getOrCreateTopic

public Topic getOrCreateTopic(TopicMap topicmap,
                              Locator si,
                              java.lang.String baseName,
                              java.lang.String displayName)

getOrCreateTopic

public Topic getOrCreateTopic(TopicMap topicmap,
                              Locator si,
                              java.lang.String baseName,
                              java.lang.String displayName,
                              Topic typeTopic)

makeSI

public Locator makeSI(java.lang.String str)

useTempTopicMap

public boolean useTempTopicMap()

Overrides:

useTempTopicMap in class AbstractExtractor