org.grobid.core.analyzers

Class GrobidAnalyzer

java.lang.Object

org.grobid.core.analyzers.GrobidAnalyzer

All Implemented Interfaces:

Analyzer

public class GrobidAnalyzer
extends java.lang.Object
implements Analyzer

An Analyzer able to dispatch text to be tokenized to the adequate analyzer given a specified language. The language might be preliminary set by the language recognizer or manually if it is already known by the context of usage of the text.

Method Summary

Modifier and Type	Method and Description
static GrobidAnalyzer	getInstance()
java.lang.String	getName()
java.util.List<java.lang.String>	retokenize(java.util.List<java.lang.String> textTokenized) Re-tokenizer entry point to be applied to text already tokenized in the PDF representation
java.util.List<java.lang.String>	retokenize(java.util.List<java.lang.String> textTokenized, Language lang)
java.util.List<java.lang.String>	tokenize(java.lang.String text) Tokenizer entry point
java.util.List<java.lang.String>	tokenize(java.lang.String text, Language lang)
java.util.List<LayoutToken>	tokenizeWithLayoutToken(java.lang.String text)
java.util.List<LayoutToken>	tokenizeWithLayoutToken(java.lang.String text, Language lang)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

getInstance

public static GrobidAnalyzer getInstance()

getName

public java.lang.String getName()

Specified by:

getName in interface Analyzer

tokenize

public java.util.List<java.lang.String> tokenize(java.lang.String text)

Tokenizer entry point

Specified by:

tokenize in interface Analyzer

tokenize

public java.util.List<java.lang.String> tokenize(java.lang.String text,
                                                 Language lang)

Specified by:

tokenize in interface Analyzer

retokenize

public java.util.List<java.lang.String> retokenize(java.util.List<java.lang.String> textTokenized)

Re-tokenizer entry point to be applied to text already tokenized in the PDF representation

Specified by:

retokenize in interface Analyzer

retokenize

public java.util.List<java.lang.String> retokenize(java.util.List<java.lang.String> textTokenized,
                                                   Language lang)

tokenizeWithLayoutToken

public java.util.List<LayoutToken> tokenizeWithLayoutToken(java.lang.String text)

Specified by:

tokenizeWithLayoutToken in interface Analyzer

tokenizeWithLayoutToken

public java.util.List<LayoutToken> tokenizeWithLayoutToken(java.lang.String text,
                                                           Language lang)