org.grobid.core.engines

Class MonographParser

java.lang.Object

org.grobid.core.engines.AbstractParser

org.grobid.core.engines.MonographParser

All Implemented Interfaces:

java.io.Closeable, java.lang.AutoCloseable, GenericTagger

public class MonographParser
extends AbstractParser

Realise a high level segmentation of a monograph. Monograph is to be understood here in the context library cataloging, basically as a standalone book. The monograph could be an ebook (novels), a conference proceedings volume, a book collection volume, a phd/msc thesis, a standalone report (with toc, etc.), a manual (with multiple chapters). Monographs, here, are NOT magazine volumes, journal issues, newspapers, standalone chapters, standalone scholar articles, tables of content, reference works, dictionaries, encyclopedia volumes, graphic novels.

Field Summary

Fields inherited from class org.grobid.core.engines.AbstractParser

analyzer, cntManager

Constructor Summary

Constructors

Constructor and Description
MonographParser() TODO some documentation...

Method Summary

Modifier and Type	Method and Description
Document	createTrainingFromPDF(java.io.File inputFile, java.lang.String pathRaw, java.lang.String pathTEI, int id) Process the specified pdf and format the result as training data for the monograph model.
java.lang.String	getAllBlocksFeatured(Document doc) Addition of the features at block level for the complete document.
java.lang.String	getAllLinesFeatured(Document doc) Addition of the features at line level for the complete document.
Document	prepareDocument(Document doc)
Document	processing(DocumentSource documentSource, GrobidAnalysisConfig config) Segment a PDF document into high level subdocuments.

Methods inherited from class org.grobid.core.engines.AbstractParser

close, label, label

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MonographParser

public MonographParser()

TODO some documentation...

Method Detail

processing

public Document processing(DocumentSource documentSource,
                           GrobidAnalysisConfig config)

Segment a PDF document into high level subdocuments.

Parameters:

documentSource - document source

Returns:

Document object with segmentation information

prepareDocument

public Document prepareDocument(Document doc)

getAllLinesFeatured

public java.lang.String getAllLinesFeatured(Document doc)

Addition of the features at line level for the complete document.

This is an alternative to the token level, where the unit for labeling is the line - so allowing faster processing and involving less features. Lexical features becomes line prefix and suffix, the feature text unit is the first 10 characters of the line without space. The dictionary flags are at line level (i.e. the line contains a name mention, a place mention, a year, etc.) Regarding layout features: font, size and style are the one associated to the first token of the line.

getAllBlocksFeatured

public java.lang.String getAllBlocksFeatured(Document doc)

Addition of the features at block level for the complete document.

This is an alternative to the token and line level, where the unit for labeling is the block - so allowing even faster processing and involving less features. Lexical features becomes block prefix and suffix, the feature text unit is the first 10 characters of the block without space. The dictionary flags are at block level (i.e. the block contains a name mention, a place mention, a year, etc.) Regarding layout features: font, size and style are the one associated to the first token of the block.

createTrainingFromPDF

public Document createTrainingFromPDF(java.io.File inputFile,
                                      java.lang.String pathRaw,
                                      java.lang.String pathTEI,
                                      int id)

Process the specified pdf and format the result as training data for the monograph model.

Parameters:

inputFile - input PDF file

pathFullText - path to raw monograph featured sequence

pathTEI - path to TEI

id - id