org.grobid.core.jni

Class DeLFTModel

java.lang.Object

org.grobid.core.jni.DeLFTModel

public class DeLFTModel
extends java.lang.Object

Field Summary

Fields

Modifier and Type	Field and Description
static Logger	LOGGER

Constructor Summary

Constructors

Constructor and Description
DeLFTModel(GrobidModel model)

Method Summary

Modifier and Type	Method and Description
void	close()
java.lang.String	label(java.lang.String data)
static void	train(java.lang.String modelName, java.io.File trainingData, java.io.File outputModel) Train with an external process rather than with JNI, this approach appears to be more stable for the training process (JNI approach hangs after a while) and does not raise any runtime/integration issues.
static void	trainJNI(java.lang.String modelName, java.io.File trainingData, java.io.File outputModel) Training via JNI CPython interpreter (JEP).

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOGGER

public static final Logger LOGGER

Constructor Detail

DeLFTModel

public DeLFTModel(GrobidModel model)

Method Detail

label

public java.lang.String label(java.lang.String data)

trainJNI

public static void trainJNI(java.lang.String modelName,
                            java.io.File trainingData,
                            java.io.File outputModel)

Training via JNI CPython interpreter (JEP). It appears that after some epochs, the JEP thread usually hangs... Possibly issues with IO threads at the level of JEP (output not consumed because of \r and no end of line?).

train

public static void train(java.lang.String modelName,
                         java.io.File trainingData,
                         java.io.File outputModel)

Train with an external process rather than with JNI, this approach appears to be more stable for the training process (JNI approach hangs after a while) and does not raise any runtime/integration issues.

close

public void close()