LingPy

Evaluation of Automatic Analyses (evaluate)

This is the basic module for the evaluation of automatic analyses. The module consists of three classes which deal with the evaluation of automatic analyses (alignments, cognate judgments). The evaluation is based on the comparison of a gold standard (reference set) with a test set. The different evaluation measures which can be calculated with help of the different classes are essentially all based on the calculation of the proportion to which the test set is similar to the reference set.

The evaluation measures implemented in this module can be divided into two parts: Those measures which deal with the comparison of automatic alignments, and those which deal with the comparison of automatic cognate judgments.

Evaluation of Automatic Sequence Analyses

EvalPSA(gold, test) Base class for the evaluation of automatic pairwise sequence analyses.
EvalMSA(gold, test) Base class for the evaluation of automatic multiple sequence analyses.

Evaluation of Lexicostatistical Analyses

EvalLXS(gold, test) Basic class for comparing automatic lexicostatistical analyses.

Table Of Contents