A few scripts for computing inter-annotator agreement for MAE/MAI XMLs.
cohen.py : Methods for computing Cohen's kappa coefficient
corpus.py : Module for working with collections of documents
fleiss.py : Methods for computing Fleiss's kappa coefficient
krippendorff.py : Methods for computing Krippendorff's alpha coefficient
test_kappa.py : Test suite for Fleiss's and Cohen's kappas
iaa.py : Script for loading a corpus from a directory and computing IAA
prf.py : Starter code for computing Precision, Recall, and F1