There are 0 repository under fleiss-kappa topic.
The tool creates a visualization of the video annotation matrix. It also converts a labeled video matrix into a Fleiss Matrix. Finally, it calculates the Overall Fleiss Kappa Score, Percent Overall Agreement among raters above chance, Confidence Interval of Kappa & Significance Test
The program implements the calculus of the Fleiss' Kappa in the both the fixed and margin-free version. The data used are a collection of possible results of an analysis of 6 annotators on 100 texts.
Evaluation and agreement scripts for the DISCOSUMO project. Each evaluation script takes both manual annotations as automatic summarization output. The formatting of these files is highly project-specific. However, the evaluation functions for precision, recall, ROUGE, Jaccard, Cohen's kappa and Fleiss' kappa may be applicable to other domains too.
Raters inter-rater agreement
Using information retrieval to help an emerging local artist boost its streams
Data and codes for analysing an industry model Pacific oyster for sustainable aquaculture
Multi-label inter rater agreement using fleiss kappa, krippendorff's alpha and the MASI similarity measure for set simmilarity. Written in R Quarto.