inter-rater-agreement

There are 0 repository under inter-rater-agreement topic.

• vinid / quica

  quica is a tool to run inter coder agreement pipelines in an easy and effective ways. Multiple measures are run and results are collected in a single table than can be easily exported in Latex

  inter-rater-agreementinter-coder-agreementpythonevaluation-metricsevaluation-framework
  Language:Python 23

• nmalkin / qcas

  Qualitative Coding Assistant for Google Sheets

  qualitative-analysisqualitative-researchgrounded-theorycodingsheetsgoogle-sheetsgoogle-apps-scriptinterrater-reliabilityinter-rater-agreement
  Language:TypeScript 6

• crowd-deliberation / data

  The official Crowd Deliberation data set.

  inter-rater-agreementgroup-deliberationambiguity
  2

• jiangqn / kappa-coefficient

  A python script to compute kappa-coefficient, which is a statistical measure of inter-rater agreement.

  kappa-computtinginter-rater-agreementstatistical-measurespython-script
  Language:Python 2

• nmalkin / kupper_hafner

  Kupper-Hafner inter-rater agreement calculation library

  statisticsirragreementreliabilitypythonkappainterrater-reliabilityinter-rater-agreement
  Language:Python 2

• DISCOSUMO / evaluation

  Evaluation and agreement scripts for the DISCOSUMO project. Each evaluation script takes both manual annotations as automatic summarization output. The formatting of these files is highly project-specific. However, the evaluation functions for precision, recall, ROUGE, Jaccard, Cohen's kappa and Fleiss' kappa may be applicable to other domains too.

  automatic-summarizationextractive-summarizationforum-threadsevaluationevaluation-metricsrouge-nrouge-lprecisionrecalljaccardcohens-kappafleiss-kappainter-rater-agreement
  Language:Python 1

• eltonyeung / NOAH-Fleiss-kappa-multiraters-inter-rater-agreement

  Raters inter-rater agreement

  inter-rater-agreementfleiss-kappacohens-kappa
  1

• DannyF46 / Inter-rater-Agreement-Statistics

  A calculator for two different inter-rater agreement statistics, generalized to any numbers of categories

  inter-rater-agreementstatisticscohen-kappagwet-ac1
  Language:Python 0

• theoam / TDArchetypalAnalysis

  Replication package for the Archetypal Analysis conducted in the paper: Evaluating the Agreement among Technical Debt Measurement Tools: Building an Empirical Benchmark of Technical Debt Liabilities accepted at Springer's EMSE Journal.

  technical-debtarchetypal-analysisinter-rater-agreementempirical-benchmarkreplication-package
  Language:R 0