smart-on-fhir / chart-review

Measure agreement between chart reviewers.

https://docs.smarthealthit.org/cumulus/chart-review/

smart-on-fhir/chart-review Issues

minor: when using --csv option, chart-review should still print summary info
Updated 7 days ago2
Support nested choice labels
Updated 2 months ago
No minimum python version listed, but 3.10 or above is required for `|` operator for union types.
Closed 2 months ago2
verbose output option
Closed 4 months ago1
Consider adding a way to export Label Studio labels
Closed 3 months ago3
Making `labelstudio-export.json` filename configurable
Updated 4 months ago4
Output number of charts per reviewer
Closed 4 months ago
Docs does not mention Kappa agreement scores
Closed 4 months ago
Documentation improvements for chart review workflow
Updated 4 months ago3
Implement Cohen's Kappa for "agreement" between two reviewers
Closed 5 months ago1
Add some info/debug commands
Closed 4 months ago2
New Feature: Aggreagate multiple annotators into a set of ground-truth annotations
Updated 6 months ago1
workaround exists : QA check: fail fast or warn if supplied "label" is not recognized
Updated 8 months ago
New Feature: annotations for results per chart as CSV/SQL
Updated 8 months ago2
New Feature: exclude chart IDS where specified label is present
Updated 8 months ago1
New Feature: ignore labels
Closed 8 months ago4
New Feature: Rewrite Labels as "Binary Label"
Closed 8 months ago3
New Feature: LABEL PRIORITY: allow for custom rules for scoring the chart review
Closed 9 months ago5
Investigate using a library to provide some matrix types / logic
Updated a year ago
Initial robustification thoughts
Closed a year ago1