pyannote / pyannote-metrics

A toolkit for reproducible evaluation, diagnostic, and error analysis of speaker diarization systems

http://pyannote.github.io/pyannote-metrics

pyannote/pyannote-metrics Issues

Calculate DER for specified speaker identification mapping
Updated 23 days ago
Ideation: Exploring New Metrics for Speaker Diarization in Unlabeled Audio Contexts
Updated 5 months ago14
hello , how to import some metrics with VAD? such as precesion,recall,FPR?
Updated 2 years ago1
How to calculate the relavent error rate in diarization overlap?
Updated 2 years ago1
Collar calculation is not standard?
Closed 2 years ago3
Calls to `confidence_interval` fails on any metric when it has only "seen" one file
Closed 2 years ago3
ImportError: cannot import name 'Pipeline' from 'pyannote.audio'
Updated 2 years ago3
Overlaps
Closed 3 years ago7
Leading zeros in decimal integer literals are not permitted; use an 0o prefix for octal integers
Closed 3 years ago1
How can I pass a predefined mapping
Closed 3 years ago
Issue understanding the outputs of coverage and purity metrics
Closed 3 years ago1
Error when loading diarizarion model to pipeline
Closed 3 years ago5
Replace Munkres by scipy.optimize.linear_sum_assignment
Closed 3 years ago
feeding information on annotations from a csv (non-rttm like) format
Closed 3 years ago1
pyannote-metrics.py diarization TypeError: get_protocol() got an unexpected keyword argument 'progress'
Closed 4 years ago1
Different Total values from Detection Error Rate and Diarization Error Rate when there is overlap segment
Closed 4 years ago6
import errors
Closed 4 years ago2
How to apply collar metric on speaker diarization pipeline
Closed 4 years ago3
When Hypothesis is a Single Segment, segmentation.py seems to return 1.0 for both coverage and purity
Closed 4 years ago9
Detection Error Rate Computation
Closed 4 years ago4
Segmentation metrics fail with empty annotations
Updated 5 years ago
DER computation on bunch of files
Closed 5 years ago2
AssertionError: daemonic processes are not allowed to have children
Closed 5 years ago2
Precision & Recall of VAD always gives 100%.
Closed 5 years ago2
DER differs from the one obtained with NIST SCTK `md-eval.pl`
Closed 5 years ago2
Question: computation of detection accuracy
Closed 5 years ago4
Question : Which metric for validating a multi-label classifier ?
Closed 5 years ago1
Results are wrong if I change speaker label format in mdtm file.
Closed 5 years ago2
Input type to Segmentation Metrics
Closed 6 years ago4
Purity and coverage should take non-speech regions into account
Updated 6 years ago1
Images broken on the Sphinx docs
Closed 6 years ago2
Segmentation Purity is always 100%
Closed 7 years ago7
How to plot Annotation without Ipython Notebook
Closed 7 years ago
Avoid divide by zero error when computing cross entropy
Closed 7 years ago3
Add collar and skip_overlap support to DiarizationPurity and DiarizationCoverage
Closed 7 years ago
Add option to ignore overlapping speech regions
Closed 7 years ago6
Collar removal is applied twice in DiarizationErrorRate
Closed 7 years ago
error in pip install on windows
Closed 7 years ago4
DiarizationHomogeneity need to inherit UEMSupportMixin
Closed 7 years ago1
unidecode package should be added to package's installation requirements
Closed 8 years ago1
Package gets installed in Python 2.7 but gives error when importing in code
Closed 8 years ago6
RuntimeError: An attempt has been made to start a new process before the current process has finished its bootstrapping phase.
Closed 8 years ago1
errors + correct do not sum to 100% - is this by design?
Closed 8 years ago5
Python 3.5 results are not same to Python 2.7
Closed 8 years ago6
Add accuracy to pyannote.metrics.py detection mode
Closed 8 years ago1
Remove dependency to pyannote.algorithms
Closed 8 years ago1
Remove Unknown label handling
Closed 8 years ago1
Add .report() reporting method
Closed 8 years ago
Make BaseMetric.__call__ thread-safe
Closed 8 years ago