Citadel AI langcheck Issues

citadel-ai/langcheck Issues

Follow up `use_async` option
Updated 3 months ago1
Split LangCheck into language-specific packages such as `langcheck[ja]`, `langcheck[de]`, etc
Updated 4 months ago4
Document maximum allowed input lengths for each metric
Updated 5 months ago
Improve testing of installation on different machines and python base images
Updated 5 months ago
Consider computing German fluency without translating to English
Updated 5 months ago
Specify langcheck.__version__
Updated 6 months ago
Pin versions for HuggingFace models
Updated 4 months ago5
Add docstrings for object properties so they show up in documentation
Updated 7 months ago
Create langcheck.utils.detect_language()
Updated 6 months ago7
Allow metrics to run on GPU
Updated 7 months ago
Eliminate unexpected spaces introduced before periods by `TreebankWordDetokenizer().detokenize()`.
Updated 7 months ago
Installation problem on Python 3.10 on Apple Silicon Mac
Closed 7 months ago
Support OpenAI >= 1
Closed 7 months ago
Add versions to ReadTheDocs documentation
Closed 7 months ago1
Fix documentation page title for MetricValue
Updated 8 months ago
Visualize thresholds when plotting MetricValueWithThresholds
Closed 8 months ago2
Add "refusal to answer" metric
Updated 8 months ago2
Fix `NOQA E501` showing up in documentation
Closed 8 months ago
Installing tensorflow breaks the transformers library in `test_factual_consistency()`
Updated 8 months ago2
Introduce 係り受け解析 (Dependency Analysis) - based Japanese reading ease scores
Updated 8 months ago
Refactoring of common parts in `ja/` and `en/`
Updated 8 months ago
Add `interactive=False` parameter to plotting functions
Updated 8 months ago6
Add `prompts` parameter to all metrics
Closed 8 months ago
Make all metrics accept a single string value as well
Closed 8 months ago
Rename langcheck.eval to langcheck.metrics
Closed 8 months ago2
Show tqdm progress bar for metric functions
Closed 7 months ago3
Store exception messages in EvalValue
Updated 8 months ago

citadel-ai / langcheck

citadel-ai/langcheck Issues

Follow up `use_async` option

Split LangCheck into language-specific packages such as `langcheck[ja]`, `langcheck[de]`, etc

Document maximum allowed input lengths for each metric

Improve testing of installation on different machines and python base images

Consider computing German fluency without translating to English

Specify langcheck.version

Pin versions for HuggingFace models

Add docstrings for object properties so they show up in documentation

Create langcheck.utils.detect_language()

Allow metrics to run on GPU

Eliminate unexpected spaces introduced before periods by `TreebankWordDetokenizer().detokenize()`.

Installation problem on Python 3.10 on Apple Silicon Mac

Support OpenAI >= 1

Add versions to ReadTheDocs documentation

Fix documentation page title for MetricValue

Visualize thresholds when plotting MetricValueWithThresholds

Add "refusal to answer" metric

Fix `NOQA E501` showing up in documentation

Installing tensorflow breaks the transformers library in `test_factual_consistency()`

Introduce 係り受け解析 (Dependency Analysis) - based Japanese reading ease scores

Refactoring of common parts in `ja/` and `en/`

Add `interactive=False` parameter to plotting functions

Add `prompts` parameter to all metrics

Make all metrics accept a single string value as well

Rename langcheck.eval to langcheck.metrics

Show tqdm progress bar for metric functions

Store exception messages in EvalValue