neubig / example-critique

Example using Inspired Cognition Critique for Evaluation w/ Zeno

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Zeno 🤝 Inspired Critique

An example of using Inspired Critique metrics for evaluating generative NLP models in Zeno.

This example looks at German-English translations from the MT Metrics Eval V2 dataset.

Install the requirements with pip install -r requirements.txt and run it with zeno config.toml

About

Example using Inspired Cognition Critique for Evaluation w/ Zeno


Languages

Language:JavaScript 88.5%Language:Jupyter Notebook 7.8%Language:Python 3.7%