oplatek / chateval-llm

Three Ways of Using Large Language Models to Evaluate Chat. A system description of Dstc11 Track 4 submission.

ChatEvaluation using ChatGPT and Llama2.

Three Ways of Using Large Language Models to Evaluate Chat, on Arxiv.
Accepted to DST11 workshop, 2023, Prague

 

Chateval Package

Installation

# Optional for reinstallation
conda deactivate; rm -rf env; 
# Installing new conda environment and editable pip moosenet package
conda env create --prefix ./env -f environment.yml \
  && conda activate ./env \
  && pip install -e .[dev]