h2oai / h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://codellama.h2o.ai/

Home Page:http://h2o.ai

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Can you add langsmith/wandb for tracing and ragas for evaluation metrics?

vitalyshalumov opened this issue · comments

I have some code in WIP for verifiers that include such things, but not done. RAGAS is ok, but it's a bit loose compared to specific checking of actual specific faqs like done here: https://github.com/h2oai/enterprise-h2ogpte/tree/main/rag_benchmark