explodinggradients / ragas

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

Home Page:https://docs.ragas.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Open Analytics

jjmachan opened this issue · comments

We track very basic usage metrics to guide us to figure out what our users want, what is working and what's not. As a young startup, we have to be brutally honest about this which is why we are tracking these metrics. We are also an Open Startup, which is a product or company which operates in the open and shares its statistics publically.

All the data and the code we track will be open-sourced soon

If you don't want to send tracking info, you can easily disable it by setting RAGAS_DO_NOT_TRACK to True.

Keeping this issue open for feedback from the community and further discussions.

Refs

When will this data be opened? :-)

Yeah will open that up as soon as I figure out the right Bigquery permissions 😂 (if you have some experience please do let me know)

also curious as to what u were looking for in the data, so that we can prioritize this better

Ohh I think you will not find any of that information in that, it just has the count of evaluations run, nothing more

I will checkout the resource, thanks for sharing :)

Gentle bump on your promise to open source this data! Even a CSV file dump would honor your commitment :-)

we're a bit tied down at the moment but we could work with you to make it happen. Would it be possible for you to volunteer some time to make it possible? would really really appreciate the help 🙏🏽

could you give me your email ID? I'll ping you personally and we can set it up? or at the very least export the CSV for you

(apologies for the delay)

Is there any update on publishing the data?