Data is Better Together is a collab between 🤗 Hugging Face, 🏓 Argilla, and the Open Source ML community. Our goal is to empower the open source community to collectively build impactful datasets.
The community has created a dataset of 10k prompts DIBT/10k_prompts_ranked ranked by quality as part of Data is Better Together.
We are working on several strands of work. Here are current active projects.
Our first DIBT activity is focused on ranking the quality of prompts. We have already released version 1.0 of this dataset DIBT/10k_prompts_ranked. So far over 385 people have contributed annotations to this dataset but we are continuing to collect more annotations!
- Follow the progress of this effort in this dashboard
- You can contribute to the ranking of prompts here
There are not enough language-specific benchmarks for open LLMs! We want to create a leaderboard for more languages by leveraging the community! You can find more information about this project in the MPEP README.