Data is Better Together is a collab between 🤗 Hugging Face, 🏓 Argilla, and the Open Source ML community. Our goal is to empower the open source community to collectively build impactful datasets.
The community has created a dataset of 10k prompts DIBT/10k_prompts_ranked ranked by quality as part of Data is Better Together.
We are working on several strands of work. Here are current active projects.
Our first DIBT activity is focused on ranking the quality of prompts. We have already released version 1.0 of this dataset DIBT/10k_prompts_ranked. So far over 385 people have contributed annotations to this dataset but we are continuing to collect more annotations!
- Follow the progress of this effort in this dashboard
- You can contribute to the ranking of prompts here
There are not enough language-specific benchmarks for open LLMs! We want to create a leaderboard for more languages by leveraging the community! You can find more information about this project in the MPEP README.
Once you have your annotation suite running on a Hugging Face Space, you can easily set up a dashboard to track the annotation effort. Follow the steps in 03_create_dashboard.ipynb to set up one for the language you are working on.
You can also check the status of all translation efforts in our Multilingual Dashboard.
Want to contribute translations? Currently, these translation efforts are underway:
The Data is Better Together community has created several guides to support efforts to create valuable datasets via the open source community. Currently, we have the following guides: