Data collection and generation

[Mohammad Najafi]

Thanks for releasing your research codes to everyone.
The variables here I found a bit difficult to figure out what they are for.
Can you please explain them?
And in general, could you please add a more comprehensive readme about the data collection/generation parts of the code base?
Thanks!

[Yuxiang Wei]

Hi, you can find the instructions at README-DEV.md. Internally it will load starcoderdata and collect the seeds in tandem with the data generation.