bigscience-workshop / promptsource

Toolkit for creating, sharing and using natural language prompts.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Flag in Promptsource for PromptLanguage

jzf2101 opened this issue · comments

As discussed by the evaluation meeting, it would be useful to include a flag for the language of the prompts for multi-lingual evaluation. I wanted to open this up to see if we could allow for the creation of this additional field and to enquire as to how this would be preferred to be included. @awebson has been working with me on adding prompts into a branch and we're open to keeping this within the branch. @stephenbach @VictorSanh do you have a preference on how this is implemented?

Closed via #771 .