Repository not reset for multiple tasks
bauersimon opened this issue · comments
When multiple tasks are within a repository, the repository must be reset after every task. This is not the case yet.
symflower / eval-dev-quality
DevQualityEval: An evaluation benchmark 📈 and framework to compare and evolve the quality of code generation of LLMs.