benchmark is failing

[KannamSridharKumar]

I've tried bechmark with default problems and a custom problem. In both cases its giving an error - KeyError: 0
From the logs, it is generating response for all the problems using all the LLMs models in the list, and then failing.

[Vladimir Prelovac]

Feel free to submit a PR.