princeton-nlp / SWE-agent

[NeurIPS 2024] SWE-agent takes a GitHub issue and tries to automatically fix it, using GPT-4, or your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges.

https://princeton-nlp.github.io/SWE-agent/

What is the effect of using gpt-4o?

praguepp opened this issue 4 months ago · comments

praguepp commented 4 months ago

Describe the issue

What is the effect of using gpt-4o?

Optional: Relevant documentation page

No response

Ofir Press commented 4 months ago

It slightly lowers performance compared to GPT-4 Turbo, we'll post results to swebench.com in the next few days. Follow one of us on Twitter to get notified.