Deep dive into gpt engineer
depombo opened this issue · comments
Most of their prompts are here https://github.com/AntonOsika/gpt-engineer/tree/main/gpt_engineer/preprompts
The main takeaway is that they ask gpt to generate the files/folder plan with a description for each and then generates all of them on one go, but it still made a significant amount of mistakes import and dependency mistakes. We have faced the former, but not much of the latter yet. Once you give gpt-engineer a prompt as a user it asks a ton of clarifying questions regardless of whether you provided enough detail or not. Some of them are repetitive. It helped me realize if something was missing, but most of the time it was annoying and I got the sense they weren't very helpful. In our restricted syntax we already get most of the wins here.