Giters

JetBrains-Research / coqpilot

VSCode extension that is designed to help automate writing of Coq proofs.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Any insight into API cost?

adrianleh opened this issue · comments

commented

Hi all,

very interested in trying this project. Do you have any insight into the API cost that I should expect to incur? Ofc, this will depend on a number of factors but I think having some general use-cases with different cost estimates might be helpful for other users, so any insights are appreciated.

commented

Hi @adrianleh! You are right, it mostly depends on the number of tries for a particular goal and on the model you have chosen. While testing, we have experienced very low API costs when using gpt-3.5, and relatively big for gpt-4. For a fixed number of 30 tries per each hole I can give you the following numbers: for gpt-3.5 I have paid no more than 3$ per month while using and testing the plugin quite a lot; for gpt-4 numbers were around 8 times as big.

commented

Thanks! Is is definitely useful! Happy to close the issue for now