gofireflyio / aiac

Artificial Intelligence Infrastructure-as-Code Generator.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Pretty sure the ollama backend api code is not working

oshea00 opened this issue · comments

Unless there's an aiac branch I should be using. The @latest aiac v4 build seems to have things stubbed in, but requests are failing and it's falling back to quasi-OPENAI mode. Happy to help.

A little more on this. I was unable to repro this after I configured OPENAI_API_KEY and ran a few queries using that backend. Then I tried ollama and... it works.
image

Thinking that something may have been cached from openai, I removed OPENAI key, restarted WSL2, and tried ollama again:
image