microsoft / aici

AICI: Prompts as (Wasm) Programs

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Exception when no token generated

matthai opened this issue · comments

If I don't run FixedTokens() or text_gen() in the program, the program run crashes after finishing execution.

import pyaici.server as aici

async def main():
    print(f' starting main.........')

result = aici.start(main())

Does the print and crashes with:
image

Thanks for reporting this @matthai Running a controller without interacting with the LLM isn't a scenario that had occurred to me!