the-crypt-keeper / LLooM

Experimental LLM Inference UX to aid in creative writing

the-crypt-keeper/LLooM Issues

Suggestion beams parts containing a : breaks the graphviz visualization
Updated 5 months ago
Proper vllm prompt caching (sglang support?)
Updated 5 months ago
Track the full probability chain along each beam instead of only the final string and accumulated probability mass
Updated 6 months ago1
Add the ablity to continue generation.
Updated 6 months ago1
Add a suggestion hard limiter
Closed 6 months ago1
This application is highly senstive to latency.
Closed 6 months ago2
Move depth and probability controls into an expander instead of hiding them
Closed 6 months ago1
Explore applying a chat template
Updated 6 months ago
Clicking a node in the viz should filter options to those passing through that node
Updated 6 months ago1