Dillo is an exploration into using LLMs to detect bugs in code. Inspired by AI Found a Bug in My Code by Joel Einbinder, Dillo uses the logprobs of each token in a given code snippet to highlight unlikely tokens in code.
While a demo can be found at dillo.dmo.ooo, renting a GPU 24/7 is expensive, so the hosted demo won't always work. If you're interested in playing around with it, feel free reach out and ask me to turn it on, or host it yourself with the following steps.
- Node.js
- pnpm
- Instance of DeepSeek Coder
- Clone the repository
- Run
pnpm install
in the root directory - Copy
.env.example
to create a.env.local
file if it doesn't already exist - Run
pnpm run dev
While I use RunPod to host DeekSeek, feel free to self-host or use your own favorite provider. If using RunPod, I've made this template and found that it works well on RunPod's A4500s.