neuml / txtchat

💭 Retrieval augmented generation (RAG) and language model powered search applications

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Suggested LLMs

DnVS97 opened this issue · comments

Hello, thanks for creating and sharing this github repository.

I was curious which LLMs you have experimented with and which one you would suggest for prompting?

Thanks in advance!

So far the best open models I've used are the FLAN-T5 models. I've had the best results with flan-t5-xl but pretty good results with flan-t5-large. The smaller variants can also work if you're willing to fine-tune.