valentimarco / Ollama-Fix

A CheshireCat plugin to fix stop inference strings

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Ollamafix

awesome plugin
Awesome plugin
awesome plugin

A Cheshire Cat plugin for fix Langchain's Ollama class

Why exist?

The langchain integrations is a very mess, espcialy with Ollama where they Hard coded the list of stop strings!
This creates problems with the inference by generating endless tokens .-.

About

A CheshireCat plugin to fix stop inference strings


Languages

Language:Python 100.0%