Does ctransformers support ollama models?
PriyaranjanMarathe opened this issue · comments
Does ctransformers support ollama models?
How do I specify the model in this code below?
llm = CTransformers(model="***where is the model file for a ollama model?",
model_type="llama",
max_new_tokens=512,
temperature=0.1)