Giters

miurla / morphic

An AI-powered search engine with a generative UI

Home Page:https://morphic.sh

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

[Unstable] Support Ollama AI Provider

miurla opened this issue · comments

commented

Overview

Currently, Ollama support is an unstable and experimental feature. This feature is implemented using the Ollama AI Provider. It is explicitly stated that it is unstable in Object generation and Tool usage. Additionally, Tool streaming is not supported. Morphic is very unstable because it requires these capabilities. Please use it with the understanding of these limitations.

Environment Variables

  • OLLAMA_MODEL=[YOUR_OLLAMA_MODEL]
    • The main model to use. Recommended: mistral or openherms
    • Object generation, Tool usage
  • OLLAMA_SUB_MODEL=[YOUR_OLLAMA_SUB_MODEL]
    • The sub model to use. Recommended: phi3 or llama3
    • Text generation
  • OLLAMA_BASE_URL=[YOUR_OLLAMA_URL]
    • The base URL to use. e.g. http://localhost:11434

PR