mrcsparker / camel

LLMs in Elixir

Camel

Prototype for LLM in Elixir.

Camel.get_accelerator

Heavily based on: https://github.com/Atome-FE/llama-node/

Installation

If available in Hex, the package can be installed by adding camel to your list of dependencies in mix.exs:

def deps do
  [
    {:camel, "~> 0.1.0"}
  ]
end

Documentation can be generated with ExDoc and published on HexDocs. Once published, the docs can be found at https://hexdocs.pm/ellem.

API

This is a test for llama models. It is being developed as a prototype

Camel.new("./open_llama_3b-f16.bin") |> Camel.generate("Today is the best day to")