elixir-nx / bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)

elixir-nx/bumblebee Issues

Bumblebee.apply_tokenizer fails for empty text
Closed 2 months ago2
Using bumblebee from git is broken
Updated 2 months ago2
Error loading gpt3.5 tokenizer
Closed 2 months ago4
llama3 requires 2 eos_token_id's
Closed 3 months ago1
Support Mixtral
Updated 3 months ago4
Just download a model from HuggingFace?
Closed 4 months ago5
Stream audio chunk by chunk to Whisper
Closed 4 months ago22
Add support for "google/gemma-7b-it"
Closed 4 months ago1
CUDA 12.2 support
Closed 5 months ago3
Support LLaVA
Updated 5 months ago10
Huggingface repository not found - `bert-base-google-bert`
Closed 5 months ago1
Llama 2 derivative model errors expecting top_k to be provided
Closed 5 months ago2
Unknown error serving Llama 2 derivative model
Closed 5 months ago2
Bumblebee error when serving Mistral LLM with latest 0.5.0 release
Closed 5 months ago1
Download sharded parameters in parallel
Updated 5 months ago
Running Whisper using bf16 fails
Closed 5 months ago1
Parameter persistence with sharding support
Updated 5 months ago4
Token Classification error in Livebook
Closed 5 months ago1
[Documentation] Image struct is not correct in Livebook Examples
Closed 5 months ago2
Tied word embeddings
Updated 5 months ago2
Add annotations to QKV layers
Updated 5 months ago
Confidences/probabilities for Whisper results
Updated 5 months ago
Support returning token count information
Closed 5 months ago9
Error when using TinyLlama
Closed 5 months ago2
Featurizer different from python?
Closed 6 months ago10
Weird behaviour with progress status.
Closed 6 months ago2
Model "Salesforce - Blip large" fails
Closed 9 months ago7
`TextEmbedding` crashes when both Mean Pooling and `compile` opts is specified
Closed 7 months ago2
Cannot use `whisper-*.en` models in bumblebee
Closed 7 months ago3
Improve the error message when Hugging Face resource isn't found a the referenced location.
Closed 7 months ago1
Token Truncation differs from Transformers implementation
Closed 7 months ago
Finetuning Whisper with Bumblebee / Axon
Closed 7 months ago2
Use tokenizer_config.json as the primary source of metadata
Closed 7 months ago
Support non-deterministic output in text generation serving
Closed 7 months ago
Allow text completion streaming true/false option on a per-call basis
Closed 8 months ago2
Text completion behavior is different when streaming vs not streaming
Closed 8 months ago1
Support Starcoder Model
Closed 8 months ago1
Bumblebee fails to load gpt models in main.
Closed 8 months ago1
running 'elixir speech_to_text.exs' UndefinedFunctionError
Closed 8 months ago5
Halting Nx Serving streams with a stop token
Closed 8 months ago4
Support temperature in generation options
Closed 8 months ago
Support DeepSeek Coder Model
Closed 8 months ago11
Multimodal projected embeddings
Closed 8 months ago2
"cannot perform operation across devices mps and cpu" when running examples with torchx and mps
Closed 8 months ago1
Way to tell if Bumblebee or Nx or whatever has access to a GPU?
Closed 8 months ago8
How to load .en variants under recent versions?
Closed 9 months ago4
How do you deploy this on Fly.io?
Closed 9 months ago5
Error running Stable Diffusion example
Closed 9 months ago7
Will there be any support for LLaMa2 in the future?
Closed 9 months ago2
Reducing entry barrier for Elixir ML - can we showcase bumblebee based elixir code exposed as REST api to integrate with other frameworks ?
Closed 9 months ago2