havenhq / mamba-chat

Mamba-Chat: A chat LLM based on the state-space model architecture 🐍

havenhq/mamba-chat Issues

Issue while installing requirements.txt
Updated 3 months ago4
MoE https://arxiv.org/abs/2401.04081
Closed 4 months ago
ImportError: /usr/local/lib/python3.10/dist-packages/causal_conv1d_cuda.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN3c104cuda9SetDeviceEi
Closed 5 months ago1
Cant use trained model
Updated 5 months ago3
Error during training
Closed 5 months ago6
Any plan or interest to use OpenChat algorithm (https://github.com/imoneoi/openchat) to train your chat?
Updated 5 months ago
Eval on benchmark?
Updated 5 months ago
How could I run this on windows 10?
Updated 6 months ago5
Error When Inferencing
Closed 6 months ago1
Finetune on 3090 but loss equal to zero
Updated 6 months ago4
Memory requirements for training
Updated 6 months ago
Colab notebook has error, numpy array used instead of torch
Closed 6 months ago7
Demo
Closed 6 months ago3
TypeError: MixerModel.__init__() got an unexpected keyword argument 'bos_token_id'
Updated 6 months ago1
setting device for training
Closed 6 months ago1
Bug in train_mamba.py line 53
Closed 6 months ago2