marella/ctransformers Issues
GGUF MODEL INFERENCE
UpdatedCannot generate text on GPU
Updated 3Everything OK? Abandoned?
Updated 10Not working with gpu_layers
Closed 2Model not loading on GPU
Updated 1Infinite token generation
Closed 1Multimodal models compatibility
UpdatedSlow + No config options
Closed 2Fine-tuning option?
UpdatedSomething wrong with a generator
Closed 1Request: `stopping_criteria`
UpdatedWill rwkv be supported?
UpdatedOut of memory exits process
UpdatedCuda 11.8
Updated 1Can't use AVX2 lib in Linux.
Updatedlogprobs are greater than 0
UpdatedAdding additional models
UpdatedHow to know if my CPU supports BLAS?
Updated 1Calculate Token spends
Updated