Giters
ggerganov
/
ggml
Tensor library for machine learning
Geek Repo:
Geek Repo
Github PK Tool:
Github PK Tool
Stargazers:
9364
Watchers:
114
Issues:
343
Forks:
837
ggerganov/ggml Issues
Adding native backend for Qualcomm mobile SoC
Updated
3 days ago
Quant and Dequant operators
Updated
6 days ago
Why perform such operations on k and v as shown in the above diagram?
Updated
9 days ago
Comments count
1
How to deploy my own model using ggml framework
Updated
15 days ago
Comments count
3
quantization func test failed with GGML_QKK_64
Closed
15 days ago
Comments count
2
Automatically convert pytorch model to ggml
Updated
16 days ago
Comments count
4
Incorrect Error Handling in ggml_backend_graph_compute Function in example/magika/main.cpp
Closed
21 days ago
Comments count
1
Replit code completion example not working
Closed
24 days ago
Comments count
1
Error: Unsupported op TIMESTEP_EMBEDDING
Updated
a month ago
In gpt-2/convert-h5-to-ggml.py : size mismatch for wpe.weight ... torch.Size([50255, 1024]) ...
Updated
a month ago
ggml : add Magika inference
Closed
a month ago
Problems with Metal and iOS
Closed
a month ago
Comments count
16
ggml : make ggml_fp16_t private
Closed
a month ago
Comments count
2
mnist convert from tensorflow to ggml
Updated
a month ago
ggml : simplify the ggml_compute_forward_ calls
Closed
a month ago
Comments count
2
Question about documentation with encoder-decoder models
Updated
a month ago
Does ggml_cont really work?
Updated
a month ago
How do pixel unshuffle in ggml ?
Updated
a month ago
Comments count
2
Division by zero error
Closed
2 months ago
Comments count
2
ggml : add optional CPU backend context, support reusing threads, async compute
Updated
2 months ago
Comments count
2
Is there interest in implementations of something analogous to `torch.Tensor.scatter_` and `torch.gather`?
Updated
2 months ago
Error when trying to run GPT inference
Updated
2 months ago
cmake -G "MinGW Makefiles" -DGGML_CUBLAS=ON .. error in windows 10
Updated
2 months ago
Comments count
2
why add 512 : ggml_backend_alloc_buffer(backend_kv, memory_size + 512*2);
Closed
2 months ago
Comments count
4
Is it possible to use this on an NPU processor?
Updated
2 months ago
Comments count
3
"array size is too large" on model load
Closed
2 months ago
Comments count
1
some notes about how ggml works using the GPT-2 example
Closed
2 months ago
Comments count
2
Matmul on 4d tensors with cuda backend
Closed
2 months ago
Comments count
8
Is a ggml tensor's dimension order reversed?
Updated
2 months ago
Comments count
1
Any tutorial to convert pytroch model to gguf?
Closed
2 months ago
Comments count
4
re-introduce `n_dims` field?
Updated
2 months ago
Comments count
4
Add option to use either cudaMalloc or cudaMallocManaged
Updated
2 months ago
ggml_allocr_alloc_graph allocated overlapping tensor memory
Closed
2 months ago
Comments count
4
Reuse gpt2_graph
Closed
2 months ago
Comments count
2
`ggml_cpy_inplace` and `ggml_cont_inplace`
Closed
3 months ago
Comments count
1
Possible typo in comment
Closed
3 months ago
Comments count
2
test-conv1d and test-conv2d failed on GPUs with computation capability <= 6.1
Closed
3 months ago
make: *** No rule to make target 'gpt-2'. Stop.
Closed
3 months ago
Comments count
2
Execution speed varies greatly
Updated
3 months ago
Citing the ggml in a paper
Updated
3 months ago
Comments count
2
Garbage output on Metal on x86-64 mac
Updated
3 months ago
WebAssembly triggers ggml_assert_aligned on Mac M1
Updated
3 months ago
Comments count
2
What can be used instead ggml_get_backend()?
Closed
3 months ago
Comments count
2
Bug in CUDA backend when allocated tensors in a given buffer exceed GGML_CUDA_MAX_NODES
Updated
3 months ago
[Feature Request] Circular padding tensor operation
Closed
4 months ago
Comments count
1
GGML_OP_VIEW backpropagation performance
Updated
4 months ago
Unable to attach with GDB when hitting GGML_ASSERT after backend v2 changes
Closed
4 months ago
Comments count
4
Support ROCm
Updated
4 months ago
ggml : storing strides as number of elements instead of number of bytes
Updated
4 months ago
Comments count
1
Add example which implements Vision Transformer(ViT) image classification
Updated
4 months ago
Comments count
1
Previous
Next