cyrusmsk / gemm_apple

GEMM on Apple Silicon

Matrix Multiplication on Apple Silicon (M1)

Checked solutions

• NumPy
• TensorFlow ANE https://github.com/tlkh/tf-metal-experiments/blob/main/coreml_matmul.py
• TensorFlow Metal https://github.com/tlkh/tf-metal-experiments/blob/main/unified_mem_benchmark.py
• Tuned Metal, Torch and Tinygrad https://github.com/tinygrad/tinygrad/blob/master/extra/gemm/metal_matmul.py
• Apple's Framework https://github.com/ml-explore/mlx
• Python Bindings for GGML https://github.com/abetlen/ggml-python

Useful links

• https://github.com/philipturner/metal-benchmarks