smpanaro

coreml-llm-cli

CLI to demonstrate running a large language model (LLM) on Apple Neural Engine.

more-ane-transformers

Run transformers (incl. LLMs) on the Apple Neural Engine.

CoreMLInspect

See the device (CPU/GPU/ANE) and estimated cost for every layer in your CoreML model.

apple-silicon-4bit-quant

Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"

norm-tweaking

Post post-training-quantization (PTQ) method for improving LLMs. Unofficial implementation of https://arxiv.org/abs/2309.02784

mlx-squeezellm-gradients

SqueezeLLM-style gradients/Fisher Information collection in MLX

netron

Visualizer for neural network, deep learning, and machine learning models

litgpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

QuaRot

Code for QuaRot, an end-to-end 4-bit inference of large language models.

swift-transformers

Swift Package to implement a transformers-like API in Swift

WhisperKit

Swift native on-device speech recognition with Whisper for Apple Silicon

whisperkittools

Python tools for WhisperKit: Model conversion, optimization and evaluation

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

blogs.hn

tiny directory of tech blogs

CLIP-Finder2

CLIP-Finder enables semantic offline searches of images from gallery photos using natural language descriptions or the camera. Built on Apple's MobileCLIP-S0 architecture, it ensures optimal performance and accurate media retrieval.

coremltools

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.

Elva

zstd/brotli/lz4 swift kit

FloatingPanel

A clean and easy-to-use floating panel UI component for iOS

ggml

Tensor library for machine learning

kmeans1d

A Python package for optimal 1D k-means clustering.

powerlevel10k

A Zsh theme

smpanaro.github.io

My personal website.

spotless

Keep your code spotless

SqueezeLLM-gradients

swift-chat

Mac app to demonstrate swift-transformers

time-series-compression

Utilities for evaluating time series compression techniques. Companion to blog post.

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

tree-sitter-flatbuffers

tree-sitter grammar for FlatBuffers

zed-extensions

Extensions for the Zed editor

zed-flatbuffers

zed.dev extension with language support for FlatBuffers