smpanaro

more-ane-transformers

Run transformers (incl. LLMs) on the Apple Neural Engine.

CoreMLInspect

See the device (CPU/GPU/ANE) and estimated cost for every layer in your CoreML model.

norm-tweaking

Post post-training-quantization (PTQ) method for improving LLMs. Unofficial implementation of https://arxiv.org/abs/2309.02784

apple-silicon-4bit-quant

Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"

litgpt

Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

mlx-squeezellm-gradients

SqueezeLLM-style gradients/Fisher Information collection in MLX

swift-transformers

Swift Package to implement a transformers-like API in Swift

AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

blogs.hn

tiny directory of tech blogs

CameraManager

Simple Swift class to provide all the configurations you need to create custom camera view in your app

CollectionViewPagingLayout

A simple but highly customizable UICollectionViewLayout for UICollectionView -- Simple SwiftUI views that let you make page-view effects.

coremltools

Core ML tools contain supporting tools for Core ML model conversion, editing, and validation.

docker-crontab

A docker job scheduler (aka. crontab for docker)

Elva

zstd/brotli/lz4 swift kit

ggml

Tensor library for machine learning

kmeans1d

A Python package for optimal 1D k-means clustering.

MKFoundationKit

Collection of categories for NSFoundation classes to accelerate development.

MKUnits

Unit conversion library for Objective-C.

netron

Visualizer for neural network, deep learning, and machine learning models

powerlevel10k

A Zsh theme

qmk_firmware

keyboard controller firmware for Atmel AVR and ARM USB families

realm-persisted-observe

smpanaro.github.io

My personal website.

spotless

Keep your code spotless

SqueezeLLM-gradients

swift-chat

Mac app to demonstrate swift-transformers

time-series-compression

Utilities for evaluating time series compression techniques. Companion to blog post.

tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

WhisperKit

Swift native on-device speech recognition with Whisper for Apple Silicon

whisperkittools

Python tools for WhisperKit: Model conversion, optimization and evaluation