muhtasham's repositories
summarization-eval
📝 Reference-Free automatic summarization evaluation with potential hallucination detection
pod-helper
🎧 Pod-Helper: Real-time audio transcription and repair on consumer hardware
mlx-examples
Examples in the MLX framework
COSINE
This is the code for our paper `Fine-Tuning Pre-trained Language Model with Weak Supervision: A Contrastive-Regularized Self-Training Approach' (In Proc. of NAACL-HLT 2021).
DeepSeek-Coder-V2
DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence
DeepSeek-MoE
DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models
dstack
Open-source toolkit for training, fine-tuning, and deploying generative AI models on multiple clouds. https://discord.gg/u8SmfwPpMd
fal-js
The JavaScript client and utilities to fal-serverless with built-in TypeScript definitions
instructor
openai function calls for humans
k-diffusion
Karras et al. (2022) diffusion models for PyTorch
lectures
Material for cuda-mode lectures
LiveCodeBench
Official repository for the paper "LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code"
llama_index
LlamaIndex (formerly GPT Index) is a data framework for your LLM applications
mistral-jax
JAX port of the Mistral 7b model
OpenDiloco
OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
S-LoRA
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
starcoder2
Home of StarCoder2!
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
TensorRT-Model-Optimizer
TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization and sparsity. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM or TensorRT to optimize inference speed on NVIDIA GPUs.
Triton-Puzzles
Puzzles for learning Triton