David Corvoysier's repositories
gtest-cmake-example
A sample project using GoogleTest with CMake
tensorsandbox
My tensorflow sandbox
linux-shlib-link-samples
A few examples of how to link Linux shared libraries with secondary dependencies
build-benchmark
Compare build systems performance for a large C project
kconfig-samples
Illustrate the use of the Kconfig and Kbuild tools
linux-qemu-from-scratch
Build a minimal Linux system and boot it from QEMU
ao
The torchao repository contains api's and workflows for quantization and pruning gpu models.
c_modules_section_sample
Illustrates decentralized modules declaration in C using ELF sections
deep-learning-containers
AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.
kaizouman.github.io
Personal blog
llm-hosting-container
Large Language Model Hosting Container
llmperf
LLMPerf is a library for validating and benchmarking LLMs
lm-evaluation-harness
A framework for few-shot evaluation of language models.
onnx_integer
A proof-of-concept to convert a quantized ONNX model to an integer graph
smoothquant
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
torch-int
This repository contains integer operators on GPUs for PyTorch.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs