Ye Wang's repositories
ORTCustomOpLibrary
A standalone code repository to generate dynamic library files for custom OnnxRuntime operators.
BenchmarkEnv
A Docker based testing environment for benchmarking ONNXRuntime(ORT) CUDA Execution Provider, ORT TensorRT Execution Provider and Nvidia FasterTransformer
CppCoreGuidelines
The C++ Core Guidelines are a set of tried-and-true guidelines, rules, and best practices about coding in C++
FeaturizersLibrary
A library of cross-platform, cross-framework, cross-programming language featurizers (operations in a data processing pipeline) that can be used during Machine Learning training and prediction activities.
triton
Development repository for the Triton language and compiler
onnxruntime
ONNX Runtime: cross-platform, high performance scoring engine for ML models
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs