wangyems

ORTCustomOpLibrary

A standalone code repository to generate dynamic library files for custom OnnxRuntime operators.

BenchmarkEnv

A Docker based testing environment for benchmarking ONNXRuntime(ORT) CUDA Execution Provider, ORT TensorRT Execution Provider and Nvidia FasterTransformer

caffe

Please use https://github.com/BVLC/caffe as the main repo.

cast_removel_example

CppCoreGuidelines

The C++ Core Guidelines are a set of tried-and-true guidelines, rules, and best practices about coding in C++

FeaturizersLibrary

A library of cross-platform, cross-framework, cross-programming language featurizers (operations in a data processing pipeline) that can be used during Machine Learning training and prediction activities.

TensorRT

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

triton

Development repository for the Triton language and compiler

onnx

Open standard for machine learning interoperability

onnxruntime

ONNX Runtime: cross-platform, high performance scoring engine for ML models

phi2

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs