matthewygf

GPUSchedule

A GPU Cluster Simulator for Distributed Deep Learning Training.

albert_zh

A LITE BERT FOR SELF-SUPERVISED LEARNING OF LANGUAGE REPRESENTATIONS, 海量中文预训练ALBERT模型

all-for-one

gpu-monitoring-tools

Tools for monitoring NVIDIA GPUs on Linux

incubator-tvm

Open deep learning compiler stack for cpu, gpu and specialized accelerators

kube-scheduler-simulator

A web-based simulator for the Kubernetes scheduler

torch_interference

allennlp

An open-source NLP research library, built on PyTorch.

aptos

Kaggle aptos

automl

Google Brain AutoML

backend

Common source, scripts and utilities for creating Triton backends.

cadvisor

Analyzes resource usage and performance characteristics of running containers.

cluster-config

Ansible manifests for configuring cluster

common

Common source, scripts and utilities shared across all Triton repositories.

core

DeepLearningExamples

Deep Learning Examples

enas

TensorFlow Code for paper "Efficient Neural Architecture Search via Parameter Sharing"

kubernetes

Production-Grade Container Scheduling and Management

models

Models and examples built with TensorFlow

mxnet-operator

A Kubernetes operator for mxnet jobs

onnxruntime_backend

The Triton backend for the ONNX Runtime.

profiler-ui

The TensorFlow Profiler (TFProf) UI provides a visual interface for profiling TensorFlow models.

python_backend

Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

server

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

tf-operator

Tools for ML/Tensorflow on Kubernetes.

vision

Datasets, Transforms and Models specific to Computer Vision

volcano

A Kubernetes Native Batch System

volcano-jobs-gen

job generator for volcano system only

yolov5

YOLOv5 in PyTorch > ONNX > CoreML > TFLite