KRAI

ck-qaic

Qualcomm Cloud AI (QAIC) implementation of MLPerf Inference benchmarks

ck-mlperf

Automated workflows for MLPerf, the industry-leading benchmark for evaluating performance of ML software and hardware

axs

KRAI X workflow automation system

axs2gcp

Automated KRAI X workflows for Google Cloud Platform

axs2kilt

Automated KRAI X workflows for KILT (KRAI Inference Library Technology)

axs2kilt_v3.0

axs repository for KILT

ck-armnn

Collective Knowledge workflows for ArmNN

ck-tensorflow

Collective Knowledge components for TensorFlow (code, data sets, models, packages, workflows):

kilt-mlperf

LLM_Wiki

This is just a place for us to put whatever we’ve learnt about LLMs, be it papers, blog posts or our own experiences.

axs2mlperf

Automated workflows for reproducing MLPerf Inference submissions

inference

Reference implementations of inference benchmarks

axs2config

axs2onnxrt

axs2qaic

Automated KRAI X workflows for reproducing MLPerf Inference submissions on systems equipped with Qualcomm Cloud AI 100 accelerators

axs2qaic-docker

Building Docker images for reproducing MLPerf Inference submissions with Qualcomm Cloud AI 100 accelerators

axs2snpe

axs2system

axs2tensorrt

bert_pruners

ck-env

CK repository with components and automation actions to enable portable workflows across diverse platforms including Linux, Windows, MacOS and Android. It includes software detection plugins and meta packages (code, data sets, models, scripts, etc) with the possibility of multiple versions to co-exist in a user or system environment:

ck-math

Collective Knowledge packages for various mathematical libs to be plugged into portable and customizable CK research workflows:

cloud-ai-sdk

Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high throughput and low latency across Computer Vision, Object Detection, Natural Language Processing and Generative AI models.

inference_policies

Issues related to MLPerf™ Inference policies, including rules and suggested changes

inference_results_v3.1

This repository contains the results and code for the MLPerf™ Inference v3.1 benchmark.

MultilineToOneLiner

TextLineConverter for NLP

nn_pruning-dev

Prune a model while finetuning or training.

NvidiaDeepLearningExamples

Deep Learning Examples

power-dev

Dev repo for power measurement for the MLPerf benchmarks

TextToJSONConverter

TextToJSONConverter