omerh

fastapi

FastAPI framework, high performance, easy to learn, fast to code, ready for production

AppFlowy

AppFlowy is an open-source alternative to Notion. You are in charge of your data and customizations. Built with Flutter and Rust.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

harbor

An open source trusted cloud native registry project that stores, signs, and scans content.

opentofu

OpenTofu lets you declaratively manage your cloud infrastructure.

supervision

We write your reusable computer vision tools. 💜

deepface

A Lightweight Face Recognition and Facial Attribute Analysis (Age, Gender, Emotion and Race) Library for Python

open-llms

📋 A list of open LLMs available for commercial use.

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

matterbridge

bridge between mattermost, IRC, gitter, xmpp, slack, discord, telegram, rocketchat, twitch, ssh-chat, zulip, whatsapp, keybase, matrix, microsoft teams, nextcloud, mumble, vk and more with REST API (mattermost not required!)

kraken

P2P Docker registry capable of distributing TBs of data in seconds

FasterTransformer

Transformer related optimization, including BERT, GPT

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

notebooks

Notebooks using the Hugging Face libraries 🤗

k8s-device-plugin

NVIDIA device plugin for Kubernetes

whatsmeow

Go library for the WhatsApp web multidevice API

alpaca_eval

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

amazon-bedrock-workshop

This is a workshop designed for Amazon Bedrock a foundational model service.

deep-learning-containers

AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.

pulsar

A modular and blazing fast runtime security tool for the IoT, powered by eBPF.

dregsy

Keep container registries in sync

toxicity

The world's largest social media toxicity dataset.

rag-using-langchain-amazon-bedrock-and-opensearch

RAG with langchain using Amazon Bedrock and Amazon OpenSearch

deep-learning-models

Natural language processing & computer vision models optimized for AWS

awsome-distributed-training

Collection of best practices, reference architectures, model training examples and utilities to train large models on AWS.

ec2-spot-interruption-dashboard

This is a sample solution for logging EC2 Spot Instance Interruptions, storing them in CloudWatch and S3, and visualizing them with a CloudWatch Dashboard and Amazon Athena.

aws-efa-nccl-baseami-pipeline

EFA/NCCL base AMI build Packer and CodeBuild/Pipeline files. Also base Docker build files to enable EFA/NCCL in containers

knowledge-augmented-LLMs

Context is Key: Combining Embedding-based Retrieval with LLMs for Comprehensive Knowledge Enrichment

eks-automated-ipmgmt-multus-pods

accelerate-aws-sagemaker

Examples showcasing AWS SageMaker integration of 🤗 Accelerate. Just give the `accelerate config` and do `accelerate launch` 🚀. As simple as that!