bdalal

llm.c

LLM training in simple, raw C/CUDA

llm_distillation_playbook

Best practices for distilling large language models.

List-of-Dirty-Naughty-Obscene-and-Otherwise-Bad-Words

List of Dirty, Naughty, Obscene, and Otherwise Bad Words

cv-sentence-extractor

Scraping Wikipedia for fair use sentences

deep-learning-pytorch-huggingface

noTunes

A simple macOS application that will prevent iTunes or Apple Music from launching.

navi

An interactive cheatsheet tool for the command-line

llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

interviews.ai

It is my belief that you, the postgraduate students and job-seekers for whom the book is primarily meant will benefit from reading it; however, it is my hope that even the most experienced researchers will find it fascinating as well.

120-Data-Science-Interview-Questions

Answers to 120 commonly asked data science interview questions.

teaching

Open-Source Information Retrieval Courses @ TU Wien

docTTTTTquery

docTTTTTquery document expansion model

matchmaker

Training & evaluation library for text-based neural re-ranking and dense retrieval models built with PyTorch

CtCI-6th-Edition-Python

Cracking the Coding Interview 6th Ed. Python Solutions

AugLy

A data augmentations library for audio, image, text, and video.

TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

detext

DeText: A Deep Neural Text Understanding Framework for Ranking and Classification Tasks

onnx-simplifier

Simplify your onnx model

I-BERT

[ICML'21 Oral] I-BERT: Integer-only BERT Quantization

nlp-architect

A model library for exploring state-of-the-art deep learning topologies and techniques for optimizing Natural Language Processing neural networks

ldig

Language Detection with Infinity-gram

pretrain-gnns

Strategies for Pre-training Graph Neural Networks

FBTT-Embedding

This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as recommendation and natural language processing. We showed this library can reduce the total model size by up to 100x in Facebook’s open sourced DLRM model while achieving same model quality. Our implementation is faster than the state-of-the-art implementations. Existing the state-of-the-art library also decompresses the whole embedding tables on the fly therefore they do not provide memory reduction during runtime of the training. Our library decompresses only the requested rows therefore can provide 10,000 times memory footprint reduction per embedding table. The library also includes a software cache to store a portion of the entries in the table in decompressed format for faster lookup and process.

dgl

Python package built to ease deep learning on graph, on top of existing DL frameworks.

langdetect

Port of Google's language-detection library to Python.

cs-video-courses

List of Computer Science courses with video lectures.

SME

pytorch_geometric

Graph Neural Network Library for PyTorch

lw-k8s-workshop

Hands-on Labs for Fusion 5 Kubernetes Workshop