ConstantinSchmidts

Macaw-LLM

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

VALOR

Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset

fast-whisper-finetuning

spacy-llm

🦙 Integrating LLMs into structured NLP pipelines

chatgpt-retrieval-plugin

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

speechbrain

A PyTorch-based Speech Toolkit

NDRData-Corona-Liveticker

Textcorpus der Corona-Liveticker-Meldungen von NDR.de 2020-2023

clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

nlp

pyannote-audio

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

dalai

The simplest way to run LLaMA on your local machine

llama.cpp

LLM inference in C/C++

minimal

Minimal is a Jekyll theme for GitHub Pages

inaSpeechSegmenter

CNN-based audio segmentation toolkit. Allows to detect speech, music, noise and speaker gender. Has been designed for large scale gender equality studies based on speech time per gender.

automated-election-reporting-de

automated-election-reporting-de automates the election reporting by generating articles based on election data

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

whisper-diarization

Automatic Speech Recognition with Speaker Diarization based on OpenAI Whisper

whisper

Robust Speech Recognition via Large-Scale Weak Supervision

recurring-content-detector

Unsupervised detection of opening / closing credits, recaps, and previews in video files 🎥🍿🎬

wit

WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.

Open-Assistant

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

cleanlab

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

Made-With-ML

Learn how to design, develop, deploy and iterate on production-grade ML applications.

subtitle2go

german-asr-lm-tools

Crawling and creating a German language model resource

scf

Subtitling Conversion Framework

pruefstelle

Prototyp zum Qualitätsmanagement automatischer Erschließung (Textmining) im Archiv

benchmarkstt

Open Source AI Benchmarking toolkit for benchmarking speech to text services

berts

DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models

opencv

Open Source Computer Vision Library