virtualflo

MusePose

MusePose: a Pose-Driven Image-to-Video Framework for Virtual Human Generation

HierSpeechpp

The official implementation of HierSpeech++

pytorch-lightning

Pretrain, finetune and deploy AI models on multiple GPUs, TPUs with zero code changes.

Real-Time-Voice-Cloning

Clone a voice in 5 seconds to generate arbitrary speech in real-time

screenshot-to-code

Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)

metavoice-src

Foundational model for human-like, expressive TTS

homebridge-panasonic-heat-pump

whisperX

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Fooocus

Focus on prompting and generating

llamafile

Distribute and run LLMs with a single file.

seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation

deepface

A Lightweight Face Recognition and Facial Attribute Analysis (Age, Gender, Emotion and Race) Library for Python

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

TTS

🐸💬 - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

Deepfake-using-Wave2Lip

A deep learning model to lip-sync a given video with any given audio. It uses GAN architecture to orchestrate loss reconstruction or training.

sd-wav2lip-uhq

Wav2Lip UHQ extension for Automatic1111

DeepFaceLab

DeepFaceLab is the leading software for creating deepfakes.

pyannote-audio

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

inaSpeechSegmenter

CNN-based audio segmentation toolkit. Allows to detect speech, music, noise and speaker gender. Has been designed for large scale gender equality studies based on speech time per gender.

Retrieval-based-Voice-Conversion-WebUI

Easily train a good VC model with voice data <= 10 mins!

GFPGAN

GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.

ultimatevocalremovergui

GUI for a Vocal Remover that uses Deep Neural Networks.

so-vits-svc-fork

so-vits-svc fork with realtime support, improved interface and more features.

Wav2Lip

This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Multimedia 2020. For HD commercial model, please try out Sync Labs

whisperX

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

MaskFreeVIS

Mask-Free Video Instance Segmentation [CVPR 2023]

diart

A python package to build AI-powered real-time audio applications

GHunt

🕵️‍♂️ Offensive Google framework.

pysot

SenseTime Research platform for single object tracking, implementing algorithms like SiamRPN and SiamMask.

whisper

Robust Speech Recognition via Large-Scale Weak Supervision