helloliucc

SyncTalk

[CVPR 2024] This is the official source for our paper "SyncTalk: The Devil is in the Synchronization for Talking Head Synthesis"

EchoMimic

Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditioning

LivePortrait

Bring portraits to life!

duix.ai

VAD

Voice activity detection (VAD) toolkit including DNN, bDNN, LSTM and ACAM based VAD. We also provide our directly recorded dataset.

metahuman-stream

Real time interactive streaming digital human

speechbrain

A PyTorch-based Speech Toolkit

silero-vad

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

ncnn

ncnn is a high-performance neural network inference framework optimized for the mobile platform

flowframes

Flowframes Windows GUI for video interpolation using DAIN (NCNN) or RIFE (CUDA/NCNN)

paper2gui

Convert AI papers to GUI，Make it easy and convenient for everyone to use artificial intelligence technology。让每个人都简单方便的使用前沿人工智能技术

fish-speech

Brand new TTS solution

Streamer-Sales

Streamer-Sales 销冠 —— 卖货主播 LLM 大模型🛒🎁，一个能够根据给定的商品特点从激发用户购买意愿角度出发进行商品解说的卖货主播大模型。🚀⭐内含详细的数据生成流程❗ 📦另外还集成了 LMDeploy 加速推理🚀、RAG检索增强生成 📚、TTS文字转语音🔊、数字人生成 🦸、 Agent 使用网络查询实时信息🌐、ASR 语音转文字🎙️

chatgpt-web

用 Express 和 Vue3 搭建的 ChatGPT 演示网页

libopenshot

OpenShot Video Library (libopenshot) is a free, open-source project dedicated to delivering high quality video editing, animation, and playback solutions to the world. API currently supports C++, Python, and Ruby.

vidgear

A High-performance cross-platform Video Processing Python framework powerpacked with unique trailblazing features :fire:

hallo

Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation

MetaGPT

🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming

Agently-Daily-News-Collector

An open-source LLM based automatically daily news collecting workflow showcase powered by Agently AI application development framework.

seed-tts-eval

json-repair

🔧 Repair JSON！Solution for JSON Anomalies from LLMs.

TypeChat

TypeChat is a library that makes it easy to build natural language interfaces using types.

V-Express

V-Express aims to generate a talking head video under the control of a reference image, an audio, and a sequence of V-Kps images.

ChatTTS-WebUI

ChatTTS

A generative speech model for daily dialogue.

Vach

Real time streaming talking head

whip-go

Simple WHIP client for WebRTC streaming from any media source

OBS-studio-webrtc

This is a fork of OBS-studio with generic support for webrtc. It leverages the same webrtc implementation most browsers use.

AniTalker

[ACM MM 2024] This is the official code for "AniTalker: Animate Vivid and Diverse Talking Faces through Identity-Decoupled Facial Motion Encoding"

InternVL

[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型