OpenTalker / video-retalking

[SIGGRAPH Asia 2022] VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

https://opentalker.github.io/video-retalking/

OpenTalker/video-retalking Issues

Need to be able to lipsync videos having some frames having no Face
Closed 2 months ago4
求助，折腾48小时了，还没好，报错解决不掉
Updated 2 months ago4
UnboundLocalError: local variable 'mask_sharp' referenced before assignment
Updated 2 months ago2
ModuleNotFoundError: No module named 'torchvision.transforms.functional_tensor'
Updated 2 months ago9
UnboundLocalError: local variable 'keypoints' referenced before assignment
Closed 6 months ago1
UnboundLocalError: local variable 'keypoints' referenced before assignment
Updated 2 months ago2
mask_sharp error
Updated 2 months ago2
how to generate video in realtime and restream to RTMP or WebRTC server/app
Updated 2 months ago
Lips don't sync on big faces.
Updated 2 months ago1
python 3.8 not match basicsr==1.4.2 which is in requirements.txt???
Updated 2 months ago3
Very slow speed?
Updated 2 months ago2
FileNotFoundError: [Errno 2] No such file or directory: './results/output.mp4'
Updated 2 months ago3
Problem producing high resolution output
Updated 2 months ago8
RuntimeError: PytorchStreamReader failed reading file data/36: file read failed
Closed 2 months ago2
sieve improvements
Updated 2 months ago2
Linux 环境下，按照python3.8版本安装，dlib会报错
Updated 2 months ago1
When will the training code for the model be made public?
Updated 2 months ago1
vrtc: error: invalid value for --gpu-architecture (-arch)
Updated 2 months ago2
The colab notebook stops at loading checkpoints if I use custom voice and video.
Updated 3 months ago1
请问传入什么样的mp4文件会获得较好的效果
Closed 3 months ago
[Step 5] FaceDet:: 0%|
Closed 3 months ago
Is there ANYWAY, to make this FAST, FASTER? And to use GPU, Pytorch, Batchj size etc?
Updated 3 months ago6
model running speed
Updated 3 months ago
提升生成速度
Updated 3 months ago
TensorBody.h:338:30: note: declared here 338 | DeprecatedTypeProperties & type() const
Updated 3 months ago
SSL Issue with usage
Updated 3 months ago1
您好，请问一下可以重新进行训练模型吗？我觉得对于中文语音来说，7秒之内唇形很准确，但是7秒之后就不准了，有些停顿的地方都不停顿。
Updated 3 months ago
[ Security issue ] Replicate model uses other people's audio
Updated 4 months ago
nvrtc compilation failed + 'keypoints' errors
Closed 4 months ago1
ModuleNotFoundError: No module named 'face_alignment'
Updated 4 months ago
Accessing elements in a 2D array
Updated 4 months ago
reshape error
Closed 4 months ago4
UnboundLocalError: local variable 'mask_sharp' referenced before assignment
Updated 4 months ago2
训练复现的下半张脸，颜色总是不一致，为什么？
Updated 4 months ago1
No such file or directory 2DFAN4-cd938726ad.zip
Updated 4 months ago1
Face not detected! But face was in the video all the time
Closed 5 months ago
step3 - TypeError: mel() takes 0 positional arguments but 2 positional arguments (and 3 keyword-only arguments) were given
Updated 5 months ago3
Confusion about why only using the first frame of the video to crop the face region for the stablized image generation?
Updated 5 months ago1
Traceback error
Updated 5 months ago1
使用中文wav文件合成的视频没有声音
Updated 5 months ago
No such file or directory: 'thirdpart/face3d/BFM/similarity Lm3D_all.mat'
Updated 5 months ago
ImportError: dlopen(/opt/anaconda3/envs/video_retalking/lib/python3.8/site-packages/_dlib_pybind11.cpython-38-darwin.so, 0x0002): symbol not found in flat namespace (_png_do_expand_palette_rgb8_neon)
Updated 5 months ago
无法安装CU111
Updated 6 months ago2
It stops at facedetect.
Updated 6 months ago
video-retalking感觉驱动任意视频，在音频停顿时候（音频为0），会出现驱动后嘴巴闭不拢的问题
Updated 6 months ago
Laplacian_Pyramid_Blending_with_mask 输出的脸部特别糊
Updated 6 months ago
object has no attribute 'append'
Updated 6 months ago
Training script
Updated 6 months ago
Execution freezes at FaceDet stage
Updated 7 months ago2
运行FaceDet的时候卡住了，无法运行
Updated 7 months ago