sstzal / DiffTalk

[CVPR2023] The implementation for "DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animation"

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

How can the driven-audio feature a and the landmark representation l be used for cross-attention module?

Haoqing-Wang opened this issue · comments

As we all know, the driven-audio feature a and the landmark representation l are just a vector, not a batch of vectors, so how can they be used in cross-attention module as Key and Value?

Did you understand how this works? I'm totally confused right now😭.