About crossattn in RDM

[Zephan]

Thanks for your impressive work!

I notice that in the config and comments, crossattn is used for context to condition input. However, simply addition op is used in ResBlock. Any performance differences between them?

And it would be nice if you could provide the original crossattn implementation.

[Tianhong Li]

Thanks for your interest! I directly modify LDM's code for RDM, so there might be some legacy issues (crossattn is one of them). To clarify, cross-attention is not used in RDM. We only use simple addition when incorporating conditioning.

[Zephan]

Thanks for your reply!