List of embedded layers that need to be implemented to support the diffusion model
baek2sm opened this issue · comments
It is a list of embedding layers that need to be implemented to support the diffusion model.
It would be nice if anyone who has time could take care of it one by one, then implement it.
Since there are no layers that are very complex, it would be good practice for nntrainer.
-
GaussianFourierProjectionEmbedding
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L224-L251 -
ImageHintTimeEmbedding
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L471-L499 -
ImageProjection
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L382-L402 -
ImageTimeEmbedding
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L458-L468 -
FourierEmbedder
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L552-L565 -
TextImageProjection
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L355-L379 -
TextImageTimeEmbedding
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L440-L455 -
TextTimeEmbedding
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L424-L437 -
TimestepEmbedding
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L159-L204 -
AttentionPooling
https://github.com/huggingface/diffusers/blob/28e8d1f6ec82a60a9b69554d83f02d385b79d1cc/src/diffusers/models/embeddings.py#L502-L549
cibot: Thank you for posting issue