yashkant / spad

Code for SPAD : Spatially Aware Multiview Diffusers, CVPR 2024

Home Page:https://yashkant.github.io/spad/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Some questions about the infer code.

yiboz2001 opened this issue · comments

Hello!
Thanks for your open-source work~ I have some questions after trying the infer code.

  1. What does the "[tdv]" token mean, which is added to the original caption? It seems not to be mentioned in the paper.
  2. Can it generate results of zero elev degree? The default value is 45 degrees, and I meet code errors when I change the value to 0 directly.
    Looking for your reply!

hi, thanks for checking out spad!

  1. we appended the "[tdv]" token to all captions during multiview training. this provides an additional signal through text that the domain of the new data is slightly different from single view training that was performed previously (on laion).

  2. i believe you maybe looking for 90-degree elevation, since 0-degree would place all the cameras at the same location (on z-axis). here's the camera conversion equations that we follow, and here's the corresponding code. i believe you could try setting the elevation to 90-degrees, and see if that generates the right results.

hope this helps!