Do you guys are aware for Marigold Depth ?
al3dv2 opened this issue · comments
Hi I saw that you guys use Zoe depth but Marigold Depth have higher resolution https://huggingface.co/spaces/toshas/marigold
May be it's can help to get even better result ? thanks for this awesome project
Thank you for bringing this to our attention! We are in the process of evaluating the Marigold Depth model within our framework. We share your optimism and hope that incorporating Marigold will indeed enhance our method's performance.
@GaussianObject there's now better than marigold https://github.com/kijai/ComfyUI-depth-fm?tab=readme-ov-file
Thank you again for your valuable input! It's exciting to see the community engaging and suggesting alternatives that might enhance our project. We've taken a look at the link you provided for ComfyUI-depth-fm, and we appreciate the recommendation.
To add to our previous discussion, we've conducted additional ablation studies on mip360, focusing on the impact of depth loss. Here are the experimental results:
| Method | LPIPS | PSNR | SSIM |
|---|---|---|---|
| w/o_depth_loss | 5.0860 | 24.84 | 0.9341 |
| GaussianObject | 4.9926 | 24.81 | 0.9350 |
These results indicate that depth loss doesn't play a dominant role in our methodology. Based on this insight, we are exploring how to better integrate depth estimation models and Gaussian point clouds to further improve our system.
Your feedback has been incredibly helpful, and we look forward to possibly integrating these insights into our work. Thank you for your contribution to our project's development!
Thank you! I've found another one that might be better than other depth methods, and it's do normal too https://github.com/kijai/ComfyUI-Geowizard
Sincerely, many thanks for this great project. We will also be looking forward to the updates regarding the revised model with the new ways of integrated depth estimation models.