v3 has a more reliable upload system for larger files. Can take multiple files at once:
https://colab.research.google.com/drive/1Wi-1Ji_fhcoGpK-drT4dVrl5AjfVUQ5M
v2 has a GUI and STL generation:
https://colab.research.google.com/drive/1wbbXpMC_UUwE3e7Tifq9fYNnd5Rn0zna
v1 is broken into sections:
https://colab.research.google.com/drive/1taTL_8GVx1G93ZXp_o-s4FLL-SY6N8TC
This is an adapted version of https://colab.research.google.com/github/isl-org/ZoeDepth/blob/main/notebooks/ZoeDepth_quickstart.ipynb
Corresponding paper : ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depth
Here, higher resolution depth maps are generated from the following process:
- Generate a depth map for the overall image
- Split original image into overlapping tiles
- Generate depth maps for the tiles
- Reassemble into a single depth map by applying gradient masks and average weighting from first depth map
- Repeat steps 2-4 at higher resolution
- Combine all three depth maps by:
a) Calculate edge filter from original RGB image
b) Blur edge filter and use as mask for high resolution depth map
c) Apply masked high resolution to average of low and medium resolution depth maps
The difference between the low resolution original and the new version can be seen below:
