SCONE: Surface Coverage Optimization in Unknown Environments
by Volumetric Integration
Antoine Guédon Pascal Monasse Vincent Lepetit
Official PyTorch implementation of SCONE: Surface Coverage Optimization in Unknown Environments by Volumetric Integration (NeurIPS 2022, Spotlight).
We released a new model called MACARONS (CVPR 2023) which is a direct improvement of SCONE.
MACARONS adapts the approach from SCONE to a fully self-supervised pipeline: It learns simultaneously to explore and reconstruct 3D scenes from RGB images only (there is no need for 3D ground truth data nor depth sensors).
The codebase of MACARONS includes an entire, updated version of SCONE's code as well as detailed instructions for generating the ShapeNet training data we used for SCONE.
Please refer to MACARONS' repo to find all the information you need.
This repository currently contains:
- scripts to initialize and train models
- evaluation pipelines to reproduce quantitative results
Note: We will add installation guidelines, training data generation scripts and test notebooks as soon as possible to allow for reproducibility.
If you find this code useful, don't forget to star the repo ⭐ and cite the paper 👇
@inproceedings{guedon2022scone,
title={{SCONE: Surface Coverage Optimization in Unknown Environments by Volumetric Integration}},
author={Gu\'edon, Antoine and Monasse, Pascal and Lepetit, Vincent},
booktitle={{Advances in Neural Information Processing Systems}},
year={2022},
}
Major code updates 📋
- 11/22: first code release
We will add more details as soon as possible.
We generate training data for both occupancy probability prediction and coverage gain estimation from ShapeNetCore v1.
We will add the data generation scripts and corresponding instructions as soon as possible.
We conducted inference experiments in large environments using 3D meshes downloaded on the website Sketchfab under the CC license.
3D models courtesy of Brian Trepanier, Andrea Spognetta, and Vr Interiors.
We will add more details as soon as possible.
We will add more details as soon as possible.
We adapted the code from Phil Wang to generate spherical harmonic features.
We thank him for this very useful harmonics computation script!
We also thank Tom Monnier for his Markdown template, which we took inspiration from.