Using Generative AI to reconstruct corrupted images of Earth onboard the European Space Agency's OPS-SAT-1 spacecraft:
- On September 29, 2023, the OPS-SAT-1 mission achieved a significant milestone when it successfully captured, noised, and subsequently denoised two images using WGANs, marking the pioneering first application of Generative AI in space.
- This repository serves as the WGANs source code Git submodule to the experiments's parent repo: georgeslabreche/opssat-onboard-image-denoiser.
- Refer to the parent repo for results and experiment artifacts downlinked from the spacecraft.
The restored images have remarkably high structural similarity indices of 0.89 and 0.92---where 1 would indicate that they are identical to their original images.
 |
 |
 |
| (a) Original. | (b) Noised. | (c) Denoised. |
 |
 |
 |
| (d) Original. | (e) Noised. | (f) Denoised. |
Figure 1: Fixed-Pattern Noise (FPN) factor 50 noising and WGANs Generative AI denoising onboard the spacecraft. Images are post-processed with color equalize.
We appreciate citations to our upcoming peer-reviewed IEEE publication. Thank you!
@inproceedings{ieee_aeroconf_labreche2024,
title = {{Generative AI... in Space! Adversarial Networks to Denoise Images Onboard the OPS-SAT-1 Spacecraft}},
author = {Labrèche, Georges and Guzman, Cesar and Bammens, Sam},
booktitle = {{2024 IEEE Aerospace Conference}},
year = {2024}
}Labrèche, G., Guzman, C., & Bammens, S. (2024). Generative AI... in Space! Adversarial Networks to Denoise Images Onboard the OPS-SAT-1 Spacecraft. 2024 IEEE Aerospace Conference.
The authors would like to thank the OPS-SAT-1 Mission Control Team at ESA's European Space Operations Centre (ESOC) for their continued support in validating the experiment, especially Vladimir Zelenevskiy, Rodrigo Laurinovics, Marcin Jasiukowicz, and Adrian Calleja. Their persistence in scheduling and running the experiment onboard the spacecraft until sufficient data was acquired and downlinked was crucial to the success of this experiment. A special thank you to Kevin Cheng from Subspace Signal for granting and facilitating remote access to the GPU computing infrastructure used to train the models presented in this work.
About the experimenters!
Georges enjoys running marathons and running experiments on the OPS-SAT-1 Space Lab. Through his work, he has established himself as a leading figure in applied artificial intelligence for in-orbit machine learning in onboard spacecraft autonomy. He lives in Queens, NY, and supports the OPS-SAT-1 mission through his Estonian-based consultancy Tanagra Space. Georges received his B.S. in Software Engineering from the University of Ottawa, Canada, M.A. in International Affairs from the New School University in New York, NY, and M.S. in Spacecraft Design from Luleå University of Technology in Kiruna, Sweden.
César is an interdisciplinary R&D engineer with a background in reactive planning, plan execution and monitoring, space systems engineering, and machine learning. Cesar holds a Ph.D. in AI. He enjoys developing machine learning experiments on the OPS-SAT-1 Space Lab. In 2012, He collaborated with NASA Ames Research Center and is an R&D partner at the Estonian-based consultancy Tanagra Space.
A distinguished graduate with an M.S. degree in electronics and computer engineering technology from Hasselt University and KU Leuven in 2021, has a compelling background. He embarked on his career journey with ESA. During his initial two years, Sam served as a Young Graduate Trainee on the mission control team of OPS-SAT, showcasing his expertise. Presently, he holds the role of Spacecraft Operations Engineer within ESA's ESOC interplanetary department. He's a vital part of the flight control team dedicated to ESA's Solar Orbiter mission, solidifying his presence in the realm of space exploration.
This repo is still a bit messy. There's some cleanup todo before it can be easily re-used:
- Script and instructions to fetch the training data.
- Instructions on how to install and run the training.
- Refactor training data file paths.
