epishchik / SRGD

Super Resolution Gaming Dataset

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Super Resolution Gaming Dataset (SRGD)

LR HR

download Open issue Closed issue LICENSE

Description

Image Super Resolution is a machine learning task where the goal is to increase the resolution of an image, often by a factor of 4x or more, while maintaining its content and details as much as possible. The end result is a high resolution version of the original image. This task can be used for various applications such as improving image quality, enhancing visual detail, and increasing the accuracy of computer vision algorithms.

Video games require a lot of computing resources such as GPU, CPU, RAM, etc. To reduce the computing cost, some companies such as NVIDIA, AMD create their own solutions based on super resolution technologies. This is because it may be faster to render at a lower resolution and then upscale the image than to just render at high resolution.

We've collected a dataset mostly using the Unreal Engine game engine. There aren't a lot of datasets for super resolution in games, so we hope that the collected dataset will give independent developers more room to get started in this area.

Documentation

Each part described below, and others such as the setup process, has a short overview on the README page, for more information see the wiki page.

Dataset

Dataset was collected using Unreal Engine and consists of 2 independent datasets, each dataset has all images in 4 different resolutions - 270p, 360p, 540p, 1080p:

  • GameEngineData: 14431 train and 3600 test images.
  • DownscaleData: 29726 train and 7421 test images.

Models

Name Link Type Config PSNR* SSIM* LPIPS*
Real-ESRGAN xinntao/Real-ESRGAN GAN RealESRGAN_x4plus 23.5409 0.7992 0.3924
EMT Fried-Rice-Lab/EMT Transformer EMT_x4 24.5443 0.8231 0.3889
ResShift zsyOAOA/ResShift Diffusion ResShift_RealSRx4 23.0368 0.7992 0.4829

* - metric was calculated using pretrained versions** of the models on the GameEngineData dataset with x4 scaling from 270p to 1080p.

** - the config field specifies the exact version of the model which was used to calculate metric.

Kaggle

A competition based on the SRGD dataset has been launched on the Kaggle platform and will run until August 26, 2024. The SRGD dataset will be publicly available on Huggingface after the competition ends.

Bibtex

@misc{srgd,
    author = {Evgenii Pishchik},
    title = {Super Resolution Gaming Dataset},
    year = {2023},
    url = {https://github.com/Pe4enIks/SRGD}
}

About

Super Resolution Gaming Dataset

License:Apache License 2.0


Languages

Language:Python 91.7%Language:Shell 6.6%Language:Dockerfile 1.7%