developmentseed / sentinel-2-cog

Convert Sentinel-2 JPEG 2000 to COG with AWS Lambda

Home Page:https://gist.github.com/vincentsarago/0e8c3fba19a4b2b6855bca77f18b88fb

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

sentinel2 to COGEO

Use AWS Lambda and rio-cogeo to convert Sentinel-2 JPEG2000 to CloudOptimized GeoTIFF.

Deployment

Package Lambda

Create package.zip

$ docker-compose build --no-cache
$ docker-compose run --rm package

Deploy to AWS

$ npm install
$ sls deploy --bucket my-output-bucket

Use

A CLI is porvided within this repo to invoke the lambda function directly.

$ python scripts/invoke.py --help
Usage: invoke.py [OPTIONS] SCENEID

  Invoke Lambda.

Options:
  -b, --bidx TEXT  Band index to copy  [required]
  --stage TEXT     Stack stage
  --function TEXT  Function's name
  --region TEXT    AWS Lambda region
  --help           Show this message and exit.

sentinel-2-cog works with Sentinel scene id as defined by rio-tiler

Example

$ python scripts/invoke.py S2B_tile_20190421_18TXR_0 --bidx 04 --bidx 03 --bidx 02

Cost

Each band is processed in ~40Sec, meaning that if you want to process 1M scenes with 4 bands (04, 03, 02, 08) it should cost you around 11$ + the datatransfer (writing to S3).

Contribution & Development

Issues and pull requests are more than welcome.

Dev install & Pull-Request

$ git clone http://github.com/developmentseed/sentinel-2-cog.git
$ cd sentinel-2-cog
$ pip install -e .[dev]

Python >=3.6 only

This repo is set to use pre-commit to run flake8, pydocstring and black ("uncompromising Python code formatter") when committing new code.

$ pre-commit install
$ git add .
$ git commit -m'my change'
black....................................................................Passed
Flake8...................................................................Passed
Verifying PEP257 Compliance..............................................Passed
$ git push origin

About

Created by Development Seed

About

Convert Sentinel-2 JPEG 2000 to COG with AWS Lambda

https://gist.github.com/vincentsarago/0e8c3fba19a4b2b6855bca77f18b88fb

License:MIT License


Languages

Language:Python 79.0%Language:Shell 16.3%Language:Dockerfile 4.7%