cosmos-omnibus should not start if it fails to obtain (download/extract) the snapshot

[Andrey Arapov]

image: ghcr.io/akash-network/cosmos-omnibus:v0.4.0-generic

cosmos-omnibus should not start if it fails to obtain (download/extract) the snapshot

It should fail to start when it is unable to download or extract the snapshot instead of starting the node.

This happens when Pod restarts but the snapshot is gone. (when ephemeral storage is used).

And Pod restarts aren't rare. Pod can restart due to provider maintenance, when pod takes up 100% of allocated ephemeral storage space.

Logs

Downloading genesis https://github.com/Sifchain/networks/blob/master/betanet/sifchain-1/genesis.json.gz?raw=true
+ '[' 1 == 1 ']'
+ GENESIS_FILENAME=genesis.json
+ echo 'Downloading genesis https://github.com/Sifchain/networks/blob/master/betanet/sifchain-1/genesis.json.gz?raw=true'
+ curl -sfL 'https://github.com/Sifchain/networks/blob/master/betanet/sifchain-1/genesis.json.gz?raw=true'
+ file genesis.json
+ grep -q 'gzip compressed data'
+ mv genesis.json genesis.json.gz
+ gzip -d genesis.json.gz
+ file genesis.json
+ grep -q 'tar archive'
+ file genesis.json
+ grep -q 'Zip archive data'
+ mkdir -p /root/.sifnoded/config
+ mv genesis.json /root/.sifnoded/config/genesis.json
+ '[' 1 == 1 ']'
+ '[' -z https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4 ']'
+ '[' -z https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4 ']'
+ '[' -z https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4 ']'
+ SNAPSHOT_FORMAT_DEFAULT=tar.gz
+ SNAPSHOT_URL_TRIM=https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4
+ case "${SNAPSHOT_URL_TRIM,,}" in
+ SNAPSHOT_FORMAT_DEFAULT=tar.lz4
+ SNAPSHOT_FORMAT=tar.lz4
+ '[' -n https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4 ']'
Downloading snapshot from https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4...
+ echo 'Downloading snapshot from https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4...'
+ rm -rf /root/.sifnoded/data
+ mkdir -p /root/.sifnoded/data
+ cd /root/.sifnoded/data
+ tar_cmd='tar xf -'
+ [[ tar.lz4 == \t\a\r\.\g\z ]]
+ [[ tar.lz4 == \t\a\r\.\l\z\4 ]]
+ tar_cmd='lz4 -d | tar xf -'
+ [[ tar.lz4 == \t\a\r\.\z\s\t ]]
+ pv_extra_args=
++ wget https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4 --spider --server-response -O -
++ sed -ne '/Content-Length/{s/.*: //;p}'
+ snapshot_size_in_bytes=0
+ case "$snapshot_size_in_bytes" in
+ [[ https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4 == *\l\i\n\k\.\s\t\o\r\j\s\h\a\r\e\.\i\o* ]]
+ stdbuf -o0 tr '\r' '\n'
+ wget -nv -O - https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4
+ pv -petrafb -i 5
+ eval lz4 -d '|' tar xf -
++ lz4 -d
++ tar xf -
https://snapshots.polkachu.com/snapshots/sifchain/sifchain_14723348.tar.lz4:
2023-11-22 16:44:59 ERROR 404: Not Found.
0.00 B 0:00:00 [0.00 B/s] [0.00 B/s] [<=>                                      ]

tar: This does not look like a tar archive
tar: Exiting with failure status due to previous errors
+ '[' -n data ']'
+ mv './data/*' ./
mv: cannot stat './data/*': No such file or directory
+ '[' -n '' ']'
+ '[' 0 == 1 ']'
+ '[' 1 == 1 ']'
+ export COSMOVISOR_VERSION=1.5.0
+ COSMOVISOR_VERSION=1.5.0
++ uname -s
++ uname -m
++ sed 's|x86_64|amd64|'
+ export COSMOVISOR_URL=https://github.com/cosmos/cosmos-sdk/releases/download/cosmovisor%2Fv1.5.0/cosmovisor-v1.5.0-Linux-amd64.tar.gz
+ COSMOVISOR_URL=https://github.com/cosmos/cosmos-sdk/releases/download/cosmovisor%2Fv1.5.0/cosmovisor-v1.5.0-Linux-amd64.tar.gz
+ '[' '!' -f /bin/cosmovisor ']'
Downloading Cosmovisor from https://github.com/cosmos/cosmos-sdk/releases/download/cosmovisor%2Fv1.5.0/cosmovisor-v1.5.0-Linux-amd64.tar.gz...
+ echo 'Downloading Cosmovisor from https://github.com/cosmos/cosmos-sdk/releases/download/cosmovisor%2Fv1.5.0/cosmovisor-v1.5.0-Linux-amd64.tar.gz...'
+ mkdir -p cosmovisor_temp
+ cd cosmovisor_temp
+ curl -Ls https://github.com/cosmos/cosmos-sdk/releases/download/cosmovisor%2Fv1.5.0/cosmovisor-v1.5.0-Linux-amd64.tar.gz
+ tar zx
+ cp cosmovisor /bin/cosmovisor
+ cd ..
+ rm -r cosmovisor_temp
+ export DAEMON_NAME=sifnoded
+ DAEMON_NAME=sifnoded
+ export DAEMON_HOME=/root/.sifnoded
+ DAEMON_HOME=/root/.sifnoded
+ mkdir -p /root/.sifnoded/cosmovisor/upgrades
+ mkdir -p /root/.sifnoded/cosmovisor/genesis/bin
+ cp /bin/sifnoded /root/.sifnoded/cosmovisor/genesis/bin/
+ [[ ! -f /root/.sifnoded/data/priv_validator_state.json ]]
+ mkdir -p /root/.sifnoded/data
+ echo '{"height":"0","round":0,"step":0}'
+ '[' 0 -ne 0 ']'
+ '[' -z '' ']'
+ '[' 1 == 1 ']'
+ export 'START_CMD=cosmovisor run start'
+ START_CMD='cosmovisor run start'
+ '[' -n '' ']'
+ echo 'Running '\''cosmovisor run start'\''...'
Running 'cosmovisor run start'...
+ exec cosmovisor run start
4:45PM INF running app args=["start"] module=cosmovisor path=/root/.sifnoded/cosmovisor/genesis/bin/sifnoded
4:45PM INF starting node with ABCI Tendermint in-process
4:45PM INF service start impl=multiAppConn module=proxy msg={}