google / weather-tools

Tools to make weather data accessible and useful.

Home Page:https://weather-tools.readthedocs.io/

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

`gcloud alpha commands` used but not installed in enviroment

aniketsinghrawat opened this issue · comments

What is the issue?
gcloud alpha storage cp is being used in weather-mv but it is not installed in conda enviroment.

for cmd in ['gcloud alpha storage cp', 'gsutil cp']:
try:
subprocess.run(cmd.split() + [src, dst], check=True, capture_output=True)
return
except subprocess.CalledProcessError as e:
errors.append(e)

Bug this is causing
The weather-mv pipeline hangs at this command as gcloud tries to install it and waits for user input.

$ python weather_mv/weather-mv bq -i "/local/path/data.nc" -o  myproject.mydataset.mytable --dry-run
warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md

INFO:root:Missing pipeline option (runner). Executing pipeline using the default runner: DirectRunner.