cassienickles / earthdata-cloud-cookbook

A tutorial book of workflows for research using NASA EarthData in the Cloud created by the NASA-Openscapes team

Hello!

This Earthdata Cloud Cookbook is being developed by the NASA Openscapes team.

How to contribute to our book

Information for our team to contribute to the Cookbook. This includes setup and workflow instructions.

Hackdays

In 2023 we are iterating and improving on our original cookbook structure, incorporating current technical approaches and what we've learned teaching NASA colleagues and Earth science researchers. We will increasingly track our tasks and progress using issues in this repository. We are having ongoing virtual Hackdays (ongoing notes and spreadsheet) to focus progress together.

Hackdays:

• February 2, 2023
• March 2, 2023
• March 30, 2023
• May 10, 2023

Hackday 4 Summary

This was our first Hackday "opening up" to folks beyond the NASA Mentors. Thanks Owen Littlejohns for joining and contributing!

• OPeNDAP: Cassie & Chris added OPeNDAP access to how-do-i > access data > if I’m local Merged branch into cookbook main! NASA-Openscapes#202 (review)

• harmony-py: Amy and Owen added Harmony to how-do-i > subset data NASA-Openscapes#187 s . Nearly ready to merge but zoom screensharing stopped

Hackday 3 Summary

Brief planning check-in and then mostly worked in breakouts the whole time - 

• OPeNDAP tutorial (Chris) - goal to not use pyDAP, instead earthaccess/Xarray and Zarr.

  • Progress: Added auth steps and CMR query. Notebook; issue #177

• How-Tos: Harmony-py subset example with PO.DAAC data (Amy) 

  • Progress: Pushed work-in-progress to branch, draft PR 

• How-Tos: Populated "access data"; created "read data" for python. (Cassie & Andy) 

  • Progress: merged PR

  • Next steps: Tagging R people fill in their wisdom - please go through and populate some of the R parts

• Tutorials: Import AppEEARS tutorial (Mahsa & Julie)

  • Progress: successful import and draft PR

  • Question: not re-import all notebooks each time (see draft PR)

• Tutorials: earthaccess walk-through (Jess). Shared workflow with Luis (conversation below). Focus: how to use earthaccess outside the JupyterHub

• Get-Started section (Jess) -  reviewed old chapters commented out in quarto_yml to see how to incorporate/delete. 

  • Progress: notes/suggestions below

  • Next steps: review & do!

• Environments chapter (Erin) started, notes here: #186 

• DOI, Zenodo, Citation, Documentation (Stef) - Deposit in Zenodo & get DOI for cookbook #178. Added DOI badge to README: commit

  • woohoo https://zenodo.org/record/7786711

  • Next steps: review pull request for citation text: #191 

  • Next steps: create Openscapes Zenodo Community (a là NASA TOPS & add Cookbook et al there)

Hackday 2 Summary

At our 2nd hackday we had a brief overview of cookbook progress since we'd last met before working in breakout groups together. In this session: 

• Updated the importer function by adding .md capability and rethinking storing copies of notebooks bc will get out of sync (commit) (Cassie+Luis)

• added CC-BY license and added license text to page footer (Erin+Stef)

• Planned How-Tos restructure through organization & level of granularity on left and right nav (draft PR) (Andy, Catalina, Mahsa, Alexis, Julie)

• Update and add Cloud OPeNDAP tutorials (issue) (Chris, Michele)

• Reviewing earthaccess tutorial in cookbook to parse and point to the docs; also how to sync a forked repo via cmd line (Jess)

Progress following Hackday 1

• _CookbookTutorialsInventory_Feb_2023.xlsx that Catalina made to identify Tutorials in the Cookbook and track decisions and progress for updating; and Imported Cloud Hackathon Tutorials so this content is available to modernize in the cookbook

• Reorg How-Tos structure as "How Do I..." - the work that Andy led to restructure the How-Tos structure to be more goal-oriented

• Cookbook GitHub Issues - began organizing ideas in Issues