saltysoup / a3-bootcamp-ce

A3 bootcamp labs for CEs

Day 1 training

Choose from 1 of the following:

1. Pre-training Llama2 with Nvidia NeMo framework on Slurm
2. Pre-training Llama2 with Nvidia NeMo framework on GKE
3. Fine-Tuning Llama3 with Nvidia NeMo framework on Slurm

Day 2 inference

1. Running, optimising performance and benchmarking Gemma with vLLM on GKE using L4 and H100 GPUs
2. Converting Gemma from GPU to TPU with Jetstream on GKE with TPUv5e