set up experiment tracking server
jeremyjordan opened this issue · comments
What's your idea?
We should set up an experiment tracking server to record metrics across various model training runs.
Describe the solution you'd like
Since this is a public repo, we'd be able to use Weights and Biases for free. If we go this route, we don't have to worry about how to deploy the server.
Describe alternatives you've considered
MLflow has a nice experiment tracking server that I've used on other projects. This is a self-hosted solution, so we'd want to consider how we deploy the experiment tracking server.