Port NaNDetector
dlwh opened this issue · comments
David Hall commented
I borrowed this from MetaSeq https://github.com/facebookresearch/metaseq/blob/f2cd36798793604cf51ab8b8a2cb167c964f9667/metaseq/nan_detector.py and put it in our composer fork
https://github.com/stanford-crfm/composer/blob/pubmed/composer/utils/nan_detector.py