aws / deep-learning-containers

AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet.

https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html

huggingface_pytorch_neuronx] DLC for PyTorch 1.13.1 - Transformers 4.36.2 - Optimum-neuron 0.0.20 - Neuron SDK 2.17.0

JingyaHuang opened this issue 4 months ago · comments

Jingya HUANG commented 4 months ago

Overview for huggingface_pytorch_neuronx DLCs to update

Inference

Inference - Neuronx

Dependencies versions:

transformers: 4.36.2
torch: 1.13.1
aws-neuron-sdk: 2.17.0
optimum-neuron: 0.0.20

Training

Training - Neuronx

Dependencies versions:

transformers: 4.36.2
torch: 1.13.1
aws-neuron-sdk: 2.17.0
optimum-neuron: 0.0.20

cc. @catalin-manciu-aws @arjkesh @philschmid @mmcclean-aws