It explains how to test and deploy StableLM on SageMaker
- Test StableLM in local mode
- Deploy StableLM model on SageMaker enpodint using DJL
- How to create StableVicuna 13B model
- Note that you need LLaMA model first
It explains how to test and deploy StableDiffusion on SageMaker
- Test StableDiffusion in local mode
- Deploy StableDiffusion model on SageMaker enpodint
It explains how to test, deploy, and fine-tune (SFT, RLHF) Dolly on SageMaker
- Check the
Dolly
directory. - The example is explained using Korean.
- All examples are tested on Python 3.9. Local mode notebook have a version information of python packages.
- If it has error when deploy to endpoint, check the local mode version and match with this version in the
requirements.txt
Need to use conda env in Sagemaker notebook
source /home/ec2-user/anaconda3/bin/activate JupyterSystemEnv
conda env list
conda activate pytorch_p310
Install DJL in local env
git clone https://github.com/deepjavalibrary/djl-serving.git
cd djl-serving
cd engines/python/setup
pip install -U -e .