OPT inference generate example

[virgulvirgul]

Hi, is there any generate example for OTP models?

[DouJS]

Hi， you can follow https://github.com/dujiangsu/EnergonAI/blob/feature/opt-175b/energonai/utils/checkpointing_opt.py to load parameters of opt model.
As for the generate example, you can refer to the hf_gpt2 example.