convert a tencentpretrain llama model to huggingface?
jamestch opened this issue · comments
jamestch commented
How to convert a tencentpretrain llama model to huggingface? can u share the script?
Thanks a lot!
Baketbek Jantoro commented
你有找到这个方法吗
csho commented
去scripts/ 文件夹下找convert_tencentpretrain_to_llama.py,用这个转换。
python convert_tencentpretrain_to_llama.py --input_model_path 输入模型路径/input_model.bin --output_model_path 输出模型路径/pytorch_model.bin --layers_num 32
7B的模型层数是32