Question about the medAlpaca init weight

Question

Question about the medAlpaca init weight

XZhang97666 opened this issue a year ago · comments

Hi, I want to clarify the setting of medAlpaca. To my best of knowledge, the medAlpaca is initiate from Alpaca. However, have you ever try to use your dataset to directly ft Llama instead of Alpaca.

Keno · Answer 1 · Sun Sep 17 2023 19:13:56 GMT+0800 (China Standard Time)

Hi @XZhang97666. MedAlapca is trained in the style of Alpaca (same prompt, very similar code) hence the name. However, the model is based on LLaMA weights not on the Alpaca weights.