mesolitica / malaya

Natural Language Toolkit for Malaysian language, https://malaya.readthedocs.io/

instruction finetuning

huseinzol05 opened this issue 10 months ago · comments

HUSEIN ZOLKEPLI commented 10 months ago

truncated based, https://github.com/huseinzol05/malaya/blob/5.1/session/llama2/main-lora.py
packing based, https://github.com/huseinzol05/malaya/blob/5.1/session/llama2/main-lora-packing.py