Bug: The first [INST] has no corresponding closing [\INST]
amit9oct opened this issue · comments
As per the Llama 2 chat format. (https://gpus.llm-utils.org/llama-2-prompt-template/)
We should have the following:
<s>[INST] <<SYS>>
{your_system_message}
<</SYS>>
{user_message_1} [/INST]
However, the current implementation will generate something like:
<s>[INST] <<SYS>>
{your_system_message}
<</SYS>>
[INST] {user_message_1} [/INST]
which is wrong.