Lightning-AI / lit-llama

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Question about 'validating...' from lora.py

nevermet opened this issue · comments

Dear all,

I'm running lora.py with my custom data. While I was looking at the loss output, I saw the text below:
...
Validating ...
Recommend a movie for me to watch during the weekend and explain the reason.
Below is an instruction that describes a task. Write a response that appropriately completes the request.

Instruction:

Recommend a movie for me to watch during the weekend and explain the reason.
...

Do I have to change the instruction to something related to my data?

Thanks in advance.