chaoyi-wu / Finetune_LLAMA

简单易懂的LLaMA微调指南。

chaoyi-wu/Finetune_LLAMA Issues

如何实现多节点fsdp
Updated 5 months ago1
test_sample.py运行报错，貌似是device不一样，untimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking argument for argument index in method wrapper_CUDA_gather)
Updated 5 months ago2
你好，请问最低需要什么等级的显卡呢，必须A100吗，我的显存目前完全不够
Updated 7 months ago3
微调数据集切换成自己的中文数据集之后出现报错：RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)`
Updated 8 months ago
4090-24G 是否能微调呢
Updated 8 months ago1
咱们这个是否支持出LLAMA之外的其他模型呢
Updated 10 months ago1
使用苹果Mac Studio 192G微调怎么样，性能速度是否推荐呢？
Updated a year ago
convert_to_ds_params.py doesn't generate tokenizer
Updated a year ago3
attention mask for different documents in dataset chunk
Updated a year ago3
A100 Memory
Closed a year ago1