june42 / easy-lm-trainer

πŸ€— μ΅œμ†Œν•œμ˜ μ„ΈνŒ…μœΌλ‘œ LM을 ν•™μŠ΅ν•˜κΈ° μœ„ν•œ μƒ˜ν”Œμ½”λ“œ

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Easy LM Trainer

Huggingface Transformersλ₯Ό μ‚¬μš©ν•΄ LM을 ν•™μŠ΅ν•  λ•Œ, λ‹¨μˆœ LM(CLM) ν•™μŠ΅ μž‘μ—…μ„ 보닀 μ‰½κ²Œ μ‹œμž‘ν•˜κΈ° μœ„ν•œ Boilerplate ν”„λ‘œμ νŠΈ.

ν™˜κ²½

  • CPython 3.10+
  • PyTorchλŠ” CUDA ν™˜κ²½μ— 맞게 μ„€μΉ˜ν•˜κΈ° (1.12.1 이상)
pip install -r requirements.txt

About

πŸ€— μ΅œμ†Œν•œμ˜ μ„ΈνŒ…μœΌλ‘œ LM을 ν•™μŠ΅ν•˜κΈ° μœ„ν•œ μƒ˜ν”Œμ½”λ“œ


Languages

Language:Python 95.4%Language:Shell 4.6%