Study notes on parameter-efficient finetuning techniques

Question

Study notes on parameter-efficient finetuning techniques

utterances-bot opened this issue a year ago · comments

Study notes on parameter-efficient finetuning techniques

Traditional finetuning involves training the parameters of a large language model with a shallower domain-specific network. However, this approach requires a...

https://ljvmiranda921.github.io/notebook/2023/05/01/peft/

Huahui Yi · Answer 1 · Wed Jun 21 2023 02:38:10 GMT+0800 (China Standard Time)

Thank you for your excellent summary of PEFT. By the way, may I ask what software you used for drawing the diagrams?

Lj Miranda · Answer 2 · Wed Jun 21 2023 08:21:57 GMT+0800 (China Standard Time)

Hi @HuahuiYi , thanks for the kind words. I use Figma for drawing the diagrams. I tried to make it look "stylistically" like it was drawn via LaTeX/TikZ, so I'm using simple boxes and gradients + the Computer Modern font.

Huahui Yi · Answer 3 · Fri Jun 23 2023 16:28:50 GMT+0800 (China Standard Time)

Hi @HuahuiYi , thanks for the kind words. I use Figma for drawing the diagrams. I tried to make it look "stylistically" like it was drawn via LaTeX/TikZ, so I'm using simple boxes and gradients + the Computer Modern font.

I really like the drawing style in the article, thank you for selflessly sharing it with me.