openai / weak-to-strong

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

what's the meaning of fraction of GPT4?

ljch2018 opened this issue · comments

commented
image I read the original paper, but met some problems about the graph.
  1. What's the meaning of fraction of GPT4 (X-axis) ?
  2. Is one line stand for a different student model?

Thank you very much.

commented

1.The fraction of GPT4 (X-axis) may represents the size of the student model, '1' represents GPT4, 10^-2 represents GPT4 parameters * 0.01 and so on.
2. one line represents weak model conpute. The lighter the color, the greater the weak model conpute.

zidong is correct except that 10^(-2) doesn't necessarily mean parameters * 0.01, it means less parameters and trained for 0.01x the compute