Giters

deepseek-ai / DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Repository from Github https://github.comdeepseek-ai/DeepSeek-V2Repository from Github https://github.comdeepseek-ai/DeepSeek-V2

What's the Prompt and Response length in the Paper?

JadeRay opened this issue · comments

commented

image

The paper has mentioned 50K tps for generation phase and 100K throughput for prefill phase, my question is what's the tested prompt length and repsonse length in avg and P99?