Giters

deepseek-ai / DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

Repository from Github https://github.comdeepseek-ai/DeepSeek-V2Repository from Github https://github.comdeepseek-ai/DeepSeek-V2

hi, could you provide a code like llama3?

lambda7xx opened this issue · comments

commented

hi, Dear DeepSeek team:

if your team could provide a implementation like https://github.com/meta-llama/llama3/tree/main/llama, it will be great. Llama3 is very helpful to learn.

commented

Maybe you are looking for https://huggingface.co/deepseek-ai/DeepSeek-V2-Lite/blob/main/modeling_deepseek.py

I think if the deepseek team can maintain a repo like llama, it will be great. In llama repo, it has a model implementation and a example to run the model(https://github.com/meta-llama/llama3/blob/main/example_text_completion.py).