docker for vllm. with deepseekv2 support merged
supdizh opened this issue · comments
https://hub.docker.com/r/superdizh891/vllm042-dsv2
build a docker of vllm with vllm-project/vllm#4650 merged
hope deepseek's PR could get merged, quite a pain to compile vllm for it