vLLM/Recipes

DeepSeek

deepseek-ai·10 recipesHuggingFace

Multimodal

2
DeepSeek-OCR-2
3B
dense
BF167G
v0.12.0+→
DeepSeek-OCR
3B
dense
BF167G
v0.12.0+→

Text

8
DeepSeek-V4-Flash-Vision-Exp
285B / 13B
moe
FP8202G
v0.29.0+→
DeepSeek-V4-Pro
1600B / 49B
moe
FP8960GFP8960GNVFP4960GFP8960G
v0.20.0+→
DeepSeek-V4-Flash
284B / 13B
moe
FP8200GFP8170GNVFP4170GFP8200G
v0.20.0+→
DeepSeek-V3.2
671B / 37B
moe
FP8805GNVFP4403G
v0.18.0+→
DeepSeek-V3.2-Exp
671B / 37B
moe
FP8805G
v0.12.0+→
DeepSeek-V3.1
671B / 37B
moe
FP8805GNVFP4403G
v0.12.0+→
DeepSeek-R1
671B / 37B
moe
FP8805GFP8805GNVFP4403G
v0.12.0+→
DeepSeek-V3
671B / 37B
moe
FP8805GFP4403G
v0.12.0+→