vllm-project
Kimi-K3.1-Pro-pruned75
image text to textother286 downloadsHugging Face
No server in stock right now has the 888 GB this model needs for inference.
GPU memory it needs (estimate)
Rule of thumb from the model's size. Real needs depend on batch size, context length and framework.
Inference (full precision)
888 GB