# Get Started with Kimi K3 on CoreWeave Dedicated Inference

DevFeed: [Get Started with Kimi K3 on CoreWeave Dedicated Inference](<https://devfeed.tech/articles/get-started-with-kimi-k3-on-coreweave-dedicated-inference-96129.md>)

Original publisher: [Read original article](<https://wf.coreweave.com/blog/get-started-with-kimi-k3-dedicated-inference>)

Author: CoreWeave

Published: 2026-10-22T16:27:39Z

Content type: tutorial

Language: en

Sources: [Coreweave Blog Posts](<https://devfeed.tech/sources/coreweave-blog-posts.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [GB300 NVL72](<https://devfeed.tech/topics/gb300-nvl72.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [AI Factory](<https://devfeed.tech/topics/ai-factory.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-compute](<https://devfeed.tech/tags/ai-compute.md>), [all](<https://devfeed.tech/tags/all.md>), [content-type](<https://devfeed.tech/tags/content-type.md>), [coreweave](<https://devfeed.tech/tags/coreweave.md>), [dedicated-inference](<https://devfeed.tech/tags/dedicated-inference.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [gb300](<https://devfeed.tech/tags/gb300.md>), [gb300-nvl72](<https://devfeed.tech/tags/gb300-nvl72.md>), [guide](<https://devfeed.tech/tags/guide.md>), [inference](<https://devfeed.tech/tags/inference.md>), [k3](<https://devfeed.tech/tags/k3.md>), [kimi](<https://devfeed.tech/tags/kimi.md>), [kimi-k3](<https://devfeed.tech/tags/kimi-k3.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [this](<https://devfeed.tech/tags/this.md>), [with](<https://devfeed.tech/tags/with.md>)

## AI overview

CoreWeave Dedicated Inference deploys customer-provided Kimi K3 weights on NVIDIA GB300 NVL72, with a tenant-isolated gateway, autoscaling, and vLLM serving on NVIDIA Dynamo. Setup involves staging Kimi K3 and a DSpark draft model in CoreWeave AI Object Storage, granting access, creating a gateway and deployment with a validated engine configuration, verifying the endpoint, and then cleaning up. Customers must supply a valid Kimi K3 license and weights; billing is per GPU-hour, with no ingress or egress fees. In CoreWeave's 16-GPU tests of multi-turn agentic workloads with a sustained 95% cache hit rate, GB300 scaled to concurrency 32 at 198,000 output tokens per minute per GPU. At concurrency 32, that was 209% higher throughput than GB200, with 133% higher p50 decode throughput; GB200 peaked at concurrency 16 and became unusable at 32 for latency-sensitive interactive workloads. The stack also supports KV-cache-aware routing, speculative decoding, and prefill/decode disaggregation.

## Source excerpt

Follow this step-by-step guide to deploy Kimi K3 on CoreWeave Dedicated Inference on NVIDIA GB300 NVL72.