# Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models

DevFeed: [Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models](<https://devfeed.tech/articles/sarvam-launches-sarvam-token-factory-bringing-india-hosted-inference-to-8-open-models-137112.md>)

Original publisher: [Read original article](<https://www.marktechpost.com/2026/11/17/sarvam-token-factory-india-inference-platform/>)

Author: Asif Razzaq

Published: 2026-11-17T09:51:18Z

Content type: news

Language: en

Sources: [MarkTechPost](<https://devfeed.tech/sources/marktechpost.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [Dynamo](<https://devfeed.tech/topics/dynamo.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [gemma](<https://devfeed.tech/topics/gemma.md>)

Tags: [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-shorts](<https://devfeed.tech/tags/ai-shorts.md>), [api](<https://devfeed.tech/tags/api.md>), [applications](<https://devfeed.tech/tags/applications.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [deepseek-v4-1-flash](<https://devfeed.tech/tags/deepseek-v4-1-flash.md>), [editors-pick](<https://devfeed.tech/tags/editors-pick.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [factory](<https://devfeed.tech/tags/factory.md>), [for-devs](<https://devfeed.tech/tags/for-devs.md>), [gemma](<https://devfeed.tech/tags/gemma.md>), [gemma-4](<https://devfeed.tech/tags/gemma-4.md>), [gemma-4-31b](<https://devfeed.tech/tags/gemma-4-31b.md>), [glm](<https://devfeed.tech/tags/glm.md>), [glm-5-3](<https://devfeed.tech/tags/glm-5-3.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-clusters](<https://devfeed.tech/tags/gpu-clusters.md>), [india](<https://devfeed.tech/tags/india.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kimi](<https://devfeed.tech/tags/kimi.md>), [kimi-k3](<https://devfeed.tech/tags/kimi-k3.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [models](<https://devfeed.tech/tags/models.md>), [open](<https://devfeed.tech/tags/open.md>), [staff](<https://devfeed.tech/tags/staff.md>), [tech-news](<https://devfeed.tech/tags/tech-news.md>), [technology](<https://devfeed.tech/tags/technology.md>), [token](<https://devfeed.tech/tags/token.md>), [token-factory](<https://devfeed.tech/tags/token-factory.md>)

## AI overview

Sarvam Token Factory serves Sarvam and open-weight models from GPU clusters in India through one OpenAI-compatible API; enterprises can also request on-premise deployment. The launch lists eight models, with shared endpoints for pay-as-you-go access and provisioned throughput required for some models. Its stack separates prefill and decode GPU pools and uses cache-aware routing and a shared cache. Sarvam reports performance gains from caching and other optimizations, including fitting Sarvam 105B on one B200 per replica. Its self-reported benchmarks show advantages in several tested cases, such as Kimi K3.1 Pro throughput versus InferenceX, but Together reports faster first-token latency and streaming on DeepSeek V4.1 Flash. Introductory prices run through 2026; provisioned model rates are not published in the excerpt.

## Source excerpt

Sarvam Token Factory is now open to everyone. It serves Sarvam 105B, GLM 5.3, DeepSeek V4.1 Flash, Kimi K3.1 Pro and Gemma 4 31B from GPU clusters in India through one OpenAI-compatible API. The post Sarvam Launches Sarvam Token Factory: Bringing India-Hosted Inference to 8 Open Models appeared first on MarkTechPost.