# Gemma 4 on AI Gateway

DevFeed: [Gemma 4 on AI Gateway](<https://devfeed.tech/articles/gemma-4-on-ai-gateway-948.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/gemma-4-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-04-02T07:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [api](<https://devfeed.tech/tags/api.md>), [cost](<https://devfeed.tech/tags/cost.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [gemma](<https://devfeed.tech/tags/gemma.md>), [google](<https://devfeed.tech/tags/google.md>), [inference](<https://devfeed.tech/tags/inference.md>), [json](<https://devfeed.tech/tags/json.md>), [latency](<https://devfeed.tech/tags/latency.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [moe](<https://devfeed.tech/tags/moe.md>), [observability](<https://devfeed.tech/tags/observability.md>), [routing](<https://devfeed.tech/tags/routing.md>), [vercel](<https://devfeed.tech/tags/vercel.md>), [vision](<https://devfeed.tech/tags/vision.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

## AI overview

Vercel AI Gateway now offers Google's Gemma 4 26B MoE and 31B Dense models. The release highlights model capabilities, tradeoffs between latency and output quality, and gateway features for routing, retries, usage, cost, and observability.

## Source excerpt

Gemma 4 26B (MoE) and 31B (Dense) from Google are now available on Vercel AI Gateway. Built on the same architecture as Gemini 3, both open models support function-calling, agentic workflows, structured JSON output, and system instructions. Both support up to 256K context, 140+ languages, and native vision. 26B (MoE): Activates only 3.8B of its 26B total parameters during inference, optimized for lower latency and faster tokens-per-second. 31B (Dense): All parameters are active during inference, targeting higher output quality. Better suited as a foundation for fine-tuning. To use Gemma 4, set model to google/gemma-4-31b-it or google/gemma-4-26b-a4b-it in the AI SDK. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, observability, Bring Your Own Key support, and intelligent provider routing with automatic retries. Learn more about AI Gateway, view the AI Gateway model leaderboard or try it in our model playground. Read more