# Chat completions endpoints

API endpoints for chat-completion requests that generate model responses, with support for streaming in documented implementations.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Perplexity Launches Orchestrator API for Failover and Model Routing

DevFeed: [Perplexity Launches Orchestrator API for Failover and Model Routing](<https://devfeed.tech/articles/perplexity-launches-orchestrator-api-for-failover-and-model-routing-144513.md>)

Original publisher: [Read original article](<https://www.marktechpost.com/2026/11/19/perplexity-orchestrator-api-failover-model-routing/>)

Author: Michal Sutter

Published: 2026-11-19T17:47:00Z

Content type: news

Language: en

Sources: [MarkTechPost](<https://devfeed.tech/sources/marktechpost.md>)

Topics: [Model Routing](<https://devfeed.tech/topics/model-routing.md>), [API](<https://devfeed.tech/topics/api.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>)

Tags: [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-shorts](<https://devfeed.tech/tags/ai-shorts.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [api](<https://devfeed.tech/tags/api.md>), [applications](<https://devfeed.tech/tags/applications.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [automatic](<https://devfeed.tech/tags/automatic.md>), [billing](<https://devfeed.tech/tags/billing.md>), [editors-pick](<https://devfeed.tech/tags/editors-pick.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [failover](<https://devfeed.tech/tags/failover.md>), [for-devs](<https://devfeed.tech/tags/for-devs.md>), [google](<https://devfeed.tech/tags/google.md>), [launches](<https://devfeed.tech/tags/launches.md>), [model](<https://devfeed.tech/tags/model.md>), [model-routing](<https://devfeed.tech/tags/model-routing.md>), [models](<https://devfeed.tech/tags/models.md>), [new-releases](<https://devfeed.tech/tags/new-releases.md>), [open](<https://devfeed.tech/tags/open.md>), [open-weight-models](<https://devfeed.tech/tags/open-weight-models.md>), [openai](<https://devfeed.tech/tags/openai.md>), [orchestrator](<https://devfeed.tech/tags/orchestrator.md>), [perplexity](<https://devfeed.tech/tags/perplexity.md>), [preview](<https://devfeed.tech/tags/preview.md>), [route](<https://devfeed.tech/tags/route.md>), [router](<https://devfeed.tech/tags/router.md>), [routing](<https://devfeed.tech/tags/routing.md>), [software-engineering](<https://devfeed.tech/tags/software-engineering.md>), [staff](<https://devfeed.tech/tags/staff.md>), [tech-news](<https://devfeed.tech/tags/tech-news.md>), [technology](<https://devfeed.tech/tags/technology.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>), [xai](<https://devfeed.tech/tags/xai.md>)

### AI overview

Perplexity Orchestrator provides one endpoint for OpenAI, Anthropic, Google, xAI, and open-weight models, accepting OpenAI Chat Completions and Responses plus Anthropic Messages requests. It selects a serving provider by availability, capacity, and latency; failover keeps the requested model fixed, retries provider errors, rate limits, and timeouts, and does not bill attempts that fail before producing output. Invalid or over-context requests are not retried, and users cannot select a deployment. The preview `perplexity/auto` router chooses among described routes, falling back to a default model when no route matches or routing fails. Perplexity reports a 63-task test where refusal routing raised completion from 38 to 41 tasks, with higher estimated cost; results may vary by workload. Requests use the answering model's published token rate, with no additional platform fee, while model access depends on cumulative credit purchases. The excerpt reports reliability comparisons without success-rate percentages and describes provider speed differences.

### Source excerpt

Perplexity's Orchestrator API serves OpenAI, Anthropic, Google, xAI and open-weight models through 1 endpoint, with same-model provider failover, unified billing and a preview perplexity/auto router that sends each request to a described route. The post Perplexity Launches Orchestrator API for Failover and Model Routing appeared first on MarkTechPost.

## AI Gateway now supports Private Inference

DevFeed: [AI Gateway now supports Private Inference](<https://devfeed.tech/articles/ai-gateway-now-supports-private-inference-136322.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/ai-gateway-now-supports-private-inference>)

Author: Jerilyn Zheng

Published: 2026-11-16T07:47:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [inference-providers](<https://devfeed.tech/topics/inference-providers.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [Model Routing](<https://devfeed.tech/topics/model-routing.md>), [Self Hosted AI Tools](<https://devfeed.tech/topics/self-hosted-ai-tools.md>), [Cryptography](<https://devfeed.tech/topics/cryptography.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>)

Tags: [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [apis](<https://devfeed.tech/tags/apis.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [chat](<https://devfeed.tech/tags/chat.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [inference](<https://devfeed.tech/tags/inference.md>), [logs](<https://devfeed.tech/tags/logs.md>), [messages](<https://devfeed.tech/tags/messages.md>), [model](<https://devfeed.tech/tags/model.md>), [monitor](<https://devfeed.tech/tags/monitor.md>), [observability](<https://devfeed.tech/tags/observability.md>), [private](<https://devfeed.tech/tags/private.md>), [reporting](<https://devfeed.tech/tags/reporting.md>), [responses](<https://devfeed.tech/tags/responses.md>), [sdks](<https://devfeed.tech/tags/sdks.md>), [time-to-first-token](<https://devfeed.tech/tags/time-to-first-token.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [trace](<https://devfeed.tech/tags/trace.md>), [traffic](<https://devfeed.tech/tags/traffic.md>)

### AI overview

Vercel AI Gateway's Private Inference lets teams route fine-tuned, self-hosted, or prerelease models through the same authentication, SDKs, APIs, and observability used for catalog models. Add an endpoint as a private provider with its base URL, API format, and credentials, then register its models; setup is also available through Vercel CLI 65.16.0 or later. Requests use a `private/<slug>` model ID through Chat Completions, Responses, or Messages, with AI Gateway translating requests to the endpoint's format. Private models are limited to the Vercel team and excluded from the public catalog; credentials are encrypted, and Zero Data Retention can be enabled per provider. Logs and reporting include private model traffic, with charts for requests, tokens, and time to first token. A catalog model can be configured as a fallback if a private endpoint fails. The excerpt points to documentation for supported model types, requirements, and billing details.

### Source excerpt

Private Inference connects your own model endpoints to AI Gateway. Enterprises running fine-tuned, self-hosted, or prerelease models used to need separate keys, client code, and logs for them. Those models can now run through the same authentication, SDKs and APIs, and observability as catalog models, so every model your team uses is managed in one place. Use Private Inference to: Switch between private and catalog models: Call private models through Chat Completions, Responses, or Messages. AI Gateway translates each request to your endpoint's format, so switching only changes the model ID. Keep models scoped to your team: Only your Vercel team can view or call private models, and they aren't listed in the public catalog. Credentials are stored encrypted, and you can enable Zero Data Retention per provider. Connect coding agents: Use private models in Claude Code, Codex, Cursor, and other coding agents connected to AI Gateway. Monitor traffic together: View private model requests alongside catalog traffic in logs, trace drains, and custom reporting. Observability charts break down requests, tokens, and time to first token by private model. Configure fallbacks: Optionally fall back to a catalog model if your private endpoint fails. To get started, open the Private Inference page and add your endpoint as a private provider. Enter its base URL, select its API format, and add its credentials. Then add the models it serves. You can also register the provider and model with the Vercel CLI, version 65.16.0 or later: Call the model using its private/<slug> ID: Private model requests appear in AI Gateway logs alongside requests to catalog models. type: embedded-entry-inline id: 1GzjEiRrj3NaTriLhtBYIX Read the Private Inference documentation for supported model types, requirements, and billing details. Read more

## Introducing Kimi K3.1 Pro on Amazon Bedrock

DevFeed: [Introducing Kimi K3.1 Pro on Amazon Bedrock](<https://devfeed.tech/articles/introducing-kimi-k3-1-pro-on-amazon-bedrock-127754.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/introducing-kimi-k3-1-pro-on-amazon-bedrock/>)

Author: Aris Tsakpinis

Published: 2026-11-11T01:07:19Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [coding assistant](<https://devfeed.tech/topics/coding-assistant.md>), [prompt](<https://devfeed.tech/topics/prompt.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [Amazon CloudWatch](<https://devfeed.tech/topics/amazon-cloudwatch.md>), [amazon](<https://devfeed.tech/topics/amazon.md>), [litellm](<https://devfeed.tech/topics/litellm.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apis](<https://devfeed.tech/tags/apis.md>), [bedrock](<https://devfeed.tech/tags/bedrock.md>), [caching](<https://devfeed.tech/tags/caching.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-assistant](<https://devfeed.tech/tags/coding-assistant.md>), [foundational-100](<https://devfeed.tech/tags/foundational-100.md>), [inference](<https://devfeed.tech/tags/inference.md>), [k3](<https://devfeed.tech/tags/k3.md>), [kimi](<https://devfeed.tech/tags/kimi.md>), [kimi-k3](<https://devfeed.tech/tags/kimi-k3.md>), [kimi-k3-1-pro](<https://devfeed.tech/tags/kimi-k3-1-pro.md>), [moonshot](<https://devfeed.tech/tags/moonshot.md>), [moonshot-ai](<https://devfeed.tech/tags/moonshot-ai.md>), [openai](<https://devfeed.tech/tags/openai.md>), [opencode](<https://devfeed.tech/tags/opencode.md>), [optimize](<https://devfeed.tech/tags/optimize.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [prompt-caching](<https://devfeed.tech/tags/prompt-caching.md>)

### AI overview

Kimi K3.1 Pro Highspeed is available on Amazon Bedrock through Chat Completions, Responses, Converse, and Invoke APIs. The article recommends Chat Completions and the lower-cost global inference profile for most workloads; US and India profiles keep processing within those regions. Reduce response time and output tokens on simpler tasks by setting reasoning effort to low or high instead of the max default. Flex costs half the Standard price but can take longer, and on-demand quota is shared across tiers. Explicit prompt caching can reduce latency and input cost for repeated context on Chat Completions, Responses, and Invoke, but not Converse; stable content must reach 256 tokens, and cache writes cost more while reads are discounted. The article also explains connecting OpenCode through Bedrock's Chat Completions provider. AWS data-boundary processing, no sharing with Moonshot AI, and zero data retention are stated.

### Source excerpt

Kimi K3.1 Pro from Moonshot AI is now available on Amazon Bedrock. Learn how to get started through the OpenAI-compatible Chat Completions, Responses, and Converse APIs, optimize inference with explicit prompt caching, and use the model as a coding assistant in OpenCode.

## Claude Fable 5.2 now available on AI Gateway

DevFeed: [Claude Fable 5.2 now available on AI Gateway](<https://devfeed.tech/articles/claude-fable-5-2-now-available-on-ai-gateway-123932.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/claude-fable-5-2-now-available-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-11-09T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [Claude](<https://devfeed.tech/topics/claude.md>), [anthropic](<https://devfeed.tech/topics/anthropic.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [api](<https://devfeed.tech/tags/api.md>), [biology](<https://devfeed.tech/tags/biology.md>), [classifiers](<https://devfeed.tech/tags/classifiers.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [claude-fable](<https://devfeed.tech/tags/claude-fable.md>), [claude-fable-5-2](<https://devfeed.tech/tags/claude-fable-5-2.md>), [code](<https://devfeed.tech/tags/code.md>), [codex](<https://devfeed.tech/tags/codex.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agent](<https://devfeed.tech/tags/coding-agent.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cursor](<https://devfeed.tech/tags/cursor.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [data-retention](<https://devfeed.tech/tags/data-retention.md>), [effort](<https://devfeed.tech/tags/effort.md>), [error](<https://devfeed.tech/tags/error.md>)

### AI overview

Anthropic's Claude Fable 5.2 is available through AI Gateway for open-ended technical work, with stated improvements in coding, reasoning, and vision over earlier Fable models. The text says it can handle long, ambiguous tasks unattended, delegate simpler work to smaller models, or advise other Claude models. Reasoning effort ranges from low to max, with high as the API default. Cybersecurity and biology classifiers are enabled. Access requires data retention: prompts and completions are retained for 30 days and not used to train Claude; requests are rejected if Zero Data Retention is enabled. To handle requests declined by the cybersecurity classifier, configure a `models` array in `providerOptions.gateway`; AI Gateway tries the listed models in order, as in the example using Opus 5.5 followed by Sonnet 5.5. The model is available via the AI SDK, Chat Completions, Responses, Anthropic Messages, and coding agents connected through AI Gateway.

### Source excerpt

Claude Fable 5.2 from Anthropic is now available on AI Gateway. Fable 5.2 is built for open-ended technical work and improves on earlier Fable models in coding, reasoning, and vision. It can run long, ambiguous tasks unattended, and works as an orchestrator that hands simpler tasks to smaller models, or as an advisor that other Claude models consult on harder problems. It also communicates more clearly and generates output faster than earlier Fable models. Effort runs from low to max, with high as the API default. Fable 5.2 has cybersecurity and biology safety classifiers enabled. Access to Claude Fable 5.2 requires data retention. Anthropic does not support Zero Data Retention for the model. Prompts and completions are retained for 30 days and are not used to train Claude. If your team has ZDR turned on, AI Gateway returns an error instead of sending the request to Fable 5.2. To keep requests served when a classifier is triggered, use model fallbacks. Add a models array to providerOptions.gateway, and AI Gateway tries each model in order when the cybersecurity classifier declines a request. Call it through the AI SDK, the Chat Completions, Responses, and Anthropic Messages APIs, or a coding agent connected to AI Gateway. Use anthropic/claude-fable-5.2 as the model name: This request falls back to Opus 5.5, then Sonnet 5.5, if the cybersecurity classifier declines it. The models option works the same way on every AI Gateway API format. To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup: Try Claude Fable 5.2 in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, inclu

## Kimi K3.1 Pro now has more ZDR providers on AI Gateway

DevFeed: [Kimi K3.1 Pro now has more ZDR providers on AI Gateway](<https://devfeed.tech/articles/kimi-k3-1-pro-now-has-more-zdr-providers-on-ai-gateway-117141.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/kimi-k3-1-pro-now-has-more-zdr-providers-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-11-04T17:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [litellm](<https://devfeed.tech/topics/litellm.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>)

Tags: [3d-modeling](<https://devfeed.tech/tags/3d-modeling.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-sdk](<https://devfeed.tech/tags/ai-sdk.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [api](<https://devfeed.tech/tags/api.md>), [apis](<https://devfeed.tech/tags/apis.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cost](<https://devfeed.tech/tags/cost.md>), [failover](<https://devfeed.tech/tags/failover.md>), [financial](<https://devfeed.tech/tags/financial.md>), [image](<https://devfeed.tech/tags/image.md>), [input](<https://devfeed.tech/tags/input.md>), [install](<https://devfeed.tech/tags/install.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [k3](<https://devfeed.tech/tags/k3.md>), [kimi](<https://devfeed.tech/tags/kimi.md>), [kimi-k3-1-pro](<https://devfeed.tech/tags/kimi-k3-1-pro.md>), [providers](<https://devfeed.tech/tags/providers.md>)

### AI overview

Kimi K3.1 Pro and K3.1 Pro Highspeed are available through AI Gateway from additional ZDR providers; Moonshot AI had previously been the only provider serving them. Both models accept image input and have a 1M-token context window. The text highlights coding, 3D modeling, and financial analysis, and says Highspeed is suited to interactive work where response time matters. They can be called through the AI SDK, Chat Completions, Responses, Anthropic Messages, or connected coding agents. ZDR can be required per request with the gateway provider option or for all team requests through dashboard settings. When enabled, routing is limited to providers with a ZDR agreement, and requests fail if none is available for the model.

### Source excerpt

Kimi K3.1 Pro and its higher-speed version, Kimi K3.1 Pro Highspeed, are now available on AI Gateway from more Zero Data Retention (ZDR) providers. Until today, Moonshot AI was the only provider serving either model. K3.1 Pro improves on earlier Kimi models in coding, 3D modeling, and financial analysis, and can carry long agent runs from a small fix to a full project. Both models have a 1M-token context window and accept image input, and Highspeed suits interactive work like coding agents, where response time matters. Call either model through the AI SDK, the Chat Completions, Responses, and Anthropic Messages APIs, or a coding agent connected to AI Gateway. For Highspeed, use moonshotai/kimi-k3.1-pro-highspeed in place of the model name below. Use moonshotai/kimi-k3.1-pro as the model name: Setting zeroDataRetention in the gateway provider options requires ZDR for that request. To require it for every request your team sends, including requests from coding agents, turn on ZDR in the AI Gateway dashboard settings. With either one on, AI Gateway routes only to providers with a ZDR agreement. If none is available for the model, the request fails instead of going to a provider without one. To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select moonshotai/kimi-k3.1-pro or moonshotai/kimi-k3.1-pro-highspeed in the agent. See the coding agents guide for details. Try Kimi K3.1 Pro in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all language models available on AI Gateway. Read more

## GPT-6.1 Terra now available on AI Gateway

DevFeed: [GPT-6.1 Terra now available on AI Gateway](<https://devfeed.tech/articles/gpt-6-1-terra-now-available-on-ai-gateway-100784.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/gpt-6-1-terra-now-available-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-10-26T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [OpenAI](<https://devfeed.tech/topics/openai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [litellm](<https://devfeed.tech/topics/litellm.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>), [codex](<https://devfeed.tech/topics/codex.md>), [cursor](<https://devfeed.tech/topics/cursor.md>)

Tags: [accounting](<https://devfeed.tech/tags/accounting.md>), [accounting-software](<https://devfeed.tech/tags/accounting-software.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-sdk](<https://devfeed.tech/tags/ai-sdk.md>), [api](<https://devfeed.tech/tags/api.md>), [api-keys](<https://devfeed.tech/tags/api-keys.md>), [bring-your-own-key](<https://devfeed.tech/tags/bring-your-own-key.md>), [caching](<https://devfeed.tech/tags/caching.md>), [chat](<https://devfeed.tech/tags/chat.md>), [cli](<https://devfeed.tech/tags/cli.md>), [codex](<https://devfeed.tech/tags/codex.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [coding-tasks](<https://devfeed.tech/tags/coding-tasks.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [gpt-6-1](<https://devfeed.tech/tags/gpt-6-1.md>), [gpt-6-1-terra](<https://devfeed.tech/tags/gpt-6-1-terra.md>)

### AI overview

OpenAI's GPT-6.1 Terra is available through AI Gateway for visual reasoning, computer use, writing, and high-volume document or desktop workflows. The text says it improves on the previous Terra model in visual reasoning, factual accuracy, and coding, but recommends larger GPT-6 models for the most complex coding tasks. It accepts text and images, returns text, and has a context window exceeding 1M tokens; supported features include configurable reasoning effort, structured outputs, tool calling, and prompt caching. Latency-sensitive use can select `openai/gpt-6.1-terra-fast`. Integration options include the AI SDK, Chat Completions API, Responses API, and connected coding agents. For Codex, Cursor, and others, the text instructs users to run `npx vercel ai-gateway setup` and select `openai/gpt-6.1-terra`. AI Gateway offers usage and cost tracking, retries, failover, routing, reporting, Zero Data Retention support, and API-key budgets. It says pricing matches providers with no markup or platform inference fee, including BYOK requests.

### Source excerpt

GPT-6.1 Terra from OpenAI is now available on AI Gateway. GPT-6.1 Terra is a fast model for visual reasoning, computer use, and writing, and it improves on the previous Terra model in visual reasoning, factual accuracy, and coding. It suits high-volume work in documents and desktop apps, such as filling out forms, interpreting technical drawings, or entering invoice details into accounting software. OpenAI still recommends its larger GPT-6 models for the most complex coding tasks. The model accepts text and images and returns text, with a context window of more than 1M tokens. It supports configurable reasoning effort, structured outputs, tool calling, and implicit and explicit prompt caching. For latency-sensitive work, fast mode is available as openai/gpt-6.1-terra-fast. GPT-6.1 Terra works with the AI SDK, the OpenAI-compatible Chat Completions API, the Responses API, and coding agents connected to AI Gateway. Use openai/gpt-6.1-terra as the model name: To use it in Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select openai/gpt-6.1-terra in the agent. See the coding agents guide for details. Try GPT-6.1 Terra in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all language models available on AI Gateway. Read more

## Fireworks AI API from an Agent

DevFeed: [Fireworks AI API from an Agent](<https://devfeed.tech/articles/fireworks-ai-api-from-an-agent-98750.md>)

Original publisher: [Read original article](<https://www.swytchcode.com/content/fireworks-api-ai-agent>)

Author: Chaitrali Kakde

Published: 2026-10-24T06:00:00Z

Content type: tutorial

Language: en

Sources: [Swytchcode](<https://devfeed.tech/sources/swytchcode.md>)

Topics: [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [LLM observability](<https://devfeed.tech/topics/llm-observability.md>), [API Logging](<https://devfeed.tech/topics/api-logging.md>), [API Governance](<https://devfeed.tech/topics/api-governance.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [API](<https://devfeed.tech/topics/api.md>), [AI agent hallucinations](<https://devfeed.tech/topics/ai-agent-hallucinations.md>), [Multi-step AI processes](<https://devfeed.tech/topics/multi-step-ai-processes.md>)

Tags: [account](<https://devfeed.tech/tags/account.md>), [accounting](<https://devfeed.tech/tags/accounting.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-integration](<https://devfeed.tech/tags/agent-integration.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-api](<https://devfeed.tech/tags/ai-api.md>), [api](<https://devfeed.tech/tags/api.md>), [api-key](<https://devfeed.tech/tags/api-key.md>), [argument](<https://devfeed.tech/tags/argument.md>), [arguments](<https://devfeed.tech/tags/arguments.md>), [audit](<https://devfeed.tech/tags/audit.md>), [bill](<https://devfeed.tech/tags/bill.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [fireworks-ai](<https://devfeed.tech/tags/fireworks-ai.md>), [model](<https://devfeed.tech/tags/model.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [routing](<https://devfeed.tech/tags/routing.md>), [token](<https://devfeed.tech/tags/token.md>)

### AI overview

Fireworks' chat completions API largely follows OpenAI conventions, but its default `context_length_exceeded_behavior: "truncate"` can return a successful answer after silently cutting an overlong prompt. Set it to `"error"` and handle failures. Model identifiers use full `accounts/fireworks/models/<model-name>` paths. For spend tracking, log usage per call: `prompt_tokens` and `total_tokens` are required, `completion_tokens` may be absent, and streaming includes usage by default. The excerpt recommends setting `max_tokens`, denying calls above a policy threshold, pinning allowed models, and excluding quota-update methods from the agent's allowlist. Retries can incur additional charges; rate limits receive exponential backoff, while a retry ceiling and caching identical requests are suggested. The excerpt also describes audit logs for calls and policy denials.

### Source excerpt

When your agent calls another model, a model is deciding your token spend. Fireworks routing, the truncate default that silently eats your prompt, and how to cap the bill.

## Usage metrics API adds usage from tools like OpenCode

DevFeed: [Usage metrics API adds usage from tools like OpenCode](<https://devfeed.tech/articles/usage-metrics-api-adds-usage-from-tools-like-opencode-98584.md>)

Original publisher: [Read original article](<https://github.blog/changelog/2026-10-23-usage-metrics-api-adds-usage-from-tools-like-opencode>)

Author: Allison

Published: 2026-10-23T23:42:03Z

Content type: release

Language: en

Sources: [GitHub Changelog](<https://devfeed.tech/sources/github-changelog.md>)

Topics: [API](<https://devfeed.tech/topics/api.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>)

Tags: [account-management](<https://devfeed.tech/tags/account-management.md>), [api](<https://devfeed.tech/tags/api.md>), [copilot](<https://devfeed.tech/tags/copilot.md>), [enterprise-management-tools](<https://devfeed.tech/tags/enterprise-management-tools.md>), [improvement](<https://devfeed.tech/tags/improvement.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [opencode](<https://devfeed.tech/tags/opencode.md>), [tools](<https://devfeed.tech/tags/tools.md>)

### AI overview

The Copilot usage metrics API adds `totals_by_client` to enterprise, organization, and user reports covering 1-day and 28-day periods. It groups successful model calls by the client tool and reports request counts, distinct sessions, token usage, and per-model breakdowns, including whether model selection was user-, auto-, or product-selected. This captures Copilot model traffic from tools such as OpenCode that may not send editor telemetry, and differs from agent app activity, which counts jobs started by agent apps. Access requires the Copilot usage metrics policy to be enabled and an eligible owner, billing manager, or role with `View Copilot Metrics`. Treat client labels as best-effort integration IDs; request counts measure model calls, not prompts. Code review models appear as `unknown`, and some selection modes or unrecognized clients are grouped as `other`. The addition is backward compatible, with an empty array when there is no usage.

### Source excerpt

The Copilot usage metrics API now reports model usage from more of the tools your developers use with Copilot, including tools like OpenCode that weren't previously captured in your reports.... The post Usage metrics API adds usage from tools like OpenCode appeared first on The GitHub Blog.

## Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway

DevFeed: [Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway](<https://devfeed.tech/articles/kimi-k3-1-pro-and-kimi-k3-1-pro-highspeed-are-available-now-in-ai-gateway-98347.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/kimi-k3-1-pro-and-kimi-k3-1-pro-highspeed-are-available-now-in-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-10-23T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Finance](<https://devfeed.tech/topics/finance.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [3d-modeling](<https://devfeed.tech/tags/3d-modeling.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-tasks](<https://devfeed.tech/tags/agentic-tasks.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-sdk](<https://devfeed.tech/tags/ai-sdk.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [animation](<https://devfeed.tech/tags/animation.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [api](<https://devfeed.tech/tags/api.md>), [api-keys](<https://devfeed.tech/tags/api-keys.md>), [apis](<https://devfeed.tech/tags/apis.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [k3](<https://devfeed.tech/tags/k3.md>), [kimi](<https://devfeed.tech/tags/kimi.md>), [kimi-k3](<https://devfeed.tech/tags/kimi-k3.md>), [kimi-k3-1-pro](<https://devfeed.tech/tags/kimi-k3-1-pro.md>)

### AI overview

Moonshot AI's Kimi K3.1 Pro and faster Highspeed variant are available through AI Gateway. The excerpt says K3.1 Pro improves coding, 3D modeling, financial analysis, and agentic tasks over Kimi K3, while retaining a 1M-token context window and image input. It describes coding work from codebase fixes to full projects and long agent runs, plus linked financial models and research grounded in source documents. Both variants can be called through the AI SDK, Chat Completions, Responses, Anthropic Messages, or supported coding agents; the excerpt gives `npx vercel ai-gateway setup` for configuring agents and distinct model names for each variant. AI Gateway offers usage and cost tracking, retries, failover, routing, reporting, Zero Data Retention support, and API-key budgets. It states that pricing matches providers without markup or an inference platform fee, including BYOK. Broader provider support is expected after Moonshot's planned model-weight release by November 4.

### Source excerpt

Kimi K3.1 Pro from Moonshot AI is now available on AI Gateway, along with Kimi K3.1 Pro Highspeed, a faster version for interactive use. K3.1 Pro is the first model in Moonshot's K3.1 series. It builds on Kimi K3 with improvements in coding, 3D modeling, financial analysis, and agentic tasks, and keeps the 1M-token context window and image input. For coding, K3.1 Pro handles work ranging from small fixes in an existing codebase to building a full project, including long agent runs with many steps. It builds front-end pages and interactive scenes with stronger typography and animation than earlier Kimi models. In finance, it can carry a task from start to finish, such as building a linked financial model with adjustable assumptions and scenarios, or writing research grounded in source documents. K3.1 Pro makes fewer factual errors than earlier Kimi models on difficult prompts. Moonshot AI plans to release the model weights by November 4: support for more providers will follow. Call either model through the AI SDK, the Chat Completions, Responses, and Anthropic Messages APIs, or a coding agent connected to AI Gateway. For Highspeed, use moonshotai/kimi-k3.1-pro-highspeed in place of the model name below. Use moonshotai/kimi-k3.1-pro as the model name: To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select moonshotai/kimi-k3.1-pro or moonshotai/kimi-k3.1-pro-highspeed in the agent. See the coding agents guide for details. Try Kimi K3.1 Pro in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all la

## Getting started with GLM-5.3 on Runpod's public endpoint

DevFeed: [Getting started with GLM-5.3 on Runpod's public endpoint](<https://devfeed.tech/articles/getting-started-with-glm-5-3-on-runpod-s-public-endpoint-96404.md>)

Original publisher: [Read original article](<https://www.runpod.io/blog/getting-started-glm-5-3-runpod-public-endpoint>)

Author: Jessica Garson Beauchemin

Published: 2026-10-22T21:40:55Z

Content type: tutorial

Language: en

Sources: [Runpod Blog.](<https://devfeed.tech/sources/runpod-blog.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [cURL](<https://devfeed.tech/topics/curl.md>), [client library](<https://devfeed.tech/topics/client-library.md>)

Tags: [ai-model](<https://devfeed.tech/tags/ai-model.md>), [api](<https://devfeed.tech/tags/api.md>), [api-key](<https://devfeed.tech/tags/api-key.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [curl](<https://devfeed.tech/tags/curl.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [explore](<https://devfeed.tech/tags/explore.md>), [getting-started](<https://devfeed.tech/tags/getting-started.md>), [glm](<https://devfeed.tech/tags/glm.md>), [glm-5-3](<https://devfeed.tech/tags/glm-5-3.md>), [header](<https://devfeed.tech/tags/header.md>), [hub](<https://devfeed.tech/tags/hub.md>), [openai](<https://devfeed.tech/tags/openai.md>), [playground](<https://devfeed.tech/tags/playground.md>), [public](<https://devfeed.tech/tags/public.md>), [python](<https://devfeed.tech/tags/python.md>), [sdk](<https://devfeed.tech/tags/sdk.md>)

### AI overview

GLM-5.3 is available through Runpod's public endpoints at listed rates of $0.77 per million input tokens, $0.143 per million cached input tokens, and $2.42 per million output tokens. The excerpt shows three ways to try it: configure messages and sampling options in the Playground; submit a curl request to `/run` and poll `/status/{job_id}` until completion; or make a single chat-completions call with the OpenAI SDK using Runpod's `/openai/v1` base URL. Both code examples require a Runpod API key, and the curl example also uses `jq`. The SDK example can stream response chunks with `stream=True`. The text describes the pricing as more competitive than competitors' but provides no comparison figures.

### Source excerpt

GLM-5.3 is now on Runpod's public endpoints at a lower price than elsewhere. Try it in the Playground, call it with curl, or use the OpenAI SDK in Python.

## How to Run Basaran on Runpod: An OpenAI API Alternative

DevFeed: [How to Run Basaran on Runpod: An OpenAI API Alternative](<https://devfeed.tech/articles/how-to-run-basaran-on-runpod-an-openai-api-alternative-94572.md>)

Original publisher: [Read original article](<https://www.runpod.io/blog/run-basaran-on-runpod>)

Author: Madiator2011

Published: 2026-10-22T02:42:59Z

Content type: tutorial

Language: en

Sources: [Runpod Blog.](<https://devfeed.tech/sources/runpod-blog.md>)

Topics: [Documentation](<https://devfeed.tech/topics/documentation.md>), [open-responses](<https://devfeed.tech/topics/open-responses.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [API](<https://devfeed.tech/topics/api.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [environment-variables](<https://devfeed.tech/tags/environment-variables.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [http](<https://devfeed.tech/tags/http.md>), [model](<https://devfeed.tech/tags/model.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openai](<https://devfeed.tech/tags/openai.md>), [openai-api](<https://devfeed.tech/tags/openai-api.md>), [pod](<https://devfeed.tech/tags/pod.md>), [proxy](<https://devfeed.tech/tags/proxy.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [template](<https://devfeed.tech/tags/template.md>), [text-generation](<https://devfeed.tech/tags/text-generation.md>)

### AI overview

Basaran, an open-source alternative to the OpenAI text completion API, can be launched on Runpod using its predefined template: create a pod and let it pull the image. The default model is `bigscience/bloomz-560m`; to use another, change the pod's `MODEL` environment variable to a valid model identifier compatible with Basaran, then reset the pod to apply the change. Once it is running, connect over HTTP on port 80 to use the interface, or append `/v1/completions` to the proxy URL for API access.

### Source excerpt

Learn how to deploy Basaran, an open-source text generation API, on Runpod using a prebuilt template. Customize the model via environment variables and.

## US Bans DeepSeek From Government Use

DevFeed: [US Bans DeepSeek From Government Use](<https://devfeed.tech/articles/us-bans-deepseek-from-government-use-91247.md>)

Original publisher: [Read original article](<https://yro.slashdot.org/story/26/10/20/0546213/us-bans-deepseek-from-government-use>)

Author: BeauHD

Published: 2026-10-20T16:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [shadow AI](<https://devfeed.tech/topics/shadow-ai.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>)

Tags: [administration](<https://devfeed.tech/tags/administration.md>), [agencies](<https://devfeed.tech/tags/agencies.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-services](<https://devfeed.tech/tags/ai-services.md>), [api](<https://devfeed.tech/tags/api.md>), [apis](<https://devfeed.tech/tags/apis.md>), [bbc](<https://devfeed.tech/tags/bbc.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [federal-agencies](<https://devfeed.tech/tags/federal-agencies.md>), [gateways](<https://devfeed.tech/tags/gateways.md>), [government](<https://devfeed.tech/tags/government.md>), [models](<https://devfeed.tech/tags/models.md>), [openrouter](<https://devfeed.tech/tags/openrouter.md>), [order](<https://devfeed.tech/tags/order.md>), [products-and-services](<https://devfeed.tech/tags/products-and-services.md>), [providers](<https://devfeed.tech/tags/providers.md>), [security](<https://devfeed.tech/tags/security.md>), [services](<https://devfeed.tech/tags/services.md>), [us](<https://devfeed.tech/tags/us.md>)

### AI overview

The administration has ordered most US civilian federal agencies to remove DeepSeek and affiliated products, as well as third-party products and services developed using DeepSeek implementations. The excerpt says the order leaves "developed using" unclear, complicating compliance. OpenRouter routes requests to the provider it considers the best fit, and Vercel AI Gateway does the same by default; agencies using such gateways could therefore reach DeepSeek models unless they constrain providers. The Department of Homeland Security did not specify the security threats behind the decision.

### Source excerpt

The Trump administration has banned DeepSeek AI from most US civilian federal agencies, ordering the removal of the Chinese company's models and technology developed using them. The Department of Homeland Security did not specify the security threats behind the decision. The BBC reports: The order (PDF) is broad, as it requires agencies to ditch "all DeepSeek and DeepSeek-affiliate products, and third-party products and services developed using DeepSeek implementations." Complying will be tricky as it is not clear which third-party products and services have been developed using DeepSeek's wares. Nor is it clear whether "developed using" means providing ongoing access to DeepSeek models via API or simply refers to any app vibe-coded with the help of DeepSeek. It also leaves open the question of AI gateways. Services such as OpenRouter and Vercel AI Gateway make DeepSeek's models available through APIs. And those using gateway services may find themselves using DeepSeek models without meaning to do so. OpenRouter, for example, "routes requests to the best available providers for your model." It selects what the service deems to be the best fit provider of AI services. Vercel AI Gateway does the same by default. So federal civilian agencies could be using DeepSeek models inadvertently, if they haven't taken steps to constrain their AI providers. Read more of this story at Slashdot.

## MiniMax M3.1 Flash now available on AI Gateway for free

DevFeed: [MiniMax M3.1 Flash now available on AI Gateway for free](<https://devfeed.tech/articles/minimax-m3-1-flash-now-available-on-ai-gateway-for-free-89978.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/minimax-m3-1-flash-now-available-on-ai-gateway-for-free>)

Author: Jerilyn Zheng

Published: 2026-10-19T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [Tool](<https://devfeed.tech/topics/tool.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>)

Tags: [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [minimax](<https://devfeed.tech/tags/minimax.md>)

### AI overview

MiniMax M3.1 Flash is available through Vercel AI Gateway for free until Oct 22 when MiniMax serves the request. The open-weight multimodal model supports coding and agentic work with a 1M-token context window. The announcement provides SDK usage and coding-agent setup instructions, and explains that pinned requests switch to MiniMax's standard rate after the offer ends.

### Source excerpt

MiniMax M3.1 Flash from MiniMax is now available on AI Gateway for free until Oct 22. MiniMax M3.1 Flash is an open-weight multimodal model for coding and agentic work, with a 1M-token context window for long documents and multi-step agent sessions. Compared with earlier MiniMax models, M3.1 Flash improves on complex agentic tasks, coding, and cybersecurity. On the agent side, that covers multi-step business processes and computer use that carries a task from one application to the next. For coding, MiniMax reports its best results on application development, particularly frontend interactions, targeted bug fixes, and component tests. The free rate applies only when MiniMax serves the request. To make sure it does, sort the provider with order in the gateway provider options. After the offer ends, pinned requests bill at MiniMax's standard rate. Call it through the AI SDK, the Chat Completions, Responses, and Anthropic Messages APIs, or a coding agent connected to AI Gateway. Use minimax/minimax-m3.1-flash as the model name: To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select minimax/minimax-m3.1-flash in the agent. See the coding agents guide for details. Try MiniMax M3.1 Flash in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all language models available on AI Gateway. Read more

## DeepSeek Just Released V4.1-Flash-1017, Scores 77.0 on DeepSWE, Opens Search API

DevFeed: [DeepSeek Just Released V4.1-Flash-1017, Scores 77.0 on DeepSWE, Opens Search API](<https://devfeed.tech/articles/deepseek-just-released-v4-1-flash-1017-scores-77-0-on-deepswe-opens-search-api-89247.md>)

Original publisher: [Read original article](<https://www.marktechpost.com/2026/10/17/deepseek-just-released-v4-1-flash-1017-scores-77-0-on-deepswe-opens-search-api/>)

Author: Asif Razzaq

Published: 2026-10-17T08:53:58Z

Content type: news

Language: en

Sources: [MarkTechPost](<https://devfeed.tech/sources/marktechpost.md>)

Topics: [DeepSeek Harness](<https://devfeed.tech/topics/dsh.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>)

Tags: [agent-harness](<https://devfeed.tech/tags/agent-harness.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-paper-summary](<https://devfeed.tech/tags/ai-paper-summary.md>), [ai-shorts](<https://devfeed.tech/tags/ai-shorts.md>), [api](<https://devfeed.tech/tags/api.md>), [applications](<https://devfeed.tech/tags/applications.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-opus-5](<https://devfeed.tech/tags/claude-opus-5.md>), [code](<https://devfeed.tech/tags/code.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [deepseek-v4-1-flash](<https://devfeed.tech/tags/deepseek-v4-1-flash.md>), [deepseek-v4-1-flash-1017](<https://devfeed.tech/tags/deepseek-v4-1-flash-1017.md>), [deepswe-v1-1](<https://devfeed.tech/tags/deepswe-v1-1.md>), [editors-pick](<https://devfeed.tech/tags/editors-pick.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [new-releases](<https://devfeed.tech/tags/new-releases.md>), [release](<https://devfeed.tech/tags/release.md>), [search](<https://devfeed.tech/tags/search.md>), [search-api](<https://devfeed.tech/tags/search-api.md>), [staff](<https://devfeed.tech/tags/staff.md>), [tech-news](<https://devfeed.tech/tags/tech-news.md>), [technology](<https://devfeed.tech/tags/technology.md>)

### AI overview

DeepSeek released V4.1-Flash-1017, a post-training checkpoint aimed at coding and agent workflows, and opened its Search and Fetch APIs to developers. The article reports DeepSeek's benchmark results, model architecture and pricing, along with API endpoints and usage limits. It notes that the model leads on some reported benchmarks while Claude Opus 5 leads on others.

### Source excerpt

DeepSeek has just released DeepSeek-V4.1-Flash-1017, a new checkpoint of its V4.1-Flash model. It is live on the DeepSeek website, app and API. DeepSeek claims stronger scores, faster task completion and shorter outputs than the September V4.1-Flash release. The company calls it a Pareto improvement in performance and cost. Alongside it, DeepSeek opened its Search and [...] The post DeepSeek Just Released V4.1-Flash-1017, Scores 77.0 on DeepSWE, Opens Search API appeared first on MarkTechPost.

## Muse Spark Open now available on AI Gateway

DevFeed: [Muse Spark Open now available on AI Gateway](<https://devfeed.tech/articles/muse-spark-open-now-available-on-ai-gateway-88227.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/muse-spark-open-now-available-on-ai-gateway>)

Author: Zachary Chen

Published: 2026-10-15T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [Claude](<https://devfeed.tech/topics/claude.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [open-responses](<https://devfeed.tech/topics/open-responses.md>), [codex](<https://devfeed.tech/topics/codex.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-workflows](<https://devfeed.tech/tags/agentic-workflows.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-sdk](<https://devfeed.tech/tags/ai-sdk.md>), [api](<https://devfeed.tech/tags/api.md>), [cli](<https://devfeed.tech/tags/cli.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [context](<https://devfeed.tech/tags/context.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [data-retention](<https://devfeed.tech/tags/data-retention.md>), [failover](<https://devfeed.tech/tags/failover.md>), [keys](<https://devfeed.tech/tags/keys.md>), [muse-spark](<https://devfeed.tech/tags/muse-spark.md>), [muse-spark-open](<https://devfeed.tech/tags/muse-spark-open.md>), [open](<https://devfeed.tech/tags/open.md>), [playground](<https://devfeed.tech/tags/playground.md>), [spark](<https://devfeed.tech/tags/spark.md>)

### AI overview

Vercel has added Meta's open-weight Muse Spark Open reasoning model to AI Gateway. The model targets coding and agentic workflows such as multi-file refactoring, debugging, and large-codebase analysis, with text and image input and a 1M-token context window. It is available through several API formats and coding agents, and AI Gateway provides usage and cost tracking, retries, failover, and related controls.

### Source excerpt

Muse Spark Open from Meta is now available on AI Gateway. The open-weight reasoning model is designed for coding and agentic workflows, including multi-file refactoring, debugging, and understanding large codebases. Muse Spark Open supports text and image input with a 1M-token context window, allowing agents to work with code and screenshots in the same request. It is available with ZDR and no training, without creating separate provider accounts. Use meta/muse-spark-open as the model name across all API formats and coding agents. The model is available across the AI SDK, the OpenAI-compatible Chat Completions and Responses APIs, the Anthropic-compatible Messages API, and coding agents connected to AI Gateway. To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select meta/muse-spark-open in the agent. See the coding agents guide for details. Try Muse Spark Open in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all language models available on AI Gateway. Read more

## Nano Banana 2.1 now available on AI Gateway

DevFeed: [Nano Banana 2.1 now available on AI Gateway](<https://devfeed.tech/articles/nano-banana-2-1-now-available-on-ai-gateway-65890.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/nano-banana-2-1-now-available-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-10-06T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [ai-image-generator](<https://devfeed.tech/topics/ai-image-generator.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [gateway](<https://devfeed.tech/topics/gateway.md>)

Tags: [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-sdk](<https://devfeed.tech/tags/ai-sdk.md>), [api](<https://devfeed.tech/tags/api.md>), [image](<https://devfeed.tech/tags/image.md>), [sdk](<https://devfeed.tech/tags/sdk.md>)

### AI overview

Google's Nano Banana 2.1 image generation and editing model is now available through Vercel AI Gateway. The release highlights product recontextualization, localized mask- and ink-based edits, and improved factuality, and provides access through the AI SDK, an OpenAI-compatible Chat Completions API, or AI CLI. AI Gateway also offers usage and cost tracking, retries, failover, routing, and performance settings.

### Source excerpt

Nano Banana 2.1 from Google is now available on AI Gateway. It improves image generation and editing over earlier Nano Banana models. This release targets product recontextualization, mask- and ink-based editing, and factuality. Product recontextualization places an existing product in a new scene. Mask- and ink-based edits change only the region marked by a mask or by strokes drawn on the image. Factuality is how accurately images depict real-world subjects. The model renders photorealistic skin tones, intricate materials, sharp lighting, and coherent backgrounds at the latency and cost of a Flash-tier model. Call it through the AI SDK or the OpenAI-compatible Chat Completions API, or the AI CLI. AI CLI is an open-source command-line tool from Vercel Labs for generating text, images, video, and audio from your terminal. It runs on AI Gateway, so any Gateway model ID works with -m. Use google/gemini-nano-banana-2.1 as the model name. Generated images are returned in result.files: Try Nano Banana 2.1 in imagen.sh, or the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all image models available on AI Gateway. Read more

## OpenAI Ultrafast mode now available on AI Gateway

DevFeed: [OpenAI Ultrafast mode now available on AI Gateway](<https://devfeed.tech/articles/openai-ultrafast-mode-now-available-on-ai-gateway-66976.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/openai-ultrafast-mode-now-available-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-10-05T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [gpt-6-astra](<https://devfeed.tech/topics/gpt-6-astra.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [ChatGPT API](<https://devfeed.tech/topics/chatgpt-api.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [open-responses](<https://devfeed.tech/topics/open-responses.md>), [WebSocket](<https://devfeed.tech/topics/websocket.md>)

Tags: [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [eu](<https://devfeed.tech/tags/eu.md>), [global](<https://devfeed.tech/tags/global.md>), [gpt-6-astra](<https://devfeed.tech/tags/gpt-6-astra.md>), [model](<https://devfeed.tech/tags/model.md>), [openai](<https://devfeed.tech/tags/openai.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [service](<https://devfeed.tech/tags/service.md>), [us](<https://devfeed.tech/tags/us.md>)

### AI overview

Vercel's AI Gateway now supports OpenAI's Ultrafast service tier for GPT-6 Astra through AI SDK, Chat Completions, and Responses APIs. Ultrafast is available for US and global processing, while requests pinned to unsupported regions use the standard tier. Ultrafast requests cost six times the standard per-token rate; fallback requests are billed at the rate of the tier served.

### Source excerpt

AI Gateway now supports OpenAI's Ultrafast service tier for GPT-6 Astra, providing faster output for interactive applications and rapid coding iterations. To use Ultrafast, request it for openai/gpt-6-astra through AI SDK, the Chat Completions API, or Responses API: For workflows with frequent tool calls, OpenAI recommends the Responses API over a persistent WebSocket connection to reduce overhead between turns. See the Ultrafast service-tier examples for persistent connections, including AI SDK over WebSocket. Ultrafast supports US and global processing. Requests pinned to unsupported regions, such as the EU, run at the standard (default) tier. Standard processing remains the default when no service tier is specified. Requests served at Ultrafast are billed at 6x the standard per-token rate, while requests that fall back to another tier are billed at the rate for the tier actually served. Check the GPT-6 Astra model page for current rates and learn more about the GPT-6 model family. Read more

## Visual Studio September Update - Power Your Workflow with Your Model

DevFeed: [Visual Studio September Update - Power Your Workflow with Your Model](<https://devfeed.tech/articles/visual-studio-september-update-power-your-workflow-with-your-model-61996.md>)

Original publisher: [Read original article](<https://devblogs.microsoft.com/visualstudio/visual-studio-september-update-power-your-workflow-with-your-model/>)

Author: Mark Downie

Published: 2026-09-29T16:00:04Z

Content type: release

Language: en

Sources: [Visual Studio](<https://devfeed.tech/sources/visual-studio-blog.md>)

Topics: [Visual Studio](<https://devfeed.tech/topics/visual-studio.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [NuGet](<https://devfeed.tech/topics/nuget.md>), [Test-driven development](<https://devfeed.tech/topics/tdd.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [byom](<https://devfeed.tech/tags/byom.md>), [github-copilot](<https://devfeed.tech/tags/github-copilot.md>), [nuget](<https://devfeed.tech/tags/nuget.md>), [visual-studio](<https://devfeed.tech/tags/visual-studio.md>)

### AI overview

Visual Studio's September update adds Bring Your Own Model support through GitHub Copilot or supported providers, including Microsoft Foundry, OpenAI, Anthropic, and Ollama. It also describes using AI to address NuGet Audit warnings from the Error List, along with other workflow and debugging updates. BYOM is a preview; the update notes that the earlier BYOM experience is no longer supported and previously added Ollama models must be added again.

### Source excerpt

Bring your own AI model with updates to BYOM, fix NuGet vulnerabilities from the Error List, explore pull requests with the Git agent, see which operand decides an if condition, and attach to Podman containers. The post Visual Studio September Update - Power Your Workflow with Your Model appeared first on Visual Studio Blog.

## GPT-6.1 Sol now available on AI Gateway

DevFeed: [GPT-6.1 Sol now available on AI Gateway](<https://devfeed.tech/articles/gpt-6-1-sol-now-available-on-ai-gateway-62116.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/gpt-6-1-sol-now-available-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-09-29T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [gpt-6-astra](<https://devfeed.tech/topics/gpt-6-astra.md>), [io interface](<https://devfeed.tech/topics/io-interface.md>), [ChatGPT API](<https://devfeed.tech/topics/chatgpt-api.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [codex](<https://devfeed.tech/topics/codex.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [api](<https://devfeed.tech/tags/api.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [gpt-6](<https://devfeed.tech/tags/gpt-6.md>), [gpt-6-1-sol](<https://devfeed.tech/tags/gpt-6-1-sol.md>), [openai](<https://devfeed.tech/tags/openai.md>), [pricing](<https://devfeed.tech/tags/pricing.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [sol](<https://devfeed.tech/tags/sol.md>), [vercel](<https://devfeed.tech/tags/vercel.md>)

### AI overview

Vercel announces GPT-6.1 Sol on AI Gateway, describing improvements for coding, computer use, complex document reading, and multi-step workflows. The release outlines pricing advantages over GPT-6 Astra and explains how to use the model through the AI SDK, compatible APIs, and coding agents.

### Source excerpt

GPT-6.1 Sol from OpenAI is now available on AI Gateway. It improves on GPT-6 Sol for coding, computer use, and professional work, including reading complex documents and carrying out multi-step workflows. The model is suited to agents that need to debug code, work through business tasks, or extract answers from PDFs with tables and charts. It also improves factual accuracy on difficult questions. Its standard input and output pricing is lower than GPT-6 Astra's, while cheaper cached input makes it useful for requests that reuse a long shared context. Use openai/gpt-6.1-sol as the model name with the AI SDK, OpenAI-compatible Chat Completions API, or Responses API. You can also select it in coding agents connected to AI Gateway: To use the model in coding agents like Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select openai/gpt-6.1-sol in the agent. See the coding agents guide for details. Try GPT-6.1 Sol in the playground and learn more about the GPT-6 model family. Read more

## Grok 4.7 is now available on Amazon Bedrock

DevFeed: [Grok 4.7 is now available on Amazon Bedrock](<https://devfeed.tech/articles/grok-4-7-is-now-available-on-amazon-bedrock-61389.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/grok-4-7-is-now-available-on-amazon-bedrock/>)

Author: Suheel Farooq

Published: 2026-09-28T22:13:16Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [Test-driven development](<https://devfeed.tech/topics/tdd.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agents](<https://devfeed.tech/tags/agents.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-machine-learning](<https://devfeed.tech/tags/amazon-machine-learning.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [coding](<https://devfeed.tech/tags/coding.md>), [context](<https://devfeed.tech/tags/context.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cursorbench](<https://devfeed.tech/tags/cursorbench.md>), [evaluations](<https://devfeed.tech/tags/evaluations.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [frontier-model](<https://devfeed.tech/tags/frontier-model.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [grok-4](<https://devfeed.tech/tags/grok-4.md>), [it](<https://devfeed.tech/tags/it.md>), [model](<https://devfeed.tech/tags/model.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [responses](<https://devfeed.tech/tags/responses.md>), [token](<https://devfeed.tech/tags/token.md>), [xai](<https://devfeed.tech/tags/xai.md>)

### AI overview

xAI's Grok 4.7 is available through Amazon Bedrock for coding, long-running agents, and knowledge work. It offers a 500K-token context window, four configurable reasoning-effort levels, and access through the Responses, Chat Completions, and Converse APIs. xAI says the model is designed for longer tasks and more careful self-verification.

### Source excerpt

xAI's Grok 4.7 is now available on Amazon Bedrock: a frontier model for coding, long-running agents, and knowledge work. It offers a 500K token context window and four configurable reasoning effort levels, reachable through the Responses, Chat Completions, and Converse APIs.

## Batch API: half-price inference by bundling requests

DevFeed: [Batch API: half-price inference by bundling requests](<https://devfeed.tech/articles/batch-api-half-price-inference-by-bundling-requests-78530.md>)

Original publisher: [Read original article](<https://openrouter.ai/blog/announcements/batch-api/>)

Author: Brian Thomas

Published: 2026-09-22T00:00:00Z

Content type: release

Language: en

Sources: [OpenRouter](<https://devfeed.tech/sources/openrouter.md>)

Topics: [API](<https://devfeed.tech/topics/api.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [rate-limiting](<https://devfeed.tech/topics/rate-limiting.md>), [model-serving](<https://devfeed.tech/topics/model-serving.md>), [client library](<https://devfeed.tech/topics/client-library.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [batch](<https://devfeed.tech/tags/batch.md>), [batching](<https://devfeed.tech/tags/batching.md>), [cost](<https://devfeed.tech/tags/cost.md>), [inference](<https://devfeed.tech/tags/inference.md>)

### AI overview

OpenRouter introduces an asynchronous Batch API for workloads that can tolerate variable response times. It supports more than 70 models and offers a generally 50% or greater reduction in per-token pricing. In the reported two-week beta, the median batch completed in 7 minutes, and 90% completed within an hour. The API supports chat completions, responses, messages, and embeddings, with results returned independently for each request.

### Source excerpt

Send a whole workload in one POST, collect the results within 24 hours, and typically pay half the per-token price. Across 230k+ batches that completed over our two week beta period, the median finished in 7 minutes.

## What Is Jev? TypeSafe's Decision Model Explained for Developers

DevFeed: [What Is Jev? TypeSafe's Decision Model Explained for Developers](<https://devfeed.tech/articles/what-is-jev-typesafe-s-decision-model-explained-for-developers-78630.md>)

Original publisher: [Read original article](<https://openrouter.ai/blog/insights/what-is-jev/>)

Author: Kenny Rogers

Published: 2026-09-21T00:00:00Z

Content type: tutorial

Language: en

Sources: [OpenRouter](<https://devfeed.tech/sources/openrouter.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [API Business Models](<https://devfeed.tech/topics/api-business-models.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-api](<https://devfeed.tech/tags/ai-api.md>), [decision-model](<https://devfeed.tech/tags/decision-model.md>), [developers](<https://devfeed.tech/tags/developers.md>), [for-developers](<https://devfeed.tech/tags/for-developers.md>), [jev](<https://devfeed.tech/tags/jev.md>), [model](<https://devfeed.tech/tags/model.md>), [openrouter](<https://devfeed.tech/tags/openrouter.md>)

### AI overview

Jev is a decision model from TypeSafe that responds to text and typed questions with fixed choices, scores, or yes/no probabilities rather than generated prose. This tutorial explains its Choice, Score, and Noul outputs, how to interpret probability and confidence, how to set thresholds using labeled data, and when to combine it with an LLM or use deterministic code. It also demonstrates calling Jev through OpenRouter and the TypeSafe SDKs.

### Source excerpt

Jev reads text and returns typed answers with probabilities instead of prose. Here's what that means, three live API calls, how to read the numbers, and how to call it with an OpenRouter key.

## Nano Banana API: Edit Images with Gemini in Code

DevFeed: [Nano Banana API: Edit Images with Gemini in Code](<https://devfeed.tech/articles/nano-banana-api-edit-images-with-gemini-in-code-78661.md>)

Original publisher: [Read original article](<https://openrouter.ai/blog/tutorials/nano-banana/>)

Author: OpenRouter

Published: 2026-09-09T00:00:00Z

Content type: tutorial

Language: en

Sources: [OpenRouter](<https://devfeed.tech/sources/openrouter.md>)

Topics: [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Image](<https://devfeed.tech/topics/image.md>), [vercel ai sdk](<https://devfeed.tech/topics/vercel-ai-sdk.md>)

Tags: [ai-api](<https://devfeed.tech/tags/ai-api.md>), [ai-model](<https://devfeed.tech/tags/ai-model.md>), [api](<https://devfeed.tech/tags/api.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [images](<https://devfeed.tech/tags/images.md>), [python](<https://devfeed.tech/tags/python.md>), [typescript](<https://devfeed.tech/tags/typescript.md>)

### AI overview

A tutorial demonstrates editing an existing image through the OpenRouter API using Gemini image models. It includes Python and TypeScript requests, explains sending images as URLs or base64 data URLs, retrieving edited images, iterating with follow-up prompts, switching models, and handling common errors and costs.

### Source excerpt

Send a source image and an edit prompt in one request, get the edited image back, and change the editing model by editing a single field. Runnable Python and TypeScript included.

## 4 NVIDIA AI tasks, 1 Elasticsearch API: Embeddings, chat, completion, and rerank

DevFeed: [4 NVIDIA AI tasks, 1 Elasticsearch API: Embeddings, chat, completion, and rerank](<https://devfeed.tech/articles/4-nvidia-ai-tasks-1-elasticsearch-api-embeddings-chat-completion-and-rerank-78798.md>)

Original publisher: [Read original article](<https://www.elastic.co/search-labs/blog/elasticsearch-nvidia-inference>)

Author: Jan Kazlouski

Published: 2026-07-21T00:00:00Z

Content type: tutorial

Language: en

Sources: [Elasticsearch Labs](<https://devfeed.tech/sources/elasticsearch-labs.md>)

Topics: [elasticsearch](<https://devfeed.tech/topics/elasticsearch.md>), [NVIDIA NIM](<https://devfeed.tech/topics/nvidia-nim.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Chat completions endpoints](<https://devfeed.tech/topics/chat-completions-endpoints.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [BioNeMo](<https://devfeed.tech/topics/bionemo.md>), [health check](<https://devfeed.tech/topics/health-check.md>)

Tags: [ai-tools](<https://devfeed.tech/tags/ai-tools.md>), [apis](<https://devfeed.tech/tags/apis.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [conversational-ai](<https://devfeed.tech/tags/conversational-ai.md>), [cross-encoder](<https://devfeed.tech/tags/cross-encoder.md>), [elasticsearch](<https://devfeed.tech/tags/elasticsearch.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [integrations](<https://devfeed.tech/tags/integrations.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [vector-database](<https://devfeed.tech/tags/vector-database.md>)

### AI overview

The article explains how to connect NVIDIA-hosted models to Elasticsearch through its inference API. It walks through setting up endpoints for text embeddings, completion, chat completion, and reranking, including API-key configuration, model selection, streaming options, and example requests. It also describes using custom URLs for on-premises NVIDIA NIM deployments.

### Source excerpt

Set up NVIDIA hosted models in Elasticsearch with one API key and a model ID. No custom integration code needed.

[Next page](<https://devfeed.tech/topics/chat-completions-endpoints.md?cursor=WyIyMDI2LTA3LTIxVDAwOjAwOjAwKzAwOjAwIiwgIjE0MzExODdiLTVhY2YtNGQ4NC05MTZkLTA0Zjg1Y2E2YzQ0ZiJd>)