# Caching

Published articles for Caching.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## September 2026 newsletter

DevFeed: [September 2026 newsletter](<https://devfeed.tech/articles/september-2026-newsletter-41317.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/202609-newsletter>)

Author: Mark Needham

Published: 2026-09-17T13:42:49Z

Content type: news

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [releases](<https://devfeed.tech/topics/releases.md>), [Replication](<https://devfeed.tech/topics/replication.md>), [Grafana Cloud Metrics](<https://devfeed.tech/topics/grafana-cloud-metrics.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [caching](<https://devfeed.tech/tags/caching.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [events](<https://devfeed.tech/tags/events.md>), [news](<https://devfeed.tech/tags/news.md>), [newsletter](<https://devfeed.tech/tags/newsletter.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [release](<https://devfeed.tech/tags/release.md>), [replication](<https://devfeed.tech/tags/replication.md>), [september-2026](<https://devfeed.tech/tags/september-2026.md>)

### AI overview

The September 2026 ClickHouse newsletter covers the 26.8 release, including custom HTTP handlers, pipelined SQL, dynamic query filtering, tokenizer support, and other features. It also summarizes replication-queue diagnostics, CostBench results, preview releases, community contributions, and upcoming events.

### Source excerpt

Welcome to the September 2026 ClickHouse newsletter, featuring ClickHouse 26.8, PromQL, On-Demand Compute, CostBench results, and the latest community news and events.

## Local and distributed cache coherence: stale data caused by missed invalidation messages

DevFeed: [Local and distributed cache coherence: stale data caused by missed invalidation messages](<https://devfeed.tech/articles/local-cache-plus-distributed-cache-the-coherence-bill-nobody-budgets-for-39606.md>)

Original publisher: [Read original article](<https://ankit-rana.com/logs/54-local-and-distributed-cache-coherence/>)

Author: hello@ankit-rana.com

Published: 2026-09-17T00:00:00Z

Content type: opinion

Language: en

Sources: [Ankit Rana | Mechanical Sympathy](<https://devfeed.tech/sources/ankit-rana-mechanical-sympathy.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Redis](<https://devfeed.tech/topics/redis.md>), [data](<https://devfeed.tech/topics/data.md>), [Network](<https://devfeed.tech/topics/network.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [cache-coherence](<https://devfeed.tech/tags/cache-coherence.md>), [caching](<https://devfeed.tech/tags/caching.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [data](<https://devfeed.tech/tags/data.md>), [distributed-cache](<https://devfeed.tech/tags/distributed-cache.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [jvm](<https://devfeed.tech/tags/jvm.md>), [network](<https://devfeed.tech/tags/network.md>), [redis](<https://devfeed.tech/tags/redis.md>), [ttl](<https://devfeed.tech/tags/ttl.md>)

### AI overview

The article explains that adding an in-process cache in front of a distributed cache can improve latency but creates independently stale copies across service instances. It focuses on Redis pub/sub invalidation, which provides no persistence, acknowledgement, retry, or replay, allowing instances to miss invalidation messages and serve stale data until their TTL expires.

### Source excerpt

An in-process cache in front of a distributed cache removes a network hop and adds one independent copy of the data per instance, each of which can be stale on its own schedule. Invalidation is normally broadcast over pub/sub, which is fire and forget, so any instance that is restarting, garbage collecting or briefly disconnected simply misses the message and serves stale data until its TTL expires. That TTL is not a performance setting, it is the maximum duration of incorrectness.

## Dropbox Evolves Riviera Content Processing Platform to Support AI Workloads

DevFeed: [Dropbox Evolves Riviera Content Processing Platform to Support AI Workloads](<https://devfeed.tech/articles/dropbox-evolves-riviera-content-processing-platform-to-support-ai-workloads-31517.md>)

Original publisher: [Read original article](<https://www.infoq.com/news/2026/09/dropbox-riviera-ai-platform/>)

Author: Leela Kumili

Published: 2026-09-16T14:42:00Z

Content type: news

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [dropbox](<https://devfeed.tech/topics/dropbox.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [API](<https://devfeed.tech/topics/api.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-ml-data-engineering](<https://devfeed.tech/tags/ai-ml-data-engineering.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apis](<https://devfeed.tech/tags/apis.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [architecture-design](<https://devfeed.tech/tags/architecture-design.md>), [asynchronous-architecture](<https://devfeed.tech/tags/asynchronous-architecture.md>), [backend](<https://devfeed.tech/tags/backend.md>), [caching](<https://devfeed.tech/tags/caching.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [development](<https://devfeed.tech/tags/development.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [dropbox](<https://devfeed.tech/tags/dropbox.md>), [dropbox-riviera-ai-platform](<https://devfeed.tech/tags/dropbox-riviera-ai-platform.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [enterprise-content-management](<https://devfeed.tech/tags/enterprise-content-management.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [ml-data-engineering](<https://devfeed.tech/tags/ml-data-engineering.md>), [model-context-protocol-mcp](<https://devfeed.tech/tags/model-context-protocol-mcp.md>), [news](<https://devfeed.tech/tags/news.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [plugins](<https://devfeed.tech/tags/plugins.md>), [rag](<https://devfeed.tech/tags/rag.md>), [tika](<https://devfeed.tech/tags/tika.md>)

### AI overview

Dropbox has expanded Riviera from an internal file-preview service into a content-processing platform supporting more than 300 file formats and over 100 transformation capabilities. The platform supports Dropbox products including Search, Replay, Sign, and Dash, and provides APIs for asynchronous document conversion, media transcription, and structured metadata extraction for AI and RAG workflows.

### Source excerpt

Dropbox has evolved Riviera from a file preview service into a universal content processing platform supporting more than 300 file formats and over 100 transformation capabilities. Processing hundreds of thousands of transformations per second, Riviera now supports Search, Replay, Sign, and Dash, while its APIs enable asynchronous content extraction for AI and RAG workflows. By Leela Kumili

## The User Write Lock: an Alternative to Transactions for Google App Engine

DevFeed: [The User Write Lock: an Alternative to Transactions for Google App Engine](<https://devfeed.tech/articles/the-user-write-lock-an-alternative-to-transactions-for-google-app-engine-27418.md>)

Original publisher: [Read original article](<http://engineering.khanacademy.org/posts/user-write-lock.htm>)

Author: Khan Academy

Published: 2016-06-20T22:00:00Z

Content type: tutorial

Language: en

Sources: [Khan Academy](<https://devfeed.tech/sources/khan-academy.md>)

Topics: [Transactions](<https://devfeed.tech/topics/transactions.md>), [Databases](<https://devfeed.tech/topics/databases.md>), [Google](<https://devfeed.tech/topics/google.md>)

Tags: [caching](<https://devfeed.tech/tags/caching.md>), [databases](<https://devfeed.tech/tags/databases.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [google](<https://devfeed.tech/tags/google.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [news](<https://devfeed.tech/tags/news.md>), [processes](<https://devfeed.tech/tags/processes.md>), [retry](<https://devfeed.tech/tags/retry.md>), [transactions](<https://devfeed.tech/tags/transactions.md>)

### AI overview

This developer article explains how transactions in Google App Engine's datastore provide atomicity for single-entity and multi-entity writes, but can introduce frozen datastore state, retries, idempotence requirements, and restrictions on datastore queries. It presents the User Write Lock as an alternative, although the supplied text ends before describing that alternative.

### Source excerpt

By Craig Silverstein Transactions are the standard method in Google App Engine's datastore -- as in many databases ... Read more

## How Khan Academy Scaled to 2.5x Traffic During the Coronavirus Pandemic

DevFeed: [How Khan Academy Scaled to 2.5x Traffic During the Coronavirus Pandemic](<https://devfeed.tech/articles/how-khan-academy-successfully-handled-2-5x-traffic-in-a-week-27379.md>)

Original publisher: [Read original article](<http://engineering.khanacademy.org/posts/handling-2x-traffic-in-a-week.htm>)

Author: Khan Academy

Published: 2020-05-09T22:00:00Z

Content type: article

Language: en

Sources: [Khan Academy](<https://devfeed.tech/sources/khan-academy.md>)

Topics: [Scalability](<https://devfeed.tech/topics/scalability.md>), [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [Load Balancing](<https://devfeed.tech/topics/load-balancing.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [caching](<https://devfeed.tech/tags/caching.md>), [cdn](<https://devfeed.tech/tags/cdn.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [gcp](<https://devfeed.tech/tags/gcp.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [load-balancing](<https://devfeed.tech/tags/load-balancing.md>), [news](<https://devfeed.tech/tags/news.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

Marta Kosarchyn explains how Khan Academy handled site usage reaching 2.5 times the previous year's level during the coronavirus pandemic. The article attributes the scalability to Google Cloud services, serverless infrastructure, Datastore, Memcache, Fastly CDN caching, and advance preparation.

### Source excerpt

By Marta Kosarchyn Talk about rapid scaling... A few months ago I posted some thoughts on scaling and ... Read more

## Prompt Caching Support in Spring AI with Anthropic Claude

DevFeed: [Prompt Caching Support in Spring AI with Anthropic Claude](<https://devfeed.tech/articles/prompt-caching-support-in-spring-ai-with-anthropic-claude-30893.md>)

Original publisher: [Read original article](<https://www.baeldung.com/spring-ai-anthropic-claude-prompt-cache>)

Author: Stelios Anastasakis

Published: 2026-09-16T07:49:56Z

Content type: tutorial

Language: en

Sources: [Baeldung](<https://devfeed.tech/sources/baeldung.md>)

Topics: [Spring AI](<https://devfeed.tech/topics/spring-ai.md>), [Anthropic Claude](<https://devfeed.tech/topics/anthropic-claude.md>), [Caching](<https://devfeed.tech/topics/caching.md>)

Tags: [anthropic](<https://devfeed.tech/tags/anthropic.md>), [anthropic-claude](<https://devfeed.tech/tags/anthropic-claude.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [artificial-intelligence-anthropic-spring-ai-chatclient](<https://devfeed.tech/tags/artificial-intelligence-anthropic-spring-ai-chatclient.md>), [caching](<https://devfeed.tech/tags/caching.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [spring-ai](<https://devfeed.tech/tags/spring-ai.md>), [spring-ai-chatclient](<https://devfeed.tech/tags/spring-ai-chatclient.md>)

### AI overview

This tutorial explains how prompt caching works in Spring AI with Anthropic Claude. It covers dependencies, model-specific requirements and limitations, configuration options, caching hierarchy, and practical considerations. Prompt caching can reduce latency and input-token costs when prompt prefixes are reused.

### Source excerpt

Learn how prompt caching works, the limitations for different Claude models, and how to use it in Spring AI. The post Prompt Caching Support in Spring AI with Anthropic Claude first appeared on Baeldung.

## Optimizing cost and latency with Amazon Bedrock prompt caching

DevFeed: [Optimizing cost and latency with Amazon Bedrock prompt caching](<https://devfeed.tech/articles/optimizing-cost-and-latency-with-amazon-bedrock-prompt-caching-26941.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/optimizing-cost-and-latency-with-amazon-bedrock-prompt-caching/>)

Author: Daniel Abib

Published: 2026-09-15T16:18:19Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [API](<https://devfeed.tech/topics/api.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [Multi-tenancy](<https://devfeed.tech/topics/multi-tenancy.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [api](<https://devfeed.tech/tags/api.md>), [caching](<https://devfeed.tech/tags/caching.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [integration](<https://devfeed.tech/tags/integration.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [latency](<https://devfeed.tech/tags/latency.md>), [pricing](<https://devfeed.tech/tags/pricing.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This AWS post explains how Amazon Bedrock prompt caching can reduce repeated input-token costs by up to 90 percent and lower time to first token when requests reuse the same context. It presents six scenarios using the Converse API, including document, system prompt, tool definition, mixed TTL, tenant-isolated, and LangChain caching.

### Source excerpt

Prompt caching in Amazon Bedrock can cut input token costs by up to 90% when you repeatedly send the same context to foundation models. This post walks through six practical prompt caching scenarios using the Converse API: message content, system prompt, tool definition, mixed TTL, tenant isolation, and LangChain integration.

## Laravel MCP 1.0 Is Released

DevFeed: [Laravel MCP 1.0 Is Released](<https://devfeed.tech/articles/laravel-mcp-1-0-is-released-26975.md>)

Original publisher: [Read original article](<https://laravel-news.com/laravel-mcp-1-0>)

Author: Eric L. Barnes

Published: 2026-09-15T14:27:51Z

Content type: release

Language: en

Sources: [Laravel](<https://devfeed.tech/sources/laravel.md>)

Topics: [Laravel](<https://devfeed.tech/topics/laravel.md>), [Model Context Protocol (MCP)](<https://devfeed.tech/topics/model-context-protocol-mcp.md>), [OAuth](<https://devfeed.tech/topics/oauth.md>), [pkce](<https://devfeed.tech/topics/pkce.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [servers](<https://devfeed.tech/topics/servers.md>)

Tags: [caching](<https://devfeed.tech/tags/caching.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [laravel](<https://devfeed.tech/tags/laravel.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [news](<https://devfeed.tech/tags/news.md>), [oauth](<https://devfeed.tech/tags/oauth.md>), [pkce](<https://devfeed.tech/tags/pkce.md>), [servers](<https://devfeed.tech/tags/servers.md>)

### AI overview

Laravel MCP 1.0 is the first stable release of Laravel's package for building Model Context Protocol servers. It adds protocol revision 2026-07-28 support, searchable tool catalogs, cache hints, stateless request handling, OAuth changes requiring PKCE, and Client ID Metadata Documents.

### Source excerpt

Laravel MCP 1.0 ships protocol revision 2026-07-28, stateless servers, searchable tool catalogs, cache hints, and reworked OAuth with required PKCE. The post Laravel MCP 1.0 Is Released appeared first on Laravel News. Join the Laravel Newsletter to get Laravel articles like this directly in your inbox.

## Why your Redis is slow: it is single threaded and you sent it KEYS

DevFeed: [Why your Redis is slow: it is single threaded and you sent it KEYS](<https://devfeed.tech/articles/why-your-redis-is-slow-it-is-single-threaded-and-you-sent-it-keys-39605.md>)

Original publisher: [Read original article](<https://ankit-rana.com/logs/53-redis-single-threaded-keys-command/>)

Author: hello@ankit-rana.com

Published: 2026-09-15T00:00:00Z

Content type: tutorial

Language: en

Sources: [Ankit Rana | Mechanical Sympathy](<https://devfeed.tech/sources/ankit-rana-mechanical-sympathy.md>)

Topics: [Redis](<https://devfeed.tech/topics/redis.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [Concurrency](<https://devfeed.tech/topics/concurrency.md>)

Tags: [blocking](<https://devfeed.tech/tags/blocking.md>), [caching](<https://devfeed.tech/tags/caching.md>), [command](<https://devfeed.tech/tags/command.md>), [latency](<https://devfeed.tech/tags/latency.md>), [observability](<https://devfeed.tech/tags/observability.md>), [performance](<https://devfeed.tech/tags/performance.md>), [redis](<https://devfeed.tech/tags/redis.md>), [single-threaded](<https://devfeed.tech/tags/single-threaded.md>)

### AI overview

The article explains that Redis executes commands one at a time on a single thread, so expensive commands can block every client and cause latency spikes across all operations. It identifies KEYS as a key offender and also discusses large DEL operations, unbounded LRANGE, SMEMBERS on large sets, and FLUSHALL. Redis 6 threaded I/O helps with socket handling but does not change single-threaded command execution.

### Source excerpt

Redis executes commands one at a time on a single thread, so any command that takes 200ms makes every other client wait 200ms regardless of how trivial their request was. KEYS scans the entire keyspace and is the obvious offender, but DEL on a large collection, unbounded LRANGE, SMEMBERS on a big set and FLUSHALL are all linear in the size of the data and block identically. The tell is a latency spike across all operations at once while CPU and network look normal.

## Agoda Replaces 72-Shard SQL Server Price Cache with DragonflyDB

DevFeed: [Agoda Replaces 72-Shard SQL Server Price Cache with DragonflyDB](<https://devfeed.tech/articles/agoda-replaces-72-shard-sql-server-price-cache-with-dragonflydb-21543.md>)

Original publisher: [Read original article](<https://www.infoq.com/news/2026/09/agoda-price-cache-dragonflydb/>)

Author: Leela Kumili

Published: 2026-09-14T13:48:00Z

Content type: news

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [Cache](<https://devfeed.tech/topics/cache.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [migration](<https://devfeed.tech/topics/migration.md>), [sql-server](<https://devfeed.tech/topics/sql-server.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [Prometheus](<https://devfeed.tech/topics/prometheus.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [agoda-price-cache-dragonflydb](<https://devfeed.tech/tags/agoda-price-cache-dragonflydb.md>), [architecture-design](<https://devfeed.tech/tags/architecture-design.md>), [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [development](<https://devfeed.tech/tags/development.md>), [devops](<https://devfeed.tech/tags/devops.md>), [distributed-cache](<https://devfeed.tech/tags/distributed-cache.md>), [distributed-data](<https://devfeed.tech/tags/distributed-data.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [latency](<https://devfeed.tech/tags/latency.md>), [microservices](<https://devfeed.tech/tags/microservices.md>), [migration](<https://devfeed.tech/tags/migration.md>), [news](<https://devfeed.tech/tags/news.md>), [prometheus](<https://devfeed.tech/tags/prometheus.md>), [redis](<https://devfeed.tech/tags/redis.md>), [sql-server](<https://devfeed.tech/tags/sql-server.md>)

### AI overview

Agoda migrated its 1.5 TB hotel Price Cache from 72 Microsoft SQL Server shards to DragonflyDB. The staged migration used workload testing, dual reads, parity metrics, and gradual traffic shifting; Agoda reported substantially lower P99 read latency.

### Source excerpt

Agoda migrated its 1.5 TB hotel Price Cache from 72 SQL Server shards to DragonflyDB to handle growing read and write volumes. The migration used staged dual reads, parity validation, gradual traffic shifting, and decentralized failover detection. Agoda reports an approximately eightfold reduction in P99 read latency, with two DragonflyDB clusters providing high availability. By Leela Kumili

## Using Exact-Match Response Caching to Reduce LLM Costs

DevFeed: [Using Exact-Match Response Caching to Reduce LLM Costs](<https://devfeed.tech/articles/why-an-old-caching-trick-is-your-secret-to-lower-llm-costs-17399.md>)

Original publisher: [Read original article](<https://thenewstack.io/llm-response-caching-costs/>)

Author: Abhilash Rao Mesala

Published: 2026-09-14T11:00:00Z

Content type: article

Language: en

Sources: [The New Stack](<https://devfeed.tech/sources/the-new-stack.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [ai-engineering](<https://devfeed.tech/tags/ai-engineering.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [caching](<https://devfeed.tech/tags/caching.md>), [contributed](<https://devfeed.tech/tags/contributed.md>), [cost](<https://devfeed.tech/tags/cost.md>), [finops](<https://devfeed.tech/tags/finops.md>), [generation](<https://devfeed.tech/tags/generation.md>), [hash](<https://devfeed.tech/tags/hash.md>), [llm](<https://devfeed.tech/tags/llm.md>), [token](<https://devfeed.tech/tags/token.md>)

### AI overview

The article explains how to reduce LLM costs by fingerprinting requests, context, model settings, and underlying data to create exact-match cache keys. Valid cached responses can be reused without calling the model. It distinguishes response caching from provider prompt caching, where only eligible prompt computation is reused.

### Source excerpt

An LLM can answer the same question a thousand times and charge you each time. Before paying for another answer, The post Why an old caching trick is your secret to lower LLM costs appeared first on The New Stack.

## Cloudflare Tests Cache Transcoding to Reduce Storage Requirements

DevFeed: [Cloudflare Tests Cache Transcoding to Reduce Storage Requirements](<https://devfeed.tech/articles/cloudflare-tests-cache-transcoding-to-reduce-storage-requirements-8992.md>)

Original publisher: [Read original article](<https://www.infoq.com/news/2026/09/cloudflare-cache-transcoding/>)

Author: Renato Losio

Published: 2026-09-13T10:35:00Z

Content type: news

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Transcodings](<https://devfeed.tech/topics/transcodings.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Pingora](<https://devfeed.tech/topics/pingora.md>)

Tags: [architecture-design](<https://devfeed.tech/tags/architecture-design.md>), [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [cdn](<https://devfeed.tech/tags/cdn.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloudflare](<https://devfeed.tech/tags/cloudflare.md>), [cloudflare-cache-transcoding](<https://devfeed.tech/tags/cloudflare-cache-transcoding.md>), [compression](<https://devfeed.tech/tags/compression.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [data-centers](<https://devfeed.tech/tags/data-centers.md>), [development](<https://devfeed.tech/tags/development.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [news](<https://devfeed.tech/tags/news.md>), [pingora](<https://devfeed.tech/tags/pingora.md>), [rust](<https://devfeed.tech/tags/rust.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

Cloudflare is testing Cache Transcoding, a prototype that Zstandard-compresses eligible uncompressed text before it is stored in cache. The approach aims to increase effective cache capacity and reduce inter-data-center transfer, with configurable CPU and storage trade-offs.

### Source excerpt

Cloudflare recently described a prototype called Cache Transcoding that compresses eligible cache content, mainly uncompressed text such as HTML, JSON, CSS, and JavaScript, using Zstandard before storing it on disk. The hyperscaler estimates that the approach could provide petabytes of additional effective cache capacity, although broader testing is still needed. By Renato Losio

## Cache invalidation is a distributed systems problem

DevFeed: [Cache invalidation is a distributed systems problem](<https://devfeed.tech/articles/cache-invalidation-is-a-distributed-systems-problem-in-a-convenience-costume-39604.md>)

Original publisher: [Read original article](<https://ankit-rana.com/logs/52-cache-invalidation-distributed-problem/>)

Author: hello@ankit-rana.com

Published: 2026-09-13T00:00:00Z

Content type: tutorial

Language: en

Sources: [Ankit Rana | Mechanical Sympathy](<https://devfeed.tech/sources/ankit-rana-mechanical-sympathy.md>)

Topics: [Cache](<https://devfeed.tech/topics/cache.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [distributed-systems](<https://devfeed.tech/topics/distributed-systems.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [cache-invalidation](<https://devfeed.tech/tags/cache-invalidation.md>), [caching](<https://devfeed.tech/tags/caching.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [ordering](<https://devfeed.tech/tags/ordering.md>), [race-conditions](<https://devfeed.tech/tags/race-conditions.md>), [redis](<https://devfeed.tech/tags/redis.md>), [ttl](<https://devfeed.tech/tags/ttl.md>)

### AI overview

Cache invalidation coordinates updates between a database and a cache without a shared transaction. The article explains how operation ordering can let a concurrent reader repopulate stale data and recommends writing to the database before invalidating the cache, followed by a second invalidation to close the remaining race.

### Source excerpt

A cache and a database are two stores that must agree, which makes every invalidation a distributed transaction without a coordinator. The ordering matters more than the mechanism: invalidating before the database write leaves a window where a concurrent reader repopulates the cache with the old value and it stays wrong until the TTL expires. Deleting the key rather than writing the new value removes a whole class of ordering bug, because two concurrent deletes commute and two concurrent writes do not.

## Claims About RubyGems Caching and RubyDoc Code Execution

DevFeed: [Claims About RubyGems Caching and RubyDoc Code Execution](<https://devfeed.tech/articles/what-a-time-to-be-alive-39007.md>)

Original publisher: [Read original article](<https://tenderlovemaking.com/2026/09/11/what-a-time-to-be-alive/>)

Published: 2026-09-12T00:02:11Z

Content type: opinion

Language: en

Sources: [Aaron Patterson](<https://devfeed.tech/sources/aaron-patterson.md>)

Topics: [rubygems](<https://devfeed.tech/topics/rubygems.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [vulnerability](<https://devfeed.tech/topics/vulnerability.md>), [Docker](<https://devfeed.tech/topics/docker.md>), [Web Scraping](<https://devfeed.tech/topics/web-scraping.md>)

Tags: [caching](<https://devfeed.tech/tags/caching.md>), [docker](<https://devfeed.tech/tags/docker.md>), [rubygems](<https://devfeed.tech/tags/rubygems.md>), [scraping](<https://devfeed.tech/tags/scraping.md>), [vulnerability](<https://devfeed.tech/tags/vulnerability.md>)

### AI overview

An opinion post discusses alleged RubyGems activity involving a caching vulnerability and web scraping. It also describes how published gems can cause RubyDoc.info to run YARD-loaded code in a networked Docker container.

### Source excerpt

Today Reuters and the Wall Street Journal both reported about rogue AI agents at OpenAI attacking RubyGems.org. https://www.rubyhack.ai/ has an amazing writeup, and you should read it. I just wanted to make a quick post about it because it's wild. TL;DR: It seems like OpenAI Bots knew about the RubyGems caching vulnerability, tried to take advantage of it, and at the same time ran some weird web scraping code on RubyDoc.info. Back in May, socket.dev reported about a "GemStuffer Campaign" where someone (I guess OpenAI) was uploading tons of junk gems to RubyGems.org. For some reason, the gems would scrape UK government websites, then repackage the data as gems, and attempt to upload them to RubyGems. I honestly didn't think much about this (or even look into it) until Sydney Von Arx and Spencer Kitts (both co-authors on https://www.rubyhack.ai) contacted me asking about RubyGems. I thought the claims they were making were completely outlandish until I actually read the code in these "GemStuffer" gems. After reading the code in these gems, a couple things stood out to me. YARD Documentation First, the gems leverage YARD documentation to execute arbitrary code on host machines. In most of the examples you'll see a .yardopts file that looks like this: --load ./script.rb README.md lib/**/*.rb Here's a link to an example. If you have YARD installed, and you install this gem, then YARD will load and run whatever is in ./script.rb from inside the gem. I think it's pretty common knowledge that C extensions will execute extconf.rb (so you basically have an RCE vector), but I was surprised to find out that a documentation tool would do that too. Nobody is going to install a gem named slnleaker5 though, so why would this matter? Well, any time a Gem is published RubyDoc.info will download the gem and process the YARD documentation. RubyDoc.info will execute the arbitrary code inside a Docker container. The Docker container still has network access though, so these gems could ha

## Choosing among write-through, write-behind, and write-around caching strategies

DevFeed: [Choosing among write-through, write-behind, and write-around caching strategies](<https://devfeed.tech/articles/write-through-write-behind-write-around-picking-wrong-costs-you-consistency-or-throughput-39603.md>)

Original publisher: [Read original article](<https://ankit-rana.com/logs/51-write-through-behind-around/>)

Author: hello@ankit-rana.com

Published: 2026-09-11T00:00:00Z

Content type: tutorial

Language: en

Sources: [Ankit Rana | Mechanical Sympathy](<https://devfeed.tech/sources/ankit-rana-mechanical-sympathy.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Databases](<https://devfeed.tech/topics/databases.md>), [Redis](<https://devfeed.tech/topics/redis.md>), [consistency](<https://devfeed.tech/topics/consistency.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [database](<https://devfeed.tech/tags/database.md>), [latency](<https://devfeed.tech/tags/latency.md>), [orders](<https://devfeed.tech/tags/orders.md>), [postgres](<https://devfeed.tech/tags/postgres.md>), [redis](<https://devfeed.tech/tags/redis.md>), [strategies](<https://devfeed.tech/tags/strategies.md>), [system-design](<https://devfeed.tech/tags/system-design.md>), [write](<https://devfeed.tech/tags/write.md>), [write-behind](<https://devfeed.tech/tags/write-behind.md>), [write-through](<https://devfeed.tech/tags/write-through.md>)

### AI overview

This article compares write-through, write-behind, and write-around caching strategies. It explains their trade-offs among database latency, cache hit rates, consistency, and the risk of losing acknowledged writes when a process fails.

### Source excerpt

The three write strategies differ in what happens between the cache write and the database write, and that gap is where correctness lives. Write-through updates both before acknowledging, so it is safe and pays the full database latency. Write-behind acknowledges after the cache write and flushes later, which is fast and can lose acknowledged writes if the process dies. Write-around skips the cache entirely on write, which avoids caching data nobody reads and costs a miss on the next read.

## Reduce LLM latency with prefix-aware routing on Amazon SageMaker Inference

DevFeed: [Reduce LLM latency with prefix-aware routing on Amazon SageMaker Inference](<https://devfeed.tech/articles/reduce-llm-latency-with-prefix-aware-routing-on-amazon-sagemaker-inference-4740.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/reduce-llm-latency-with-prefix-aware-routing-on-amazon-sagemaker-inference/>)

Author: Kareem Syed-Mohammed

Published: 2026-09-10T21:58:09Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Low-Latency Inference](<https://devfeed.tech/topics/low-latency-inference.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Inference Performance](<https://devfeed.tech/topics/inference-performance.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [caching](<https://devfeed.tech/tags/caching.md>), [inference](<https://devfeed.tech/tags/inference.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tensorrt-llm](<https://devfeed.tech/tags/tensorrt-llm.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

Amazon SageMaker Inference introduces prefix-aware routing for LLM requests. By consistently sending requests with matching prompt prefixes to the same instance, it improves reuse of cached KV computations and can reduce time to first token.

### Source excerpt

Amazon SageMaker Inference now offers prefix-aware routing, a routing strategy that sends requests sharing the same prompt prefix to the same instance so the KV cache stays warm. In benchmarks on Llama 3.1 70B, it reduced P50 time-to-first-token by up to 77% and raised KV cache hit rates from about 25% to over 80%.

## Reduce inference cold starts on Amazon SageMaker HyperPod with model caching

DevFeed: [Reduce inference cold starts on Amazon SageMaker HyperPod with model caching](<https://devfeed.tech/articles/reduce-inference-cold-starts-on-amazon-sagemaker-hyperpod-with-model-caching-4739.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/reduce-inference-cold-starts-on-amazon-sagemaker-hyperpod-with-model-caching/>)

Author: Kareem Syed-Mohammed

Published: 2026-09-10T21:37:49Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [autoscaling](<https://devfeed.tech/topics/autoscaling.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-hyperpod](<https://devfeed.tech/tags/amazon-sagemaker-hyperpod.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [caching](<https://devfeed.tech/tags/caching.md>), [expert-400](<https://devfeed.tech/tags/expert-400.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [llm](<https://devfeed.tech/tags/llm.md>)

### AI overview

Amazon SageMaker HyperPod model caching preloads model weights and container images onto cluster nodes, reducing inference-pod cold starts by serving assets from local NVMe storage.

### Source excerpt

Amazon SageMaker HyperPod now supports model caching for inference, which pre-loads model weights and container images onto cluster nodes so pods read from local NVMe storage instead of downloading over the network. Learn how model caching cuts cold starts from tens of minutes to seconds, how it works, and how to enable it.

## Caching Responses for Repeated Questions in Production LLM Applications

DevFeed: [Caching Responses for Repeated Questions in Production LLM Applications](<https://devfeed.tech/articles/why-multi-turn-agents-need-more-than-a-task-graph-18248.md>)

Original publisher: [Read original article](<https://blog.dailydoseofds.com/p/why-multi-turn-agents-need-more-than>)

Author: Avi Chawla

Published: 2026-09-10T21:34:26Z

Content type: article

Language: en

Sources: [Daily Dose of Data Science](<https://devfeed.tech/sources/daily-dose-of-data-science.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Redis](<https://devfeed.tech/topics/redis.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [redis](<https://devfeed.tech/tags/redis.md>)

### AI overview

Production LLM applications can reduce repeated model calls by caching generated responses and matching new questions to prior questions using embeddings. The article discusses Redis LangCache, including similarity thresholds, expiration, data isolation, monitoring, and an example where a cache hit was roughly 6x faster than direct inference.

### Source excerpt

What production agents must preserve between turns, and what they must reset.

## Improving Lakebase Postgres compute cache

DevFeed: [Improving Lakebase Postgres compute cache](<https://devfeed.tech/articles/improving-lakebase-postgres-compute-cache-11541.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/improving-lakebase-postgres-compute-cache>)

Author: David Wein; Sunil Kamath; Haoyu Huang

Published: 2026-09-10T13:47:03Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [Databases](<https://devfeed.tech/topics/databases.md>), [autoscaling](<https://devfeed.tech/topics/autoscaling.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Filesystems](<https://devfeed.tech/topics/filesystems.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>)

Tags: [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [data](<https://devfeed.tech/tags/data.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [filesystem](<https://devfeed.tech/tags/filesystem.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [memory](<https://devfeed.tech/tags/memory.md>), [s3](<https://devfeed.tech/tags/s3.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

This Databricks article describes improvements to compute-side caching for Lakebase Postgres, a disaggregated storage system backed by object storage such as Amazon S3. It explains PostgreSQL shared buffers, the operating system page cache, and the planned use of dynamically autoscaling shared buffers consuming up to 75% of compute memory. It also introduces a local file cache as an incremental solution for fixed compute instances.

### Source excerpt

The disaggregated storage model of Lakebase Postgres provides a feature rich, flexible...

## Why You're Getting 429s in Production Using Auth0 and How to Stop Them

DevFeed: [Why You're Getting 429s in Production Using Auth0 and How to Stop Them](<https://devfeed.tech/articles/why-you-re-getting-429s-in-production-using-auth0-and-how-to-stop-them-15655.md>)

Original publisher: [Read original article](<https://auth0.com/blog/why-getting-429s-and-how-to-stop-them/>)

Author: Carla Urrea Stabile

Published: 2026-09-10T00:00:00Z

Content type: tutorial

Language: en

Sources: [Auth0 Blog](<https://devfeed.tech/sources/auth0-blog.md>)

Topics: [Auth0](<https://devfeed.tech/topics/auth0.md>), [API](<https://devfeed.tech/topics/api.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [JSON Web Tokens](<https://devfeed.tech/topics/jwt.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [apis](<https://devfeed.tech/tags/apis.md>), [auth0](<https://devfeed.tech/tags/auth0.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [caching](<https://devfeed.tech/tags/caching.md>), [errors](<https://devfeed.tech/tags/errors.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [jwt](<https://devfeed.tech/tags/jwt.md>), [latency](<https://devfeed.tech/tags/latency.md>), [production](<https://devfeed.tech/tags/production.md>), [token](<https://devfeed.tech/tags/token.md>)

### AI overview

This tutorial explains why Auth0 API requests return 429 rate-limit errors in production. It identifies per-request Management API calls and repeatedly fetching machine-to-machine tokens as common causes, and recommends putting suitable authorization data in JWT claims, caching reusable tokens, logging rate-limit headers, and using short-lived tokens or live checks when changes must take effect immediately.

### Source excerpt

Getting Auth0 429 status code errors in production? They almost always trace back to APIs rate limit. Here are the two causes and how to fix them.

## ICYMI: What landed for AI builders in August 2026

DevFeed: [ICYMI: What landed for AI builders in August 2026](<https://devfeed.tech/articles/icymi-what-landed-for-ai-builders-in-august-2026-4735.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/icymi-what-landed-for-ai-builders-in-august-2026/>)

Author: Tanvi Girinath

Published: 2026-09-09T20:01:03Z

Content type: news

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Caching](<https://devfeed.tech/topics/caching.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [caching](<https://devfeed.tech/tags/caching.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [govcloud](<https://devfeed.tech/tags/govcloud.md>), [inference](<https://devfeed.tech/tags/inference.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [latency](<https://devfeed.tech/tags/latency.md>), [open](<https://devfeed.tech/tags/open.md>), [robots](<https://devfeed.tech/tags/robots.md>), [updates](<https://devfeed.tech/tags/updates.md>)

### AI overview

A recap of August 2026 Amazon Bedrock, AgentCore, and Strands updates for AI builders, including expanded context windows, inference, long-running agents, GovCloud availability, and robot deployment.

### Source excerpt

A recap of August 2026 launches for AI builders across Amazon Bedrock, Amazon Bedrock AgentCore, and Strands: million-token context for OpenAI models, cross-Region inference, agents that run for up to 14 days on dedicated compute, expanded AWS GovCloud availability, and Strands Robots for physical deployment.

## Negative caching protects databases from repeated lookups for nonexistent keys

DevFeed: [Negative caching protects databases from repeated lookups for nonexistent keys](<https://devfeed.tech/articles/negative-caching-the-misses-cost-more-than-the-hits-39602.md>)

Original publisher: [Read original article](<https://ankit-rana.com/logs/50-negative-caching-misses-cost-more/>)

Author: hello@ankit-rana.com

Published: 2026-09-09T00:00:00Z

Content type: tutorial

Language: en

Sources: [Ankit Rana | Mechanical Sympathy](<https://devfeed.tech/sources/ankit-rana-mechanical-sympathy.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Cache](<https://devfeed.tech/topics/cache.md>), [Database](<https://devfeed.tech/topics/database.md>), [Security](<https://devfeed.tech/topics/security.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [cache](<https://devfeed.tech/tags/cache.md>), [cache-penetration](<https://devfeed.tech/tags/cache-penetration.md>), [caching](<https://devfeed.tech/tags/caching.md>), [database](<https://devfeed.tech/tags/database.md>), [negative-caching](<https://devfeed.tech/tags/negative-caching.md>), [protection](<https://devfeed.tech/tags/protection.md>), [redis](<https://devfeed.tech/tags/redis.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [security](<https://devfeed.tech/tags/security.md>), [ttl](<https://devfeed.tech/tags/ttl.md>)

### AI overview

Negative caching prevents repeated database queries for nonexistent keys by storing a distinguishable marker for negative results. The article explains how partner integrations, scrapers, stale clients, migrations, or attackers can exploit this gap and recommends using a shorter TTL for negative entries.

### Source excerpt

A cache that stores only found values gives you no protection against lookups for things that do not exist, and a miss on a nonexistent key costs the full origin query every single time. If the key is user supplied, an attacker can generate unlimited unique misses and bypass the cache entirely, which is cache penetration. Caching the negative result fixes it, with a shorter TTL than positive entries because a value appearing is a much more likely event than one disappearing.

## DeepSeek V4.1 Flash now available on AI Gateway

DevFeed: [DeepSeek V4.1 Flash now available on AI Gateway](<https://devfeed.tech/articles/deepseek-v4-1-flash-now-available-on-ai-gateway-889.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/deepseek-v4-1-flash-now-available-on-ai-gateway>)

Author: Jerilyn Zheng

Published: 2026-09-09T00:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [deepseek](<https://devfeed.tech/topics/deepseek.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [API](<https://devfeed.tech/topics/api.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [codex](<https://devfeed.tech/topics/codex.md>), [cursor](<https://devfeed.tech/topics/cursor.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [api](<https://devfeed.tech/tags/api.md>), [caching](<https://devfeed.tech/tags/caching.md>), [codex](<https://devfeed.tech/tags/codex.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cursor](<https://devfeed.tech/tags/cursor.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [responses](<https://devfeed.tech/tags/responses.md>), [tool](<https://devfeed.tech/tags/tool.md>), [vercel](<https://devfeed.tech/tags/vercel.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

DeepSeek V4.1 Flash is now available through Vercel's AI Gateway, offering native image understanding, a 1 million token context window, responses up to 384,000 tokens, reasoning, tool use, and prompt caching. Developers can use it in Claude Code, Codex, Cursor, and other coding agents with the model name deepseek/deepseek-v4.1-flash.

### Source excerpt

DeepSeek V4.1 Flash is now available on AI Gateway with native image understanding. V4.1 Flash has vision support and accepts text and images in the same request, so you can ask questions about screenshots, read charts, and extract information from visual content. The model has a 1 million token context window and supports responses up to 384,000 tokens, along with reasoning, tool use, and prompt caching. Its new architecture processes input and generates output with separate components, reducing the active computation needed for each stage. Use deepseek/deepseek-v4.1-flash as the model name: To use it in Claude Code, Codex, Cursor, and more, install the latest Vercel CLI and run setup: Then select deepseek/deepseek-v4.1-flash in the agent. See the coding agents guide for details. Try DeepSeek V4.1 Flash in the model playground. AI Gateway provides a unified API for calling models, tracking usage and cost, and configuring retries, failover, and performance optimizations for higher-than-provider uptime. It includes built-in custom reporting, Zero Data Retention support, budgets for API keys, routing rules, and more. AI Gateway reflects provider pricing with no markup and does not charge a platform fee on inference, including on Bring Your Own Key (BYOK) requests. You can view all language models available on AI Gateway. Read more

## Architecting for 6 Billion Daily Requests: Inside Wix's Media Platform

DevFeed: [Architecting for 6 Billion Daily Requests: Inside Wix's Media Platform](<https://devfeed.tech/articles/architecting-for-6-billion-daily-requests-inside-wix-s-media-platform-22630.md>)

Original publisher: [Read original article](<https://www.wix.engineering/post/architecting-for-6-billion-daily-requests-inside-wix-s-media-platform>)

Author: Wix Engineering

Published: 2026-09-08T08:24:05Z

Content type: article

Language: en

Sources: [Wix Engineering](<https://devfeed.tech/sources/wix-engineering.md>)

Topics: [Caching](<https://devfeed.tech/topics/caching.md>), [Go Language](<https://devfeed.tech/topics/go-language.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [data](<https://devfeed.tech/topics/data.md>), [C](<https://devfeed.tech/topics/c.md>)

Tags: [c](<https://devfeed.tech/tags/c.md>), [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [compression](<https://devfeed.tech/tags/compression.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [data](<https://devfeed.tech/tags/data.md>), [go](<https://devfeed.tech/tags/go.md>), [latency](<https://devfeed.tech/tags/latency.md>), [technical](<https://devfeed.tech/tags/technical.md>)

### AI overview

Wix describes engineering challenges in its media platform, which processes images, video, and audio at large scale. The supplied text explains how the team used unsafe pointers to reduce Go/C memory-copy overhead for AVIF encoding and a tiered Masters cache to reduce CPU work during image resizing.

### Source excerpt

At Wix, "Media" isn't just about storing files. It's about processing streams of information - images, video, and audio - at an immense scale. We host over 300 million websites and serve more than 6 billion media requests every single day. To handle dozens of petabytes of data while keeping costs low and latency minimal, we had to treat media handling as a complex engineering discipline. Below are five specific technical challenges we faced and the architectural solutions we implemented to...

[Next page](<https://devfeed.tech/tags/caching.md?cursor=WyIyMDI2LTA5LTA4VDA4OjI0OjA1KzAwOjAwIiwgImNiNWY3ZmVjLTFiZjctNDc0Ny04MmJjLWU0NDQ2NzBlMTBlYSJd>)