# Amazon Simple Queue Service (SQS)

Fully managed message queuing service for microservices, distributed systems, and serverless applications.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Serverless ICYMI Q3 2026

DevFeed: [Serverless ICYMI Q3 2026](<https://devfeed.tech/articles/serverless-icymi-q3-2026-119355.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/compute/serverless-icymi-q3-2026/>)

Author: Julian Wood

Published: 2026-11-05T13:50:18Z

Content type: news

Language: en

Sources: [AWS Compute Blog](<https://devfeed.tech/sources/aws-compute-blog.md>)

Topics: [Serverless](<https://devfeed.tech/topics/serverless.md>), [AWS Lambda](<https://devfeed.tech/topics/aws-lambda.md>), [AWS Step Functions](<https://devfeed.tech/topics/aws-step-functions.md>), [Firecracker](<https://devfeed.tech/topics/firecracker.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Amazon DynamoDB](<https://devfeed.tech/topics/amazon-dynamodb.md>), [aws-sns](<https://devfeed.tech/topics/aws-sns.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [access-management](<https://devfeed.tech/tags/access-management.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-toolkit](<https://devfeed.tech/tags/agent-toolkit.md>), [agentcore](<https://devfeed.tech/tags/agentcore.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [amazon-cloudwatch](<https://devfeed.tech/tags/amazon-cloudwatch.md>), [amazon-dynamodb](<https://devfeed.tech/tags/amazon-dynamodb.md>), [amazon-eventbridge](<https://devfeed.tech/tags/amazon-eventbridge.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-simple-storage-service-amazon-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-amazon-s3.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-lambda](<https://devfeed.tech/tags/aws-lambda.md>), [icymi](<https://devfeed.tech/tags/icymi.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [q3](<https://devfeed.tech/tags/q3.md>), [recap](<https://devfeed.tech/tags/recap.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>)

### AI overview

The excerpt reports Q3 2026 AWS serverless updates spanning event routing, compute, workflows, storage and AI tooling. EventBridge's relaunched custom bus supports cross-account subscribers, configurable retention, keyed ordering and Avro, Protocol Buffers or JSON; it runs alongside the classic bus. Lambda changes include scalable network bandwidth for larger functions, container-image SnapStart, SQS polling capacity up to 10,000 event pollers, and loading code from customers' S3 buckets. Lambda Managed Instances allow 90-minute invocations and support newer Graviton instances; durable functions add .NET support, bring-your-own SDKs and customer-managed KMS encryption. Lambda MicroVMs provide Firecracker-isolated environments lasting up to eight hours and are available in 10 Regions with PrivateLink. Other reported changes include Step Functions integrations, SNS messages up to 1 MiB, API Gateway backend mTLS, and S3 updates. AI additions include serverless agent-inspection tools, AgentCore features, and Strands harness and evaluation tools. The source is a quarterly recap excerpt with launch claims and links to related resources, not a detailed evaluation of each feature.

### Source excerpt

In this 34th quarterly recap post, discover the most impactful AWS serverless launches, features, and resources from Q3 2026 that you might have missed.

## Message Queues

DevFeed: [Message Queues](<https://devfeed.tech/articles/message-queues-111142.md>)

Original publisher: [Read original article](<https://blog.alexewerlof.com/p/message-queues>)

Author: Alex Ewerlöf

Published: 2026-11-02T05:30:53Z

Content type: article

Language: en

Sources: [Alex Ewerlof Notes](<https://devfeed.tech/sources/alex-ewerlof-notes.md>)

Topics: [Messaging](<https://devfeed.tech/topics/messaging.md>), [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [decoupling](<https://devfeed.tech/topics/decoupling.md>), [backpressure](<https://devfeed.tech/topics/backpressure.md>), [scalable-architecture](<https://devfeed.tech/topics/scalable-architecture.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [about](<https://devfeed.tech/tags/about.md>), [admin](<https://devfeed.tech/tags/admin.md>), [ads](<https://devfeed.tech/tags/ads.md>), [ai](<https://devfeed.tech/tags/ai.md>), [alerting](<https://devfeed.tech/tags/alerting.md>), [alerts](<https://devfeed.tech/tags/alerts.md>), [all](<https://devfeed.tech/tags/all.md>), [allows](<https://devfeed.tech/tags/allows.md>), [also](<https://devfeed.tech/tags/also.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [message](<https://devfeed.tech/tags/message.md>), [message-queues](<https://devfeed.tech/tags/message-queues.md>), [queues](<https://devfeed.tech/tags/queues.md>), [resilient-architecture](<https://devfeed.tech/tags/resilient-architecture.md>)

### AI overview

Message queues let producers hand work to separate consumers, shortening user-facing waits, isolating worker failures, and buffering traffic spikes. Consumers acknowledge completed messages; if a worker fails before acknowledging, messages can be redelivered, so at-least-once delivery may cause duplicates and works best with idempotent processing. The text recommends queues for asynchronous work, bursty traffic, decoupled scaling, and reliability, while warning they add latency to time-sensitive synchronous workloads. It explains partitioning, ordering versus even workload distribution, back pressure, retry limits and dead letter queues, and durable storage with replay. Kafka retains messages for a configured period and scales through partitions and consumer groups; SQS is managed and offers Standard queues with best-effort ordering or FIFO queues with strict ordering and lower throughput; RabbitMQ uses exchanges and bindings for complex routing.

### Source excerpt

Part of resilient architecture patterns series

## Message Queues Explained: How They Work & Why

DevFeed: [Message Queues Explained: How They Work & Why](<https://devfeed.tech/articles/message-queues-explained-how-they-work-why-87507.md>)

Original publisher: [Read original article](<https://talent500.com/blog/message-queues/>)

Author: Kashif Khan

Published: 2026-10-15T02:16:52Z

Content type: tutorial

Language: en

Sources: [Talent500](<https://devfeed.tech/sources/backend-archives-talent500-blog.md>)

Topics: [Messaging](<https://devfeed.tech/topics/messaging.md>), [Publish-subscribe pattern](<https://devfeed.tech/topics/pubsub.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [RabbitMQ](<https://devfeed.tech/topics/rabbitmq.md>)

Tags: [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [asynchronous-communication](<https://devfeed.tech/tags/asynchronous-communication.md>), [azure-service-bus](<https://devfeed.tech/tags/azure-service-bus.md>), [backend](<https://devfeed.tech/tags/backend.md>), [background-job-processing](<https://devfeed.tech/tags/background-job-processing.md>), [benefits-of-message-queues](<https://devfeed.tech/tags/benefits-of-message-queues.md>), [dead-letter-queue](<https://devfeed.tech/tags/dead-letter-queue.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [event-streaming](<https://devfeed.tech/tags/event-streaming.md>), [google-cloud-pub-sub](<https://devfeed.tech/tags/google-cloud-pub-sub.md>), [how-message-queues-work](<https://devfeed.tech/tags/how-message-queues-work.md>), [message-broker](<https://devfeed.tech/tags/message-broker.md>), [message-prioritization](<https://devfeed.tech/tags/message-prioritization.md>), [message-producers-and-consumers](<https://devfeed.tech/tags/message-producers-and-consumers.md>), [message-queue](<https://devfeed.tech/tags/message-queue.md>), [message-queue-components](<https://devfeed.tech/tags/message-queue-components.md>), [message-queue-implementation](<https://devfeed.tech/tags/message-queue-implementation.md>), [message-queue-vs-database](<https://devfeed.tech/tags/message-queue-vs-database.md>), [message-queue-vs-message-bus](<https://devfeed.tech/tags/message-queue-vs-message-bus.md>), [message-queue-vs-pub-sub](<https://devfeed.tech/tags/message-queue-vs-pub-sub.md>), [message-queue-vs-web-services](<https://devfeed.tech/tags/message-queue-vs-web-services.md>), [message-queues](<https://devfeed.tech/tags/message-queues.md>), [message-queuing-as-a-service](<https://devfeed.tech/tags/message-queuing-as-a-service.md>), [message-routing](<https://devfeed.tech/tags/message-routing.md>), [microservices-messaging](<https://devfeed.tech/tags/microservices-messaging.md>), [point-to-point-messaging](<https://devfeed.tech/tags/point-to-point-messaging.md>), [publish-subscribe-messaging](<https://devfeed.tech/tags/publish-subscribe-messaging.md>), [python-message-queue](<https://devfeed.tech/tags/python-message-queue.md>), [queues](<https://devfeed.tech/tags/queues.md>), [rabbitmq](<https://devfeed.tech/tags/rabbitmq.md>), [types-of-message-queues](<https://devfeed.tech/tags/types-of-message-queues.md>)

### AI overview

This tutorial explains message queues as a way for applications and services to communicate asynchronously. It covers producers, consumers, routing, acknowledgements, retries, dead letter queues, queue and publish-subscribe models, and uses such as background jobs and microservices. It also introduces Kafka and managed cloud messaging services.

### Source excerpt

A message queue enables applications and services to exchange data asynchronously without depending on immediate responses. Explore how message queues work, their types, key components, benefits, and popular tools like RabbitMQ, Apache Kafka, and Amazon SQS for building scalable, reliable systems. The post Message Queues Explained: How They Work & Why appeared first on Talent500 blog.

## How to stream PostgreSQL changes to Amazon S3 with AWS Fargate

DevFeed: [How to stream PostgreSQL changes to Amazon S3 with AWS Fargate](<https://devfeed.tech/articles/how-to-stream-postgresql-changes-to-amazon-s3-with-aws-fargate-60175.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/database/how-to-stream-postgresql-changes-to-amazon-s3-with-aws-fargate/>)

Author: Ramdas Gutlapalli

Published: 2026-09-25T16:25:06Z

Content type: tutorial

Language: en

Sources: [AWS Database Blog](<https://devfeed.tech/sources/aws-database-blog.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [AWS Fargate](<https://devfeed.tech/topics/aws-fargate.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [AWS CloudFormation](<https://devfeed.tech/topics/aws-cloudformation.md>), [Amazon RDS](<https://devfeed.tech/topics/amazon-rds.md>), [Amazon Aurora](<https://devfeed.tech/topics/amazon-aurora.md>), [Amazon EventBridge](<https://devfeed.tech/topics/amazon-eventbridge.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [AWS Lambda](<https://devfeed.tech/topics/aws-lambda.md>)

Tags: [amazon-aurora](<https://devfeed.tech/tags/amazon-aurora.md>), [amazon-eventbridge](<https://devfeed.tech/tags/amazon-eventbridge.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-cloudformation](<https://devfeed.tech/tags/aws-cloudformation.md>), [aws-fargate](<https://devfeed.tech/tags/aws-fargate.md>), [aws-lambda](<https://devfeed.tech/tags/aws-lambda.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [expert-400](<https://devfeed.tech/tags/expert-400.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [postgresql-compatible](<https://devfeed.tech/tags/postgresql-compatible.md>), [rds-for-postgresql](<https://devfeed.tech/tags/rds-for-postgresql.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

A tutorial for building a managed, event-driven change data capture pipeline that streams PostgreSQL row-level changes from Amazon RDS or Aurora PostgreSQL to Amazon S3 near real time. The pipeline uses Fargate, EventBridge, SQS, Lambda, and CloudFormation, with S3 records stored as partitioned JSON files.

### Source excerpt

In this post, we show you how to build a fully managed, event-driven change data capture (CDC) pipeline. It streams row-level changes from Amazon RDS for PostgreSQL or Amazon Aurora PostgreSQL to Amazon S3 in near real time. You deploy the entire pipeline with a single AWS CloudFormation template, and it can run in private subnets with no internet gateway without exposing resources to the public internet.

## New in Symfony 8.2: Messenger Outbox and Claim Check

DevFeed: [New in Symfony 8.2: Messenger Outbox and Claim Check](<https://devfeed.tech/articles/new-in-symfony-8-2-messenger-outbox-and-claim-check-55676.md>)

Original publisher: [Read original article](<https://symfony.com/blog/new-in-symfony-8-2-messenger-outbox-and-claim-check>)

Author: Javier Eguiluz

Published: 2026-09-21T07:50:00Z

Content type: release

Language: en

Sources: [Symfony](<https://devfeed.tech/sources/symfony-blog.md>)

Topics: [Symfony](<https://devfeed.tech/topics/symfony.md>), [Database](<https://devfeed.tech/topics/database.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Cache](<https://devfeed.tech/topics/cache.md>)

Tags: [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [cache](<https://devfeed.tech/tags/cache.md>), [database](<https://devfeed.tech/tags/database.md>), [pattern](<https://devfeed.tech/tags/pattern.md>), [queue](<https://devfeed.tech/tags/queue.md>), [retries](<https://devfeed.tech/tags/retries.md>), [symfony](<https://devfeed.tech/tags/symfony.md>)

### AI overview

Symfony 8.2 adds Messenger transport options for the transactional outbox and claim check patterns. The outbox coordinates database transactions with broker delivery, while claim check stores oversized messages in a cache and sends references through the broker.

### Source excerpt

Many applications that send messages to a broker end up facing these two problems: (1) sending them is not part of the database transaction, and (2) brokers refuse messages that are too big. Symfony Messenger solves both in Symfony 8.2 with two new transport...

## Symfony 8.1.7 released

DevFeed: [Symfony 8.1.7 released](<https://devfeed.tech/articles/symfony-8-1-7-released-26607.md>)

Original publisher: [Read original article](<https://symfony.com/blog/symfony-8-1-7-released>)

Author: Fabien Potencier

Published: 2026-09-15T07:15:39Z

Content type: release

Language: en

Sources: [Symfony](<https://devfeed.tech/sources/symfony-blog.md>)

Topics: [Symfony](<https://devfeed.tech/topics/symfony.md>), [bug](<https://devfeed.tech/topics/bug.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>)

Tags: [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [bug](<https://devfeed.tech/tags/bug.md>), [release](<https://devfeed.tech/tags/release.md>), [symfony](<https://devfeed.tech/tags/symfony.md>)

### AI overview

Symfony 8.1.7 has been released. The release includes security, translation, Messenger, HTTP, form, console, and other fixes and minor changes, including a fix for keepalive handling on the Amazon SQS transport.

### Source excerpt

Symfony 8.1.7 has just been released. Read the Symfony upgrade guide to learn more about upgrading Symfony and use the SymfonyInsight upgrade reports to detect the code you will need to change in your project. Tip...

## Build AI-powered file classification with AWS Transfer Family

DevFeed: [Build AI-powered file classification with AWS Transfer Family](<https://devfeed.tech/articles/build-ai-powered-file-classification-with-aws-transfer-family-49888.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/storage/build-ai-powered-file-classification-with-aws-transfer-family/>)

Author: Erasmo Fabio Acrani

Published: 2026-09-11T19:56:57Z

Content type: tutorial

Language: en

Sources: [AWS Storage Blog](<https://devfeed.tech/sources/aws-storage-blog.md>)

Topics: [file](<https://devfeed.tech/topics/file.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Amazon EventBridge](<https://devfeed.tech/topics/amazon-eventbridge.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [Amazon Textract](<https://devfeed.tech/topics/amazon-textract.md>), [Orchestration](<https://devfeed.tech/topics/orchestration.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-cloudwatch](<https://devfeed.tech/tags/amazon-cloudwatch.md>), [amazon-eventbridge](<https://devfeed.tech/tags/amazon-eventbridge.md>), [amazon-simple-notification-service-sns](<https://devfeed.tech/tags/amazon-simple-notification-service-sns.md>), [amazon-simple-queue-service-sqs](<https://devfeed.tech/tags/amazon-simple-queue-service-sqs.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [amazon-textract](<https://devfeed.tech/tags/amazon-textract.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-lambda](<https://devfeed.tech/tags/aws-lambda.md>), [aws-transfer-family](<https://devfeed.tech/tags/aws-transfer-family.md>), [expert-400](<https://devfeed.tech/tags/expert-400.md>), [file](<https://devfeed.tech/tags/file.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [regular-expressions](<https://devfeed.tech/tags/regular-expressions.md>), [sftp](<https://devfeed.tech/tags/sftp.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This tutorial explains how to replace fragile filename-based routing with content-aware file classification. It combines AWS Transfer Family, Amazon Bedrock with Amazon Nova Lite, Amazon Textract, Amazon EventBridge, and Amazon SQS to ingest files over SFTP, classify their contents, and route them to downstream systems.

### Source excerpt

Organizations that receive files from external partners through SFTP face a persistent operational challenge: routing each file to the correct downstream system. Invoices, contracts, images, CSVs, and reports all arrive in a single landing zone, and each requires a different destination. The traditional approach--pattern-matching on file names with regular expressions--is inherently fragile. It relies on [...]

## Building Event-Driven Enterprise Applications with . NET and AWS

DevFeed: [Building Event-Driven Enterprise Applications with . NET and AWS](<https://devfeed.tech/articles/building-event-driven-enterprise-applications-with-net-and-aws-50819.md>)

Original publisher: [Read original article](<https://www.sitepoint.com/building-event-driven-enterprise-applications-with-net-and-aws/>)

Author: SitePoint Team

Published: 2026-09-11T16:23:12Z

Content type: tutorial

Language: en

Sources: [SitePoint](<https://devfeed.tech/sources/sitepoint.md>)

Topics: [event driven](<https://devfeed.tech/topics/event-driven.md>), [.NET](<https://devfeed.tech/topics/net.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [decoupling](<https://devfeed.tech/topics/decoupling.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [ASP.NET Core](<https://devfeed.tech/topics/asp-net-core.md>), [Amazon EventBridge](<https://devfeed.tech/topics/amazon-eventbridge.md>), [reliability-engineering](<https://devfeed.tech/topics/reliability-engineering.md>)

Tags: [apis](<https://devfeed.tech/tags/apis.md>), [asp-net](<https://devfeed.tech/tags/asp-net.md>), [asp-net-core](<https://devfeed.tech/tags/asp-net-core.md>), [aws](<https://devfeed.tech/tags/aws.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [database](<https://devfeed.tech/tags/database.md>), [decoupling](<https://devfeed.tech/tags/decoupling.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [devops](<https://devfeed.tech/tags/devops.md>), [enterprise-applications](<https://devfeed.tech/tags/enterprise-applications.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [net](<https://devfeed.tech/tags/net.md>), [performance](<https://devfeed.tech/tags/performance.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [software-development](<https://devfeed.tech/tags/software-development.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

A practical guide to redesigning an enterprise onboarding workflow as an event-driven system using .NET and AWS. It explains commands versus events, service decoupling, and the roles of SQS and EventBridge in buffering, retries, routing, and reliability.

### Source excerpt

null Continue reading Building Event-Driven Enterprise Applications with . NET and AWS on SitePoint.

## Testing application resilience with Amazon SQS and AWS Fault Injection Service

DevFeed: [Testing application resilience with Amazon SQS and AWS Fault Injection Service](<https://devfeed.tech/articles/testing-application-resilience-with-amazon-sqs-and-aws-fault-injection-service-4651.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/architecture/testing-application-resilience-with-amazon-sqs-and-aws-fault-injection-service/>)

Author: Richard Whitworth

Published: 2026-09-09T21:33:59Z

Content type: tutorial

Language: en

Sources: [AWS Architecture Blog](<https://devfeed.tech/sources/aws-architecture-blog.md>)

Topics: [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [AWS Fault Injection Service (FIS)](<https://devfeed.tech/topics/aws-fault-injection-service-fis.md>), [Chaos Engineering](<https://devfeed.tech/topics/chaos-engineering.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-cloudwatch](<https://devfeed.tech/tags/amazon-cloudwatch.md>), [amazon-simple-queue-service-sqs](<https://devfeed.tech/tags/amazon-simple-queue-service-sqs.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [automation](<https://devfeed.tech/tags/automation.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-fault-injection-service-fis](<https://devfeed.tech/tags/aws-fault-injection-service-fis.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [iam](<https://devfeed.tech/tags/iam.md>), [observability](<https://devfeed.tech/tags/observability.md>), [resilience](<https://devfeed.tech/tags/resilience.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

A tutorial on testing application resilience when Amazon SQS data-plane operations fail. It uses AWS Fault Injection Service and Systems Manager Automation to progressively deny queue access, evaluate recovery and observability with CloudWatch metrics, and avoid IAM deny-policy lockouts.

### Source excerpt

Learn how to use AWS Fault Injection Service and AWS Systems Manager Automation to run progressive chaos experiments against Amazon SQS queues. Validate that your retry logic, circuit breakers, and dead-letter queues actually work under failure before a real outage hits production.

## Orchestrating multi-agent AI architectures with Amazon S3 Files

DevFeed: [Orchestrating multi-agent AI architectures with Amazon S3 Files](<https://devfeed.tech/articles/orchestrating-multi-agent-ai-architectures-with-amazon-s3-files-49900.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/storage/orchestrating-multi-agent-ai-architectures-with-amazon-s3-files/>)

Author: Salman Ahmed

Published: 2026-08-14T10:51:15Z

Content type: tutorial

Language: en

Sources: [AWS Storage Blog](<https://devfeed.tech/sources/aws-storage-blog.md>)

Topics: [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Filesystems](<https://devfeed.tech/topics/filesystems.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [API](<https://devfeed.tech/topics/api.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agent](<https://devfeed.tech/tags/agent.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-elastic-kubernetes-service](<https://devfeed.tech/tags/amazon-elastic-kubernetes-service.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-simple-queue-service-sqs](<https://devfeed.tech/tags/amazon-simple-queue-service-sqs.md>), [amazon-simple-storage-service-amazon-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-amazon-s3.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [amazon-vpc](<https://devfeed.tech/tags/amazon-vpc.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [aws-fargate](<https://devfeed.tech/tags/aws-fargate.md>), [aws-lambda](<https://devfeed.tech/tags/aws-lambda.md>), [compute](<https://devfeed.tech/tags/compute.md>), [files](<https://devfeed.tech/tags/files.md>), [multi-agent](<https://devfeed.tech/tags/multi-agent.md>), [multi-agent-ai](<https://devfeed.tech/tags/multi-agent-ai.md>), [storage](<https://devfeed.tech/tags/storage.md>), [strands-agents](<https://devfeed.tech/tags/strands-agents.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This walkthrough explains how multi-agent AI pipelines can use Amazon S3 Files as shared working memory and a handoff layer. Agents write intermediate results to shared directories, while POSIX identities and access points provide scoped isolation. The architecture supports workloads running on EC2, Lambda, EKS, ECS on Fargate, and Bedrock AgentCore, with S3 events and SQS triggering processing.

### Source excerpt

Organizations are moving beyond single-model AI toward multi-agent architectures. In these systems, agents offload intermediate results to files rather than carrying everything in the prompt, because a large prompt inflates cost and degrades quality. A model's context window is finite, so files become working memory that persists after a session ends. In multi-agent systems, a [...]

## Low-latency, high-throughput SQS event processing with AWS Lambda provisioned mode

DevFeed: [Low-latency, high-throughput SQS event processing with AWS Lambda provisioned mode](<https://devfeed.tech/articles/low-latency-high-throughput-sqs-event-processing-with-aws-lambda-provisioned-mode-4668.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/compute/low-latency-high-throughput-sqs-event-processing-with-aws-lambda-provisioned-mode/>)

Author: Ben Freiberg

Published: 2026-08-10T13:42:03Z

Content type: article

Language: en

Sources: [AWS Compute Blog](<https://devfeed.tech/sources/aws-compute-blog.md>)

Topics: [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [AWS Lambda](<https://devfeed.tech/topics/aws-lambda.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Concurrency](<https://devfeed.tech/topics/concurrency.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Internet of things](<https://devfeed.tech/topics/iot.md>), [telemetry](<https://devfeed.tech/topics/telemetry.md>)

Tags: [amazon-simple-queue-service-sqs](<https://devfeed.tech/tags/amazon-simple-queue-service-sqs.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-lambda](<https://devfeed.tech/tags/aws-lambda.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [flash](<https://devfeed.tech/tags/flash.md>), [fraud](<https://devfeed.tech/tags/fraud.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [latency](<https://devfeed.tech/tags/latency.md>), [low-latency](<https://devfeed.tech/tags/low-latency.md>), [payment-processing](<https://devfeed.tech/tags/payment-processing.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>)

### AI overview

AWS explains how provisioned mode for Amazon SQS event source mappings with AWS Lambda provides explicit control over event pollers to support low-latency, high-throughput event processing. The article describes default and provisioned scaling, concurrency limits, throughput, and use cases including real-time payments, fraud detection, IoT telemetry, and flash-sale order fulfillment.

### Source excerpt

Customers building event-driven applications on AWS rely on Amazon Simple Queue Service (Amazon SQS) and AWS Lambda event source mappings (ESMs) to process millions of events every day. The fully managed polling infrastructure of ESMs eliminates the need to write and maintain custom code. You can focus on business logic while Lambda handles scaling, batching, [...]

## Your SQS consumer can hang forever by default

DevFeed: [Your SQS consumer can hang forever by default](<https://devfeed.tech/articles/your-sqs-consumer-can-hang-forever-by-default-17823.md>)

Original publisher: [Read original article](<https://encore.dev/blog/message-queue-hangs>)

Author: Ivan Cernja

Published: 2026-07-28T00:00:00Z

Content type: article

Language: en

Sources: [Encore Updates](<https://devfeed.tech/sources/encore-updates.md>)

Topics: [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [SDK](<https://devfeed.tech/topics/sdk.md>), [Rust](<https://devfeed.tech/topics/rust.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [health-check](<https://devfeed.tech/tags/health-check.md>), [queue](<https://devfeed.tech/tags/queue.md>), [retry](<https://devfeed.tech/tags/retry.md>), [rust](<https://devfeed.tech/tags/rust.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [sqs](<https://devfeed.tech/tags/sqs.md>), [tcp](<https://devfeed.tech/tags/tcp.md>), [timeout](<https://devfeed.tech/tags/timeout.md>)

### AI overview

The article explains that the AWS Rust SDK has no request timeout by default. A failed or silently dropped connection can leave an SQS receive waiting indefinitely, stopping a sequential consumer loop while the process and health check still appear healthy. It describes fixing the issue with a per-attempt timeout.

### Source excerpt

The AWS Rust SDK ships no request timeout by default, so one SQS receive on a dead connection can hang a whole consumer with nothing in the logs.

## Announcing the AWS Exporter | Port

DevFeed: [Announcing the AWS Exporter | Port](<https://devfeed.tech/articles/announcing-the-aws-exporter-port-12162.md>)

Original publisher: [Read original article](<https://www.port.io/blog/announcing-the-aws-exporter>)

Author: Tal Sabag

Published: 2026-07-22T12:04:28Z

Content type: article

Language: en

Sources: [Port](<https://devfeed.tech/sources/developer-experience-platform-engineering-blog-port.md>)

Topics: [internal developer portal](<https://devfeed.tech/topics/internal-developer-portal.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [developer-portal](<https://devfeed.tech/tags/developer-portal.md>), [encryption](<https://devfeed.tech/tags/encryption.md>), [iam](<https://devfeed.tech/tags/iam.md>), [internal-developer-portal](<https://devfeed.tech/tags/internal-developer-portal.md>), [queue](<https://devfeed.tech/tags/queue.md>), [resource](<https://devfeed.tech/tags/resource.md>), [s3](<https://devfeed.tech/tags/s3.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [software-catalog](<https://devfeed.tech/tags/software-catalog.md>)

### AI overview

Port's AWS exporter imports live AWS resource data into a software catalog and internal developer portal. It supports more than 500 resource types, maps them to blueprints and relations, and exposes metadata, tags, console links, and resource-specific details such as encryption and access configuration.

### Source excerpt

The AWS exporter brings us even closer to realizing our vision of getting everything into the software catalog and the internal developer portal.

## Amazon SQS turns 20: Two decades of reliable messaging at scale

DevFeed: [Amazon SQS turns 20: Two decades of reliable messaging at scale](<https://devfeed.tech/articles/amazon-sqs-turns-20-two-decades-of-reliable-messaging-at-scale-4607.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/aws/amazon-sqs-turns-20-two-decades-of-reliable-messaging-at-scale/>)

Author: Esra Kayabali

Published: 2026-07-13T18:13:57Z

Content type: article

Language: en

Sources: [AWS News Blog](<https://devfeed.tech/sources/aws-news-blog.md>)

Topics: [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [distributed-systems](<https://devfeed.tech/topics/distributed-systems.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Encryption](<https://devfeed.tech/topics/encryption.md>), [Security](<https://devfeed.tech/topics/security.md>), [Availability](<https://devfeed.tech/topics/availability.md>)

Tags: [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-simple-queue-service-sqs](<https://devfeed.tech/tags/amazon-simple-queue-service-sqs.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [availability](<https://devfeed.tech/tags/availability.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [encryption](<https://devfeed.tech/tags/encryption.md>), [launch](<https://devfeed.tech/tags/launch.md>), [messaging](<https://devfeed.tech/tags/messaging.md>), [news](<https://devfeed.tech/tags/news.md>), [performance](<https://devfeed.tech/tags/performance.md>), [scale](<https://devfeed.tech/tags/scale.md>), [security](<https://devfeed.tech/tags/security.md>), [systems](<https://devfeed.tech/tags/systems.md>), [transactions](<https://devfeed.tech/tags/transactions.md>)

### AI overview

Amazon SQS marks its 20th anniversary with a retrospective on reliable, asynchronous messaging and the decoupling of producers from consumers. The article highlights recent developments including higher-throughput FIFO queues, default server-side encryption, and dead-letter queue redrive enhancements.

### Source excerpt

On July 13, 2006, we launched Amazon Simple Queue Service (Amazon SQS) as one of the first three services available to customers, alongside Amazon EC2 and Amazon S3. We had learned firsthand that distributed systems need a reliable way to pass messages between components without creating tight dependencies. If one service called another directly and [...]

## Kafka vs RabbitMQ vs SQS

DevFeed: [Kafka vs RabbitMQ vs SQS](<https://devfeed.tech/articles/kafka-vs-rabbitmq-vs-sqs-33572.md>)

Original publisher: [Read original article](<https://blog.algomaster.io/p/kafka-vs-rabbitmq-vs-sqs>)

Author: Ashish Pratap Singh

Published: 2026-07-02T03:31:11Z

Content type: comparison

Language: en

Sources: [AlgoMaster Newsletter](<https://devfeed.tech/sources/algomaster-newsletter.md>)

Topics: [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [RabbitMQ](<https://devfeed.tech/topics/rabbitmq.md>), [Messaging](<https://devfeed.tech/topics/messaging.md>), [Back end](<https://devfeed.tech/topics/backend.md>)

Tags: [backend](<https://devfeed.tech/tags/backend.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [messaging](<https://devfeed.tech/tags/messaging.md>), [queues](<https://devfeed.tech/tags/queues.md>), [rabbitmq](<https://devfeed.tech/tags/rabbitmq.md>), [sqs](<https://devfeed.tech/tags/sqs.md>)

### AI overview

This comparison examines Kafka, RabbitMQ, and Amazon SQS for asynchronous systems. It explains that Kafka uses an append-only log with consumer offsets and replay, RabbitMQ routes messages through exchanges and queues with acknowledgments, and SQS provides managed queue-based messaging that consumers poll.

### Source excerpt

Most backend systems eventually need one service to hand off work to another asynchronously.

## Migrating a Hybrid Architecture to Laravel Cloud: Top Q&A Questions Answered

DevFeed: [Migrating a Hybrid Architecture to Laravel Cloud: Top Q&A Questions Answered](<https://devfeed.tech/articles/migrating-a-hybrid-architecture-to-laravel-cloud-top-q-a-questions-answered-3879.md>)

Original publisher: [Read original article](<https://laravel.com/blog/migrating-a-hybrid-architecture-to-laravel-cloud-top-qa-questions-answered>)

Author: Ana Tavares

Published: 2026-05-21T14:13:10Z

Content type: article

Language: en

Sources: [Laravel Blog](<https://devfeed.tech/sources/laravel-blog.md>)

Topics: [Laravel](<https://devfeed.tech/topics/laravel.md>), [migration](<https://devfeed.tech/topics/migration.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Vapor](<https://devfeed.tech/topics/swift-vapor.md>), [Cloudflare Workers](<https://devfeed.tech/topics/cloudflare-workers.md>), [API](<https://devfeed.tech/topics/api.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [data](<https://devfeed.tech/topics/data.md>), [Database](<https://devfeed.tech/topics/database.md>), [MongoDB](<https://devfeed.tech/topics/mongodb.md>), [Network](<https://devfeed.tech/topics/network.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloudflare-workers](<https://devfeed.tech/tags/cloudflare-workers.md>), [database](<https://devfeed.tech/tags/database.md>), [developer](<https://devfeed.tech/tags/developer.md>), [laravel](<https://devfeed.tech/tags/laravel.md>), [migration](<https://devfeed.tech/tags/migration.md>), [networking](<https://devfeed.tech/tags/networking.md>), [routing](<https://devfeed.tech/tags/routing.md>), [s3](<https://devfeed.tech/tags/s3.md>)

### AI overview

Trybe migrated a high-volume hybrid booking platform from Laravel Vapor to Laravel Cloud without dropping requests. The article covers its isolated multi-application architecture, routing through Cloudflare Workers, operational scale, and migration-related technical questions.

### Source excerpt

Trybe shared how they migrated from Laravel Vapor to Laravel Cloud in a live webinar. Here are the top developer questions from the Q&A, answered.

## Unordered mode for S3 ClickPipes is now available

DevFeed: [Unordered mode for S3 ClickPipes is now available](<https://devfeed.tech/articles/unordered-mode-for-s3-clickpipes-is-now-available-5182.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/clickpipes-s3-unordered-mode>)

Author: Marta Paes

Published: 2025-12-09T15:06:25Z

Content type: release

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [data](<https://devfeed.tech/tags/data.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [queue](<https://devfeed.tech/tags/queue.md>), [s3](<https://devfeed.tech/tags/s3.md>)

### AI overview

ClickPipes now supports unordered ingestion from Amazon S3 into ClickHouse Cloud using S3 Event Notifications through Amazon SQS. This handles backfills, retries, late-arriving data, and other out-of-order files without relying on lexicographical file order.

### Source excerpt

Ingest data from Amazon S3 into ClickHouse Cloud in any order for event-driven, blazing-fast analytics.

## HubSpot Incident Report for October 20, 2025

DevFeed: [HubSpot Incident Report for October 20, 2025](<https://devfeed.tech/articles/hubspot-incident-report-for-october-20-2025-29106.md>)

Original publisher: [Read original article](<https://product.hubspot.com/blog/incident-report-for-october-20-2025>)

Author: Kartik Vishwanath

Published: 2025-11-11T17:09:36Z

Content type: news

Language: en

Sources: [HubSpot](<https://devfeed.tech/sources/hubspot.md>)

Topics: [incident](<https://devfeed.tech/topics/incident.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>), [Resilience](<https://devfeed.tech/topics/resilience.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>), [Amazon DynamoDB](<https://devfeed.tech/topics/amazon-dynamodb.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>)

Tags: [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [aws](<https://devfeed.tech/tags/aws.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [data](<https://devfeed.tech/tags/data.md>), [database](<https://devfeed.tech/tags/database.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [dynamodb](<https://devfeed.tech/tags/dynamodb.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [failover](<https://devfeed.tech/tags/failover.md>), [hubspot](<https://devfeed.tech/tags/hubspot.md>), [iam](<https://devfeed.tech/tags/iam.md>), [improvements](<https://devfeed.tech/tags/improvements.md>), [incident](<https://devfeed.tech/tags/incident.md>), [message-queue](<https://devfeed.tech/tags/message-queue.md>), [outage](<https://devfeed.tech/tags/outage.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [report](<https://devfeed.tech/tags/report.md>), [resilience](<https://devfeed.tech/tags/resilience.md>)

### AI overview

HubSpot reports that a severe AWS outage in the us-east-1 region on October 20, 2025 disrupted multiple product features and affected third-party vendors. The incident caused failures involving DynamoDB, IAM, SQS, and EC2, and degraded HubSpot's TQ2 background task processing. HubSpot says it completed an analysis and is implementing resilience improvements.

### Source excerpt

On October 20, 2025, HubSpot experienced a significant service disruption affecting multiple product features due to a severe AWS outage in the us-east-1 region. While our infrastructure remained intact, the widespread nature of the cloud provider failure impacted both our services and critical third-party vendors we rely on. We've completed a thorough analysis of this incident and are implementing comprehensive improvements to strengthen our resilience against future cloud provider disruptions.

## Building event-driven pipelines with SQS and S3

DevFeed: [Building event-driven pipelines with SQS and S3](<https://devfeed.tech/articles/building-event-driven-pipelines-with-sqs-and-s3-12679.md>)

Original publisher: [Read original article](<https://www.redpanda.com/blog/building-event-driven-pipelines-sqs-s3>)

Author: Chandler Mayo

Published: 2025-08-21T00:00:00Z

Content type: tutorial

Language: en

Sources: [Redpanda](<https://devfeed.tech/sources/redpanda.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-sqs](<https://devfeed.tech/tags/amazon-sqs.md>), [amazon-sqs-s3-integration](<https://devfeed.tech/tags/amazon-sqs-s3-integration.md>), [automate-data-ingestion-s3](<https://devfeed.tech/tags/automate-data-ingestion-s3.md>), [building-data-pipelines-with-sqs-and-s3](<https://devfeed.tech/tags/building-data-pipelines-with-sqs-and-s3.md>), [building-event-driven-pipelines-with-sqs-and-s3](<https://devfeed.tech/tags/building-event-driven-pipelines-with-sqs-and-s3.md>), [data-pipeline-automation-with-sqs](<https://devfeed.tech/tags/data-pipeline-automation-with-sqs.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [event-driven-data-processing](<https://devfeed.tech/tags/event-driven-data-processing.md>), [event-driven-pipelines-sqs-s3](<https://devfeed.tech/tags/event-driven-pipelines-sqs-s3.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [real-time-data-pipelines-s3](<https://devfeed.tech/tags/real-time-data-pipelines-s3.md>), [s3-to-redpanda-streaming](<https://devfeed.tech/tags/s3-to-redpanda-streaming.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [set-up-event-driven-architecture-aws](<https://devfeed.tech/tags/set-up-event-driven-architecture-aws.md>), [sqs-s3-data-pipeline-tutorial](<https://devfeed.tech/tags/sqs-s3-data-pipeline-tutorial.md>), [sqs-s3-notifications-for-data-pipelines](<https://devfeed.tech/tags/sqs-s3-notifications-for-data-pipelines.md>), [streaming-data-to-redpanda-from-s3](<https://devfeed.tech/tags/streaming-data-to-redpanda-from-s3.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

### AI overview

This tutorial explains how to use S3 Event Notifications and Amazon SQS to trigger Redpanda Connect processing whenever new objects arrive in an S3 bucket. It demonstrates an automated, continuously running pipeline that ingests object-storage data into real-time streams.

### Source excerpt

Learn how to build real-time, event-driven data pipelines directly from your object storage with Amazon SQS and S3.

## Cloud-native data ingestion architecture using AWS, Databricks, and open-source tools

DevFeed: [Cloud-native data ingestion architecture using AWS, Databricks, and open-source tools](<https://devfeed.tech/articles/let-s-save-tons-of-money-with-cloud-native-data-ingestion-22560.md>)

Original publisher: [Read original article](<https://tech.scribd.com/blog/2025/cloud-native-data-ingestion.html>)

Author: R Tyler Croy

Published: 2025-08-01T00:00:00Z

Content type: tutorial

Language: en

Sources: [Scribd Tech](<https://devfeed.tech/sources/scribd-tech.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Azure](<https://devfeed.tech/topics/azure.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [azure](<https://devfeed.tech/tags/azure.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [data](<https://devfeed.tech/tags/data.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [deltalake](<https://devfeed.tech/tags/deltalake.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [featured](<https://devfeed.tech/tags/featured.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [rust](<https://devfeed.tech/tags/rust.md>), [sqs](<https://devfeed.tech/tags/sqs.md>)

### AI overview

This article presents Scribd's cloud-native data-ingestion architecture for building large datasets for Delta Lake. It describes using AWS services and open-source tools such as kafka-delta-ingest, oxbow, and Airbyte in a more event-driven and reliable platform, with Databricks and Unity Catalog. The approach can also be adapted to Azure, Google Cloud Platform, or on-premises environments.

### Source excerpt

Delta Lake is a fantastic technology for quickly querying massive data sets, but first you need those massive data sets! In this talk from Data and AI Summit 2025 I dive into the cloud-native architecture Scribd has adopted to ingest data from AWS Aurora, SQS, Kinesis Data Firehose and more!

## Order Dispatch Systems at Scale

DevFeed: [Order Dispatch Systems at Scale](<https://devfeed.tech/articles/order-dispatch-systems-at-scale-30799.md>)

Original publisher: [Read original article](<https://devblog.kogan.com/blog/order-dispatch-systems-at-scale>)

Author: Guest User

Published: 2025-07-28T01:53:56Z

Content type: tutorial

Language: en

Sources: [Kogan.com](<https://devfeed.tech/sources/kogan-com.md>)

Topics: [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Microservices](<https://devfeed.tech/topics/microservices.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [event](<https://devfeed.tech/tags/event.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [latency](<https://devfeed.tech/tags/latency.md>), [microservices-architecture](<https://devfeed.tech/tags/microservices-architecture.md>), [scale](<https://devfeed.tech/tags/scale.md>), [sqs](<https://devfeed.tech/tags/sqs.md>)

### AI overview

This tutorial compares vertical and horizontal scaling, pull-based queues using AWS Simple Queue Service, and event-driven architecture for order dispatch systems. It describes queue trade-offs and explains how event subscribers can process orders independently and scale separately.

### Source excerpt

How to load-balance like a seasoned waiter Software systems often parallel the real world. Imagine running a busy restaurant, where customers line up to make orders whilst the kitchen prepares the meals. In the software world, your users are the customers, and your backend services are the kitchen. With more people online than ever before, that line might start to grow out the front door. The ability to scale is no longer optional, it is essential. Know Your Options Vertical Scaling - Scale Up Horizontal Scaling - Scale Out Expanding your restaurant by adding more tables or a larger kitchen. In software terms, this means scaling up your infrastructure. More powerful CPUs, larger memory, increased throughput etc. This is a relative quick fix, but comes with diminishing returns and limits on how big everything can get. Opening new restaurant locations to serve more customers simultaneously and distribute existing flows. In software terms, this means adding more API servers, more worker nodes or creating many database replicas. This approach is more flexible and scalable than vertical scaling in the long term. A Steppingstone - Queues Just like how customers queue for their order, we create a pull-based task queue for our order management system using AWS Simple Queue Service (SQS). Tasks get queued into the SQS, and a consumer service will continuously poll this queue to process the tasks. This gives a lot of control for the queue consumer to dictate the frequency of polling, which works well in systems that cannot handle high throughput or requires non-concurrency like the SAP ERP (more on that later). SQS also provides built-in dead-letter-queues, retry policies, at least once delivery guarantee and scales automatically. Vertical scaling involves sizing up the compute power of the consumer (CPU, RAM etc). Horizontal scaling involves spinning up more consumers of the SQS. However, queues have limitations: Latency between order arrival and processing. Inefficient poll

## Preventing duplicate charges with idempotency and message queues

DevFeed: [Preventing duplicate charges with idempotency and message queues](<https://devfeed.tech/articles/because-nobody-likes-being-charged-twice-81734.md>)

Original publisher: [Read original article](<https://stripe.dev/blog/because-nobody-likes-being-charged-twice>)

Author: Ben Smith

Published: 2025-04-10T00:00:00Z

Content type: tutorial

Language: en

Sources: [Stripe Dot Dev Blog](<https://devfeed.tech/sources/stripe-dot-dev-blog.md>)

Topics: [payment volume spikes](<https://devfeed.tech/topics/payment-volume-spikes.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Messaging](<https://devfeed.tech/topics/messaging.md>)

Tags: [idempotency](<https://devfeed.tech/tags/idempotency.md>), [payment](<https://devfeed.tech/tags/payment.md>), [queues](<https://devfeed.tech/tags/queues.md>), [reliability](<https://devfeed.tech/tags/reliability.md>)

### AI overview

The post describes how idempotency and message queues can help prevent duplicate charges and operational errors in high volume Stripe payment systems, improving reliability as systems scale.

### Source excerpt

In complex, high-volume systems, even minor failures--like a dropped internet connection--can lead to major headaches, such as duplicate charges. This post explores advanced patterns for integrating Stripe into your enterprise applications with a focus on building fault-tolerant, user-friendly payment systems. Learn how strategies like idempotency and message queues can protect your users from double charges, reduce operational errors, and improve reliability as your system scales.

## Terraform module to manage Oxbow Lambda and its components

DevFeed: [Terraform module to manage Oxbow Lambda and its components](<https://devfeed.tech/articles/terraform-module-to-manage-oxbow-lambda-and-its-components-22561.md>)

Original publisher: [Read original article](<https://tech.scribd.com/blog/2025/terraform-oxbow-module.html>)

Author: Oleh Motrunych

Published: 2025-03-14T00:00:00Z

Content type: release

Language: en

Sources: [Scribd Tech](<https://devfeed.tech/sources/scribd-tech.md>)

Topics: [Terraform](<https://devfeed.tech/topics/terraform.md>), [AWS Lambda](<https://devfeed.tech/topics/aws-lambda.md>), [Infrastructure as code](<https://devfeed.tech/topics/infrastructure-as-code.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [event driven](<https://devfeed.tech/topics/event-driven.md>), [Amazon DynamoDB](<https://devfeed.tech/topics/amazon-dynamodb.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-lambda](<https://devfeed.tech/tags/aws-lambda.md>), [aws-s3](<https://devfeed.tech/tags/aws-s3.md>), [deltalake](<https://devfeed.tech/tags/deltalake.md>), [dynamodb](<https://devfeed.tech/tags/dynamodb.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [iac](<https://devfeed.tech/tags/iac.md>), [oxbow](<https://devfeed.tech/tags/oxbow.md>), [rust](<https://devfeed.tech/tags/rust.md>), [security](<https://devfeed.tech/tags/security.md>), [sqs](<https://devfeed.tech/tags/sqs.md>), [terraform](<https://devfeed.tech/tags/terraform.md>)

### AI overview

The article introduces terraform-oxbow, an open-source Terraform module for deploying and managing an Oxbow AWS Lambda workflow and its supporting components. It describes configurable integrations including AWS Glue, Kinesis Data Firehose, SQS, DynamoDB, IAM policies, and S3 notifications, while noting AWS notification limits and least-privilege considerations.

### Source excerpt

Oxbow is a project to take an existing storage location which contains Apache Parquet files into a Delta Lake table. It is intended to run both as an AWS Lambda or as a command line application. We are excited to introduce terraform-oxbow, an open-source Terraform module that simplifies the deployment and management of AWS Lambda and its supporting components. Whether you're working with AWS Glue, Kinesis Data Firehose, SQS, or DynamoDB, this module provides a streamlined approach to infrastructure as code (IaC) in AWS.

## Building Reliable Messaging Patterns in AWS with SQS and SNS

DevFeed: [Building Reliable Messaging Patterns in AWS with SQS and SNS](<https://devfeed.tech/articles/building-reliable-messaging-patterns-in-aws-with-sqs-and-sns-18004.md>)

Original publisher: [Read original article](<https://blog.guilleojeda.com/building-reliable-messaging-patterns-in-aws-with-sqs-and-sns>)

Author: Guillermo Ojeda

Published: 2024-12-20T15:20:38Z

Content type: tutorial

Language: en

Sources: [Guille Ojeda](<https://devfeed.tech/sources/guille-ojeda.md>)

Topics: [Amazon Simple Queue Service (SQS)](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Messaging](<https://devfeed.tech/topics/messaging.md>), [distributed-systems](<https://devfeed.tech/topics/distributed-systems.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [distributed-system](<https://devfeed.tech/tags/distributed-system.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [error-handling](<https://devfeed.tech/tags/error-handling.md>), [fifo](<https://devfeed.tech/tags/fifo.md>), [messaging](<https://devfeed.tech/tags/messaging.md>), [scale](<https://devfeed.tech/tags/scale.md>), [sns](<https://devfeed.tech/tags/sns.md>), [sqs](<https://devfeed.tech/tags/sqs.md>), [technical](<https://devfeed.tech/tags/technical.md>)

### AI overview

This tutorial explains how to build reliable distributed messaging systems with AWS SQS and SNS. It covers queue configuration, error handling, scaling patterns, message retention, long polling, visibility timeouts, and the differences between Standard and FIFO queues, using Node.js examples.

### Source excerpt

Building distributed systems requires putting a lot of attention on communication between components. These components often need to exchange information asynchronously, and that's where message queues and pub/sub systems are the go-to solution. AWS ...

[Next page](<https://devfeed.tech/topics/amazon-simple-queue-service-sqs.md?cursor=WyIyMDI0LTEyLTIwVDE1OjIwOjM4KzAwOjAwIiwgIjM4NzQwYTdjLWYxYWUtNDM1OC05NzNlLWI4MjQ2MjI4Y2I4OCJd>)