# setting up Redpanda with Amazon S3

Published articles for setting up Redpanda with Amazon S3.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Writing data from Redpanda to S3

DevFeed: [Writing data from Redpanda to S3](<https://devfeed.tech/articles/writing-data-from-redpanda-to-s3-12782.md>)

Original publisher: [Read original article](<https://www.redpanda.com/blog/writing-data-redpanda-amazon-s3>)

Author: Chandler Mayo

Published: 2025-07-29T00:00:00Z

Content type: tutorial

Language: en

Sources: [Redpanda](<https://devfeed.tech/sources/redpanda.md>)

Topics: [Redpanda-Connect](<https://devfeed.tech/topics/redpanda-connect.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [JSON](<https://devfeed.tech/topics/json.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [configuration](<https://devfeed.tech/topics/configuration.md>), [data observability](<https://devfeed.tech/topics/data-observability.md>), [debug](<https://devfeed.tech/topics/debug.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [batch-messages-from-redpanda-to-s3](<https://devfeed.tech/tags/batch-messages-from-redpanda-to-s3.md>), [event-driven-pipelines-with-redpanda-and-s3](<https://devfeed.tech/tags/event-driven-pipelines-with-redpanda-and-s3.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [json](<https://devfeed.tech/tags/json.md>), [optimizing-redpanda-data-for-s3](<https://devfeed.tech/tags/optimizing-redpanda-data-for-s3.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [redpanda-community-and-s3-integration](<https://devfeed.tech/tags/redpanda-community-and-s3-integration.md>), [redpanda-connect](<https://devfeed.tech/tags/redpanda-connect.md>), [redpanda-json-files-to-s3](<https://devfeed.tech/tags/redpanda-json-files-to-s3.md>), [redpanda-s3-bucket-configuration](<https://devfeed.tech/tags/redpanda-s3-bucket-configuration.md>), [redpanda-to-amazon-s3-data-streaming](<https://devfeed.tech/tags/redpanda-to-amazon-s3-data-streaming.md>), [redpanda-to-s3-integration](<https://devfeed.tech/tags/redpanda-to-s3-integration.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [setting-up-redpanda-with-amazon-s3](<https://devfeed.tech/tags/setting-up-redpanda-with-amazon-s3.md>), [stream-data-to-amazon-s3-from-redpanda](<https://devfeed.tech/tags/stream-data-to-amazon-s3-from-redpanda.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>), [writing-data-from-redpanda-to-s3](<https://devfeed.tech/tags/writing-data-from-redpanda-to-s3.md>)

### AI overview

This tutorial shows how to use Redpanda Connect to stream messages from a Redpanda topic into Amazon S3, writing each message as an individual JSON file. It covers deploying a YAML pipeline, configuring its input and output, and notes that the pattern is suited to small datasets, debugging, and archives rather than production-scale throughput.

### Source excerpt

Learn the easiest way to stream data into Amazon S3 from Redpanda.

## Bringing data from Amazon S3 into Redpanda Serverless

DevFeed: [Bringing data from Amazon S3 into Redpanda Serverless](<https://devfeed.tech/articles/bringing-data-from-amazon-s3-into-redpanda-serverless-12678.md>)

Original publisher: [Read original article](<https://www.redpanda.com/blog/bringing-data-amazon-s3-redpanda-serverless>)

Author: Chandler Mayo

Published: 2025-07-15T00:00:00Z

Content type: tutorial

Language: en

Sources: [Redpanda](<https://devfeed.tech/sources/redpanda.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [CSV](<https://devfeed.tech/topics/csv.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-s3-to-redpanda-integration](<https://devfeed.tech/tags/amazon-s3-to-redpanda-integration.md>), [csv-data-streaming-to-redpanda](<https://devfeed.tech/tags/csv-data-streaming-to-redpanda.md>), [data](<https://devfeed.tech/tags/data.md>), [data-pipeline-from-s3-to-redpanda](<https://devfeed.tech/tags/data-pipeline-from-s3-to-redpanda.md>), [deploying-redpanda-data-pipelines](<https://devfeed.tech/tags/deploying-redpanda-data-pipelines.md>), [event-driven-pipelines-with-s3](<https://devfeed.tech/tags/event-driven-pipelines-with-s3.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [integration](<https://devfeed.tech/tags/integration.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [redpanda-and-s3-integration-tutorial](<https://devfeed.tech/tags/redpanda-and-s3-integration-tutorial.md>), [redpanda-community-and-support](<https://devfeed.tech/tags/redpanda-community-and-support.md>), [redpanda-serverless-data-transformation](<https://devfeed.tech/tags/redpanda-serverless-data-transformation.md>), [redpanda-streaming-topics](<https://devfeed.tech/tags/redpanda-streaming-topics.md>), [s3](<https://devfeed.tech/tags/s3.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [setting-up-redpanda-with-amazon-s3](<https://devfeed.tech/tags/setting-up-redpanda-with-amazon-s3.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [streaming-data-from-amazon-s3](<https://devfeed.tech/tags/streaming-data-from-amazon-s3.md>), [video](<https://devfeed.tech/tags/video.md>), [yaml](<https://devfeed.tech/tags/yaml.md>), [zero-custom-infrastructure-data-streaming](<https://devfeed.tech/tags/zero-custom-infrastructure-data-streaming.md>)

### AI overview

This tutorial explains how to use Redpanda Connect to continuously read CSV data from an Amazon S3 bucket, transform it in a streaming pipeline, and publish the processed records to a Redpanda Serverless topic.

### Source excerpt

Learn how to set up a data pipeline from Amazon S3 to Redpanda complete with in-stream transformation logic and zero custom infrastructure.