# AWS Kinesis with Lambdas: Lessons Learned

DevFeed: [AWS Kinesis with Lambdas: Lessons Learned](<https://devfeed.tech/articles/aws-kinesis-with-lambdas-lessons-learned-28082.md>)

Original publisher: [Read original article](<https://tech.trivago.com/post/streaming-with-kinesis/>)

Author: Nikhil Kuriakose Follow

Published: 2018-07-13T00:00:00Z

Content type: tutorial

Language: en

Sources: [Trivago](<https://devfeed.tech/sources/trivago.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Kafka](<https://devfeed.tech/topics/kafka.md>), [MySQL](<https://devfeed.tech/topics/mysql.md>), [reactive](<https://devfeed.tech/topics/reactive.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [aws](<https://devfeed.tech/tags/aws.md>), [backend](<https://devfeed.tech/tags/backend.md>), [batch](<https://devfeed.tech/tags/batch.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [lambda](<https://devfeed.tech/tags/lambda.md>), [latency](<https://devfeed.tech/tags/latency.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [reactive](<https://devfeed.tech/tags/reactive.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [timeout](<https://devfeed.tech/tags/timeout.md>)

## AI overview

The article explains how a team built a reactive, serverless pipeline using Apache Kafka, AWS Kinesis, and Lambda to replicate MySQL data to AWS. It shares lessons about tuning Lambda memory, batch size, and timeout, and about scaling Kinesis shards to increase throughput.

## Source excerpt

We built a reactive pipeline to move almost a quarter billion database records to AWS and to build a reactive and serverless pipeline. This is the story of the lessons we learned along the way working with Kinesis and Lambdas