# Accommodation Consolidation: How we created an ETL pipeline on cloud

DevFeed: [Accommodation Consolidation: How we created an ETL pipeline on cloud](<https://devfeed.tech/articles/accommodation-consolidation-how-we-created-an-etl-pipeline-on-cloud-27990.md>)

Original publisher: [Read original article](<https://tech.trivago.com/post/2020-03-26-accommodationconsolidationhowwecreatedan/>)

Author: Praneeth Peiris I want

Published: 2020-03-26T00:00:00Z

Content type: article

Language: en

Sources: [Trivago](<https://devfeed.tech/sources/trivago.md>)

Topics: [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [AWS Step Functions](<https://devfeed.tech/topics/aws-step-functions.md>), [etl](<https://devfeed.tech/topics/etl.md>), [data](<https://devfeed.tech/topics/data.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-step-functions](<https://devfeed.tech/tags/aws-step-functions.md>), [backend](<https://devfeed.tech/tags/backend.md>), [batch](<https://devfeed.tech/tags/batch.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [data](<https://devfeed.tech/tags/data.md>), [engineering-culture](<https://devfeed.tech/tags/engineering-culture.md>), [etl](<https://devfeed.tech/tags/etl.md>), [overhead](<https://devfeed.tech/tags/overhead.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>)

## AI overview

trivago describes a hybrid AWS architecture using AWS Glue and AWS Step Functions to build ETL pipelines for consolidating frequently changing hotel information from hundreds of partners. The approach batches updates to reduce computational overhead and supports separately tested consolidation models and sandbox environments.

## Source excerpt

Imagine you go to your hotel for check-in and they say that your dog is not allowed even though the website clearly states that it is!trivago gets information about millions of accommodat...