# How Uber Reduced Their Log Size By 99%

DevFeed: [How Uber Reduced Their Log Size By 99%](<https://devfeed.tech/articles/how-uber-reduced-their-log-size-by-99-17981.md>)

Original publisher: [Read original article](<https://newsletter.betterstack.com/p/how-uber-reduced-their-log-size-by>)

Author: Richard Oliver Bray

Published: 2024-10-09T13:02:55Z

Content type: article

Language: en

Sources: [Hacking Scale by Better Stack](<https://devfeed.tech/sources/hacking-scale-by-better-stack.md>)

Topics: [Logging](<https://devfeed.tech/topics/logging.md>), [Hadoop](<https://devfeed.tech/topics/hadoop.md>), [Filesystems](<https://devfeed.tech/topics/filesystems.md>), [big-data](<https://devfeed.tech/topics/big-data.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [big-data](<https://devfeed.tech/tags/big-data.md>), [cli](<https://devfeed.tech/tags/cli.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [data](<https://devfeed.tech/tags/data.md>), [hadoop](<https://devfeed.tech/tags/hadoop.md>), [hdfs](<https://devfeed.tech/tags/hdfs.md>), [logging](<https://devfeed.tech/tags/logging.md>)

## AI overview

The article explains how Uber addressed the storage cost of generating roughly 5 PB of INFO-level logs each month. It describes Uber's use of HDFS and related data-processing tools, while reporting that the company reduced log storage size by 99%.

## Source excerpt

Uber broke apart an open source tool to massively compress their logs