# How Discord Processes 30+ Petabytes of Data

DevFeed: [How Discord Processes 30+ Petabytes of Data](<https://devfeed.tech/articles/how-discord-processes-30-petabytes-of-data-17969.md>)

Original publisher: [Read original article](<https://newsletter.betterstack.com/p/how-discord-processes-30-petabytes>)

Author: Richard Oliver Bray

Published: 2024-09-25T13:02:10Z

Content type: article

Language: en

Sources: [Hacking Scale by Better Stack](<https://devfeed.tech/sources/hacking-scale-by-better-stack.md>)

Topics: [Discord](<https://devfeed.tech/topics/discord.md>), [data](<https://devfeed.tech/topics/data.md>), [scylladb](<https://devfeed.tech/topics/scylladb.md>), [NoSQL](<https://devfeed.tech/topics/nosql.md>), [C++](<https://devfeed.tech/topics/c-plus-plus.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [c-plus-plus](<https://devfeed.tech/tags/c-plus-plus.md>), [data](<https://devfeed.tech/tags/data.md>), [discord](<https://devfeed.tech/tags/discord.md>), [nosql](<https://devfeed.tech/tags/nosql.md>), [scylladb](<https://devfeed.tech/tags/scylladb.md>)

## AI overview

This article explains how Discord analyzes billions of daily messages and manages large-scale data processing. It describes message storage in ScyllaDB, data cleaning, machine-learning use cases, and Discord's development of Derived to automate data transformation for analysis.

## Source excerpt

Discord's genius approach to automating insights from billions of messages