# Improve logs compression with log clustering

DevFeed: [Improve logs compression with log clustering](<https://devfeed.tech/articles/improve-logs-compression-with-log-clustering-5311.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/improve-compression-log-clustering>)

Author: Lionel Palacin

Published: 2025-10-30T15:50:19Z

Content type: article

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [Compression](<https://devfeed.tech/topics/compression.md>), [clickhouse](<https://devfeed.tech/topics/clickhouse.md>), [log management](<https://devfeed.tech/topics/log-management.md>), [Parser](<https://devfeed.tech/topics/parser.md>), [SIEM, Security, Observability](<https://devfeed.tech/topics/siem-security-observability.md>), [nginx](<https://devfeed.tech/topics/nginx.md>)

Tags: [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [compression](<https://devfeed.tech/tags/compression.md>), [data](<https://devfeed.tech/tags/data.md>), [database](<https://devfeed.tech/tags/database.md>), [development](<https://devfeed.tech/tags/development.md>), [logs](<https://devfeed.tech/tags/logs.md>), [nginx](<https://devfeed.tech/tags/nginx.md>), [observability](<https://devfeed.tech/tags/observability.md>), [platform](<https://devfeed.tech/tags/platform.md>), [product-development](<https://devfeed.tech/tags/product-development.md>)

## AI overview

This article explains how to use log clustering with Drain3 and ClickHouse UDFs to transform unstructured application logs into structured data. Extracting recurring templates and variable fields into columns enables efficient columnar storage, queryability, and reconstruction, with nearly 50x compression reported for the approach.

## Source excerpt

Learn how to implement log clustering with Drain3 and ClickHouse UDFs to automatically structure raw application logs.