# Announcing OpenTSDB 2.4.0: Rollup and Pre-Aggregation Storage, Histograms, Sketches, and More

DevFeed: [Announcing OpenTSDB 2.4.0: Rollup and Pre-Aggregation Storage, Histograms, Sketches, and More](<https://devfeed.tech/articles/announcing-opentsdb-2-4-0-rollup-and-pre-aggregation-storage-histograms-sketches-and-more-20496.md>)

Original publisher: [Read original article](<https://yahooeng.tumblr.com/post/181461332311>)

Author: amberwilsonla-blog

Published: 2018-12-27T17:01:17Z

Content type: release

Language: en

Sources: [Yahoo](<https://devfeed.tech/sources/yahoo.md>)

Topics: [Databases](<https://devfeed.tech/topics/databases.md>), [Time Series](<https://devfeed.tech/topics/time-series.md>), [Hadoop](<https://devfeed.tech/topics/hadoop.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Temporal data](<https://devfeed.tech/topics/temporal-data.md>)

Tags: [data-analysis](<https://devfeed.tech/tags/data-analysis.md>), [databases](<https://devfeed.tech/tags/databases.md>), [hadoop](<https://devfeed.tech/tags/hadoop.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [release](<https://devfeed.tech/tags/release.md>), [salesforce](<https://devfeed.tech/tags/salesforce.md>), [time-series](<https://devfeed.tech/tags/time-series.md>), [workflows](<https://devfeed.tech/tags/workflows.md>), [yahoo-engineering](<https://devfeed.tech/tags/yahoo-engineering.md>)

## AI overview

OpenTSDB 2.4.0 is released with rollup and pre-aggregation storage for time series data, along with histograms and sketches. The release focuses on retaining lower-resolution data for longer periods, reducing query workloads, and supporting more accurate percentile analysis across multiple series.

## Source excerpt

yahoodevelopers: By Chris Larsen, Architect OpenTSDB is one of the first dedicated open source time series databases built on top of Apache HBase and the Hadoop Distributed File System. Today, we are proud to share that version 2.4.0 is now available and has many new features developed in-house and with contributions from the open source community. This release would not have been possible without support from our monitoring team, the Hadoop and HBase developers, as well as contributors from other companies like Salesforce, Alibaba, JD.com, Arista and more. Thank you to everyone who contributed to this release! A few of the exciting new features include: Rollup and Pre-Aggregation Storage As time series data grows, storing the original measurements becomes expensive. Particularly in the case of monitoring workflows, users rarely care about last years' high fidelity data. It's more efficient to store lower resolution "rollups" for longer periods, discarding the original high-resolution data. OpenTSDB now supports storing and querying such data so that the raw data can expire from HBase or Bigtable, and the rollups can stick around longer. Querying for long time ranges will read from the lower resolution data, fetching fewer data points and speeding up queries. Likewise, when a user wants to query tens of thousands of time series grouped by, for example, data centers, the TSD will have to fetch and process a significant amount of data, making queries painfully slow. To improve query speed, pre-aggregated data can be stored and queried to fetch much less data at query time, while still retaining the raw data. We have an Apache Storm pipeline that computes these rollups and pre-aggregates, and we intend to open source that code in 2019. For more details, please visit http://opentsdb.net/docs/build/html/user_guide/rollups.html. Histograms and Sketches When monitoring or performing data analysis, users often like to explore percentiles of their measurements, such as the 9