# How the Guardian's Ophan Analytics Tool Moved from Elasticsearch Rollups to BigQuery

DevFeed: [How the Guardian's Ophan Analytics Tool Moved from Elasticsearch Rollups to BigQuery](<https://devfeed.tech/articles/roll-over-rollups-the-big-future-of-ophan-s-historical-data-19962.md>)

Original publisher: [Read original article](<https://www.theguardian.com/info/2023/jun/07/roll-over-rollups-the-big-future-of-ophans-historical-data>)

Author: Sam Hession

Published: 2023-06-07T12:44:33Z

Content type: article

Language: en

Sources: [Guardian](<https://devfeed.tech/sources/guardian.md>)

Topics: [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [elasticsearch](<https://devfeed.tech/topics/elasticsearch.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [data](<https://devfeed.tech/tags/data.md>), [elasticsearch](<https://devfeed.tech/tags/elasticsearch.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [warehouse](<https://devfeed.tech/tags/warehouse.md>)

## AI overview

The Guardian describes how Ophan, its real-time analytics tool, expanded from short-term pageview monitoring to historical data analysis. Because Elasticsearch Rollups remained in technical preview and lacked service-level guarantees, the team considered moving the long-term data pipeline to BigQuery.

## Source excerpt

How the Guardian's real time analytics tool pivoted from ElasticSearch Rollups to BigQuery and what we learnt along the way Ophan is the Guardian's in-house developed real time analytics tool which allows us to see how our content is performing in real-time, providing our Editorial teams with the insights they need to curate and promote our journalism. Its intuitive ways of monitoring reader engagement with content help the teams to evaluate whether it's performing optimally. Ophan's distinguishing feature has always been to provide journalists with visualised real time pageview information, with features based on the previous two weeks. More recently we have expanded these capabilities to provide insights for wider timescales with years of data available at their fingertips. Continue reading...