# Helios: hyperscale indexing for the cloud & edge (part II)

DevFeed: [Helios: hyperscale indexing for the cloud & edge (part II)](<https://devfeed.tech/articles/helios-hyperscale-indexing-for-the-cloud-edge-part-ii-28589.md>)

Original publisher: [Read original article](<https://blog.acolyer.org/2020/11/02/helios-part-ii/>)

Author: adriancolyer

Published: 2020-11-02T13:20:00Z

Content type: article

Language: en

Sources: [Adrian Colyer](<https://devfeed.tech/sources/adrian-colyer.md>)

Topics: [Cloud](<https://devfeed.tech/topics/cloud.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [data](<https://devfeed.tech/topics/data.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>), [real-time](<https://devfeed.tech/topics/real-time.md>), [Edge](<https://devfeed.tech/topics/edge.md>)

Tags: [azure](<https://devfeed.tech/tags/azure.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [parsing](<https://devfeed.tech/tags/parsing.md>), [process](<https://devfeed.tech/tags/process.md>), [time](<https://devfeed.tech/tags/time.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>)

## AI overview

This article explains Helios, a distributed system used at Microsoft for ingesting, indexing, and aggregating large streams of real-time data. It describes Helios's separation of ingestion and indexing, bottoms-up index construction, relational query-engine integration, and edge computation. The article also outlines use cases such as incident investigation, performance monitoring, reporting, and GDPR deletion requests, along with its stream-table and agent-based design.

## Source excerpt

Helios: hyperscale indexing for the cloud & edge, Potharaju et al., PVLDB'20 Last time out we looked at the motivations for a new reference blueprint for large-scale data processing, as embodied by Helios. Today we're going to dive into the details of Helios itself. As a reminder: Helios is a distributed, highly-scalable system used at Microsoft for ... Continue reading Helios: hyperscale indexing for the cloud & edge (part II)