# high scalability

Published articles for high scalability.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Lessons Learned Running Presto at Meta Scale

DevFeed: [Lessons Learned Running Presto at Meta Scale](<https://devfeed.tech/articles/lessons-learned-running-presto-at-meta-scale-27907.md>)

Original publisher: [Read original article](<http://highscalability.com/blog/2023/7/16/lessons-learned-running-presto-at-meta-scale.html>)

Author: Philip Bell

Published: 2023-07-16T16:42:21Z

Content type: tutorial

Language: en

Sources: [High Scalability](<https://devfeed.tech/sources/high-scalability.md>), [High Scalability](<https://devfeed.tech/sources/high-scalability-2.md>)

Topics: [SQL](<https://devfeed.tech/topics/sql.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [gateway](<https://devfeed.tech/topics/gateway.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [releases](<https://devfeed.tech/topics/releases.md>), [data centers](<https://devfeed.tech/topics/data-centers.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [automation](<https://devfeed.tech/tags/automation.md>), [availability](<https://devfeed.tech/tags/availability.md>), [data-centers](<https://devfeed.tech/tags/data-centers.md>), [database-scalability](<https://devfeed.tech/tags/database-scalability.md>), [ddatabase](<https://devfeed.tech/tags/ddatabase.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [high-availablilty](<https://devfeed.tech/tags/high-availablilty.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [high-scalability](<https://devfeed.tech/tags/high-scalability.md>), [load-balancer](<https://devfeed.tech/tags/load-balancer.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [presto](<https://devfeed.tech/tags/presto.md>), [releases](<https://devfeed.tech/tags/releases.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [sql](<https://devfeed.tech/tags/sql.md>)

### AI overview

This article presents lessons from running Presto, an open source SQL query engine, at Meta scale. It discusses deploying new releases across many clusters, maintaining availability during updates, routing queries through the Gateway, and automating cluster operations.

### Source excerpt

Presto is a free, open source SQL query engine. We've been using it at Meta for the past ten years, and learned a lot while doing so. Running anything at scale - tools, processes, services - takes problem solving to overcome unexpected challenges. Here are four things we learned while scaling up Presto to Meta scale, and some advice if you're interested in running your own queries at scale. Scaling Presto rapidly to meet growing demands: What challenges did we face? Deploying new Presto releases

## Gossip Protocol Explained

DevFeed: [Gossip Protocol Explained](<https://devfeed.tech/articles/gossip-protocol-explained-27906.md>)

Original publisher: [Read original article](<http://highscalability.com/blog/2023/7/16/gossip-protocol-explained.html>)

Author: NK

Published: 2023-07-16T16:38:02Z

Content type: article

Language: en

Sources: [High Scalability](<https://devfeed.tech/sources/high-scalability.md>), [High Scalability](<https://devfeed.tech/sources/high-scalability-2.md>)

Topics: [Protocol (disambiguation)](<https://devfeed.tech/topics/protocol.md>), [distributed-systems](<https://devfeed.tech/topics/distributed-systems.md>), [P2P](<https://devfeed.tech/topics/p2p.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [consistency](<https://devfeed.tech/topics/consistency.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Resilience](<https://devfeed.tech/topics/resilience.md>), [Network](<https://devfeed.tech/topics/network.md>)

Tags: [availability](<https://devfeed.tech/tags/availability.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [distributed-algorithm](<https://devfeed.tech/tags/distributed-algorithm.md>), [distributed-system](<https://devfeed.tech/tags/distributed-system.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [high-scalability](<https://devfeed.tech/tags/high-scalability.md>), [messages](<https://devfeed.tech/tags/messages.md>), [network](<https://devfeed.tech/tags/network.md>), [protocol](<https://devfeed.tech/tags/protocol.md>), [resilience](<https://devfeed.tech/tags/resilience.md>)

### AI overview

This article explains the gossip protocol as a peer-to-peer approach for managing state and communicating between nodes in distributed systems. It describes its relationship to high availability, eventual consistency, scalability, and resilience, and compares it with centralized state management, point-to-point broadcast, and eager reliable broadcast.

### Source excerpt

You can subscribe to the system design newsletter to excel in system design interviews and software architecture. The original article was published on systemdesign.one website. What Is Gossip Protocol? The typical problems in a distributed system are the following [1], [11]: maintaining the system state (liveness of nodes) communication between nodes The potential solutions to these problems are as follows [1]: centralized state management service peer-to-peer state management service

## Lessons Learned Running Presto at Meta Scale

DevFeed: [Lessons Learned Running Presto at Meta Scale](<https://devfeed.tech/articles/lessons-learned-running-presto-at-meta-scale-33604.md>)

Original publisher: [Read original article](<https://highscalability.com/lessons-learned-running-presto-at-meta-scale/>)

Author: Philip Bell

Published: 2023-07-16T15:42:21Z

Content type: article

Language: en

Sources: [High Scalability](<https://devfeed.tech/sources/high-scalability-3.md>)

Topics: [presto](<https://devfeed.tech/topics/presto.md>), [Meta](<https://devfeed.tech/topics/meta.md>), [Automation](<https://devfeed.tech/topics/automation.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [gateway](<https://devfeed.tech/topics/gateway.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [Availability](<https://devfeed.tech/topics/availability.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [datacenter](<https://devfeed.tech/topics/datacenter.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [automation](<https://devfeed.tech/tags/automation.md>), [availability](<https://devfeed.tech/tags/availability.md>), [data-centers](<https://devfeed.tech/tags/data-centers.md>), [database-scalability](<https://devfeed.tech/tags/database-scalability.md>), [ddatabase](<https://devfeed.tech/tags/ddatabase.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [high-availablilty](<https://devfeed.tech/tags/high-availablilty.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [high-scalability](<https://devfeed.tech/tags/high-scalability.md>), [load-balancer](<https://devfeed.tech/tags/load-balancer.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [presto](<https://devfeed.tech/tags/presto.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [sql](<https://devfeed.tech/tags/sql.md>)

### AI overview

The article presents lessons from running Presto, an open source SQL query engine, at Meta scale. It discusses deploying releases across many clusters, maintaining availability for interactive queries, using the Gateway load balancer to route queries, and automating cluster updates and capacity management.

### Source excerpt

Presto is a free, open source SQL query engine. We've been using it at Meta for the past ten years, and learned a lot while doing so. Running anything at scale - tools, processes, services - takes problem solving to overcome unexpected challenges. Here are four things we learned while

## Tracing App Backend Development

DevFeed: [Tracing App Backend Development](<https://devfeed.tech/articles/tracing-app-backend-development-36564.md>)

Original publisher: [Read original article](<https://berthub.eu/articles/posts/tracing-app-backend/>)

Published: 2020-04-14T18:00:22Z

Content type: opinion

Language: en

Sources: [Bert Hubert's writings](<https://devfeed.tech/sources/bert-hubert-s-writings.md>)

Topics: [tracing](<https://devfeed.tech/topics/tracing.md>), [backend-development](<https://devfeed.tech/topics/backend-development.md>), [API](<https://devfeed.tech/topics/api.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [Scalability](<https://devfeed.tech/topics/scalability.md>), [Availability](<https://devfeed.tech/topics/availability.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [availability](<https://devfeed.tech/tags/availability.md>), [backend](<https://devfeed.tech/tags/backend.md>), [github](<https://devfeed.tech/tags/github.md>), [high-scalability](<https://devfeed.tech/tags/high-scalability.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [powerdns](<https://devfeed.tech/tags/powerdns.md>), [tracing](<https://devfeed.tech/tags/tracing.md>)

### AI overview

The post discusses a Dutch government tender for privacy-sensitive Corona contact tracing technologies and a submitted proposal to build an open-source, scalable backend. The proposed backend would let apps query infected keys and authorized health care professionals submit them, with features including rollback, authorization checks, checkpointing, incremental updates, DoS filtering, high availability, and geo-redundancy.

### Source excerpt

bert@hubertnet.nl / @bert_hu_bert / LinkedIn Very quick post. The Dutch government just launched a tender for "digital technologies that can help with Corona". The tender includes words on privacy sensitive contact tracing, it explicitly refers to PEPP-PT, the Pan-European Privacy-Preserving Proximity Tracing project. Responses are due on Tuesday the 14th of April, 12:00 (noon). The question/answer form asks if you can do a demo on the 18th of April and have something that could be rolled out on the 28th.