# lyft

Published articles for lyft.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Refreshing the Travel-Time Map Behind Lyft's Marketplace: Rebuilding Neighborhood Reachability...

DevFeed: [Refreshing the Travel-Time Map Behind Lyft's Marketplace: Rebuilding Neighborhood Reachability...](<https://devfeed.tech/articles/refreshing-the-travel-time-map-behind-lyft-s-marketplace-rebuilding-neighborhood-reachability-1241.md>)

Original publisher: [Read original article](<https://eng.lyft.com/refreshing-the-travel-time-map-behind-lyfts-marketplace-rebuilding-neighborhood-reachability-5be3efbc82ea?source=rss----25cd379abb8---4>)

Author: Manjunath Shettar

Published: 2026-09-10T16:12:28Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [dataset](<https://devfeed.tech/topics/dataset.md>), [airflow](<https://devfeed.tech/topics/airflow.md>)

Tags: [airflow](<https://devfeed.tech/tags/airflow.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [feature-engineering](<https://devfeed.tech/tags/feature-engineering.md>), [latency](<https://devfeed.tech/tags/latency.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [offline](<https://devfeed.tech/tags/offline.md>), [tea](<https://devfeed.tech/tags/tea.md>)

### AI overview

Lyft describes rebuilding its Neighborhood Reachability Signals: offline, regional travel-time matrices between geohash-6 cells and their associated neighborhood-center lists. The refresh replaces older static data and is intended to support marketplace pricing, driver guidance, and demand heatmaps, with future work aimed at time-aware travel times.

### Source excerpt

Refreshing the Travel-Time Map Behind Lyft's Marketplace: Rebuilding Neighborhood Reachability Signals Every time Lyft calculates pricing to balance a market, nudges a driver toward an under-served pocket of a city, or paints a heatmap of where demand is building, there is a quiet lookup table doing work in the background. It answers a deceptively simple question: how long does it take to get from here to there?, for millions of pairs of places, across hundreds of regions. That lookup table is the Neighborhood Reachability Signal, and for years large parts of it were frozen in a snapshot of the world from 2018-2019. This is the story of how we rebuilt it, why a refresh substantial enough to be worth adopting was what finally moved Pricing to switch, the cleanly positive results that came out of that switch, and where we're taking it next, from one static file per region to time-aware travel times that change with the rhythm of the day. What is a Neighborhood Reachability Signal? A geohash is a compact way of carving the world into a grid of cells. At geohash-6 resolution, each cell is roughly the size of a few city blocks. Slice a region into geohash-6 cells and you get a clean, discrete coordinate system for "neighborhoods" that downstream systems can reason about. The Forecasting & Real-Time Optimization (FORTOP) team produces the Neighborhood Reachability Signals dataset, which consists of two companion files for each region: Neighborhood Reachability Matrix: the estimated travel time, in minutes, between the centers of pairs of geohash-6 cells. Think of it as a sparse origin-to-destination travel-time matrix for a region. Neighborhood Centers: the list of all geohashes that appear in the ETA files for that region, i.e. the "vocabulary" of cells that the marketplace is allowed to talk about. Both files are generated offline on a schedule by an Airflow DAG. They are static in the sense that they are precomputed and shipped, rather than queried live (which is exact

## Rerouting the Stream: How Lyft Moved to the Apache Flink Operator

DevFeed: [Rerouting the Stream: How Lyft Moved to the Apache Flink Operator](<https://devfeed.tech/articles/rerouting-the-stream-how-lyft-moved-to-the-apache-flink-operator-1242.md>)

Original publisher: [Read original article](<https://eng.lyft.com/rerouting-the-stream-how-lyft-moved-to-the-apache-flink-operator-36f20246d250?source=rss----25cd379abb8---4>)

Author: Maheep Myneni

Published: 2026-08-31T19:08:16Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [autoscaling](<https://devfeed.tech/topics/autoscaling.md>), [Tooling](<https://devfeed.tech/topics/tooling.md>), [Architecture & Design](<https://devfeed.tech/topics/architecture-design.md>)

Tags: [apache](<https://devfeed.tech/tags/apache.md>), [apache-flink](<https://devfeed.tech/tags/apache-flink.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [data-platforms](<https://devfeed.tech/tags/data-platforms.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [production](<https://devfeed.tech/tags/production.md>), [streaming](<https://devfeed.tech/tags/streaming.md>), [streaming-data-processing](<https://devfeed.tech/tags/streaming-data-processing.md>), [tooling](<https://devfeed.tech/tags/tooling.md>)

### AI overview

Lyft describes its migration from an internally developed Flink Kubernetes operator to the open-source Apache Flink Kubernetes Operator. The move addressed maintenance burden, technical debt, feature gaps, outdated dependencies, and growing real-time streaming demands, while providing capabilities such as autoscaling, memory tuning, safer upgrades, and automatic rollbacks.

### Source excerpt

Written by Maheep Myneni, Arda Kuyumcu, and Prem Santosh Udaya Shankar at Lyft. Why We Migrated: Technical Debt Meets Modern Streaming Demands Over the past several quarters, Lyft's Streaming Compute team retired our internally developed Flink Kubernetes operator and moved our entire streaming fleet onto the open-source Apache Flink Kubernetes operator. This post is about why we made the switch, how we pulled it off incrementally without disrupting users, and the follow-on work it took to actually get the benefits we were after. Back in 2020, when we first architected the Lyft Flink Kubernetes Operator, it was exactly what we needed. At that time, the open-source community hadn't yet built a dedicated control plane, so we built our own to manage all streaming applications on Kubernetes. It worked well for our initial workloads, but as our real-time data needs increased and our engineers' scope of ownership grew in both breadth and complexity, the cracks started to show. First came the maintenance burden. Our operator had become a relic of Lyft's early Kubernetes days, kept alive by a growing pile of custom code. Every Flink version upgrade meant carefully picking through layers of accumulated technical debt and hoping nothing broke on the way through. Second came the feature gap. Streaming tooling kept moving, and our engineers kept asking for capabilities that had become table stakes elsewhere, such as autoscaling to right-size jobs, automatic rollbacks on failed deploys, and an end to hand-tuning CPU and memory. Each request left us with two options, neither of which was ideal. We could explain why we couldn't support it yet, or spend weeks rebuilding something the open-source community had already shipped. Third was the dependency problem. We were pinned to outdated libraries. That doesn't break anything today, but it almost always creates new issues down the line. Security patches lagged, modern Kubernetes features stayed out of reach, and every quarter we waite

## Metric Semantic Layer: How Lyft Governs and Scales Key Data Definitions

DevFeed: [Metric Semantic Layer: How Lyft Governs and Scales Key Data Definitions](<https://devfeed.tech/articles/metric-semantic-layer-how-lyft-governs-and-scales-key-data-definitions-1239.md>)

Original publisher: [Read original article](<https://eng.lyft.com/metric-semantic-layer-how-lyft-governs-and-scales-key-data-definitions-56bee3643c29?source=rss----25cd379abb8---4>)

Author: Iraklikhorguani

Published: 2026-06-10T18:42:08Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>)

Tags: [ai-and-mcp](<https://devfeed.tech/tags/ai-and-mcp.md>), [data](<https://devfeed.tech/tags/data.md>), [data-governance](<https://devfeed.tech/tags/data-governance.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [knowledge-base](<https://devfeed.tech/tags/knowledge-base.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [metric-standardization](<https://devfeed.tech/tags/metric-standardization.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [python](<https://devfeed.tech/tags/python.md>), [semantic-layer](<https://devfeed.tech/tags/semantic-layer.md>), [sql](<https://devfeed.tech/tags/sql.md>)

### AI overview

Lyft describes an internal Metric Semantic Layer that centralizes metric definitions, metadata, and SQL to maintain consistent terminology, governance, and downstream use.

### Source excerpt

Written by Rohit Channe and Simran Mirchandani at Lyft. Motivation At Lyft, data isn't just a resource -- it's woven into everything we do. Metrics drive key forecasts, steer operational decisions, and put our boldest hypotheses to the test. But as Lyft scaled, products launched and evolved, and team members came and went, we found ourselves at risk of different teams using different definitions for a given metric. What did "Metric ABC" actually mean? The answer often depended on the context and application of the team you asked. The consequences were predictable. Without centralized version control or a shared standard, outdated metric definitions crept into decision-making. Our solution was to build an internal Metric Semantic Layer (MSL): a centralized repository that serves as a single, authoritative home for every metric's definition -- providing both a clear, plain-English description and the definitive SQL code. No more hunting across codebases or tribal knowledge -- just one place to store and access a standardized, agreed-upon definition. With MSL, we have a single source of truth -- consistent terminology and assumptions across every team, so everyone is genuinely speaking the same language. We achieve this through three key principles: Simplified onboarding and change management -- update a metric definition once, and the change automatically and frictionlessly flows through every downstream application that depends on it Intentional governance -- clarified ownership, defined scope, clear accountability for data quality, and a structure resilient enough to survive org changes, team rotations, and attrition Transparency and accessibility -- definitions are easy for both technical and non-technical users (and downstream applications) to find and integrate into day-to-day workflows Solution Taking the above principles into account, we implemented the Metrics Semantic Layer as a Python package: 1 -- Simplified onboarding and change management through flexible metric

## From Chaos to Clarity: How We Built a Unified, Self-Routing Support Ops Ticketing System at Lyft

DevFeed: [From Chaos to Clarity: How We Built a Unified, Self-Routing Support Ops Ticketing System at Lyft](<https://devfeed.tech/articles/from-chaos-to-clarity-how-we-built-a-unified-self-routing-support-ops-ticketing-system-at-lyft-1236.md>)

Original publisher: [Read original article](<https://eng.lyft.com/from-chaos-to-clarity-2ab50856d0c8?source=rss----25cd379abb8---4>)

Author: Atulgupta

Published: 2026-06-09T17:30:51Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>), [dashboards](<https://devfeed.tech/topics/dashboards.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [automation](<https://devfeed.tech/tags/automation.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [operations](<https://devfeed.tech/tags/operations.md>), [operations-management](<https://devfeed.tech/tags/operations-management.md>), [processes](<https://devfeed.tech/tags/processes.md>), [routing](<https://devfeed.tech/tags/routing.md>), [support](<https://devfeed.tech/tags/support.md>), [ticketing](<https://devfeed.tech/tags/ticketing.md>)

### AI overview

This article describes how Lyft Urban Solutions' Support Ops team transformed a fragmented Jira Help Center into a unified, automated, self-routing ticketing system. The redesign consolidated duplicate forms and categories, improved information capture, added labeling and routing logic, and introduced dashboards. The resulting system handles thousands of tickets annually, with one third routed automatically, reducing manual triage work.

### Source excerpt

Written by Atul Gupta, Analytics Manager -- LUS Support Ops, Lyft At Lyft, getting operators and riders connected quickly and reliably depends on more than technology -- it depends on the teams working behind the scenes to keep that technology running smoothly. For the operators managing Lyft's fleet across markets, having fast, reliable access to support is what keeps bikes on the road, stations stocked, and issues resolved before they affect riders. Building the infrastructure that makes that support possible is what our team does; this is the story of how we built it. When I first joined Lyft Urban Solutions' (LUS) Support Ops team in 2020, ticketing processes for our operators were still being established. There was no reliable way to raise issues, track progress, or get routed to the right person. We had a Jira Help Center, but it had become increasingly difficult to navigate. What followed was a five-year journey of transforming that chaos into a streamlined, automated, self-routing system that now handles thousands of tickets per year, with one third of those routed automatically -- saving hours of manual triage work annually. The Problem: Organic Growth Gone Wrong On the surface, a Jira Help Center sounds like a reasonable solution. In practice, ours had become a maze. Here's what we were dealing with: Duplicate intake forms doing the same job under different names Redundant categories with no clear ownership Forms that didn't capture the right information upfront, forcing follow-up back-and-forth No auto-labeling, so tickets couldn't be searched or reported on No routing logic -- every ticket needed a human to read it and manually assign it No dashboards -- leadership had zero visibility into ticket volume or trends With this system, tickets would've taken the team 10-15 minutes to manually triage. It was time to redesign the system. Figure 1: Before and after: four fragmented portals consolidated into one unified Help Center with multiple categories across mult

## How We Built a Smarter Pickup Experience for Gated Communities

DevFeed: [How We Built a Smarter Pickup Experience for Gated Communities](<https://devfeed.tech/articles/how-we-built-a-smarter-pickup-experience-for-gated-communities-1238.md>)

Original publisher: [Read original article](<https://eng.lyft.com/how-we-built-a-smarter-pickup-experience-for-gated-communities-47416e9df029?source=rss----25cd379abb8---4>)

Author: winnieyan

Published: 2026-04-23T19:16:44Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [App](<https://devfeed.tech/topics/app.md>), [data](<https://devfeed.tech/topics/data.md>), [Routing (disambiguation)](<https://devfeed.tech/topics/routing.md>)

Tags: [app](<https://devfeed.tech/tags/app.md>), [data](<https://devfeed.tech/tags/data.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [mapping](<https://devfeed.tech/tags/mapping.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [rideshare](<https://devfeed.tech/tags/rideshare.md>), [routing](<https://devfeed.tech/tags/routing.md>)

### AI overview

Lyft's Mapping team describes how it identified and addressed pickup problems at gated communities. The article highlights two root causes: inflexible pickup-spot recommendations and the lack of a way to share gate-access instructions before a ride. The proposed solution is an end-to-end app experience involving map data, pickup recommendations, routing, and rider and driver workflows.

### Source excerpt

If you live in a gated community, you've been there: You request a ride from your apartment complex, expect your driver to come to you as usual, and then -- your driver's car icon just stops right at the front gate. You watch helplessly as the ETA ticks up. A chat message comes in: "Hey, how do I get in?" You scramble to remember the gate code. They try it. It doesn't work. You end up meeting them awkwardly on the sidewalk outside while your coffee gets cold -- a pickup journey frustrating for both you and your driver. An example gated community in real life, Photo by Bingqian Li on Pexels It turns out you're not alone: Gated community pickups can make up 25-30% of Lyft rides in selected markets. For a long time, our app offered no special guidance in these situations. Riders would drop their pin inside the gates (fair enough -- that's where they are), while drivers would pull up to a locked entrance with no way in, leaving both parties to sort things out over chat. The result was predictable: more cancellations, longer waits, and a lot of unnecessary stress for our customers. The Lyft Mapping team decided it was time to fix this properly -- not with a band-aid, but a new end-to-end experience. Here's how we did it. What Was Actually Going Wrong? We looked through gated ride examples, zoomed into our metrics data, and found two root causes behind most of the friction. The first was an inflexible selection of pickup spots. Our app would suggest pickup spots near a rider's location -- which, for riders inside a gated community, often means inside the gate. But our data told a different story: many riders actually preferred meeting their driver right outside the gate, knowing their driver couldn't access the property. The app wasn't giving them that option clearly. The second was a communication black hole. Even riders who knew how to get their driver through the gate had no good way to pass along access instructions in advance. Instead, they'd wait until the driver was alr

## Predicting Rider Conversion in Sparse Data Environments with Bayesian Trees

DevFeed: [Predicting Rider Conversion in Sparse Data Environments with Bayesian Trees](<https://devfeed.tech/articles/predicting-rider-conversion-in-sparse-data-environments-with-bayesian-trees-1240.md>)

Original publisher: [Read original article](<https://eng.lyft.com/predicting-rider-conversion-in-sparse-data-environments-with-bayesian-trees-07227ff92789?source=rss----25cd379abb8---4>)

Author: Zammit Alban

Published: 2026-03-30T14:43:41Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>), [machine learning overfitting](<https://devfeed.tech/topics/machine-learning-overfitting.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [Language models](<https://devfeed.tech/topics/language-models.md>)

Tags: [data](<https://devfeed.tech/tags/data.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [rider](<https://devfeed.tech/tags/rider.md>), [ridesharing](<https://devfeed.tech/tags/ridesharing.md>), [statistics](<https://devfeed.tech/tags/statistics.md>), [transportation](<https://devfeed.tech/tags/transportation.md>)

### AI overview

Lyft describes predicting whether a rider will request a ride after viewing a destination, price, and ETA. The article focuses on sparse, high-cardinality contextual data, where standard gradient-boosted-tree models can overfit, and introduces Bayesian trees as indicated by the title.

### Source excerpt

At Lyft, understanding how riders go through our user experience is fundamental to operating a healthy marketplace. Specifically, it is important to have a robust model determining if a rider will actually request a ride after entering a destination and viewing a price and ETA. Accurately predicting this decision, that we call conversion, informs countless decisions across our platform. Whether it is to better balance supply and demand, improve user experiences, optimize recommendations and advertisement, understand long-term engagement, decide how to distribute coupons... rider conversion prediction is a central challenge for the Lyft business. However, predicting human behavior at scale is incredibly complex, and the exact same person might well open the app just to check current availability or actually to request a ride after viewing our prices. The contexts under which riders make their conversion decisions are extremely diverse and almost unique to each session. A user's intent changes based on where they are and where they want to go, what time it is, their previous interactions with the platform, current supply-demand market conditions, to cite a few. When we try to model this using standard machine learning approaches, we run into a significant challenge: data sparsity. The Challenge of High Cardinality and Sparsity To accurately predict conversion, we need to slice our data very thinly across many categorical features. Imagine trying to predict the conversion probability for a business traveler leaving the suburbs of Detroit at 4:00 AM on a Tuesday to catch their flight at the airport 30 minutes away. While Lyft has vast amounts of data overall, the amount of data available for that specific intersection of contexts often reveals to be very tiny. Maybe we only have ten examples in history. If we use standard techniques like Gradient Boosted Trees (e.g., LGBM, XGBoost), we encounter severe overfitting. A standard model looking at 10 examples in the training d

## Scaling Localization with AI at Lyft

DevFeed: [Scaling Localization with AI at Lyft](<https://devfeed.tech/articles/scaling-localization-with-ai-at-lyft-1243.md>)

Original publisher: [Read original article](<https://eng.lyft.com/scaling-localization-with-ai-at-lyft-b04dca99e6ee?source=rss----25cd379abb8---4>)

Author: Stefan Zier

Published: 2026-02-19T17:28:41Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [Localization (l10n)](<https://devfeed.tech/topics/localization.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [Web](<https://devfeed.tech/topics/web.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [aws](<https://devfeed.tech/tags/aws.md>), [code](<https://devfeed.tech/tags/code.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [distributed-systems](<https://devfeed.tech/tags/distributed-systems.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

Lyft re-architected its translation pipeline to combine AI with linguist oversight, context injection, evaluation, guardrails, and version-controlled prompts. The batch system reduces translation latency from days to minutes while supporting legal compliance and brand integrity across expanding markets.

### Source excerpt

Written by Stefan Zier For years, Lyft's localization infrastructure relied exclusively on human translation. While this model usually ensured excellent quality, it was bound by multi-day turnarounds and costs that scaled linearly with every new language. For the few languages Lyft initially supported (Spanish, Portuguese, and French), these limits were acceptable. However, Lyft's expansion goals quickly outpaced what traditional workflows could support. Lyft's recent Québec launch required compliance with Bill 96 (legislation mandating French-first user experiences) which demanded faster turnaround than multi-day cycles allowed. Simultaneously, the Lyft Urban Solutions ("LUS": Bikes & Scooters) division sought to expand into European markets, requiring six new languages. The business need had changed as we now needed to move faster without sacrificing quality. This post explores how we re-architected Lyft's Translation Pipeline to leverage AI alongside linguist oversight and ultimately unlock new market launches. We will walk through context injection, decoupling content generation from evaluation, implementing guardrails, and treating prompts as version-controlled production code. The new pipeline reduces translation latency from days to minutes while maintaining the fidelity required for legal compliance and brand integrity. Note: We will walk through our batch translation pipeline -- used for 99% of app and web content -- which targets a 30-minute SLA for 95% of translations. We also support real-time translation (e.g., ride chat) which uses a different architecture.* How Translations Reach Hundreds of Services Before diving into the LLM pipeline, it helps to understand how translations flow through Lyft's infrastructure. This 2020 post explains the internationalization architecture initially built to move beyond one language/currency/country. Since then, the platform has grown to serve 11 locales across 150+ services. At its core, the pipeline does two things in

## Trusting the Untestable: Validation and Diagnostics for the Doubly Robust Models

DevFeed: [Trusting the Untestable: Validation and Diagnostics for the Doubly Robust Models](<https://devfeed.tech/articles/trusting-the-untestable-validation-and-diagnostics-for-the-doubly-robust-models-1244.md>)

Original publisher: [Read original article](<https://eng.lyft.com/trusting-the-untestable-validation-and-diagnostics-for-the-doubly-robust-models-00853df009df?source=rss----25cd379abb8---4>)

Author: Shima Nassiri

Published: 2026-02-12T17:07:13Z

Content type: article

Language: en

Sources: [Lyft Engineering - Medium](<https://devfeed.tech/sources/lyft-engineering-medium.md>)

Topics: [Estimator](<https://devfeed.tech/topics/estimator.md>), [data](<https://devfeed.tech/topics/data.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>)

Tags: [aipw](<https://devfeed.tech/tags/aipw.md>), [doubleml](<https://devfeed.tech/tags/doubleml.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [experimentation](<https://devfeed.tech/tags/experimentation.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [models](<https://devfeed.tech/tags/models.md>), [quasi-experiment](<https://devfeed.tech/tags/quasi-experiment.md>), [rideshare](<https://devfeed.tech/tags/rideshare.md>), [validation](<https://devfeed.tech/tags/validation.md>)

### AI overview

The article explains how Lyft uses quasi-experimental methods to measure causal effects when randomized A/B tests are impractical. It focuses on Augmented Inverse Propensity Weighting (AIPW), a doubly robust estimator that uses outcome and propensity-score models to estimate treatment effects from non-randomized data.

### Source excerpt

written by Ross Chu and Shima Nassiri The Causal Frontier: Measurement Beyond Randomization The gold standard for determining the causal impact of a policy or product change at a company like Lyft is the A/B test (randomized experiment). By randomly assigning users to a treatment or control group, A/B tests inherently eliminate bias, providing clean estimates of the Average Treatment Effect (ATE). However, many critical business questions and large-scale initiatives simply cannot be randomized. This forces scientists to move past traditional experimentation and leverage quasi-experimental methods. We rely on non-randomized measurement in several key scenarios across Lyft: Partnerships and Policies: Assessing the incremental impact of a partnership (e.g., linking two company accounts) is often a non-randomized assignment. Since these collaborations require coordinated operational work across both companies and are typically announced or promoted broadly, this makes controlled randomization impractical. Long-Term Effect (LTE): Measuring effects that unfold over a long period, like the LTE of high prices on future rides, is typically handled by observational studies. Post-Launch Evaluation: Continuous monitoring of a policy after it has been fully rolled out requires a method that doesn't involve costly holdout groups or degradation tests. Biased Data: In cases where pre-existing experimental data is found to have an imbalance, a quasi-experimental approach can potentially leverage the biased data instead of requiring a costly rerun. Introducing Doubly Robust Models: Causal Inference Without Randomness To address these non-randomized measurement needs, Lyft relies on various quasi-experiment estimators. In this blog we specifically focus on using the Augmented Inverse Propensity Weighting (AIPW) model. This model was first established at Lyft to measure the impact of a negative user experience on future topline metrics like rides and bookings; AIPW is a form of doubly

## How Lyft powers batch and real-time analytics with ClickHouse Cloud

DevFeed: [How Lyft powers batch and real-time analytics with ClickHouse Cloud](<https://devfeed.tech/articles/how-lyft-powers-batch-and-real-time-analytics-with-clickhouse-cloud-5403.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/lyft-analytics-clickhouse-cloud>)

Author: ClickHouse

Published: 2025-09-10T12:04:33Z

Content type: article

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [data-processing](<https://devfeed.tech/topics/data-processing.md>), [migration](<https://devfeed.tech/topics/migration.md>), [Kafka](<https://devfeed.tech/topics/kafka.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [batch](<https://devfeed.tech/tags/batch.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [migration](<https://devfeed.tech/tags/migration.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [s3](<https://devfeed.tech/tags/s3.md>)

### AI overview

Lyft describes moving from Apache Druid to ClickHouse Cloud for batch and real-time analytics. The article attributes the change to performance, simpler operations, lower costs, and scalability as data volumes and adoption grew.

### Source excerpt

Lyft uses ClickHouse Cloud to power both batch and real-time analytics, handling 450+ TB of data daily, running hundreds of queries per second, and scaling efficiently beyond their legacy Druid system.

## Trino for large scale ETL at Lyft

DevFeed: [Trino for large scale ETL at Lyft](<https://devfeed.tech/articles/trino-for-large-scale-etl-at-lyft-8702.md>)

Original publisher: [Read original article](<https://trino.io/blog/2022/12/12/trino-summit-2022-lyft-recap.html>)

Author: Charles Song, Ritesh Varyani, Brian Olsen

Published: 2022-12-12T00:00:00Z

Content type: article

Language: en

Sources: [Trino Blog](<https://devfeed.tech/sources/trino-blog.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [Amazon EC2](<https://devfeed.tech/topics/amazon-ec2.md>)

Tags: [airflow](<https://devfeed.tech/tags/airflow.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [data](<https://devfeed.tech/tags/data.md>), [java](<https://devfeed.tech/tags/java.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [scale](<https://devfeed.tech/tags/scale.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

A Trino Summit recap describes Lyft's large-scale ETL deployment, including operational scale, cluster efficiency, rollback handling, workload separation, and query-testing practices.

### Source excerpt

Buckle up, for the next post in the Trino Summit 2022 recap series. In this post, we're covering the talk given by Lyft engineers, Charles and Ritesh, on how they have not only scaled Trino as adoption grew, but with less nodes and more effective usage. They also started moving to utilizing Trino more for ETL rather than just interactive analytics. Get ready for a smooth ride as Lyft brings you large scale ETL with Trino.

## Top five reasons to attend Trino Summit 2022

DevFeed: [Top five reasons to attend Trino Summit 2022](<https://devfeed.tech/articles/top-five-reasons-to-attend-trino-summit-2022-8691.md>)

Original publisher: [Read original article](<https://trino.io/blog/2022/10/31/trino-summit-2022-teaser-3.html>)

Author: Brian Olsen

Published: 2022-10-31T00:00:00Z

Content type: article

Language: en

Sources: [Trino Blog](<https://devfeed.tech/sources/trino-blog.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [datasets](<https://devfeed.tech/topics/datasets.md>)

Tags: [apple](<https://devfeed.tech/tags/apple.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [blog](<https://devfeed.tech/tags/blog.md>), [blog-post](<https://devfeed.tech/tags/blog-post.md>), [conference](<https://devfeed.tech/tags/conference.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data](<https://devfeed.tech/tags/data.md>), [free](<https://devfeed.tech/tags/free.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [production](<https://devfeed.tech/tags/production.md>), [scale](<https://devfeed.tech/tags/scale.md>), [shopify](<https://devfeed.tech/tags/shopify.md>), [summit](<https://devfeed.tech/tags/summit.md>)

### AI overview

This blog post promotes Trino Summit 2022, a free in-person and virtual conference in San Francisco. It highlights industry speakers discussing Trino architectures, production use cases, scaling, and cost reduction; opportunities to meet the authors of Trino: The Definitive Guide; and Trino's ability to query heterogeneous datasets across multiple data sources.

### Source excerpt

This blog post wraps up a series of previous posts teasing Trino Summit 2022. The conference is free and takes place in San Francisco, California on November 10th. Join us either in-person or virtually! Register now

## Trino Summit 2022: Sessions, speakers, and event details

DevFeed: [Trino Summit 2022: Sessions, speakers, and event details](<https://devfeed.tech/articles/trino-summit-2022-will-be-legendary-8688.md>)

Original publisher: [Read original article](<https://trino.io/blog/2022/09/22/trino-summit-2022-teaser.html>)

Author: Brian Olsen, Dain Sundstrom

Published: 2022-09-22T00:00:00Z

Content type: news

Language: en

Sources: [Trino Blog](<https://devfeed.tech/sources/trino-blog.md>)

Topics: [data lake](<https://devfeed.tech/topics/data-lake.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [autoscaling](<https://devfeed.tech/topics/autoscaling.md>)

Tags: [architectures](<https://devfeed.tech/tags/architectures.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [conference](<https://devfeed.tech/tags/conference.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [event](<https://devfeed.tech/tags/event.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [mpp](<https://devfeed.tech/tags/mpp.md>), [routing](<https://devfeed.tech/tags/routing.md>), [summit](<https://devfeed.tech/tags/summit.md>)

### AI overview

This article announces Trino Summit 2022, a free hybrid conference taking place on November 10th, and previews selected sessions and speakers. Topics include Trino's open source project, query federation, large-scale ETL at Lyft, autoscaling, and fault-tolerant execution.

### Source excerpt

Commander Bun Bun is back and this year we have an exciting lineup of speakers. Topics range from architectures like data mesh and data lakehouse, to running Trino at scale with fault-tolerant execution, and query federation. This conference is free and takes place on November 10th. The summit is a hybrid event for in-person and virtual attendance. Find out more details below!

## Using Amundsen to Support User Privacy via Metadata Collection at Square

DevFeed: [Using Amundsen to Support User Privacy via Metadata Collection at Square](<https://devfeed.tech/articles/using-amundsen-to-support-user-privacy-via-metadata-collection-at-square-15939.md>)

Original publisher: [Read original article](<https://developer.squareup.com/blog/using-amundsen-to-support-user-privacy-via-metadata-collection-at-square>)

Author: Alyssa Ransbury

Published: 2020-07-14T19:00:00Z

Content type: article

Language: en

Sources: [Square Corner Blog RSS Feed](<https://devfeed.tech/sources/square-corner-blog-rss-feed.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [graph-database](<https://devfeed.tech/topics/graph-database.md>), [pii](<https://devfeed.tech/topics/pii.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [MySQL](<https://devfeed.tech/topics/mysql.md>), [App](<https://devfeed.tech/topics/app.md>)

Tags: [bigquery](<https://devfeed.tech/tags/bigquery.md>), [collection](<https://devfeed.tech/tags/collection.md>), [data](<https://devfeed.tech/tags/data.md>), [database](<https://devfeed.tech/tags/database.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [graph-database](<https://devfeed.tech/tags/graph-database.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [netflix](<https://devfeed.tech/tags/netflix.md>), [pii](<https://devfeed.tech/tags/pii.md>), [privacy](<https://devfeed.tech/tags/privacy.md>)

### AI overview

Square describes using its own version of Amundsen to automate metadata collection and improve understanding of data stored, collected, and processed across many services while supporting user privacy. The system ingests schema information from Snowflake, BigQuery, and MySQL into a graph database, enabling search and richer column-level metadata such as PII semantic types and data storage security.

### Source excerpt

More scalable, automated data insights while preserving users' privacy

## Automotive Privacy

DevFeed: [Automotive Privacy](<https://devfeed.tech/articles/automotive-privacy-36690.md>)

Original publisher: [Read original article](<https://shostack.org/blog/automotive-privacy/>)

Author: Adam

Published: 2018-07-09T00:00:00Z

Content type: opinion

Language: en

Sources: [Shostack & Friends Blog](<https://devfeed.tech/sources/shostack-friends-blog.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [App](<https://devfeed.tech/topics/app.md>)

Tags: [car](<https://devfeed.tech/tags/car.md>), [data](<https://devfeed.tech/tags/data.md>), [lyft](<https://devfeed.tech/tags/lyft.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [tracking](<https://devfeed.tech/tags/tracking.md>)

### AI overview

This commentary examines automotive privacy concerns, including vehicle data collection and the difficulty of declining it. It discusses how cars and related technologies may associate trips with vehicle owners or passengers through license plates, toll beacons, sensors, maps, payment cards, and ride-booking apps.

### Source excerpt

[no description provided]