# Experiment

Published articles for Experiment.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## One or two nameservers?

DevFeed: [One or two nameservers?](<https://devfeed.tech/articles/one-or-two-nameservers-26233.md>)

Original publisher: [Read original article](<https://blog.apnic.net/2026/09/15/one-or-two-nameservers/>)

Author: Geoff Huston

Published: 2026-09-15T06:01:49Z

Content type: article

Language: en

Sources: [APNIC Blog](<https://devfeed.tech/sources/apnic-blog.md>)

Topics: [Internet](<https://devfeed.tech/topics/internet.md>), [Query (disambiguation)](<https://devfeed.tech/topics/query.md>), [Server](<https://devfeed.tech/topics/server.md>), [Caching](<https://devfeed.tech/topics/caching.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [africa](<https://devfeed.tech/tags/africa.md>), [article](<https://devfeed.tech/tags/article.md>), [china](<https://devfeed.tech/tags/china.md>), [dns](<https://devfeed.tech/tags/dns.md>), [europe](<https://devfeed.tech/tags/europe.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [india](<https://devfeed.tech/tags/india.md>), [internet](<https://devfeed.tech/tags/internet.md>), [ipv4](<https://devfeed.tech/tags/ipv4.md>), [ipv6](<https://devfeed.tech/tags/ipv6.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [measurements](<https://devfeed.tech/tags/measurements.md>), [recursive-resolver](<https://devfeed.tech/tags/recursive-resolver.md>), [repeat](<https://devfeed.tech/tags/repeat.md>), [responses](<https://devfeed.tech/tags/responses.md>), [server](<https://devfeed.tech/tags/server.md>), [tech-matters](<https://devfeed.tech/tags/tech-matters.md>)

### AI overview

This article reports an experiment testing whether serving a DNS zone with two authoritative dual-stack nameservers changes repeated queries. Compared with one nameserver, two nameservers increased the single-query completion rate from 58% to 71% and reduced the average queries per test from 3.43 to 2.57.

### Source excerpt

Do multiple dual-stack nameservers increase or decrease repeat DNS queries? The results of this experiment were a complete surprise.

## An experiment with Gemma 4 on a Raspberry Pi explores what an LLM would do with its own computer

DevFeed: [An experiment with Gemma 4 on a Raspberry Pi explores what an LLM would do with its own computer](<https://devfeed.tech/articles/what-would-you-do-if-you-had-a-computer-of-your-own-29089.md>)

Original publisher: [Read original article](<https://blog.alexewerlof.com/p/what-would-you-do-if-you-had-a-computer>)

Author: Alex Ewerlöf

Published: 2026-09-14T09:09:42Z

Content type: opinion

Language: en

Sources: [Alex Ewerlof Notes](<https://devfeed.tech/sources/alex-ewerlof-notes.md>)

Topics: [gemma4](<https://devfeed.tech/topics/gemma4.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Raspberry Pi](<https://devfeed.tech/topics/raspberry-pi.md>), [Go Language](<https://devfeed.tech/topics/go-language.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>)

Tags: [computer](<https://devfeed.tech/tags/computer.md>), [data](<https://devfeed.tech/tags/data.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [gemma-4](<https://devfeed.tech/tags/gemma-4.md>), [go](<https://devfeed.tech/tags/go.md>), [llm](<https://devfeed.tech/tags/llm.md>), [patterns](<https://devfeed.tech/tags/patterns.md>), [raspberry-pi](<https://devfeed.tech/tags/raspberry-pi.md>)

### AI overview

The author describes an experiment in which Gemma 4 12B was asked what it would do with its own computer. Running on a Raspberry Pi 1 through a Go harness, the model imagined ingesting large amounts of data, finding patterns, and running large-scale simulations.

### Source excerpt

LLM's response

## Turning Names Into Digital Architecture with Three.js

DevFeed: [Turning Names Into Digital Architecture with Three.js](<https://devfeed.tech/articles/turning-names-into-digital-architecture-with-three-js-4347.md>)

Original publisher: [Read original article](<https://tympanus.net/codrops/2026/09/09/turning-names-into-digital-architecture-with-three-js/>)

Author: Serhii Polyvanyi

Published: 2026-09-09T17:55:00Z

Content type: article

Language: en

Sources: [Codrops](<https://devfeed.tech/sources/codrops.md>)

Topics: [Three.js community](<https://devfeed.tech/topics/three-js-community.md>), [Three.js custom shaders](<https://devfeed.tech/topics/three-js-custom-shaders.md>), [Three.js shaders](<https://devfeed.tech/topics/three-js-shaders.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [articles](<https://devfeed.tech/tags/articles.md>), [best-free-frontend-development-resources](<https://devfeed.tech/tags/best-free-frontend-development-resources.md>), [best-javascript-libraries-for-animations](<https://devfeed.tech/tags/best-javascript-libraries-for-animations.md>), [best-web-development-blogs](<https://devfeed.tech/tags/best-web-development-blogs.md>), [conference](<https://devfeed.tech/tags/conference.md>), [creative-coding](<https://devfeed.tech/tags/creative-coding.md>), [creative-ui-ideas-for-web-design](<https://devfeed.tech/tags/creative-ui-ideas-for-web-design.md>), [css-animations](<https://devfeed.tech/tags/css-animations.md>), [css-grid-vs-flexbox](<https://devfeed.tech/tags/css-grid-vs-flexbox.md>), [css-hover-effects](<https://devfeed.tech/tags/css-hover-effects.md>), [css-only-effects](<https://devfeed.tech/tags/css-only-effects.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [frontend-development](<https://devfeed.tech/tags/frontend-development.md>), [gsap-animation-examples](<https://devfeed.tech/tags/gsap-animation-examples.md>), [how-to-build-a-responsive-website-from-scratch](<https://devfeed.tech/tags/how-to-build-a-responsive-website-from-scratch.md>), [how-to-create-parallax-scrolling-effects](<https://devfeed.tech/tags/how-to-create-parallax-scrolling-effects.md>), [how-to-create-smooth-css-transitions](<https://devfeed.tech/tags/how-to-create-smooth-css-transitions.md>), [how-to-make-a-portfolio-website-interactive](<https://devfeed.tech/tags/how-to-make-a-portfolio-website-interactive.md>), [how-to-optimize-animations-for-performance](<https://devfeed.tech/tags/how-to-optimize-animations-for-performance.md>), [html5-and-css3-tricks](<https://devfeed.tech/tags/html5-and-css3-tricks.md>), [javascript-effects](<https://devfeed.tech/tags/javascript-effects.md>), [javascript-ui-interactions](<https://devfeed.tech/tags/javascript-ui-interactions.md>), [micro-interactions-for-websites](<https://devfeed.tech/tags/micro-interactions-for-websites.md>), [modern-web-development](<https://devfeed.tech/tags/modern-web-development.md>), [react-ui-animations](<https://devfeed.tech/tags/react-ui-animations.md>), [step-by-step-guide-to-webgl-animations](<https://devfeed.tech/tags/step-by-step-guide-to-webgl-animations.md>), [svg-animations-in-css](<https://devfeed.tech/tags/svg-animations-in-css.md>), [three-js](<https://devfeed.tech/tags/three-js.md>), [three-js-3d-animations](<https://devfeed.tech/tags/three-js-3d-animations.md>), [three-js-conference](<https://devfeed.tech/tags/three-js-conference.md>), [ui-ux-design-tips](<https://devfeed.tech/tags/ui-ux-design-tips.md>), [web-design-tutorials](<https://devfeed.tech/tags/web-design-tutorials.md>), [webgl-tutorials-for-beginners](<https://devfeed.tech/tags/webgl-tutorials-for-beginners.md>), [wordpress-themes-and-plugins](<https://devfeed.tech/tags/wordpress-themes-and-plugins.md>)

### AI overview

An interactive Three.js experiment turns typed names into lightweight, metallic-looking 3D letter structures. It explains contour generation, interpolation and deformation, structural line geometry, and a custom shader with a baked reflection map.

### Source excerpt

For the Three.js Conference in Paris, BL/S® created an interactive experiment that transforms your name into a dynamic 3D structure.

## A switchback career move from engineering management to software engineering

DevFeed: [A switchback career move from engineering management to software engineering](<https://devfeed.tech/articles/take-that-demotion-32328.md>)

Original publisher: [Read original article](<https://newsletter.manager.dev/newsletter/take-that-demotion>)

Author: Anton Zaides

Published: 2026-09-08T06:01:00Z

Content type: opinion

Language: en

Sources: [Manager.dev](<https://devfeed.tech/sources/manager-dev.md>)

Topics: [Job](<https://devfeed.tech/topics/job.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Software](<https://devfeed.tech/topics/software.md>), [Tech Lead](<https://devfeed.tech/topics/tech-lead.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [career](<https://devfeed.tech/tags/career.md>), [data](<https://devfeed.tech/tags/data.md>), [engineering-manager](<https://devfeed.tech/tags/engineering-manager.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [software-engineer](<https://devfeed.tech/tags/software-engineer.md>)

### AI overview

The author describes moving from engineering management back to software engineering after struggling to secure another Engineering Manager role. The article also discusses an experiment in which an engineering team worked more deliberately with coding agents and a tech lead.

### Source excerpt

The perfect time for a switchback career move

## Visualize how CUPED adjusts experiment results with Datadog

DevFeed: [Visualize how CUPED adjusts experiment results with Datadog](<https://devfeed.tech/articles/visualize-how-cuped-adjusts-experiment-results-with-datadog-2246.md>)

Original publisher: [Read original article](<https://www.datadoghq.com/blog/cuped-adjustments-visualization/>)

Author: Tyler Buffington; Lukas Goetz-Weiss; Ryan Lucht

Published: 2026-09-01T00:00:00Z

Content type: tutorial

Language: en

Sources: [Datadog | The Monitor blog](<https://devfeed.tech/sources/datadog-the-monitor-blog.md>)

Topics: [experiments](<https://devfeed.tech/topics/experiments.md>)

Tags: [analysis](<https://devfeed.tech/tags/analysis.md>), [digital-experience-monitoring](<https://devfeed.tech/tags/digital-experience-monitoring.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [product-analytics](<https://devfeed.tech/tags/product-analytics.md>), [visualization](<https://devfeed.tech/tags/visualization.md>)

### AI overview

This tutorial explains Datadog Experiments' CUPED adjustments visualization, which breaks the difference between raw and CUPED-adjusted experiment lift into individual covariate contributions.

### Source excerpt

Learn how Datadog visualizes CUPED adjustments so you can trace which covariates change experiment lift estimates and improve precision.

## Better answers, broader thinking: What students gain from ChatGPT and critical-thinking training

DevFeed: [Better answers, broader thinking: What students gain from ChatGPT and critical-thinking training](<https://devfeed.tech/articles/better-answers-broader-thinking-what-students-gain-from-chatgpt-and-critical-thinking-training-6718.md>)

Original publisher: [Read original article](<https://openai.com/index/what-students-gain-from-chatgpt-critical-thinking-training>)

Published: 2026-08-27T09:00:00Z

Content type: article

Language: en

Sources: [OpenAI News](<https://devfeed.tech/sources/openai-news.md>)

Topics: [ChatGPT](<https://devfeed.tech/topics/chatgpt.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [business](<https://devfeed.tech/tags/business.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [company](<https://devfeed.tech/tags/company.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [generate](<https://devfeed.tech/tags/generate.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [marketing](<https://devfeed.tech/tags/marketing.md>), [openai](<https://devfeed.tech/tags/openai.md>), [performance](<https://devfeed.tech/tags/performance.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [research](<https://devfeed.tech/tags/research.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

Un randomized experiment with more than 1,000 first-year undergraduate students found that ChatGPT access improved the quality, coherence, logic, and professionalism of work on a real-world business assignment. Separate causal-reasoning training increased the originality and variety of ideas, and students receiving both interventions showed both benefits.

### Source excerpt

A randomized study of more than 1,000 students examines ChatGPT, critical thinking, originality, and student performance on a real-world university assignment.

## When Can LLMs Replace Humans in A/B Tests?

DevFeed: [When Can LLMs Replace Humans in A/B Tests?](<https://devfeed.tech/articles/when-can-llms-replace-humans-in-a-b-tests-154.md>)

Original publisher: [Read original article](<https://engineering.atspotify.com/2026/8/when-can-llms-replace-humans-in-a-b-tests/>)

Author: Spotify Engineering

Published: 2026-08-13T18:57:22Z

Content type: article

Language: en

Sources: [Spotify Engineering](<https://devfeed.tech/sources/spotify-engineering.md>), [Spotify Engineering Blog](<https://devfeed.tech/sources/spotify-engineering-blog.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [A/B Testing](<https://devfeed.tech/topics/a-b-testing.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [data](<https://devfeed.tech/topics/data.md>), [experiments](<https://devfeed.tech/topics/experiments.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [data](<https://devfeed.tech/tags/data.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [model](<https://devfeed.tech/tags/model.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

The article examines whether large language model predictions can replace human outcomes in A/B tests. Using the Upworthy dataset, it finds that calibrated predictions can recover treatment effects under specific assumptions, while raw predictions recovered only 39% of the observed human effect.

### Source excerpt

TL;DR: LLM predictions can stand in for human outcomes in A/B tests, but only by assumption, not by design.... The post When Can LLMs Replace Humans in A/B Tests? appeared first on Spotify Engineering.

## Introducing Mintlify Index

DevFeed: [Introducing Mintlify Index](<https://devfeed.tech/articles/introducing-mintlify-index-31073.md>)

Original publisher: [Read original article](<https://www.mintlify.com/blog/mintlify-index>)

Author: Kyan Yang

Published: 2026-08-06T00:00:00Z

Content type: release

Language: en

Sources: [Mintlify Blog](<https://devfeed.tech/sources/mintlify-blog.md>)

Topics: [Documentation](<https://devfeed.tech/topics/documentation.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [API](<https://devfeed.tech/topics/api.md>), [MCP](<https://devfeed.tech/topics/mcp.md>), [MCP Server](<https://devfeed.tech/topics/mcp-server.md>)

Tags: [announcements](<https://devfeed.tech/tags/announcements.md>), [api](<https://devfeed.tech/tags/api.md>), [beta](<https://devfeed.tech/tags/beta.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [mcp-server](<https://devfeed.tech/tags/mcp-server.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>)

### AI overview

Mintlify introduces Mintlify Index, a retrieval layer that aggregates documentation from 9,000 Mintlify-powered sites for coding agents. It routes documentation-related queries to optimized retrieval and other queries to an external web search provider, with fallback between sources. The article reports an experiment in which Index was preferred in 96 of 150 implementation-planning tasks and completed tasks 48% faster end-to-end, with higher factual correctness and citation support and fewer critical errors. Mintlify launched Index as a free beta with an API and MCP server.

### Source excerpt

Mintlify Index aggregates the docs of 9000 Mintlify-powered documentation sites into a natural language retrieval layer for coding agents.

## Explorers, exploiters, and the myth of the 100x engineer

DevFeed: [Explorers, exploiters, and the myth of the 100x engineer](<https://devfeed.tech/articles/explorers-exploiters-and-the-myth-of-the-100x-engineer-2202.md>)

Original publisher: [Read original article](<https://stackoverflow.blog/2026/08/05/the-myth-of-the-100x-engineer/>)

Author: Eira May

Published: 2026-08-05T07:40:00Z

Content type: article

Language: en

Sources: [Stack Overflow Blog](<https://devfeed.tech/sources/stack-overflow-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Strategy](<https://devfeed.tech/topics/ai-strategy.md>), [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [leaders-of-code](<https://devfeed.tech/topics/leaders-of-code.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-adoption](<https://devfeed.tech/tags/ai-adoption.md>), [ai-tools](<https://devfeed.tech/tags/ai-tools.md>), [business](<https://devfeed.tech/tags/business.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [engineering-leadership](<https://devfeed.tech/tags/engineering-leadership.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [explore](<https://devfeed.tech/tags/explore.md>), [leaders-of-code](<https://devfeed.tech/tags/leaders-of-code.md>), [learning](<https://devfeed.tech/tags/learning.md>), [podcast](<https://devfeed.tech/tags/podcast.md>), [productivity](<https://devfeed.tech/tags/productivity.md>)

### AI overview

The article challenges the myth that a small group of inherently exceptional engineers drives disproportionate AI gains. It argues that engineering leaders should treat exploration and exploitation as a continuum and help more engineers develop through curiosity, adaptability, experimentation, and learning, rather than focusing only on identifying and promoting existing "100x" performers.

### Source excerpt

The "find the special ones and promote their traits" approach isn't the best or only way to drive AI adoption and productivity on an engineering team.

## Research: How we cut AI costs by 80%

DevFeed: [Research: How we cut AI costs by 80%](<https://devfeed.tech/articles/research-how-we-cut-ai-costs-by-80-12296.md>)

Original publisher: [Read original article](<https://www.port.io/blog/research-how-we-cut-ai-costs-by-80-percent>)

Author: Zohar Einy

Published: 2026-07-30T11:24:23Z

Content type: article

Language: en

Sources: [Developer Experience & Platform Engineering Blog | Port](<https://devfeed.tech/sources/developer-experience-platform-engineering-blog-port.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [context window](<https://devfeed.tech/topics/context-window.md>), [MCP](<https://devfeed.tech/topics/mcp.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [data](<https://devfeed.tech/topics/data.md>), [sdlc](<https://devfeed.tech/topics/sdlc.md>), [GitHub](<https://devfeed.tech/topics/github.md>), [Caching](<https://devfeed.tech/topics/caching.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [claude](<https://devfeed.tech/tags/claude.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data](<https://devfeed.tech/tags/data.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [github](<https://devfeed.tech/tags/github.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [sdlc](<https://devfeed.tech/tags/sdlc.md>), [semantic-layer](<https://devfeed.tech/tags/semantic-layer.md>), [tokens](<https://devfeed.tech/tags/tokens.md>)

### AI overview

This research article examines rising AI costs caused by messy, repeatedly assembled context for agent queries. An experiment using thousands of production queries and a test set of 1000 commonly asked SDLC queries found that structured context was 80% cheaper than unstructured context. The proposed approach pre-relates context and uses a semantic layer to reduce data hops, reasoning, and token consumption.

### Source excerpt

We ran thousands of AI queries on unstructured and structured context and measured the cost. Structured context was 80% cheaper than unstructured.

## Agent platform (Part 1): How we help Grab build and run AI agents at scale

DevFeed: [Agent platform (Part 1): How we help Grab build and run AI agents at scale](<https://devfeed.tech/articles/agent-platform-part-1-how-we-help-grab-build-and-run-ai-agents-at-scale-1250.md>)

Original publisher: [Read original article](<https://engineering.grab.com/how-grab-builds-and-runs-ai-agents-at-scale>)

Author: Kendrick Tan

Published: 2026-07-24T00:00:10Z

Content type: article

Language: en

Sources: [Grab Tech](<https://devfeed.tech/sources/grab-tech.md>)

Topics: [AI Bots](<https://devfeed.tech/topics/ai-bots.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [MSP MCP](<https://devfeed.tech/topics/msp-mcp.md>)

Tags: [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [design](<https://devfeed.tech/tags/design.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [go](<https://devfeed.tech/tags/go.md>), [llm](<https://devfeed.tech/tags/llm.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [platform](<https://devfeed.tech/tags/platform.md>), [scale](<https://devfeed.tech/tags/scale.md>)

### AI overview

Grab describes the first part of its AI-agent platform story: a Tech Infra support bot that evolved from operational automation into a GPT-powered Level-0 support layer. The article outlines its reasoning and tool planes and explains how scaling challenges informed the LLM-Kit framework.

### Source excerpt

Part 1: From one support bot to a framework At Grab, AI agents have evolved from interesting team prototypes into production services used every day by millions of merchants, drivers, and consumers. Today, more than 500 services run on our internal agent framework, over 50 Model Context Protocol (MCP) servers are registered on our remote MCP framework, and a single Large Language Model (LLM) gateway fronts every model call across the company, handling billions of tokens each month. None of this was designed up front. It began as the plumbing behind one internal support bot, which then expanded because the same problems kept resurfacing for every team trying to ship an agent. This series tells the story of what the platform eventually became. This Part 1 of the blog focuses on the beginning: the architecture of our AI support bot, the specific pain points we hit while scaling and iterating on it, and how each of those failures became a core building block in the framework we now call LLM-Kit. The bot that started it Imagine you have a question for the Technical Infrastructure (Tech Infra) team - the engineers who run the cloud platforms, databases, developer tooling, and AI infrastructure behind Grab's ecosystem. Instead of immediately paging an on-call engineer, a bot first triages the request, checks the team's documentation, runbooks, and past Slack threads, and tries to answer directly in the thread. If it still cannot resolve the issue, it routes the ticket to the right human, with the relevant context already attached. That is what we built with the Tech Infra Support Bot. In the first half of 2023, Tech Infra handled thousands of support tickets, many of them repeated questions that had already been answered somewhere internally. Before LLMs, the bot's role was mainly operational; performing tasks like helping track acknowledgments and response times for on-call engineers. With the arrival of GPT-4-32k, we evolved it into a GPT-powered Level-0 support layer th

## Start Customizing NVIDIA Nemotron 3 Nano with Prime Intellect Lab in Minutes

DevFeed: [Start Customizing NVIDIA Nemotron 3 Nano with Prime Intellect Lab in Minutes](<https://devfeed.tech/articles/start-customizing-nvidia-nemotron-3-nano-with-prime-intellect-lab-in-minutes-6942.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/start-customizing-nvidia-nemotron-3-nano-with-prime-intellect-lab-in-minutes/>)

Author: Chris Alexiuk

Published: 2026-07-23T16:00:00Z

Content type: tutorial

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [rlvr](<https://devfeed.tech/topics/rlvr.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [Python](<https://devfeed.tech/topics/python.md>), [coding](<https://devfeed.tech/topics/coding.md>), [math](<https://devfeed.tech/topics/math.md>)

Tags: [agentic-ai-generative-ai](<https://devfeed.tech/tags/agentic-ai-generative-ai.md>), [blog](<https://devfeed.tech/tags/blog.md>), [coding](<https://devfeed.tech/tags/coding.md>), [customization](<https://devfeed.tech/tags/customization.md>), [developer-tools-techniques](<https://devfeed.tech/tags/developer-tools-techniques.md>), [developers](<https://devfeed.tech/tags/developers.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [featured](<https://devfeed.tech/tags/featured.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [getting-started](<https://devfeed.tech/tags/getting-started.md>), [math](<https://devfeed.tech/tags/math.md>), [nemotron](<https://devfeed.tech/tags/nemotron.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [open](<https://devfeed.tech/tags/open.md>), [python](<https://devfeed.tech/tags/python.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [rlvr](<https://devfeed.tech/tags/rlvr.md>), [top-stories](<https://devfeed.tech/tags/top-stories.md>), [train](<https://devfeed.tech/tags/train.md>), [training](<https://devfeed.tech/tags/training.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

### AI overview

This tutorial shows how to customize NVIDIA Nemotron 3 Nano with Prime Intellect Lab using reinforcement learning with verifiable rewards on a Python Math environment. It covers a baseline-training-reevaluation workflow and produces a downloadable LoRA adapter.

### Source excerpt

Customization is what enables developers to take a general model and tailor it to use cases, domains, languages, and more. However, customization comes with a...

## Raspberry Pi Projects That Sound Great But Are Usually a Bad Idea

DevFeed: [Raspberry Pi Projects That Sound Great But Are Usually a Bad Idea](<https://devfeed.tech/articles/raspberry-pi-projects-that-sound-great-but-are-usually-a-bad-idea-10813.md>)

Original publisher: [Read original article](<https://raspberrytips.com/raspberry-pi-projects-bad-idea/>)

Author: Patrick Fromaget

Published: 2026-07-18T05:00:00Z

Content type: opinion

Language: en

Sources: [RaspberryTips](<https://devfeed.tech/sources/raspberrytips.md>)

Topics: [Hardware](<https://devfeed.tech/topics/hardware.md>), [Cryptocurrency](<https://devfeed.tech/topics/cryptocurrency.md>), [hosting](<https://devfeed.tech/topics/hosting.md>), [Linux](<https://devfeed.tech/topics/linux.md>), [Security](<https://devfeed.tech/topics/security.md>), [servers](<https://devfeed.tech/topics/servers.md>), [1Password in the browser](<https://devfeed.tech/topics/1password-in-the-browser.md>)

Tags: [crypto](<https://devfeed.tech/tags/crypto.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [hosting](<https://devfeed.tech/tags/hosting.md>), [inspiration](<https://devfeed.tech/tags/inspiration.md>), [linux](<https://devfeed.tech/tags/linux.md>), [projects](<https://devfeed.tech/tags/projects.md>), [raspberry-pi](<https://devfeed.tech/tags/raspberry-pi.md>), [security](<https://devfeed.tech/tags/security.md>), [self-hosting](<https://devfeed.tech/tags/self-hosting.md>)

### AI overview

The article argues that although Raspberry Pi computers can run many projects, some are poor choices for long-term reliance because they require more reliability and maintenance than a Pi setup can provide. It presents cryptocurrency mining and self-hosting an email server as examples: both can be useful learning exercises, but Raspberry Pi hardware is generally unsuitable for profitable mining or dependable email hosting.

### Source excerpt

After years of testing and writing tutorials on RaspberryTips, I can tell you one thing: you can make your Raspberry Pi do almost anything. However, just because it works doesn't mean it's a good idea. Let's talk about it. A Raspberry Pi can run many home projects, but some are poor choices for long-term use....

## Sightlines issue no.1: Insights from Config

DevFeed: [Sightlines issue no.1: Insights from Config](<https://devfeed.tech/articles/sightlines-issue-no-1-insights-from-config-10047.md>)

Original publisher: [Read original article](<https://www.figma.com/blog/sightlines-issue-no1/>)

Author: Figma

Published: 2026-07-16T16:37:00Z

Content type: article

Language: en

Sources: [Figma Blog](<https://devfeed.tech/sources/figma-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [beginner](<https://devfeed.tech/tags/beginner.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [design](<https://devfeed.tech/tags/design.md>), [development](<https://devfeed.tech/tags/development.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [insights](<https://devfeed.tech/tags/insights.md>), [leadership](<https://devfeed.tech/tags/leadership.md>), [product-development](<https://devfeed.tech/tags/product-development.md>), [prototyping](<https://devfeed.tech/tags/prototyping.md>)

### AI overview

Sightlines issue no.1 shares lessons from Config's Leadership Collective about leading product, design, and engineering teams in the age of AI. It emphasizes enduring leadership fundamentals, experimentation, collaboration, human judgment, and maintaining quality as teams adopt AI.

### Source excerpt

The conversations we're still replaying from Config's Leadership Collective.

## How Prompt Tuning Improved GPT-5.5 in VS Code

DevFeed: [How Prompt Tuning Improved GPT-5.5 in VS Code](<https://devfeed.tech/articles/how-prompt-tuning-improved-gpt-5-5-in-vs-code-4062.md>)

Original publisher: [Read original article](<https://code.visualstudio.com/blogs/2026/07/06/optimizing-vscode-coding-harness-model-providers>)

Author: VS Code Team

Published: 2026-07-06T00:00:00Z

Content type: article

Language: en

Sources: [Visual Studio Code - Code Editing. Redefined.](<https://devfeed.tech/sources/visual-studio-code-code-editing-redefined.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [AI Bots](<https://devfeed.tech/topics/ai-bots.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [blog](<https://devfeed.tech/tags/blog.md>), [coding](<https://devfeed.tech/tags/coding.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [openai](<https://devfeed.tech/tags/openai.md>), [testing](<https://devfeed.tech/tags/testing.md>), [tools](<https://devfeed.tech/tags/tools.md>), [validation](<https://devfeed.tech/tags/validation.md>), [vs-code](<https://devfeed.tech/tags/vs-code.md>)

### AI overview

VS Code and OpenAI tested two system-prompt variants for GPT-5.5 coding agents to reduce exploration and validate edits sooner. The experiment compared the variants with a control on live traffic and shipped the stronger result.

### Source excerpt

See how VS Code and OpenAI tested GPT-5.5 system prompt changes in a two-week experiment, cutting tool calls and tail-end token usage while speeding up edits. Read the full article

## 7 questions we had going into Config Leadership Collective

DevFeed: [7 questions we had going into Config Leadership Collective](<https://devfeed.tech/articles/7-questions-we-had-going-into-config-leadership-collective-9474.md>)

Original publisher: [Read original article](<https://www.figma.com/blog/7-questions-from-lc/>)

Author: Emma Webster

Published: 2026-07-03T02:45:00Z

Content type: article

Language: en

Sources: [Figma Blog](<https://devfeed.tech/sources/figma-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [User experience (UX)](<https://devfeed.tech/topics/ux.md>), [Figma](<https://devfeed.tech/topics/figma.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [design](<https://devfeed.tech/tags/design.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [leadership](<https://devfeed.tech/tags/leadership.md>), [learning](<https://devfeed.tech/tags/learning.md>), [ux](<https://devfeed.tech/tags/ux.md>)

### AI overview

Leadership lessons from Config Leadership Collective: as AI and creative tools rapidly change design and product work, leaders are adapting their processes, experimenting hands-on, and giving teams permission to learn. The article also emphasizes enduring fundamentals such as understanding users, supporting their workflows, and maintaining craft and care.

### Source excerpt

We showed up to Leadership Collective hoping to learn how leaders are guiding their teams through change, what expertise means now, and how they're keeping quality high as the pace picks up. Here's what we heard.

## The effect distribution: The missing piece in experimentation programs

DevFeed: [The effect distribution: The missing piece in experimentation programs](<https://devfeed.tech/articles/the-effect-distribution-the-missing-piece-in-experimentation-programs-2266.md>)

Original publisher: [Read original article](<https://www.datadoghq.com/blog/effect-distribution-in-experimentation/>)

Author: Tyler Buffington

Published: 2026-07-02T00:00:00Z

Content type: article

Language: en

Sources: [Datadog | The Monitor blog](<https://devfeed.tech/sources/datadog-the-monitor-blog.md>)

Topics: [experiments](<https://devfeed.tech/topics/experiments.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [experimentation](<https://devfeed.tech/tags/experimentation.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

The article explains why effect distributions are essential for interpreting results across experimentation programs. It shows how statistically significant results can all be false positives when true effects are concentrated at zero, and introduces the challenge of estimating true effects from noisy observed effects.

### Source excerpt

Learn about the importance of considering the effect distribution when running experiments.

## Variance Reduction Below the Randomization Grain

DevFeed: [Variance Reduction Below the Randomization Grain](<https://devfeed.tech/articles/variance-reduction-below-the-randomization-grain-20111.md>)

Original publisher: [Read original article](<https://tech.instacart.com/variance-reduction-below-the-randomization-grain-31719f87a7d2?source=rss----587883b5d2ee---4>)

Author: Tilman Drerup

Published: 2026-07-01T16:28:36Z

Content type: article

Language: en

Sources: [Instacart](<https://devfeed.tech/sources/instacart.md>)

Topics: [experiments](<https://devfeed.tech/topics/experiments.md>)

Tags: [capacity](<https://devfeed.tech/tags/capacity.md>), [causal-inference](<https://devfeed.tech/tags/causal-inference.md>), [economics](<https://devfeed.tech/tags/economics.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [experimentation](<https://devfeed.tech/tags/experimentation.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [marketplaces](<https://devfeed.tech/tags/marketplaces.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [reduce](<https://devfeed.tech/tags/reduce.md>), [science](<https://devfeed.tech/tags/science.md>), [techniques](<https://devfeed.tech/tags/techniques.md>), [variance](<https://devfeed.tech/tags/variance.md>)

### AI overview

This article explains how marketplace experiments can reduce metric variance below the level at which treatment is randomized. It describes cluster-level randomization for containing interference and shows how fine-grained outcome predictability can improve statistical power and reduce experimentation time.

### Source excerpt

Sergio Camelo, Caitlin Kearns, Matias Cersosimo, and Tilman Drerup As artificial intelligence increases the velocity of engineering and science teams, experimental throughput is set to become a bottleneck for many product decisions. Many companies can now build faster than they can experiment, with queues of good ideas running the risk of not being tested because of lack of experimental capacity. This problem is particularly severe in marketplaces, where the presence of spillover and cannibalization effects between experimental units requires cluster-level randomization techniques. That randomization, in turn, has the unfortunate tendency to substantially reduce statistical power and slow down experimentation. In this post, we show that the predictability of outcomes at fine grains can be exploited to reduce the variance of aggregate metrics, even when experiments themselves are run at a coarse level. Since statistical power depends on metric variability, this yields considerable reductions in experimentation time. The Interference Problem In marketplace settings, behavior and outcomes for individual participants are inherently intertwined. In a delivery marketplace like Instacart, for example, the dispatch system solves a bipartite matching problem between shoppers and customer orders. Since assignments are global and interdependent, matching an order to one shopper means that the same order cannot be matched to another shopper. As a result, changing the handling for a single order creates ripples that affect the orders around it. If an experimenter were to assign a treatment intervention to one of these orders while leaving neighboring orders as controls, the latter would evidently be contaminated. A common response to this problem is to randomize treatments at the level of a cluster, chosen so that interference can stay within it. In food and grocery delivery, that cluster is typically a geographical region. Since every order within a region sees the same treatme

## How We Built an AI Agent to Clean Up Dead Code After A/B Tests

DevFeed: [How We Built an AI Agent to Clean Up Dead Code After A/B Tests](<https://devfeed.tech/articles/how-we-built-an-ai-agent-to-clean-up-dead-code-after-a-b-tests-26513.md>)

Original publisher: [Read original article](<https://medium.com/engineering-housing/how-we-built-an-ai-agent-to-clean-up-dead-code-after-a-b-tests-a5519af4892e?source=rss----3a69e32e2594---4>)

Author: Aseem Upadhyay

Published: 2026-06-23T10:54:43Z

Content type: article

Language: en

Sources: [Housing.com](<https://devfeed.tech/sources/housing-com.md>)

Topics: [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [experiments](<https://devfeed.tech/topics/experiments.md>), [Code](<https://devfeed.tech/topics/code.md>), [Pull Request](<https://devfeed.tech/topics/pull-request.md>), [context](<https://devfeed.tech/topics/context.md>), [Android](<https://devfeed.tech/topics/android.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents-in-action](<https://devfeed.tech/tags/ai-agents-in-action.md>), [automated](<https://devfeed.tech/tags/automated.md>), [code](<https://devfeed.tech/tags/code.md>), [concurrent](<https://devfeed.tech/tags/concurrent.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [jira](<https://devfeed.tech/tags/jira.md>), [llm](<https://devfeed.tech/tags/llm.md>)

### AI overview

Housing.com describes building an AI-agent pipeline to help clean up code after A/B tests. The workflow interprets experiment tickets, reports experiment status, and applies instructions to code, while using scripts for deterministic steps and an LLM where judgment is required.

### Source excerpt

Photo by Microsoft Copilot on Unsplash At Housing.com, running product experiments is a continuous cycle. A/B tests go live, collect data, and eventually reach a conclusion. That's the exciting part. Then comes the mundane reality where someone has to clean up the code .i.e. remove a feature flag, promote a winning variant or revert the loser variant and finally raise a change request. Sounds simple? Maybe Is it tedious and quietly expensive? Yes! lifecycle of a taskThe Problem Worth Solving An experiment conclusion ticket typically lands on an engineer's desk looking something like this: Experiment: show_listing_map_widget Platform: Android Result: Negative - revert to control The job of the assigned engineer involves four distinct steps: Find every reference to the flag across the codebase. Delete the losing variant's code path. Trace every side-effect that only existed to support that variant Commit, open a PR, and comment on the Jira ticket. Step 3 is where the trap lies. Be it applying or removing a change, changing all the infrastructure code dependent on it could increase the complexity and risk of creating technical debt. But what if we automated a part of it? The AI Agent Pipelineupdated AI enabled lifecycle The problem statement became simple: Let stakeholders own the trigger. We built two agents to make it happen, 1. to interpret tickets and report experiment status 2. to take the instructions and code. Then came the hard part. Navigating Roadblocks The real complexity lies in building an AI agent that runs autonomously and serves different users across different use cases We found ourselves wrestling with questions we hadn't fully anticipated: How do we optimise on the tokens used per request? How do we handle concurrent requests? How do we ensure that the consistency in the output? So we went looking for answers.. Optimising Tokens per request Not every step needs AI. At each point in the workflow, we asked one question: is this operation deterministic

## How Evaluation-Driven Development (EDD) Works

DevFeed: [How Evaluation-Driven Development (EDD) Works](<https://devfeed.tech/articles/how-evaluation-driven-development-edd-works-18296.md>)

Original publisher: [Read original article](<https://www.decodingai.com/p/how-evaluation-driven-development-works>)

Author: Paul Iusztin

Published: 2026-06-23T08:57:02Z

Content type: tutorial

Language: en

Sources: [Decoding ML](<https://devfeed.tech/sources/decoding-ml.md>)

Topics: [Development](<https://devfeed.tech/topics/development.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>), [dataset](<https://devfeed.tech/topics/dataset.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-evals](<https://devfeed.tech/tags/ai-evals.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [development](<https://devfeed.tech/tags/development.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [saas](<https://devfeed.tech/tags/saas.md>), [test](<https://devfeed.tech/tags/test.md>), [tests](<https://devfeed.tech/tags/tests.md>)

### AI overview

This case study explains Evaluation-Driven Development (EDD) for AI agents: measure a new feature, compare results before and after changes, and detect regressions before merging. It also discusses generating realistic test data when historical datasets, traces, or ground truth are unavailable.

### Source excerpt

Turn every AI agent change into a measured experiment you compare before and after to detect regressions and measure performance.

## Developing a Zephyr IoT app with AI

DevFeed: [Developing a Zephyr IoT app with AI](<https://devfeed.tech/articles/developing-a-zephyr-iot-app-with-ai-13779.md>)

Original publisher: [Read original article](<https://developer.espressif.com/blog/2026/06/zephyr-coding-with-ai/>)

Author: John Lee

Published: 2026-06-15T00:00:00Z

Content type: tutorial

Language: en

Sources: [Blog on Developer Portal](<https://devfeed.tech/sources/blog-on-developer-portal.md>)

Topics: [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Embedded Software Dev](<https://devfeed.tech/topics/embedded-software-dev.md>), [Internet of things](<https://devfeed.tech/topics/iot.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [cursor](<https://devfeed.tech/topics/cursor.md>), [Testing](<https://devfeed.tech/topics/testing.md>), [C](<https://devfeed.tech/topics/c.md>), [Git](<https://devfeed.tech/topics/git.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [real-time](<https://devfeed.tech/topics/real-time.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [blog](<https://devfeed.tech/tags/blog.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [cursor](<https://devfeed.tech/tags/cursor.md>), [development](<https://devfeed.tech/tags/development.md>), [drivers](<https://devfeed.tech/tags/drivers.md>), [embedded](<https://devfeed.tech/tags/embedded.md>), [esp](<https://devfeed.tech/tags/esp.md>), [esp-idf](<https://devfeed.tech/tags/esp-idf.md>), [espressif](<https://devfeed.tech/tags/espressif.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [firmware](<https://devfeed.tech/tags/firmware.md>), [git](<https://devfeed.tech/tags/git.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [iot](<https://devfeed.tech/tags/iot.md>), [llm](<https://devfeed.tech/tags/llm.md>), [m5stack](<https://devfeed.tech/tags/m5stack.md>), [testing](<https://devfeed.tech/tags/testing.md>), [workflow](<https://devfeed.tech/tags/workflow.md>), [zephyr](<https://devfeed.tech/tags/zephyr.md>)

### AI overview

This article describes applying an AI-agent workflow to develop a Zephyr-based IoT application on the ESP DualKey kit from M5Stack. It emphasizes specifications, project boundaries, Git discipline, testing, and bench validation while moving the implementation from ESP-IDF and Rust to Zephyr C.

### Source excerpt

Still on improving our AI-based, embedded software workflow, this article applies the same AI-agent discipline to Zephyr. Using the same ESP Dualkey kit from M5Stack, specs, integration rules, plan->execute->commit->test, reusable modules, journals, and Git - without redefining the product.

## Kotlin Multiplatform in Production: Two Real-World Use Cases from Booking.com

DevFeed: [Kotlin Multiplatform in Production: Two Real-World Use Cases from Booking.com](<https://devfeed.tech/articles/kotlin-multiplatform-in-production-two-real-world-use-cases-from-booking-com-23724.md>)

Original publisher: [Read original article](<https://medium.com/booking-com-development/kotlin-multiplatform-in-production-two-real-world-use-cases-from-booking-com-46ffe13a773d?source=rss----1c36c35f9c76---4>)

Author: Diego Gómez Olvera

Published: 2026-06-05T15:09:18Z

Content type: article

Language: en

Sources: [Booking.com Development - Medium](<https://devfeed.tech/sources/booking-com-development-medium.md>)

Topics: [Kotlin Multiplatform](<https://devfeed.tech/topics/kotlin-multiplatform.md>), [compose-multiplatform](<https://devfeed.tech/topics/compose-multiplatform.md>), [experiments](<https://devfeed.tech/topics/experiments.md>), [A/B Testing](<https://devfeed.tech/topics/a-b-testing.md>), [Android](<https://devfeed.tech/topics/android.md>), [iOS](<https://devfeed.tech/topics/ios.md>), [Design system](<https://devfeed.tech/topics/design-system.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [Development](<https://devfeed.tech/topics/development.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [android](<https://devfeed.tech/tags/android.md>), [booking](<https://devfeed.tech/tags/booking.md>), [bookingcom](<https://devfeed.tech/tags/bookingcom.md>), [compose](<https://devfeed.tech/tags/compose.md>), [compose-multiplatform](<https://devfeed.tech/tags/compose-multiplatform.md>), [concepts](<https://devfeed.tech/tags/concepts.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [data](<https://devfeed.tech/tags/data.md>), [development](<https://devfeed.tech/tags/development.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [experimentation](<https://devfeed.tech/tags/experimentation.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [ios](<https://devfeed.tech/tags/ios.md>), [java](<https://devfeed.tech/tags/java.md>), [jetpack-compose](<https://devfeed.tech/tags/jetpack-compose.md>), [kotlin](<https://devfeed.tech/tags/kotlin.md>), [kotlin-multiplatform](<https://devfeed.tech/tags/kotlin-multiplatform.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [multiplatform](<https://devfeed.tech/tags/multiplatform.md>), [objective-c](<https://devfeed.tech/tags/objective-c.md>)

### AI overview

This article describes two Booking.com engineering use cases for Kotlin Multiplatform and Compose Multiplatform: a shared experimentation library for consistent experiment assignments across Android and iOS, and hosting an Android design system in a web browser.

### Source excerpt

Introduction For the majority of Booking.com travelers, mobile is the primary channel for researching, planning, and booking trips. Recent data shows that over 80% of travelers rely on a mobile app during the research phase, with more than half of all bookings occurring on mobile devices. Consequently, the Android and iOS platforms are critical to the company's product strategy; engineering choices made here have significant repercussions for the entire organisation. To maintain agility at this scale, two elements must function in unison: Strict decision validation: At any time, Booking.com manages over 1,000 simultaneous experiments across its product suite, with hundreds active on mobile. Every minor adjustment undergoes A/B testing via our proprietary experimentation library before reaching the user. A unified design system ensures product consistency and makes design goals transparent to all contributors, not just maintenance engineers. This article examines two specific engineering challenges solved using Kotlin Multiplatform (KMP) and Compose Multiplatform (CMP): Developing a shared experimentation library to ensure uniform experiment assignments across Android and iOS. Using Compose Multiplatform to host our Android design system in a web browser, bridging the gap between design concepts and implementation. While both cases use the same underlying technology, each provides unique insights into multiplatform development. Use case 1: shared experimentation library on Android and iOSThe problem with two implementations Historically, our internal experimentation library, responsible for managing experiment assignments, evaluations, and tracking on mobile, was maintained as two distinct codebases: a mix of Java and Kotlin for Android and Objective-C for iOS. While intended to be identical, managing two languages with fluctuating team resources inevitably led to logic drift. Discrepancies in event-tracking and experiment-fetching behaviours emerged, though they wer

## Re-autoresearching MSMARCO BM25, on Vespa

DevFeed: [Re-autoresearching MSMARCO BM25, on Vespa](<https://devfeed.tech/articles/re-autoresearching-msmarco-bm25-on-vespa-12796.md>)

Original publisher: [Read original article](<https://blog.vespa.ai/re-autoresearching-msmarco-bm25-on-vespa/>)

Author: andreer thomas

Published: 2026-05-29T00:00:00Z

Content type: article

Language: en

Sources: [Vespa Blog](<https://devfeed.tech/sources/vespa-blog.md>)

Topics: [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [Python](<https://devfeed.tech/topics/python.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>), [pandas](<https://devfeed.tech/topics/pandas.md>), [Google Search](<https://devfeed.tech/topics/google-search.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [bm25](<https://devfeed.tech/tags/bm25.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [google-search](<https://devfeed.tech/tags/google-search.md>), [information-retrieval](<https://devfeed.tech/tags/information-retrieval.md>), [openai](<https://devfeed.tech/tags/openai.md>), [pandas](<https://devfeed.tech/tags/pandas.md>), [python](<https://devfeed.tech/tags/python.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

This article reproduces an MSMARCO BM25 autoresearch experiment in Vespa. It compares LLM-driven Python reranking with an approach restricted to existing Vespa rank features and reports a comparable improvement on a 650,000-passage subset, with better generalization to the full dataset.

### Source excerpt

BM25 is having a moment. We reproduce Doug Turnbull's MSMARCO autoresearch experiment in Vespa and get a comparable MRR@10 lift from existing rank features -- with twice the generalization to full MSMARCO.

## Four ways Google Research scientists have been using Empirical Research Assistance

DevFeed: [Four ways Google Research scientists have been using Empirical Research Assistance](<https://devfeed.tech/articles/four-ways-google-research-scientists-have-been-using-empirical-research-assistance-6778.md>)

Original publisher: [Read original article](<https://research.google/blog/four-ways-google-research-scientists-have-been-using-empirical-research-assistance/>)

Published: 2026-04-29T21:07:00Z

Content type: article

Language: en

Sources: [The latest research from Google](<https://devfeed.tech/sources/the-latest-research-from-google.md>)

Topics: [Google](<https://devfeed.tech/topics/google.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Data Mining & Modeling](<https://devfeed.tech/topics/data-mining-modeling.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [real-time](<https://devfeed.tech/topics/real-time.md>)

Tags: [accelerate](<https://devfeed.tech/tags/accelerate.md>), [ai](<https://devfeed.tech/tags/ai.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [data](<https://devfeed.tech/tags/data.md>), [data-mining-modeling](<https://devfeed.tech/tags/data-mining-modeling.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [general-science](<https://devfeed.tech/tags/general-science.md>), [generate](<https://devfeed.tech/tags/generate.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [go](<https://devfeed.tech/tags/go.md>), [google](<https://devfeed.tech/tags/google.md>), [insights](<https://devfeed.tech/tags/insights.md>), [machine-intelligence](<https://devfeed.tech/tags/machine-intelligence.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [research](<https://devfeed.tech/tags/research.md>), [science](<https://devfeed.tech/tags/science.md>), [software](<https://devfeed.tech/tags/software.md>)

### AI overview

Google Research scientists are using Empirical Research Assistance (ERA) to develop expert-level empirical software and explore AI-assisted scientific discovery across epidemiology, geospatial analysis, cosmology, atmospheric monitoring, and neuroscience. The article highlights ERA's use in computational modeling, interpretable solutions, and real-time forecasts for COVID-19, influenza, and RSV.

### Source excerpt

Data Mining & Modeling

[Next page](<https://devfeed.tech/tags/experiment.md?cursor=WyIyMDI2LTA0LTI5VDIxOjA3OjAwKzAwOjAwIiwgIjU0OWQ1NTVjLWRiZjItNDFjYy1hZDI1LWM3ZTQ3NmQ5YzU4YyJd>)