# latency-optimization

Published articles for latency-optimization.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Building transactional voice agents at Nector

DevFeed: [Building transactional voice agents at Nector](<https://devfeed.tech/articles/building-transactional-voice-agents-at-nector-39410.md>)

Original publisher: [Read original article](<https://blog.pranshu-raj.in/posts/nector-voice-agents/>)

Author: Pranshu Raj

Published: 2026-03-07T13:39:58Z

Content type: article

Language: en

Sources: [Pranshu Raj - blog on backend systems, performance and sidequests](<https://devfeed.tech/sources/pranshu-raj-blog-on-backend-systems-performance-and-sidequests.md>)

Topics: [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [Multi-tenancy](<https://devfeed.tech/topics/multi-tenancy.md>), [Back end](<https://devfeed.tech/topics/backend.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Database](<https://devfeed.tech/topics/database.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [api](<https://devfeed.tech/tags/api.md>), [backend](<https://devfeed.tech/tags/backend.md>), [database-design](<https://devfeed.tech/tags/database-design.md>), [json-rpc](<https://devfeed.tech/tags/json-rpc.md>), [latency](<https://devfeed.tech/tags/latency.md>), [latency-optimization](<https://devfeed.tech/tags/latency-optimization.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [multi-tenancy](<https://devfeed.tech/tags/multi-tenancy.md>), [observability](<https://devfeed.tech/tags/observability.md>), [pii](<https://devfeed.tech/tags/pii.md>), [production](<https://devfeed.tech/tags/production.md>), [proxy](<https://devfeed.tech/tags/proxy.md>), [rest-api](<https://devfeed.tech/tags/rest-api.md>), [voice](<https://devfeed.tech/tags/voice.md>)

### AI overview

An engineer describes building customer-facing transactional voice agents for ecommerce at Nector. The article covers a REST-to-JSON-RPC MCP proxy that improved observability, PII control, context reduction, latency, and correctness, plus experiments that reduced one agent's p90 latency from more than 8 seconds to 2 seconds.

### Source excerpt

Building production ready voice agents, latency optimization, multi tenancy, MCP proxies - six months of building customer facing voice agents

## Improving latency with Eager Workflow Start

DevFeed: [Improving latency with Eager Workflow Start](<https://devfeed.tech/articles/improving-latency-with-eager-workflow-start-35882.md>)

Original publisher: [Read original article](<https://temporal.io/blog/improving-latency-with-eager-workflow-start>)

Author: Antonio Lain

Published: 2024-04-29T06:00:00Z

Content type: article

Language: en

Sources: [Temporal Blog](<https://devfeed.tech/sources/temporal-blog.md>)

Topics: [Latency](<https://devfeed.tech/topics/latency.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [SDK](<https://devfeed.tech/topics/sdk.md>), [Go Language](<https://devfeed.tech/topics/go-language.md>), [Publish-subscribe pattern](<https://devfeed.tech/topics/pubsub.md>)

Tags: [go](<https://devfeed.tech/tags/go.md>), [latency](<https://devfeed.tech/tags/latency.md>), [latency-optimization](<https://devfeed.tech/tags/latency-optimization.md>), [pre-release](<https://devfeed.tech/tags/pre-release.md>), [product-news](<https://devfeed.tech/tags/product-news.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

This article explains Eager Workflow Start (EWS), an experimental pre-release latency optimization for Temporal workflows. EWS can include the initial workflow task in the start response when a local worker is ready, reducing startup operations for short-lived workflows deployed near the Temporal Server. The article covers its operation, expected performance improvements, limitations, and a Go example.

### Source excerpt

Discover how Eager Workflow Start (EWS) optimizes latency by reducing workflow start time, now in pre-release with local worker integration.

## Glassdoor Decreases Latency Overhead and Improves Data Monitoring with WhyLabs

DevFeed: [Glassdoor Decreases Latency Overhead and Improves Data Monitoring with WhyLabs](<https://devfeed.tech/articles/glassdoor-decreases-latency-overhead-and-improves-data-monitoring-with-whylabs-22609.md>)

Original publisher: [Read original article](<https://medium.com/glassdoor-engineering/glassdoor-decreases-latency-overhead-and-improves-data-monitoring-with-whylabs-ad399576624d?source=rss----288d984af747---4>)

Author: Lanqi Fei

Published: 2023-09-06T21:57:52Z

Content type: article

Language: en

Sources: [Glassdoor Engineering](<https://devfeed.tech/sources/glassdoor-engineering.md>)

Topics: [Latency](<https://devfeed.tech/topics/latency.md>), [Logging](<https://devfeed.tech/topics/logging.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [Library](<https://devfeed.tech/topics/library.md>), [async](<https://devfeed.tech/topics/async.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Graphs](<https://devfeed.tech/topics/graphs.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [async](<https://devfeed.tech/tags/async.md>), [complexity](<https://devfeed.tech/tags/complexity.md>), [graph](<https://devfeed.tech/tags/graph.md>), [latency](<https://devfeed.tech/tags/latency.md>), [latency-optimization](<https://devfeed.tech/tags/latency-optimization.md>), [library](<https://devfeed.tech/tags/library.md>), [logging](<https://devfeed.tech/tags/logging.md>), [model-monitoring](<https://devfeed.tech/tags/model-monitoring.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [open-source](<https://devfeed.tech/tags/open-source.md>)

### AI overview

This article examines how Glassdoor and WhyLabs addressed latency when integrating data monitoring into a real-time service. It describes changes to whylogs, an open-source data logging library, and compares architectural options including asynchronous calls, DAG-based restructuring, and keeping work in a linear execution path.

### Source excerpt

Authors: Lanqi Fei, Jamie, Natalia This blog was written by Lanqi Fei, Senior ML Scientist at Glassdoor, Jamie Broomall, Senior Software Engineer at WhyLabs, and Natalia Skaczkowska-Drabczyk, Customer Success Data Scientist at WhyLabs. The challenge of integration latency Consider the scenario where we want to integrate a new tool into an existing service that potentially operates in real-time and involves some user interface. We need to make sure that the latency of the service in production is acceptable after the integration, while still keeping the overall maintenance costs low. In this scenario, there are trade-offs to be made and the right choice will depend on the individual characteristics of the service and the newly integrated function. Simplifying this function is a common path to gaining a significant advantage in this optimization game. This blog, written in collaboration between Glassdoor and WhyLabs, describes a real-world instance of an integration latency challenge and gives a detailed walk-through of the changes applied within whylogs (an open-source data logging library maintained by WhyLabs) to mitigate it. What are the best options for reducing latency? There are a couple of options for reducing latency when integrating a new function into an existing service. Restructuring your service or architecture to allow an early response to the caller before doing the additional work (this may be as simple as using an async call pattern with a log statement or as complex as a DAG framework). You can think of your service as a graph -- its nodes should be the latency-critical tasks and ideally those should be executed, instrumented and tested independently. Using a DAG can be a good way of scaling out a service to a large number of new features and integrations while maintaining latency requirements and managing the complexity of the critical path to generating a high quality user response. The downside of this approach is the additional complexity as well