# AWS' Colleen Aubrey: Stop inventing new AI metrics -- it's your business metrics that matter

DevFeed: [AWS' Colleen Aubrey: Stop inventing new AI metrics -- it's your business metrics that matter](<https://devfeed.tech/articles/aws-colleen-aubrey-stop-inventing-new-ai-metrics-it-s-your-business-metrics-that-matter-121547.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/06/aws-colleen-aubrey-stop-inventing-new-ai-metrics-its-your-business-metrics-that-matter/>)

Author: Zeus Kerravala

Published: 2026-11-06T18:56:52Z

Content type: opinion

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [AI Strategy](<https://devfeed.tech/topics/ai-strategy.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Business, Industry, Usability, User Experience, User Research, Web Strategy](<https://devfeed.tech/topics/business-industry-usability-user-experience-user-research-web-strategy.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>)

Tags: [adoption](<https://devfeed.tech/tags/adoption.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-metrics](<https://devfeed.tech/tags/ai-metrics.md>), [ai-products](<https://devfeed.tech/tags/ai-products.md>), [ai-projects](<https://devfeed.tech/tags/ai-projects.md>), [ai-return-on-investment](<https://devfeed.tech/tags/ai-return-on-investment.md>), [ai-roi](<https://devfeed.tech/tags/ai-roi.md>), [ai-tools](<https://devfeed.tech/tags/ai-tools.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-connect](<https://devfeed.tech/tags/amazon-connect.md>), [amazon-web-services](<https://devfeed.tech/tags/amazon-web-services.md>), [amazon-web-services-inc](<https://devfeed.tech/tags/amazon-web-services-inc.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [aws](<https://devfeed.tech/tags/aws.md>), [business](<https://devfeed.tech/tags/business.md>), [colleen-aubrey](<https://devfeed.tech/tags/colleen-aubrey.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [information-technology](<https://devfeed.tech/tags/information-technology.md>), [it](<https://devfeed.tech/tags/it.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [news](<https://devfeed.tech/tags/news.md>), [siliconangle](<https://devfeed.tech/tags/siliconangle.md>), [the-latest](<https://devfeed.tech/tags/the-latest.md>), [top-story-6](<https://devfeed.tech/tags/top-story-6.md>)

## AI overview

AWS executive Colleen Aubrey's central advice is to judge AI initiatives by existing business metrics, not AI activity measures such as tokens or prompts. Her examples point to a practical path from pilots to production: target one acute decision bottleneck instead of chasing feature parity or rebuilding a whole workflow; set a baseline against a metric leaders already track; and plan to fix downstream constraints that AI exposes. At Amazon, broader use of coding tools revealed weak test coverage and pipelines, and addressing those issues accompanied a twofold increase in production push velocity. Aubrey also argues that roles should focus on outcomes and that usable design matters for adoption. The article cites Wells Vehicle Electronics reducing inventory 7% in three months while expanding monitored SKUs from 20 to 2,000, and says TE Connectivity has deployed Connect Decisions to 2,000 planners; Connect Talent was newly generally available and still had early customers deploying it.

## Source excerpt

There isn't a business or information technology leader today who doesn't have artificial intelligence at the top of their priority list. The challenge for most organizations is deciding what to measure and how to determine whether an AI initiative was successful. To better understand how customers should approach AI metrics, I spoke with Colleen Aubrey [...] The post AWS' Colleen Aubrey: Stop inventing new AI metrics -- it's your business metrics that matter appeared first on SiliconANGLE.