# AI Infrastructure

AI infrastructure comprises the compute, data, orchestration, and control-plane layers used to run training and inference workloads, along with tooling to provision, govern, and operate them.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Trump announces plan to tax US companies that build data centers abroad

DevFeed: [Trump announces plan to tax US companies that build data centers abroad](<https://devfeed.tech/articles/trump-announces-plan-to-tax-us-companies-that-build-data-centers-abroad-146823.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/20/trump-announces-plan-to-tax-us-companies-that-build-data-centers-abroad/>)

Author: Maria Deutscher

Published: 2026-11-21T00:01:34Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [data centers](<https://devfeed.tech/topics/data-centers.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-chips](<https://devfeed.tech/tags/ai-chips.md>), [ai-data-centers](<https://devfeed.tech/tags/ai-data-centers.md>), [ai-regulation](<https://devfeed.tech/tags/ai-regulation.md>), [amazon-web-services](<https://devfeed.tech/tags/amazon-web-services.md>), [aws](<https://devfeed.tech/tags/aws.md>), [china](<https://devfeed.tech/tags/china.md>), [chip](<https://devfeed.tech/tags/chip.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [commerce-department](<https://devfeed.tech/tags/commerce-department.md>), [congressional-caucus](<https://devfeed.tech/tags/congressional-caucus.md>), [construction](<https://devfeed.tech/tags/construction.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [data-centers](<https://devfeed.tech/tags/data-centers.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [graphics-card](<https://devfeed.tech/tags/graphics-card.md>), [neocloud](<https://devfeed.tech/tags/neocloud.md>), [news](<https://devfeed.tech/tags/news.md>), [policy](<https://devfeed.tech/tags/policy.md>), [public-cloud](<https://devfeed.tech/tags/public-cloud.md>), [tax](<https://devfeed.tech/tags/tax.md>), [the-latest](<https://devfeed.tech/tags/the-latest.md>), [top-story-5](<https://devfeed.tech/tags/top-story-5.md>), [trump](<https://devfeed.tech/tags/trump.md>), [us](<https://devfeed.tech/tags/us.md>), [white-house](<https://devfeed.tech/tags/white-house.md>)

### AI overview

Trump announced a plan to impose a "tremendous tax" on U.S. companies that build data centers abroad, saying he wants them built in the United States. The excerpt says it is unclear how the tax would work or whether it would target AI-focused facilities alone. That distinction matters because overseas cloud data centers may support both AI and general-purpose computing, and some were built before large language models. The article cites planned AWS investment in Germany and Google infrastructure spending in Finland as projects that could be affected if companies revise their plans. It also places the announcement alongside new U.S. restrictions on overseas AI facilities, but reports no implementation details for the proposed tax.

### Source excerpt

President Donald Trump today announced plans to impose a "tremendous tax" on U.S. companies that build data centers overseas. "We're not allowing data centers to go into other countries because China will take all of them, and we're not allowing that to happen," Trump told reporters during a White House briefing. That hints the plan [...] The post Trump announces plan to tax US companies that build data centers abroad appeared first on SiliconANGLE.

## Inference pushes AI to smaller sites, making the data layer the deciding factor

DevFeed: [Inference pushes AI to smaller sites, making the data layer the deciding factor](<https://devfeed.tech/articles/inference-pushes-ai-to-smaller-sites-making-the-data-layer-the-deciding-factor-146669.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/20/inference-monolithic-data-center-ai-data-layer-sc26/>)

Author: Sloane Kali Faye

Published: 2026-11-20T20:09:20Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>), [data centers](<https://devfeed.tech/topics/data-centers.md>), [AI Factory](<https://devfeed.tech/topics/ai-factory.md>)

Tags: [accelerated-computing](<https://devfeed.tech/tags/accelerated-computing.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-data-centers](<https://devfeed.tech/tags/ai-data-centers.md>), [ai-data-layer](<https://devfeed.tech/tags/ai-data-layer.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [alex-bouzari](<https://devfeed.tech/tags/alex-bouzari.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [data-centers](<https://devfeed.tech/tags/data-centers.md>), [data-layer](<https://devfeed.tech/tags/data-layer.md>), [ddn](<https://devfeed.tech/tags/ddn.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [distributed-inference](<https://devfeed.tech/tags/distributed-inference.md>), [edge-data-centers](<https://devfeed.tech/tags/edge-data-centers.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [enterprise-ai-hyperpod](<https://devfeed.tech/tags/enterprise-ai-hyperpod.md>), [exascaler](<https://devfeed.tech/tags/exascaler.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [heterogeneous-computing](<https://devfeed.tech/tags/heterogeneous-computing.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [high-performance-storage](<https://devfeed.tech/tags/high-performance-storage.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [hpc-infrastructure](<https://devfeed.tech/tags/hpc-infrastructure.md>), [inference](<https://devfeed.tech/tags/inference.md>), [john-furrier](<https://devfeed.tech/tags/john-furrier.md>), [news](<https://devfeed.tech/tags/news.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [parallel-file-systems](<https://devfeed.tech/tags/parallel-file-systems.md>), [rebecca-knight](<https://devfeed.tech/tags/rebecca-knight.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [sc26eventpage](<https://devfeed.tech/tags/sc26eventpage.md>), [scientific-computing](<https://devfeed.tech/tags/scientific-computing.md>), [scientific-simulation](<https://devfeed.tech/tags/scientific-simulation.md>), [supercomputing](<https://devfeed.tech/tags/supercomputing.md>), [thecube](<https://devfeed.tech/tags/thecube.md>)

### AI overview

The excerpt argues that inference is shifting AI infrastructure toward smaller sites near users and data, increasing the importance of a flexible data layer as GPU, memory and SSD costs and shortages constrain budgets. DataDirect Networks CEO Alex Bouzari says software that spans different hardware can help maximize utilization across large AI facilities and smaller 1-5 MW sites. DDN's EXAScaler move to hardware independence reflects that approach; its Enterprise AI HyperPOD combines CPUs, GPUs, networking and storage in a rack for deployment at enterprise sites with available power. The excerpt presents on-premises pods as a way to keep tighter control of company data, and frames data infrastructure as increasingly important alongside accelerated compute. These are Bouzari's views and DDN examples, not an independent comparison of providers.

### Source excerpt

Inference is moving to the center of enterprise AI spending, and the AI data layer is emerging as the piece that decides whether those investments pay off. As GPU costs climb and component shortages persist, the architecture behind AI is shifting from a handful of massive facilities toward a distributed web of smaller sites. That [...] The post Inference pushes AI to smaller sites, making the data layer the deciding factor appeared first on SiliconANGLE.

## AI deals shrink to as little as 30 days as the data layer sets the pace

DevFeed: [AI deals shrink to as little as 30 days as the data layer sets the pace](<https://devfeed.tech/articles/ai-deals-shrink-to-as-little-as-30-days-as-the-data-layer-sets-the-pace-146668.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/20/ai-data-infrastructure-deals-shrink-year-to-30-days-sc26/>)

Author: Kelly Knight

Published: 2026-11-20T19:27:47Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [accelerated-computing](<https://devfeed.tech/tags/accelerated-computing.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-data-centers](<https://devfeed.tech/tags/ai-data-centers.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-stack](<https://devfeed.tech/tags/ai-stack.md>), [ai-supercomputers](<https://devfeed.tech/tags/ai-supercomputers.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [bottleneck](<https://devfeed.tech/tags/bottleneck.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [cube-event-coverage](<https://devfeed.tech/tags/cube-event-coverage.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [data-layer](<https://devfeed.tech/tags/data-layer.md>), [days](<https://devfeed.tech/tags/days.md>), [deals](<https://devfeed.tech/tags/deals.md>), [digital-twins](<https://devfeed.tech/tags/digital-twins.md>), [disaggregated-memory](<https://devfeed.tech/tags/disaggregated-memory.md>), [energy-efficiency](<https://devfeed.tech/tags/energy-efficiency.md>), [enterprises](<https://devfeed.tech/tags/enterprises.md>), [fast](<https://devfeed.tech/tags/fast.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [heterogeneous-computing](<https://devfeed.tech/tags/heterogeneous-computing.md>), [high-performance-storage](<https://devfeed.tech/tags/high-performance-storage.md>), [high-speed-networking](<https://devfeed.tech/tags/high-speed-networking.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [hpc-unites](<https://devfeed.tech/tags/hpc-unites.md>), [hyperscalers](<https://devfeed.tech/tags/hyperscalers.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [john-furrier](<https://devfeed.tech/tags/john-furrier.md>), [kevin-delane](<https://devfeed.tech/tags/kevin-delane.md>), [layers](<https://devfeed.tech/tags/layers.md>), [memory-pooling](<https://devfeed.tech/tags/memory-pooling.md>), [national-laboratories](<https://devfeed.tech/tags/national-laboratories.md>), [neoclouds](<https://devfeed.tech/tags/neoclouds.md>), [news](<https://devfeed.tech/tags/news.md>), [parallel-file-systems](<https://devfeed.tech/tags/parallel-file-systems.md>), [performance](<https://devfeed.tech/tags/performance.md>), [quantum-computing](<https://devfeed.tech/tags/quantum-computing.md>), [research-computing](<https://devfeed.tech/tags/research-computing.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [sc26-2026](<https://devfeed.tech/tags/sc26-2026.md>), [sc26eventpage](<https://devfeed.tech/tags/sc26eventpage.md>), [scientific-simulation](<https://devfeed.tech/tags/scientific-simulation.md>), [storage](<https://devfeed.tech/tags/storage.md>), [supercomputing](<https://devfeed.tech/tags/supercomputing.md>), [sustainable-computing](<https://devfeed.tech/tags/sustainable-computing.md>), [thecube](<https://devfeed.tech/tags/thecube.md>)

### AI overview

AI infrastructure sales can now close in as little as 30 days, down from six months to a year for traditional enterprise deals, while involving more parties: capacity renters, cloud operators and integration software providers. DDN says it is responding with close partner work, including a decade-long Nvidia partnership and a Super Micro Enterprise AI HyperPOD intended as a ready-to-run stack. Its software-defined EXAScaler deployment offers more hardware choice and, according to DDN's president, can let an enterprise set up an AI pod in three hours. DDN also reports that Google Cloud customers using its Managed Lustre service achieved 70% better training performance and 40% higher GPU efficiency. The company says it is growing threefold this year while adding few salespeople, prioritizing technical and implementation hires.

### Source excerpt

Artificial intelligence has turned data infrastructure from a back-office purchase into the bottleneck that decides how fast GPUs pay off. As hyperscalers, neoclouds and enterprises race to expand their data layers, the way that infrastructure gets bought is changing just as fast. The storage industry's longtime performance specialist sees that shift as its opening. DataDirect [...] The post AI deals shrink to as little as 30 days as the data layer sets the pace appeared first on SiliconANGLE.

## Casing The HPC And AI-Sci Market With Hyperion Research

DevFeed: [Casing The HPC And AI-Sci Market With Hyperion Research](<https://devfeed.tech/articles/casing-the-hpc-and-ai-sci-market-with-hyperion-research-146832.md>)

Original publisher: [Read original article](<https://www.nextplatform.com/hpc/2026/11/20/casing-the-hpc-and-ai-sci-market-with-hyperion-research/5311388>)

Author: Timothy Prickett Morgan

Published: 2026-11-20T15:49:32Z

Content type: article

Language: en

Sources: [The Next Platform: In-depth coverage of high end computing](<https://devfeed.tech/sources/the-next-platform-in-depth-coverage-of-high-end-computing.md>)

Topics: [High-Performance Computing](<https://devfeed.tech/topics/high-performance-computing.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [clean energy data centers](<https://devfeed.tech/topics/clean-energy-data-centers.md>)

Tags: [accelerators](<https://devfeed.tech/tags/accelerators.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amd](<https://devfeed.tech/tags/amd.md>), [applications](<https://devfeed.tech/tags/applications.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [china](<https://devfeed.tech/tags/china.md>), [chips](<https://devfeed.tech/tags/chips.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-compute](<https://devfeed.tech/tags/cloud-compute.md>), [cloud-spending](<https://devfeed.tech/tags/cloud-spending.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cpus](<https://devfeed.tech/tags/cpus.md>), [cray](<https://devfeed.tech/tags/cray.md>), [custom](<https://devfeed.tech/tags/custom.md>), [dell](<https://devfeed.tech/tags/dell.md>), [dgx](<https://devfeed.tech/tags/dgx.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [hyperion](<https://devfeed.tech/tags/hyperion.md>), [hyperion-research](<https://devfeed.tech/tags/hyperion-research.md>)

### AI overview

Hyperion Research's figures show on premises HPC and AI for Science system revenue rose 19.9% to $16.48 billion in the first half of 2026, while unit shipments grew 4.4%; the article attributes the gap to larger systems, more CPUs, and higher component prices. Dell led vendor revenue at $3.93 billion, up 67.7%, ahead of HPE at $3.44 billion, up 1.1%, though the excerpt says it is unclear whether GPU allocations explain the shift and compares revenue rather than computing performance. The article projects on premises market sales will triple by 2030 and cloud capacity spending for these workloads will approach $30 billion, nearly five times its 2022 level. Combined infrastructure spending is forecast to reach about $135 billion in 2030. The author notes that cloud rentals and on premises purchases span different time periods, complicating direct cost comparisons, and says HPC centers commonly use both.

### Source excerpt

When you go to the Super Computing conference in America or the International Super Computing confer ...

## Palo Alto Networks Expands into Enterprise AI with $4.5B Deal

DevFeed: [Palo Alto Networks Expands into Enterprise AI with $4.5B Deal](<https://devfeed.tech/articles/palo-alto-networks-expands-into-enterprise-ai-with-4-5b-deal-146662.md>)

Original publisher: [Read original article](<https://www.eetimes.com/palo-alto-networks-expands-into-enterprise-ai-with-4-5b-deal/>)

Author: Majeed Ahmad

Published: 2026-11-20T15:37:26Z

Content type: news

Language: en

Sources: [EE Times](<https://devfeed.tech/sources/ee-times.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [acquisition](<https://devfeed.tech/tags/acquisition.md>), [advanced-ai-capabilities](<https://devfeed.tech/tags/advanced-ai-capabilities.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-accelerators](<https://devfeed.tech/tags/ai-accelerators.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-systems](<https://devfeed.tech/tags/ai-systems.md>), [ai-tools](<https://devfeed.tech/tags/ai-tools.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [analog](<https://devfeed.tech/tags/analog.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [business](<https://devfeed.tech/tags/business.md>), [cloud-computing](<https://devfeed.tech/tags/cloud-computing.md>), [community](<https://devfeed.tech/tags/community.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [deal](<https://devfeed.tech/tags/deal.md>), [designline](<https://devfeed.tech/tags/designline.md>), [digital](<https://devfeed.tech/tags/digital.md>), [education](<https://devfeed.tech/tags/education.md>), [ee-times](<https://devfeed.tech/tags/ee-times.md>), [ee-times-university](<https://devfeed.tech/tags/ee-times-university.md>), [eelife](<https://devfeed.tech/tags/eelife.md>), [eelive-electronic-design](<https://devfeed.tech/tags/eelive-electronic-design.md>), [eet](<https://devfeed.tech/tags/eet.md>), [electrical-engineering](<https://devfeed.tech/tags/electrical-engineering.md>), [electronic-components](<https://devfeed.tech/tags/electronic-components.md>), [electronic-engineering-times](<https://devfeed.tech/tags/electronic-engineering-times.md>), [electronics](<https://devfeed.tech/tags/electronics.md>), [embedded-systems](<https://devfeed.tech/tags/embedded-systems.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [fundamentals-courses](<https://devfeed.tech/tags/fundamentals-courses.md>), [inference](<https://devfeed.tech/tags/inference.md>), [learning](<https://devfeed.tech/tags/learning.md>), [mergers-acquisitions](<https://devfeed.tech/tags/mergers-acquisitions.md>), [mixed-signal](<https://devfeed.tech/tags/mixed-signal.md>), [news](<https://devfeed.tech/tags/news.md>), [open-weight-ai](<https://devfeed.tech/tags/open-weight-ai.md>), [open-weight-ai-models](<https://devfeed.tech/tags/open-weight-ai-models.md>), [opinion](<https://devfeed.tech/tags/opinion.md>), [palo-alto-networks](<https://devfeed.tech/tags/palo-alto-networks.md>), [part-search](<https://devfeed.tech/tags/part-search.md>), [platform](<https://devfeed.tech/tags/platform.md>), [post-training](<https://devfeed.tech/tags/post-training.md>), [product-search](<https://devfeed.tech/tags/product-search.md>), [security](<https://devfeed.tech/tags/security.md>), [semiconductors](<https://devfeed.tech/tags/semiconductors.md>), [software](<https://devfeed.tech/tags/software.md>), [startup](<https://devfeed.tech/tags/startup.md>), [tech-papers](<https://devfeed.tech/tags/tech-papers.md>), [technology](<https://devfeed.tech/tags/technology.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

Palo Alto Networks plans to acquire Applied Compute for $4.5 billion in an all-stock deal, extending its strategy from cybersecurity into enterprise AI infrastructure. Applied Compute provides post-training and inference technology for open-weight models, enabling organizations to customize and run them. The article says this could let Palo Alto Networks embed security into model training, governance and deployment across public and sovereign clouds. It also describes risks tied to open-weight models, including tampering, data leakage and misuse; adapted weights may retain fragments of confidential training data. The company says customer-held keys support data sovereignty, but that capability does not yet extend to AI accelerators. The deal requires regulatory approval and other customary conditions, with closing expected in the third quarter of 2027.

### Source excerpt

Enterprise security outfit Palo Alto Networks snaps up a startup with a platform for post-training and inference of open-weight AI models. The post Palo Alto Networks Expands into Enterprise AI with $4.5B Deal appeared first on EE Times.

## Wafer prices may climb up to 20% next year, and some TSMC customers might have to pay in advance

DevFeed: [Wafer prices may climb up to 20% next year, and some TSMC customers might have to pay in advance](<https://devfeed.tech/articles/wafer-prices-may-climb-up-to-20-next-year-and-some-tsmc-customers-might-have-to-pay-in-advance-146276.md>)

Original publisher: [Read original article](<https://www.techspot.com/news/114622-wafer-prices-may-climb-up-20-next-year.html>)

Author: Skye Jacobs

Published: 2026-11-20T13:34:00Z

Content type: news

Language: en

Sources: [TechSpot](<https://devfeed.tech/sources/techspot.md>)

Topics: [tsmc](<https://devfeed.tech/topics/tsmc.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>)

Tags: [2027](<https://devfeed.tech/tags/2027.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-accelerator](<https://devfeed.tech/tags/ai-accelerator.md>), [asic](<https://devfeed.tech/tags/asic.md>), [asics](<https://devfeed.tech/tags/asics.md>), [balance-sheet](<https://devfeed.tech/tags/balance-sheet.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [chip](<https://devfeed.tech/tags/chip.md>), [construction](<https://devfeed.tech/tags/construction.md>), [costs](<https://devfeed.tech/tags/costs.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [data-center-construction](<https://devfeed.tech/tags/data-center-construction.md>), [demand](<https://devfeed.tech/tags/demand.md>), [design](<https://devfeed.tech/tags/design.md>), [designers](<https://devfeed.tech/tags/designers.md>), [first-quarter](<https://devfeed.tech/tags/first-quarter.md>), [foundry](<https://devfeed.tech/tags/foundry.md>), [gross-margins](<https://devfeed.tech/tags/gross-margins.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [industry](<https://devfeed.tech/tags/industry.md>), [prices](<https://devfeed.tech/tags/prices.md>), [pricing](<https://devfeed.tech/tags/pricing.md>), [trendforce](<https://devfeed.tech/tags/trendforce.md>), [tsmc](<https://devfeed.tech/tags/tsmc.md>), [wafer](<https://devfeed.tech/tags/wafer.md>)

### AI overview

Foundry wafer prices are expected to rise in 2027, adding cost and cash-flow pressure for chip designers. Taiwanese firms have received notices of increases taking effect in Q1; if they cannot pass costs on, gross margins could fall 4-5 percentage points, with higher costs reaching shipments around March or April. TrendForce forecasts increases of 5-20%, sharpest for 8-inch wafers, while 12-inch pricing varies by process node; tight AI and server capacity is also affecting Chinese foundries. Separately, industry reports say TSMC is reviewing some customers' finances and data-center progress when allocating capacity. Orders above customer-specific credit limits may require cash, and some customers are reportedly prepaying. TSMC has not announced this policy, and reports mainly concern ASIC customers. Firms unable to reprice lower-end chips may drop products or markets and shift capacity to higher-value custom parts.

### Source excerpt

Taiwanese IC design firms have started receiving notices of the increases, with the higher foundry costs expected to take effect in the first quarter of 2027. If design houses cannot pass them on, their gross margins could drop by 4 to 5 percentage points. Read Entire Article

## Google Donates Agent Substrate and gVisor to the CNCF to Secure AI Agents at Scale

DevFeed: [Google Donates Agent Substrate and gVisor to the CNCF to Secure AI Agents at Scale](<https://devfeed.tech/articles/google-donates-agent-substrate-and-gvisor-to-the-cncf-to-secure-ai-agents-at-scale-146237.md>)

Original publisher: [Read original article](<https://www.infoq.com/news/2026/11/google-substrate-gvisor-cncf/>)

Author: Craig Risi

Published: 2026-11-20T12:00:00Z

Content type: news

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Cloud Native Operations](<https://devfeed.tech/topics/cloud-native-operations.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Google](<https://devfeed.tech/topics/google.md>), [container native](<https://devfeed.tech/topics/container-native.md>), [linux foundation](<https://devfeed.tech/topics/linux-foundation.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-infrastructure](<https://devfeed.tech/tags/agent-infrastructure.md>), [agent-state](<https://devfeed.tech/tags/agent-state.md>), [agent-substrate](<https://devfeed.tech/tags/agent-substrate.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-systems](<https://devfeed.tech/tags/agentic-systems.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent-infrastructure](<https://devfeed.tech/tags/ai-agent-infrastructure.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [ai-generated-code](<https://devfeed.tech/tags/ai-generated-code.md>), [ai-ml-data-engineering](<https://devfeed.tech/tags/ai-ml-data-engineering.md>), [aiops](<https://devfeed.tech/tags/aiops.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [cloud-native-computing-foundation](<https://devfeed.tech/tags/cloud-native-computing-foundation.md>), [cncf](<https://devfeed.tech/tags/cncf.md>), [containers](<https://devfeed.tech/tags/containers.md>), [devops](<https://devfeed.tech/tags/devops.md>), [google](<https://devfeed.tech/tags/google.md>), [google-substrate-gvisor-cncf](<https://devfeed.tech/tags/google-substrate-gvisor-cncf.md>), [gvisor](<https://devfeed.tech/tags/gvisor.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [ml-data-engineering](<https://devfeed.tech/tags/ml-data-engineering.md>), [news](<https://devfeed.tech/tags/news.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-governance](<https://devfeed.tech/tags/open-source-governance.md>), [scale](<https://devfeed.tech/tags/scale.md>), [secure-ai-agents](<https://devfeed.tech/tags/secure-ai-agents.md>), [vendor-neutral-open-source](<https://devfeed.tech/tags/vendor-neutral-open-source.md>)

### AI overview

Google is donating Agent Substrate and gVisor to the CNCF, alongside its OpenRL project, to support open governance of infrastructure for AI agents. Agent Substrate separates persistent agent sessions ("actors") from reusable, pre-warmed Kubernetes workers: it can save idle agents' state, release compute, and restore sessions in under 500 milliseconds without creating a Pod for every execution, according to Google. gVisor adds isolation by intercepting system calls in a user-space application kernel; Agent Substrate also supports Cloud Hypervisor microVMs for workloads needing hardware-level virtualization. The approach targets agents' frequent pauses and resumptions, costly idle compute, Kubernetes control-plane load, and risks from executing generated code. The text presents these projects as one contribution to a wider effort that also includes technologies such as Kata Containers and Firecracker.

### Source excerpt

Google has announced it is donating Agent Substrate and gVisor to the Cloud Native Computing Foundation (CNCF), placing two important components of its AI agent infrastructure under vendor-neutral open-source governance. By Craig Risi

## Google Signs Deal With Blue Origin to Send Satellite Data Centers Into Orbit

DevFeed: [Google Signs Deal With Blue Origin to Send Satellite Data Centers Into Orbit](<https://devfeed.tech/articles/google-signs-deal-with-blue-origin-to-send-satellite-data-centers-into-orbit-145754.md>)

Original publisher: [Read original article](<https://science.slashdot.org/story/26/11/20/0010255/google-signs-deal-with-blue-origin-to-send-satellite-data-centers-into-orbit>)

Author: BeauHD

Published: 2026-11-20T07:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [data centers](<https://devfeed.tech/topics/data-centers.md>), [clean energy data centers](<https://devfeed.tech/topics/clean-energy-data-centers.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-chips](<https://devfeed.tech/tags/ai-chips.md>), [ai-data-centers](<https://devfeed.tech/tags/ai-data-centers.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [blue-origin](<https://devfeed.tech/tags/blue-origin.md>), [data-centers](<https://devfeed.tech/tags/data-centers.md>), [google](<https://devfeed.tech/tags/google.md>), [google-tensor-processing-units](<https://devfeed.tech/tags/google-tensor-processing-units.md>), [new-glenn](<https://devfeed.tech/tags/new-glenn.md>), [orbit](<https://devfeed.tech/tags/orbit.md>), [project-suncatcher](<https://devfeed.tech/tags/project-suncatcher.md>), [satellite](<https://devfeed.tech/tags/satellite.md>), [solar-power](<https://devfeed.tech/tags/solar-power.md>), [space](<https://devfeed.tech/tags/space.md>)

### AI overview

Google and Blue Origin plan to test satellite based AI data centers through Google's experimental Project Suncatcher. New Glenn rockets are expected to carry servers and Google tensor processing units into sun-synchronous orbit; each satellite is described as having roughly the capacity of a data center rack. The first launch is not scheduled until early 2029, and the excerpt presents the project as a long-term experiment to explore using orbital solar power for AI infrastructure. Whether it will work remains uncertain.

### Source excerpt

Google has partnered with Jeff Bezos' Blue Origin to launch satellite-based AI data centers into orbit as part of its experimental Project Suncatcher initiative. "Engadget reports: Each of these satellites will be equipped with "roughly the capacity of a data center rack" and will enter into a sun-synchronous orbit via heavy-lift New Glenn rockets. The rocket will carry several Google tensor processing units, the company's proprietary AI chips, along with data center servers. The first launch isn't scheduled until early 2029, so we have a couple of years to see if this whole project even works. This is an experiment that Google calls a "long-term moonshot" to see if it's possible to put AI infrastructure in space by "tapping into the abundant solar power in orbit." The benefits of this would be massive. Data centers here on Earth are notorious hogs, with their snouts all over electricity grids, land and cooling systems. The hope is that the harsh vacuum of the cosmos will be a better fit for the technology. Read more of this story at Slashdot.

## ScaleWire: An End-to-End Scale-Up Ethernet Simulation Framework for LLM Systems

DevFeed: [ScaleWire: An End-to-End Scale-Up Ethernet Simulation Framework for LLM Systems](<https://devfeed.tech/articles/scalewire-an-end-to-end-scale-up-ethernet-simulation-framework-for-llm-systems-146150.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26086>)

Author: Kai Ma, Quanfeng Lv, Bowei Dai, Jingguo Ge, Kefan Ruan, Ruoqi Li

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Networking](<https://devfeed.tech/sources/arxiv-networking.md>)

Topics: [Ethernet](<https://devfeed.tech/topics/ethernet.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>)

Tags: [accelerators](<https://devfeed.tech/tags/accelerators.md>), [balance](<https://devfeed.tech/tags/balance.md>), [bandwidth](<https://devfeed.tech/tags/bandwidth.md>), [budget](<https://devfeed.tech/tags/budget.md>), [communication](<https://devfeed.tech/tags/communication.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [completion](<https://devfeed.tech/tags/completion.md>), [constraint](<https://devfeed.tech/tags/constraint.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cross](<https://devfeed.tech/tags/cross.md>), [cs-ni](<https://devfeed.tech/tags/cs-ni.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [deepseek-r1](<https://devfeed.tech/tags/deepseek-r1.md>), [design](<https://devfeed.tech/tags/design.md>), [difference](<https://devfeed.tech/tags/difference.md>), [ethernet](<https://devfeed.tech/tags/ethernet.md>), [framework](<https://devfeed.tech/tags/framework.md>), [llm](<https://devfeed.tech/tags/llm.md>), [scale-up](<https://devfeed.tech/tags/scale-up.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [systems](<https://devfeed.tech/tags/systems.md>)

### AI overview

ScaleWire combines packet-level simulation of Ethernet network-interface mechanisms across transport, network, and link layers with analytical estimates to explore on-chip resource sizing for LLM systems. The authors report validation against hardware measurements and nine analytical checks, and evaluate six NI designs across four communication workloads. For DeepSeek-R1 dispatch, design choices produce a 4.5x difference in per-XPU storage budget; the exploration engine uses 6-19% as many simulations as exhaustive search in grid comparisons. With vLLM prefill traces and GH200-measured kernel times, it also guides resource provisioning under an inference completion-time constraint. The abstract positions the framework as a way to balance communication performance against resource cost.

### Source excerpt

arXiv:2611.26086v1 Announce Type: new Abstract: LLM training and inference rely on scale-up networks for high-bandwidth, low-latency memory-semantic communication among accelerators (XPUs). Ethernet is emerging as an open interconnect for scale-up systems. In Ethernet systems, network-interface (NI) mechanisms across transport, network, and link layers interact, jointly shaping communication performance and on-chip resource requirements. We present ScaleWire, an end-to-end scale-up Ethernet simulation framework for LLM systems. It couples packet-level simulation of cross-layer NI mechanisms with a resource exploration engine that combines analytical estimates and simulation to size on-chip resources. We validate ScaleWire against hardware measurements and nine analytical checks, and evaluate six NI designs across four LLM communication workloads. For DeepSeek-R1 dispatch, NI design choices lead to a 4.5$\times$ difference in per-XPU on-chip storage budget. In grid-comparison experiments, the exploration engine uses 6-19% of the simulations required by exhaustive search. Using vLLM prefill traces with kernel times measured on GH200 GPUs, ScaleWire further guides resource provisioning under a completion-time constraint for inference execution. ScaleWire thus helps designers select NI mechanisms and provision on-chip resources to balance communication performance and resource cost.

## TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks

DevFeed: [TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks](<https://devfeed.tech/articles/triaxialkv-toward-extreme-low-precision-kv-cache-quantization-for-agentic-inference-tasks-144895.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2605.17170>)

Author: Hanzhang Shen, Haoran Wu, Yiren Zhao, Robert Mullins

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [quantization](<https://devfeed.tech/topics/quantization.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Cache](<https://devfeed.tech/topics/cache.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [bf16](<https://devfeed.tech/tags/bf16.md>), [budget](<https://devfeed.tech/tags/budget.md>), [cache](<https://devfeed.tech/tags/cache.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [chat](<https://devfeed.tech/tags/chat.md>), [compression](<https://devfeed.tech/tags/compression.md>), [computer](<https://devfeed.tech/tags/computer.md>), [computer-use](<https://devfeed.tech/tags/computer-use.md>), [context](<https://devfeed.tech/tags/context.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [custom](<https://devfeed.tech/tags/custom.md>), [decode](<https://devfeed.tech/tags/decode.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [image](<https://devfeed.tech/tags/image.md>), [implement](<https://devfeed.tech/tags/implement.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [precision](<https://devfeed.tech/tags/precision.md>), [quantization](<https://devfeed.tech/tags/quantization.md>)

### AI overview

TriAxialKV reduces KV-cache memory for agentic inference by tagging tokens across recency, modality, and semantic role, calibrating sensitivity for each tag, and assigning INT2 or INT4 precision within a fixed memory budget. Its serving system combines calibration, quantization and memory management, and fused Triton decode kernels. In the reported OSWorld computer-use evaluation with Qwen3-VL-32B-Thinking, it matched SGLang's accuracy using a BF16 cache while supporting 4.5x KV-cache capacity and 30% higher end-to-end throughput on real GPUs.

### Source excerpt

arXiv:2605.17170v2 Announce Type: replace Abstract: Agentic workloads have emerged as a major workload for LLM inference. They differ significantly from chat-only workloads, requiring long-context processing, the ability to handle multimodal inputs, and structured multi-turn interactions with tool calling capabilities. As a result, their context exhibits structure that can carry different importance along three key axes: temporal recency to the current turn, modality such as text or image tokens, and semantic role such as user queries, tool calls, observations, or reasoning. These axes capture distinct token behaviors and lead to different sensitivities to KV-cache compression. However, existing KV-cache quantization methods are typically homogeneous or exploit only heterogeneity on a single dimension, such as temporal proximity or modality, overlooking the interactions among them. To this end, we introduce TriAxialKV, a novel mixed-precision KV-cache quantization scheme that assigns each token a triaxial tag, calibrates per-tag sensitivity, and allocates INT2/INT4 bit-widths under a fixed memory budget. We implement TriAxialKV as an end-to-end serving system, comprising calibration, mixed-precision quantization and memory management, and custom fused Triton decode kernels. When using Qwen3-VL-32B-Thinking as a computer-use agent operating the OSWorld, TriAxialKV matches the accuracy of SGLang with BF16 KV cache while supporting 4.5$\times$ KV cache capacity and achieving 30% higher end-to-end throughput, when running on real GPU systems.

## GPU-Accelerated Secure Inference for Drug--Target Interaction Prediction

DevFeed: [GPU-Accelerated Secure Inference for Drug--Target Interaction Prediction](<https://devfeed.tech/articles/gpu-accelerated-secure-inference-for-drug-target-interaction-prediction-145088.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25664>)

Author: Sikha Pentyala, Steven Golob, Daniil Filienko, Ming-Chun Kao, Martine De Cock

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Cryptography](<https://devfeed.tech/topics/cryptography.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [model architecture](<https://devfeed.tech/topics/model-architecture.md>), [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [accelerated](<https://devfeed.tech/tags/accelerated.md>), [arithmetic](<https://devfeed.tech/tags/arithmetic.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [co-design](<https://devfeed.tech/tags/co-design.md>), [communication](<https://devfeed.tech/tags/communication.md>), [comparisons](<https://devfeed.tech/tags/comparisons.md>), [competition](<https://devfeed.tech/tags/competition.md>), [compute](<https://devfeed.tech/tags/compute.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [custom](<https://devfeed.tech/tags/custom.md>), [deep](<https://devfeed.tech/tags/deep.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [deep-learning-models](<https://devfeed.tech/tags/deep-learning-models.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-accelerated](<https://devfeed.tech/tags/gpu-accelerated.md>), [inference](<https://devfeed.tech/tags/inference.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [target](<https://devfeed.tech/tags/target.md>)

### AI overview

The paper's first-place iDASH 2026 Track III solution combines an MPC-friendly DTI model with GPU protocols for two-party secure inference. SlimDTA reduces operations on the secret drug, especially nonlinear operations that require communication between servers. The GPU framework evaluates linear layers using additive secret sharing and nonlinear layers using function secret sharing, with a custom CUDA comparison kernel. The authors report under 10 ms per prediction on average, with secure predictions matching the plaintext model to within 0.02%.

### Source excerpt

arXiv:2611.25664v1 Announce Type: cross Abstract: Deep learning models that predict drug--target interactions (DTI) can speed up drug discovery, but the candidate drugs they score are valuable intellectual property that their owners cannot reveal. Secure multiparty computation (MPC) lets two servers compute a prediction on a secret-shared drug, without either server learning the drug. However, secure inference of deep models is slow. Non-linear operations require communication between the servers, and MPC arithmetic does not map naturally to GPUs. In this paper, we present our solution to Track~III of the iDASH 2026 privacy and security competition, which asked for fast two-party secure DTI inference on GPUs. Our solution is built on the co-design of MPC-friendly models and MPC protocols. On the model side, we design SlimDTA, a DTI model that reduces the operations on the secret drug, and in particular the non-linear operations that require communication. On the protocol side, we build a GPU framework that evaluates the linear layers with additive secret sharing and the non-linear layers with function secret sharing, including a custom CUDA kernel for the comparisons. Our solution won first place in the competition, at under 10,ms per prediction on average, and its secure predictions match the plaintext model to within 0.02%.

## NVIDIA Vera Rubin NVL72 on CoreWeave: 10x More Tokens Per Megawatt Than Blackwell

DevFeed: [NVIDIA Vera Rubin NVL72 on CoreWeave: 10x More Tokens Per Megawatt Than Blackwell](<https://devfeed.tech/articles/nvidia-vera-rubin-nvl72-on-coreweave-10x-more-tokens-per-megawatt-than-blackwell-144651.md>)

Original publisher: [Read original article](<https://wf.coreweave.com/blog/nvidia-vera-rubin-nvl72-on-coreweave-10x-more-tokens-per-megawatt-than-blackwell>)

Author: CoreWeave

Published: 2026-11-19T22:40:29Z

Content type: news

Language: en

Sources: [Coreweave Blog Posts](<https://devfeed.tech/sources/coreweave-blog-posts.md>)

Topics: [Vera Rubin NVL72](<https://devfeed.tech/topics/vera-rubin-nvl72.md>), [NVIDIA Vera Rubin](<https://devfeed.tech/topics/nvidia-vera-rubin.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [TensorRT-LLM](<https://devfeed.tech/topics/tensorrt-llm.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>), [NVIDIA Blackwell](<https://devfeed.tech/topics/nvidia-blackwell.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [GB200](<https://devfeed.tech/topics/gb200.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agentic-security](<https://devfeed.tech/tags/agentic-security.md>), [agentic-workloads](<https://devfeed.tech/tags/agentic-workloads.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [blackwell](<https://devfeed.tech/tags/blackwell.md>), [blog](<https://devfeed.tech/tags/blog.md>), [coreweave](<https://devfeed.tech/tags/coreweave.md>), [first](<https://devfeed.tech/tags/first.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [megawatt](<https://devfeed.tech/tags/megawatt.md>), [milestone](<https://devfeed.tech/tags/milestone.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-vera-rubin](<https://devfeed.tech/tags/nvidia-vera-rubin.md>), [nvl72](<https://devfeed.tech/tags/nvl72.md>), [performance](<https://devfeed.tech/tags/performance.md>), [silicon](<https://devfeed.tech/tags/silicon.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [vera-rubin-nvl72](<https://devfeed.tech/tags/vera-rubin-nvl72.md>)

### AI overview

In CoreWeave's DeepSeek R1 evaluation, Vera Rubin NVL72 delivered 10x the tokens per second per megawatt of NVIDIA GB200 NVL72 at a matched interactivity target (TPS/user). Both systems used inference optimizations including expert parallelism, NVFP4, multi-token prediction, and disaggregated prefill and decode with TensorRT-LLM and Dynamo. CoreWeave attributes the result's relevance to reasoning workloads' high token demand and describes Vera Rubin's 72 Rubin GPUs, 36 Vera CPUs, 260 TB/s NVLink 6 fabric, and native NVFP4 support. The measurement is an initial result; CoreWeave expects further gains from tuning and says it will publish updated numbers. Customer benefits in the excerpt are expectations, not reported measured outcomes.

### Source excerpt

CoreWeave publishes first-ever measured silicon performance of NVIDIA Vera Rubin NVL72, marking a new milestone in AI infrastructure.

## How the BMW Group governs hundreds of agents across thousands of developers

DevFeed: [How the BMW Group governs hundreds of agents across thousands of developers](<https://devfeed.tech/articles/how-the-bmw-group-governs-hundreds-of-agents-across-thousands-of-developers-144472.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/how-the-bmw-group-governs-hundreds-of-agents-across-thousands-of-developers/>)

Author: Dr. Jens Kohl

Published: 2026-11-19T22:20:23Z

Content type: article

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [LLM observability](<https://devfeed.tech/topics/llm-observability.md>), [Cloud Architecture](<https://devfeed.tech/topics/cloud-architecture.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [agent to agent communication](<https://devfeed.tech/topics/agent-to-agent-communication.md>), [OpenTelemetry](<https://devfeed.tech/topics/opentelemetry.md>), [internal developer platform automation](<https://devfeed.tech/topics/internal-developer-platform-automation.md>)

Tags: [2023](<https://devfeed.tech/tags/2023.md>), [a2a](<https://devfeed.tech/tags/a2a.md>), [a2a-protocol](<https://devfeed.tech/tags/a2a-protocol.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-harness](<https://devfeed.tech/tags/agent-harness.md>), [agent-infrastructure](<https://devfeed.tech/tags/agent-infrastructure.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [automotive](<https://devfeed.tech/tags/automotive.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [bmw](<https://devfeed.tech/tags/bmw.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [developers](<https://devfeed.tech/tags/developers.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-scale](<https://devfeed.tech/tags/enterprise-scale.md>), [governance](<https://devfeed.tech/tags/governance.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [patterns](<https://devfeed.tech/tags/patterns.md>), [practices](<https://devfeed.tech/tags/practices.md>), [quality](<https://devfeed.tech/tags/quality.md>), [scale](<https://devfeed.tech/tags/scale.md>), [teams](<https://devfeed.tech/tags/teams.md>)

### AI overview

BMW Group's approach to governing agents across its R&D organization centers on reusable architecture and lifecycle controls that let teams experiment while enforcing safety, security, quality, and compliance. Governance rules live outside individual agents--in integration layers, a central registry, and deterministic CI/CD and policy checks--so they can survive framework or model changes. Teams set autonomy per workflow step, from explicit human approval to bounded autonomy, and increase it based on evaluation evidence. Agents are built from composable MCP tools, skills, and flows, with specialized agents and least-privilege access used to contain complexity. CI pipelines run tests, security and governance checks, and ground-truth evaluations before deployment; runtime monitoring flags data or model drift for human review. IaC templates, shared registries, and centrally curated checks support distributed team contributions without mandating a single framework. The article describes these practices and reported benefits but provides no quantitative outcome measures.

### Source excerpt

When hundreds of agents serve thousands of developers, governance cannot be an afterthought. The BMW Group shares the practices and patterns its R&D teams use to build, govern, and operate AI agents at enterprise scale without sacrificing speed, quality, or compliance.

## Amazon SageMaker AI now detects latency drift, idle GPUs, and missed optimizations on your inference endpoints

DevFeed: [Amazon SageMaker AI now detects latency drift, idle GPUs, and missed optimizations on your inference endpoints](<https://devfeed.tech/articles/amazon-sagemaker-ai-now-detects-latency-drift-idle-gpus-and-missed-optimizations-on-your-inference-endpoints-144471.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/amazon-sagemaker-ai-now-detects-latency-drift-idle-gpus-and-missed-optimizations-on-your-inference-endpoints/>)

Author: Hazim Qudah

Published: 2026-11-19T21:28:18Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [gpu monitoring](<https://devfeed.tech/topics/gpu-monitoring.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [vllm](<https://devfeed.tech/topics/vllm.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [amazon-sagemaker-studio](<https://devfeed.tech/tags/amazon-sagemaker-studio.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [aws-user-notifications](<https://devfeed.tech/tags/aws-user-notifications.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [drift](<https://devfeed.tech/tags/drift.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [gpu-utilization](<https://devfeed.tech/tags/gpu-utilization.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [inference-endpoints](<https://devfeed.tech/tags/inference-endpoints.md>), [latency](<https://devfeed.tech/tags/latency.md>), [optimizations](<https://devfeed.tech/tags/optimizations.md>), [performance](<https://devfeed.tech/tags/performance.md>), [serving](<https://devfeed.tech/tags/serving.md>), [studio](<https://devfeed.tech/tags/studio.md>)

### AI overview

Amazon SageMaker AI monitors eligible generative AI inference endpoints by default when they use vLLM serving containers and GPU instances. Using aggregated latency, GPU utilization, and serving configuration signals, it can flag week-over-week latency drift, mostly idle GPUs, or supported optimizations and updates that are missing. Monitoring does not read request or response content and has no GPU cost. Findings arrive through AWS Health and email; users can open them in SageMaker Studio and benchmark alternatives on separate compute, comparing response time, throughput, and cost per million tokens. No endpoint change occurs until the user chooses to apply a result, and keeping the current configuration is also an option. Benchmarks incur standard SageMaker charges or use an ML reservation. Monitoring can be disabled by setting OPT_OUT_TRACKING on a model container; doing so prevents telemetry collection and notifications for that endpoint.

### Source excerpt

Amazon SageMaker AI now monitors your generative AI inference endpoints by default and tells you when a change could improve performance or lower cost. It tracks latency, GPU utilization, and serving configuration, then sends a finding through AWS Health with a one-click path to benchmark alternatives in SageMaker Studio before you apply any change.

## Enterprise AI is pushing cloud infrastructure beyond the GPU

DevFeed: [Enterprise AI is pushing cloud infrastructure beyond the GPU](<https://devfeed.tech/articles/enterprise-ai-is-pushing-cloud-infrastructure-beyond-the-gpu-144376.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/19/enterprise-ai-pushing-cloud-infrastructure-beyond-gpu-kubeconna/>)

Author: Paul Nashawaty

Published: 2026-11-19T21:07:03Z

Content type: article

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Cloud Architecture](<https://devfeed.tech/topics/cloud-architecture.md>), [digital sovereignty](<https://devfeed.tech/topics/digital-sovereignty.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agentic-ai-systems](<https://devfeed.tech/tags/agentic-ai-systems.md>), [agentic-workflow](<https://devfeed.tech/tags/agentic-workflow.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-adoption](<https://devfeed.tech/tags/ai-adoption.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [ai-cloud](<https://devfeed.tech/tags/ai-cloud.md>), [ai-economics](<https://devfeed.tech/tags/ai-economics.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [appdevangle](<https://devfeed.tech/tags/appdevangle.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-infrastructure](<https://devfeed.tech/tags/cloud-infrastructure.md>), [cloud-native-applications](<https://devfeed.tech/tags/cloud-native-applications.md>), [cloud-native-computing-foundation](<https://devfeed.tech/tags/cloud-native-computing-foundation.md>), [cncf](<https://devfeed.tech/tags/cncf.md>), [cpus](<https://devfeed.tech/tags/cpus.md>), [cube-event-coverage](<https://devfeed.tech/tags/cube-event-coverage.md>), [data-sovereignty](<https://devfeed.tech/tags/data-sovereignty.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [enterprise-ai-infrastructure](<https://devfeed.tech/tags/enterprise-ai-infrastructure.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [kevin-cochrane](<https://devfeed.tech/tags/kevin-cochrane.md>), [kubecon-plus-cloudnativecon-north-america-2026](<https://devfeed.tech/tags/kubecon-plus-cloudnativecon-north-america-2026.md>), [kubeconna](<https://devfeed.tech/tags/kubeconna.md>), [neoclouds](<https://devfeed.tech/tags/neoclouds.md>), [news](<https://devfeed.tech/tags/news.md>), [paul-nashawaty](<https://devfeed.tech/tags/paul-nashawaty.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [production](<https://devfeed.tech/tags/production.md>), [thecube](<https://devfeed.tech/tags/thecube.md>), [vultr](<https://devfeed.tech/tags/vultr.md>)

### AI overview

Enterprise AI infrastructure increasingly needs a full cloud platform, since production agents use more than GPUs: they also need CPU capacity, data and application access, networking, storage, and secure execution environments. Vultr's Kevin Cochrane describes the company's approach as combining traditional cloud and specialized AI compute with cloud-native services; its regions are said to operate independently, keeping data and application operations within each region. The article also notes that some workloads may use post-trained open-source models on owned infrastructure: Cochrane cites one platform engineering organization's reported 80% inference cost reduction, while acknowledging outcomes depend on workload and operations. Platform engineers are expected to help provide governed, preconfigured stacks as enterprises move from AI pilots to production.

### Source excerpt

Enterprise adoption of artificial intelligence is creating new requirements for enterprise AI infrastructure. While much of the early AI investment centered on access to powerful GPUs, organizations moving AI applications and agents into production are discovering that accelerators are only one part of the equation. Agentic AI systems need environments where they can execute code, [...] The post Enterprise AI is pushing cloud infrastructure beyond the GPU appeared first on SiliconANGLE.

## AI inference servers shrink to fit the air-cooled racks enterprises already run

DevFeed: [AI inference servers shrink to fit the air-cooled racks enterprises already run](<https://devfeed.tech/articles/ai-inference-servers-shrink-to-fit-the-air-cooled-racks-enterprises-already-run-144256.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/19/power-efficient-inference-chips-let-enterprises-own-ai-hardware-sc26/>)

Author: Ryan Stevens

Published: 2026-11-19T19:29:20Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [on-prem](<https://devfeed.tech/topics/on-prem.md>)

Tags: [accelerated-computing](<https://devfeed.tech/tags/accelerated-computing.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai-data-centers](<https://devfeed.tech/tags/ai-data-centers.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-supercomputers](<https://devfeed.tech/tags/ai-supercomputers.md>), [air-cooled-data-centers](<https://devfeed.tech/tags/air-cooled-data-centers.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [axelera-ai](<https://devfeed.tech/tags/axelera-ai.md>), [compute](<https://devfeed.tech/tags/compute.md>), [compute-express-link](<https://devfeed.tech/tags/compute-express-link.md>), [cube-event-coverage](<https://devfeed.tech/tags/cube-event-coverage.md>), [cxl](<https://devfeed.tech/tags/cxl.md>), [data-center-infrastructure](<https://devfeed.tech/tags/data-center-infrastructure.md>), [digital-in-memory-computing](<https://devfeed.tech/tags/digital-in-memory-computing.md>), [digital-twins](<https://devfeed.tech/tags/digital-twins.md>), [disaggregated-memory](<https://devfeed.tech/tags/disaggregated-memory.md>), [edge-ai](<https://devfeed.tech/tags/edge-ai.md>), [energy-efficiency](<https://devfeed.tech/tags/energy-efficiency.md>), [enterprises](<https://devfeed.tech/tags/enterprises.md>), [europa](<https://devfeed.tech/tags/europa.md>), [exascale-computing](<https://devfeed.tech/tags/exascale-computing.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [heterogeneous-computing](<https://devfeed.tech/tags/heterogeneous-computing.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [high-performance-storage](<https://devfeed.tech/tags/high-performance-storage.md>), [high-speed-networking](<https://devfeed.tech/tags/high-speed-networking.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [hpc-infrastructure](<https://devfeed.tech/tags/hpc-infrastructure.md>), [hpc-unites](<https://devfeed.tech/tags/hpc-unites.md>), [inference-chips](<https://devfeed.tech/tags/inference-chips.md>), [infra](<https://devfeed.tech/tags/infra.md>), [john-furrier](<https://devfeed.tech/tags/john-furrier.md>), [manuel-botija](<https://devfeed.tech/tags/manuel-botija.md>), [memory-pooling](<https://devfeed.tech/tags/memory-pooling.md>), [national-laboratories](<https://devfeed.tech/tags/national-laboratories.md>), [news](<https://devfeed.tech/tags/news.md>), [nyse-wired](<https://devfeed.tech/tags/nyse-wired.md>), [parallel-file-systems](<https://devfeed.tech/tags/parallel-file-systems.md>), [quantum-computing](<https://devfeed.tech/tags/quantum-computing.md>), [quantum-hpc-integration](<https://devfeed.tech/tags/quantum-hpc-integration.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [sc26eventpage](<https://devfeed.tech/tags/sc26eventpage.md>), [scinet](<https://devfeed.tech/tags/scinet.md>), [servers](<https://devfeed.tech/tags/servers.md>), [thecube](<https://devfeed.tech/tags/thecube.md>)

### AI overview

Axelera AI says its Titania third-generation architecture scales its inference design to a 400-watt chip, enabling a six-kilowatt server intended to perform like leading data-center GPUs while fitting existing 20-30-kilowatt air-cooled enterprise racks. The company contrasts this with GPU racks that Botija says cost at least $1 million and usually require liquid cooling. Axelera attributes its chips' performance-per-watt advantage to digital in-memory computing, and argues that fitting into ordinary data centers could let enterprises own and amortize AI infrastructure instead of renting compute. These are company claims in an excerpt; it provides no independent benchmark results.

### Source excerpt

Power-efficient inference chips are becoming the entry price for enterprises that want to run AI on hardware they own. As AI shifts from building models to running them every day, costly graphics processing unit racks and the liquid cooling they demand keep many companies renting compute instead. That gap is opening room for challengers to [...] The post AI inference servers shrink to fit the air-cooled racks enterprises already run appeared first on SiliconANGLE.

## D-Matrix bets stacked DRAM can solve inference's memory bandwidth problem

DevFeed: [D-Matrix bets stacked DRAM can solve inference's memory bandwidth problem](<https://devfeed.tech/articles/d-matrix-bets-stacked-dram-can-solve-inference-s-memory-bandwidth-problem-144257.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/19/raptor-chip-stacks-3d-dram-tackle-inference-memory-limits-sc26/>)

Author: Kelly Knight

Published: 2026-11-19T19:21:48Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [d-matrix](<https://devfeed.tech/topics/d-matrix.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [NVLink](<https://devfeed.tech/topics/nvlink.md>), [AI Factory](<https://devfeed.tech/topics/ai-factory.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [3d-dram](<https://devfeed.tech/tags/3d-dram.md>), [accelerated-computing](<https://devfeed.tech/tags/accelerated-computing.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-data-centers](<https://devfeed.tech/tags/ai-data-centers.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [bandwidth](<https://devfeed.tech/tags/bandwidth.md>), [can](<https://devfeed.tech/tags/can.md>), [chip](<https://devfeed.tech/tags/chip.md>), [compute](<https://devfeed.tech/tags/compute.md>), [corsair](<https://devfeed.tech/tags/corsair.md>), [cube-event-coverage](<https://devfeed.tech/tags/cube-event-coverage.md>), [d-matrix](<https://devfeed.tech/tags/d-matrix.md>), [designs](<https://devfeed.tech/tags/designs.md>), [dram](<https://devfeed.tech/tags/dram.md>), [emerging-tech](<https://devfeed.tech/tags/emerging-tech.md>), [first](<https://devfeed.tech/tags/first.md>), [game](<https://devfeed.tech/tags/game.md>), [generation](<https://devfeed.tech/tags/generation.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [high-bandwidth-memory](<https://devfeed.tech/tags/high-bandwidth-memory.md>), [high-performance-computing](<https://devfeed.tech/tags/high-performance-computing.md>), [high-speed-networking](<https://devfeed.tech/tags/high-speed-networking.md>), [hpc](<https://devfeed.tech/tags/hpc.md>), [hpc-infrastructure](<https://devfeed.tech/tags/hpc-infrastructure.md>), [inference](<https://devfeed.tech/tags/inference.md>), [john-furrier](<https://devfeed.tech/tags/john-furrier.md>), [memory](<https://devfeed.tech/tags/memory.md>), [memory-bandwidth](<https://devfeed.tech/tags/memory-bandwidth.md>), [nasdaq-nvda](<https://devfeed.tech/tags/nasdaq-nvda.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvlink-fusion](<https://devfeed.tech/tags/nvlink-fusion.md>), [raptor](<https://devfeed.tech/tags/raptor.md>), [satyam-srivastava](<https://devfeed.tech/tags/satyam-srivastava.md>), [sc26](<https://devfeed.tech/tags/sc26.md>), [sc26eventpage](<https://devfeed.tech/tags/sc26eventpage.md>), [scientific-simulation](<https://devfeed.tech/tags/scientific-simulation.md>), [solve](<https://devfeed.tech/tags/solve.md>), [supercomputing](<https://devfeed.tech/tags/supercomputing.md>), [sustainable-computing](<https://devfeed.tech/tags/sustainable-computing.md>), [thecube](<https://devfeed.tech/tags/thecube.md>)

### AI overview

D-Matrix says Raptor, its planned second-generation chip, will stack 3D DRAM beneath compute logic to address inference's memory-bandwidth demands. The Pavehawk test chip is validating the approach: memory sits on a separate layer, close to logic, without crossing an interposer. The company places this memory tier between SRAM and HBM in capacity and claims 10 times HBM's bandwidth and energy efficiency. Srivastava also says pairing Corsair-based servers with Hopper GPUs can raise utilization from about 20% to as much as 80%. D-Matrix's adoption of Nvidia NVLink Fusion is intended to connect its accelerators to Nvidia AI factories, supporting systems that coordinate GPUs, CPUs and accelerators according to workload. These performance figures and utilization gains are company-reported claims.

### Source excerpt

As artificial intelligence workloads shift to inference, memory bandwidth decides whether hardware generates tokens quickly or sits idle. D-Matrix Corp. is answering with Raptor, a second-generation chip stacking 3D DRAM beneath its compute logic. AI infrastructure has become a systems game, and winners combine memory, interconnect and software into cohesive designs, according to Satyam Srivastava [...] The post D-Matrix bets stacked DRAM can solve inference's memory bandwidth problem appeared first on SiliconANGLE.

## Palo Alto Networks Signs $4.5 Billion Deal For Applied Compute

DevFeed: [Palo Alto Networks Signs $4.5 Billion Deal For Applied Compute](<https://devfeed.tech/articles/palo-alto-networks-signs-4-5-billion-deal-for-applied-compute-144295.md>)

Original publisher: [Read original article](<https://it.slashdot.org/story/26/11/19/1812240/palo-alto-networks-signs-45-billion-deal-for-applied-compute>)

Author: BeauHD

Published: 2026-11-19T19:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [ai security](<https://devfeed.tech/topics/ai-security.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>)

Tags: [2027](<https://devfeed.tech/tags/2027.md>), [acquisition](<https://devfeed.tech/tags/acquisition.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-startup](<https://devfeed.tech/tags/ai-startup.md>), [ai-systems](<https://devfeed.tech/tags/ai-systems.md>), [ai-tools](<https://devfeed.tech/tags/ai-tools.md>), [applied-compute](<https://devfeed.tech/tags/applied-compute.md>), [business](<https://devfeed.tech/tags/business.md>), [chronosphere](<https://devfeed.tech/tags/chronosphere.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-management](<https://devfeed.tech/tags/cloud-management.md>), [customers](<https://devfeed.tech/tags/customers.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [deal](<https://devfeed.tech/tags/deal.md>), [deals](<https://devfeed.tech/tags/deals.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [exploit](<https://devfeed.tech/tags/exploit.md>), [fiscal-2027](<https://devfeed.tech/tags/fiscal-2027.md>), [palo-alto-networks](<https://devfeed.tech/tags/palo-alto-networks.md>)

### AI overview

Palo Alto Networks has agreed to acquire AI startup Applied Compute for $4.5 billion, aiming to help enterprises securely train and deploy open-weight AI models. The deal is expected to close in the third quarter of fiscal 2027. The acquisition extends the company's effort to build an integrated cybersecurity platform as AI adoption creates new security risks; an analyst quoted in the excerpt says AI tools are surfacing vulnerabilities faster than companies can patch them, contributing to customer interest in consolidating platforms.

### Source excerpt

Palo Alto Networks has agreed to acquire AI startup Applied Compute for $4.5 billion as it expands beyond traditional cybersecurity into securing enterprise AI systems, including the training and deployment of open-weight models. The deal is expected to close in the third quarter of fiscal 2027. Reuters reports: Palo Alto Networks has been repositioning itself as an integrated cybersecurity provider, with recent deals, including its $3.35 billion acquisition of cloud management and monitoring firm Chronosphere and an agreement with Israeli startup Koi. The company is looking to tap growing cybersecurity spending as the rapid adoption of AI creates new security risks and gives attackers new ways to exploit vulnerabilities. "AI tools are surfacing vulnerabilities faster than companies can patch them, and that is pushing customers to consolidate onto fewer platforms," said Catharine Trebnick, senior research analyst at Rosenblatt Securities. With the acquisition of Applied Compute, Palo Alto aims to offer a technology platform that helps customers securely train and deploy open-weight models as they expand their use of AI. Read more of this story at Slashdot.

## The AI 'forever bottleneck': Data center power

DevFeed: [The AI 'forever bottleneck': Data center power](<https://devfeed.tech/articles/the-ai-forever-bottleneck-data-center-power-144326.md>)

Original publisher: [Read original article](<https://sdtimes.com/datacenters/the-ai-forever-bottleneck-data-center-power/>)

Author: David Rubinstein

Published: 2026-11-19T17:29:03Z

Content type: article

Language: en

Sources: [SD Times](<https://devfeed.tech/sources/sd-times.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [clean energy data centers](<https://devfeed.tech/topics/clean-energy-data-centers.md>), [communications](<https://devfeed.tech/topics/communications.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [availability](<https://devfeed.tech/tags/availability.md>), [bandwidth](<https://devfeed.tech/tags/bandwidth.md>), [bottleneck](<https://devfeed.tech/tags/bottleneck.md>), [community](<https://devfeed.tech/tags/community.md>), [computing-capacity](<https://devfeed.tech/tags/computing-capacity.md>), [connectivity](<https://devfeed.tech/tags/connectivity.md>), [construction](<https://devfeed.tech/tags/construction.md>), [cooling](<https://devfeed.tech/tags/cooling.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [data-center-power](<https://devfeed.tech/tags/data-center-power.md>), [datacenter-siting](<https://devfeed.tech/tags/datacenter-siting.md>), [deeper-look](<https://devfeed.tech/tags/deeper-look.md>), [electricity](<https://devfeed.tech/tags/electricity.md>), [energy](<https://devfeed.tech/tags/energy.md>), [energy-storage](<https://devfeed.tech/tags/energy-storage.md>), [fiber](<https://devfeed.tech/tags/fiber.md>), [geography](<https://devfeed.tech/tags/geography.md>), [hollow-core-fiber](<https://devfeed.tech/tags/hollow-core-fiber.md>), [nuclear-energy](<https://devfeed.tech/tags/nuclear-energy.md>), [power](<https://devfeed.tech/tags/power.md>), [solar-power](<https://devfeed.tech/tags/solar-power.md>)

### AI overview

The interviewee argues that electricity availability and the years needed for grid and substation upgrades are becoming the "forever bottleneck" for AI data centers, shifting expansion from a chip race to a siting and infrastructure challenge. He says planning must account for power, networks, water, construction, permitting and community acceptance; he cites four-to-six-year waits for new substations and grid upgrades. In his view, tech companies and data center operators are investing in energy projects, while municipalities and operators can negotiate community benefits such as fire stations, schools, training and jobs. Dispersed campuses also increase demand for fiber within data centers, between facilities and across regions and continents. He says AI makes latency, reliability and network economics matter alongside bandwidth, and points to hollow core fiber as one emerging option. These are the interviewee's claims and perspectives in the supplied excerpt.

### Source excerpt

As AI adoption expands, so does the need for power to drive this growing demand. But questions around how much power is required, where will these data centers be sited, what will be their environmental impact, and who will pay for it, all remain mostly unanswered. To drill down into the topic, I recently hosted... ... continue reading The post The AI 'forever bottleneck': Data center power appeared first on SD Times.

## Where should AI workloads run? Probably next to the data.

DevFeed: [Where should AI workloads run? Probably next to the data.](<https://devfeed.tech/articles/where-should-ai-workloads-run-probably-next-to-the-data-144043.md>)

Original publisher: [Read original article](<https://thenewstack.io/ai-workloads-data-gravity/>)

Author: Shubham Thakur

Published: 2026-11-19T16:30:00Z

Content type: article

Language: en

Sources: [The New Stack](<https://devfeed.tech/sources/the-new-stack.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [data gravity](<https://devfeed.tech/topics/data-gravity.md>), [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>), [data mobility](<https://devfeed.tech/topics/data-mobility.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>), [ML model versioning](<https://devfeed.tech/topics/ml-model-versioning.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [acceldata](<https://devfeed.tech/tags/acceldata.md>), [accelerators](<https://devfeed.tech/tags/accelerators.md>), [access-controls](<https://devfeed.tech/tags/access-controls.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-state](<https://devfeed.tech/tags/agent-state.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-governance](<https://devfeed.tech/tags/ai-governance.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-stack](<https://devfeed.tech/tags/ai-stack.md>), [ai-strategy](<https://devfeed.tech/tags/ai-strategy.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache](<https://devfeed.tech/tags/apache.md>), [aws](<https://devfeed.tech/tags/aws.md>), [blocks](<https://devfeed.tech/tags/blocks.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [data](<https://devfeed.tech/tags/data.md>), [ec2](<https://devfeed.tech/tags/ec2.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [post-contributed](<https://devfeed.tech/tags/post-contributed.md>), [prices](<https://devfeed.tech/tags/prices.md>), [sponsor-acceldata](<https://devfeed.tech/tags/sponsor-acceldata.md>), [sponsored-post-contributed](<https://devfeed.tech/tags/sponsored-post-contributed.md>)

### AI overview

AI workload placement should account for where data already lives: repeated large reads can make cross-region or cross-environment transfers costly and slow, while moving compute may avoid full-dataset copies. The article recommends evaluating each job against residency and access rules, compatible accelerator and runtime capacity, performance, and total cost, including transfer, storage, queueing, and engineering overhead. Workloads differ: bursty training may suit cloud capacity, residency-bound jobs must stay in an approved jurisdiction, and transaction-near inference must meet latency targets. Hybrid setups can keep data-heavy or constrained work local while using cloud elasticity where worthwhile, provided identity, policy, observability, and runtime compatibility span environments. Open table formats can support in-place reads across engines, but portability depends on target support. Sovereignty also covers prompts, retrieval indexes, orchestration state, and access controls, not only GPU location. Revisit placement as prices, data, or deadlines change; if no option meets policy and capacity requirements, queue or reject the job.

### Source excerpt

AWS raised prices on EC2 Capacity Blocks, its reserved GPU capacity, by about 15% in January and about 20% in The post Where should AI workloads run? Probably next to the data. appeared first on The New Stack.

## Using NVIDIA Run:ai GPU Fractioning on Amazon EKS

DevFeed: [Using NVIDIA Run:ai GPU Fractioning on Amazon EKS](<https://devfeed.tech/articles/using-nvidia-run-ai-gpu-fractioning-on-amazon-eks-143848.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/using-nvidia-runai-gpu-fractioning-on-amazon-eks/>)

Author: Muru Bhaskaran

Published: 2026-11-19T16:13:51Z

Content type: tutorial

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon Elastic Kubernetes Service](<https://devfeed.tech/topics/amazon-elastic-kubernetes-service.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [gpu monitoring](<https://devfeed.tech/topics/gpu-monitoring.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-ec2](<https://devfeed.tech/tags/amazon-ec2.md>), [amazon-eks](<https://devfeed.tech/tags/amazon-eks.md>), [amazon-elastic-kubernetes-service](<https://devfeed.tech/tags/amazon-elastic-kubernetes-service.md>), [eks](<https://devfeed.tech/tags/eks.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-memory](<https://devfeed.tech/tags/gpu-memory.md>), [kai-scheduler](<https://devfeed.tech/tags/kai-scheduler.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [linux](<https://devfeed.tech/tags/linux.md>), [memory](<https://devfeed.tech/tags/memory.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-run-ai](<https://devfeed.tech/tags/nvidia-run-ai.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [operator](<https://devfeed.tech/tags/operator.md>), [pod](<https://devfeed.tech/tags/pod.md>), [pods](<https://devfeed.tech/tags/pods.md>), [run-ai](<https://devfeed.tech/tags/run-ai.md>), [scheduler](<https://devfeed.tech/tags/scheduler.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

NVIDIA Run:ai GPU Fractioning lets two Kubernetes Pods share one NVIDIA A10G on Amazon EKS with enforced per-Pod GPU-memory contracts. In the validated setup, each Pod had an 8 GiB limit and successfully allocated 6 GiB; a 9 GiB allocation was rejected. The approach builds on MPS and adds Kubernetes scheduling, memory enforcement, and per-Pod metrics. The walkthrough uses a custom Amazon Linux 2023 image with an R615 driver, KAI Scheduler, and the GPU Fractioning Operator. It validates memory bounds and placement, not throughput, fault containment, or security isolation. Production use requires compatible hardware and software, capacity and runtime headroom, trusted workloads, and performance and rollback testing. It assumes pre-provisioned GPU capacity; GPU-fraction-aware autoscaling was not configured or validated.

### Source excerpt

Learn how to run two memory-bounded Kubernetes Pods on a single NVIDIA A10G GPU using open-source NVIDIA Run:ai GPU Fractioning on Amazon EKS. This walkthrough builds a custom Amazon Linux 2023 image, installs KAI Scheduler and the GPU Fractioning Operator, and validates per-Pod GPU-memory contracts with enforcement and metrics.

## How to Run Claude Code and Other Coding Agents in the Cloud 24/7

DevFeed: [How to Run Claude Code and Other Coding Agents in the Cloud 24/7](<https://devfeed.tech/articles/how-to-run-claude-code-and-other-coding-agents-in-the-cloud-24-7-144203.md>)

Original publisher: [Read original article](<https://towardsdatascience.com/how-to-run-claude-code-and-other-coding-agents-in-the-cloud-247/>)

Author: Eivind Kjosbakken

Published: 2026-11-19T15:00:00Z

Content type: article

Language: en

Sources: [Towards Data Science](<https://devfeed.tech/sources/towards-data-science.md>)

Topics: [agentic-coding](<https://devfeed.tech/topics/agentic-coding.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai-coding-assistants](<https://devfeed.tech/tags/ai-coding-assistants.md>), [ai-credits](<https://devfeed.tech/tags/ai-credits.md>), [automation](<https://devfeed.tech/tags/automation.md>), [aws](<https://devfeed.tech/tags/aws.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-coding](<https://devfeed.tech/tags/cloud-coding.md>), [code](<https://devfeed.tech/tags/code.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agent](<https://devfeed.tech/tags/coding-agent.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [computer](<https://devfeed.tech/tags/computer.md>), [control](<https://devfeed.tech/tags/control.md>), [cron](<https://devfeed.tech/tags/cron.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [full](<https://devfeed.tech/tags/full.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [llm-agents](<https://devfeed.tech/tags/llm-agents.md>), [llm-applications](<https://devfeed.tech/tags/llm-applications.md>), [run](<https://devfeed.tech/tags/run.md>), [server](<https://devfeed.tech/tags/server.md>)

### AI overview

Cloud coding sessions can keep long-running agents active when a local computer is closed or offline, reducing interruptions and the need to restart sessions. The quick option described is to set Claude Code in the Claude desktop app to use a cloud environment by default; it also reduces local RAM use, but the app limits automation such as cron jobs. For more flexibility and support for other agents and scheduled jobs, the author rents and configures a server, then connects through Paradev (formerly Superset) to work remotely. This route requires setup and occasional troubleshooting; the author estimates 4-5 hours initially and about two hours resolving issues. The article cites cheaper providers such as Hetzner and compares renting a 128 GB server at roughly $500/month with a $7,000-$8,000 Mac, as estimates from November 2026.

### Source excerpt

Two setups: flip Claude Code's cloud environment on for the quick path, or rent a server for full control. The post How to Run Claude Code and Other Coding Agents in the Cloud 24/7 appeared first on Towards Data Science.

## Anthropic's IPO puts AI's circular financing boom to the test

DevFeed: [Anthropic's IPO puts AI's circular financing boom to the test](<https://devfeed.tech/articles/anthropic-s-ipo-puts-ai-s-circular-financing-boom-to-the-test-143740.md>)

Original publisher: [Read original article](<https://techcrunch.com/2026/11/19/anthropics-ipo-puts-ais-circular-financing-boom-to-the-test/>)

Author: Rebecca Bellan

Published: 2026-11-19T14:54:39Z

Content type: news

Language: en

Sources: [TechCrunch | AI News & Artificial Intelligence](<https://devfeed.tech/sources/techcrunch-ai-news-artificial-intelligence.md>)

Topics: [Finance](<https://devfeed.tech/topics/finance.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-boom](<https://devfeed.tech/tags/ai-boom.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-race](<https://devfeed.tech/tags/ai-race.md>), [ai-startup](<https://devfeed.tech/tags/ai-startup.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amd](<https://devfeed.tech/tags/amd.md>), [analysts](<https://devfeed.tech/tags/analysts.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [anthropic-ipo](<https://devfeed.tech/tags/anthropic-ipo.md>), [bonds](<https://devfeed.tech/tags/bonds.md>), [broadcom](<https://devfeed.tech/tags/broadcom.md>), [capital](<https://devfeed.tech/tags/capital.md>), [cheaper-tokens](<https://devfeed.tech/tags/cheaper-tokens.md>), [claude](<https://devfeed.tech/tags/claude.md>), [compute](<https://devfeed.tech/tags/compute.md>), [financing](<https://devfeed.tech/tags/financing.md>), [google](<https://devfeed.tech/tags/google.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [ipo](<https://devfeed.tech/tags/ipo.md>), [partners](<https://devfeed.tech/tags/partners.md>)

### AI overview

Anthropic's IPO may shift its financing from supplier-investors toward public investors and bonds, while leaving its large compute obligations intact. Amazon and Google hold stakes valued at about $307.9 billion combined at the stated $83 share price; several infrastructure providers also invested through a $26 billion private placement and have commercial partnerships with Anthropic. The excerpt reports about $220 billion in expected cash and short-term investments after the IPO and placement, against $900 billion in committed spending, primarily for compute and infrastructure. Analysts cited estimate roughly $280 billion in cumulative revenue over four years is needed to cover compute costs and consider that achievable if growth continues. They identify losing the AI race as Anthropic's central risk, while arguing that suppliers could still benefit from broader AI demand served on their data centers. Their views differ on circular financing: one analyst calls Anthropic's arrangements additive, while another sees neocloud CoreWeave as more dependent on Nvidia's support.

### Source excerpt

Anthropic faces enormous compute commitments as it goes public, but its biggest infrastructure partners, including Amazon and Google, could continue profiting from AI even if Anthropic loses its lead.

## Deploy R models on Red Hat OpenShift AI with KServe

DevFeed: [Deploy R models on Red Hat OpenShift AI with KServe](<https://devfeed.tech/articles/deploy-r-models-on-red-hat-openshift-ai-with-kserve-144330.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/11/19/deploy-r-models-red-hat-openshift-ai-kserve>)

Author: Anneli Sara Banderby

Published: 2026-11-19T14:16:36Z

Content type: tutorial

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [KServe](<https://devfeed.tech/topics/kserve.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [redhat ubi](<https://devfeed.tech/topics/redhat-ubi.md>), [redhat](<https://devfeed.tech/topics/redhat.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [api](<https://devfeed.tech/tags/api.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [cli](<https://devfeed.tech/tags/cli.md>), [containers](<https://devfeed.tech/tags/containers.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [kserve](<https://devfeed.tech/tags/kserve.md>), [models](<https://devfeed.tech/tags/models.md>), [openshift](<https://devfeed.tech/tags/openshift.md>), [openshift-ai](<https://devfeed.tech/tags/openshift-ai.md>), [r](<https://devfeed.tech/tags/r.md>), [red-hat-openshift](<https://devfeed.tech/tags/red-hat-openshift.md>)

### AI overview

The guide shows how to serve R models on Red Hat OpenShift AI by building a custom KServe runtime, packaging a model in an OCI ModelCar, registering the runtime, and deploying through either CLI manifests or the web console. The runtime supports .rds models with a predict() method, plus .qs2, .rda, and .RData files; it exposes V2 inference and Prometheus metrics endpoints. Building requires Podman, oc, Git, and an image registry, while importing the runtime through the console requires OpenShift AI administrator permissions. The CLI path configures a service account and bearer-token authentication; both example flows send an inference request and show predicted Iris classes. OpenShift supplies Kubernetes deployment functions such as scaling and resource management, while the guide notes UBI images can be scanned for CVEs. The article also describes optional monitoring and pipeline capabilities.

### Source excerpt

Hark, my fellow R programmers, the time is upon us to move out of the workbench, package our glorious models in containers, and send them out into the world! The post Deploy R models on Red Hat OpenShift AI with KServe appeared first on Red Hat Developer.

[Next page](<https://devfeed.tech/topics/ai-infrastructure.md?cursor=WyIyMDI2LTExLTE5VDE0OjE2OjM2KzAwOjAwIiwgIjc2NzM0ZjRlLWVkZGEtNDRkMy1iYmYxLTcwM2Y4MTUzZGQzMiJd>)