# Data Infrastructure

Data infrastructure comprises systems, tools, and capabilities for collecting, storing, processing, governing, and using data.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Koduri's Oxmiq Offers IP, Tools for Indian Teams to Design AI Chips

DevFeed: [Koduri's Oxmiq Offers IP, Tools for Indian Teams to Design AI Chips](<https://devfeed.tech/articles/koduri-s-oxmiq-offers-ip-tools-for-indian-teams-to-design-ai-chips-141138.md>)

Original publisher: [Read original article](<https://www.eetimes.com/koduri-oxmiq-offers-ip-tools-for-indian-teams-to-design-ai-chips/>)

Author: Yashasvini Razdan

Published: 2026-11-18T13:30:00Z

Content type: news

Language: en

Sources: [EE Times](<https://devfeed.tech/sources/ee-times.md>)

Topics: [Chip design](<https://devfeed.tech/topics/chip-design.md>), [AI Platform](<https://devfeed.tech/topics/ai-platform.md>), [clean energy data centers](<https://devfeed.tech/topics/clean-energy-data-centers.md>), [Tool](<https://devfeed.tech/topics/tool.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>)

Tags: [ai-chip](<https://devfeed.tech/tags/ai-chip.md>), [ai-chips](<https://devfeed.tech/tags/ai-chips.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [analog](<https://devfeed.tech/tags/analog.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [business](<https://devfeed.tech/tags/business.md>), [chip-design](<https://devfeed.tech/tags/chip-design.md>), [community](<https://devfeed.tech/tags/community.md>), [custom-silicon](<https://devfeed.tech/tags/custom-silicon.md>), [data-centers](<https://devfeed.tech/tags/data-centers.md>), [designline](<https://devfeed.tech/tags/designline.md>), [digital](<https://devfeed.tech/tags/digital.md>), [education](<https://devfeed.tech/tags/education.md>), [ee-times](<https://devfeed.tech/tags/ee-times.md>), [ee-times-university](<https://devfeed.tech/tags/ee-times-university.md>), [eelife](<https://devfeed.tech/tags/eelife.md>), [eelive-electronic-design](<https://devfeed.tech/tags/eelive-electronic-design.md>), [eet](<https://devfeed.tech/tags/eet.md>), [electrical-engineering](<https://devfeed.tech/tags/electrical-engineering.md>), [electronic-components](<https://devfeed.tech/tags/electronic-components.md>), [electronic-engineering-times](<https://devfeed.tech/tags/electronic-engineering-times.md>), [electronics](<https://devfeed.tech/tags/electronics.md>), [embedded-systems](<https://devfeed.tech/tags/embedded-systems.md>), [fundamentals-courses](<https://devfeed.tech/tags/fundamentals-courses.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [india](<https://devfeed.tech/tags/india.md>), [indian](<https://devfeed.tech/tags/indian.md>), [ip](<https://devfeed.tech/tags/ip.md>), [learning](<https://devfeed.tech/tags/learning.md>), [mixed-signal](<https://devfeed.tech/tags/mixed-signal.md>), [news](<https://devfeed.tech/tags/news.md>), [opinion](<https://devfeed.tech/tags/opinion.md>), [part-search](<https://devfeed.tech/tags/part-search.md>), [product-search](<https://devfeed.tech/tags/product-search.md>), [semiconductors](<https://devfeed.tech/tags/semiconductors.md>), [software](<https://devfeed.tech/tags/software.md>), [supply-chain-distribution](<https://devfeed.tech/tags/supply-chain-distribution.md>), [teams](<https://devfeed.tech/tags/teams.md>), [tech-papers](<https://devfeed.tech/tags/tech-papers.md>), [technology](<https://devfeed.tech/tags/technology.md>), [tools](<https://devfeed.tech/tags/tools.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

Oxmiq Labs says it has built tools and IP to help Indian teams design AI chips, and is planning an India initiative it expects to detail in December. Founder Raja Koduri argues that efficiency depends on optimizing the full data-center system, especially its memory hierarchy, power use and cooling, rather than a chip alone. Oxmiq's AM Intelligence Labs partnership covers site selection, compute and data-center design, and partner selection; the initial build uses Nvidia GPUs, with Indian designs intended to follow. Koduri says custom silicon and systems may make economic sense for customers planning at least 100 MW, but require IP, tools and expertise. He estimates India will need at least 6 GW of AI infrastructure by 2030 and says its combined GPU capacity, including planned deployments, would remain below 100 MW.

### Source excerpt

India's AI infrastructure needs could exceed 6 GW by 2030. Oxmiq Labs CEO Raja Koduri explains why domestic chip design and custom systems matter. The post Koduri's Oxmiq Offers IP, Tools for Indian Teams to Design AI Chips appeared first on EE Times.

## Fivetran Now Offers Data Processing Centers: Canada and U.K. | Blog | Fivetran

DevFeed: [Fivetran Now Offers Data Processing Centers: Canada and U.K. | Blog | Fivetran](<https://devfeed.tech/articles/fivetran-now-offers-data-processing-centers-canada-and-u-k-blog-fivetran-140202.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/canada-uk-data-processing-centers>)

Author: Fivetran

Published: 2026-11-18T03:07:10Z

Content type: release

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [data-processing](<https://devfeed.tech/topics/data-processing.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>)

Tags: [canada](<https://devfeed.tech/tags/canada.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [data-localization](<https://devfeed.tech/tags/data-localization.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [data-regulations](<https://devfeed.tech/tags/data-regulations.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [region](<https://devfeed.tech/tags/region.md>)

### AI overview

Fivetran added Canada and U.K. data processing locations so customers can choose where jobs run before data is loaded into its final destination, helping them meet internal security and local data-localization requirements. Customers select a preferred processing region when setting up their first connector; that region applies to future connectors. They can change it later by editing connection details in the dashboard.

### Source excerpt

We're committed to helping you comply with data localization requirements wherever you operate.

## Fivetran Named a 2019 Gartner Peer Insights Customers' Choice for Data Integration Tools | Blog | Fivetran

DevFeed: [Fivetran Named a 2019 Gartner Peer Insights Customers' Choice for Data Integration Tools | Blog | Fivetran](<https://devfeed.tech/articles/fivetran-named-a-2019-gartner-peer-insights-customers-choice-for-data-integration-tools-blog-fivetran-140226.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/fivetran-named-a-2019-gartner-peer-insights-customers-choice-for-data-integration-tools>)

Author: Fivetran

Published: 2026-11-18T02:46:08Z

Content type: release

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>)

Tags: [2019](<https://devfeed.tech/tags/2019.md>), [about](<https://devfeed.tech/tags/about.md>), [accelerate](<https://devfeed.tech/tags/accelerate.md>), [affiliates](<https://devfeed.tech/tags/affiliates.md>), [all](<https://devfeed.tech/tags/all.md>), [analyst](<https://devfeed.tech/tags/analyst.md>), [analysts](<https://devfeed.tech/tags/analysts.md>), [blog](<https://devfeed.tech/tags/blog.md>), [choice](<https://devfeed.tech/tags/choice.md>), [customers](<https://devfeed.tech/tags/customers.md>), [data](<https://devfeed.tech/tags/data.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [gartner](<https://devfeed.tech/tags/gartner.md>), [insights](<https://devfeed.tech/tags/insights.md>), [integration](<https://devfeed.tech/tags/integration.md>), [peer](<https://devfeed.tech/tags/peer.md>), [rating](<https://devfeed.tech/tags/rating.md>), [tools](<https://devfeed.tech/tags/tools.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Fivetran says it received the 2019 Gartner Peer Insights Customers' Choice distinction for data integration tools, citing customer feedback and a 4.4/5 rating as of November 20, 2019. The company describes connectors that adapt to schema and API changes to support reliable data delivery, and says it is expanding connector coverage, adding in-warehouse transformations, and improving reliability and support. Quoted users report easier data ingestion and setup, including for NetSuite, reduced pipeline setup effort, and responsive troubleshooting support. Gartner's disclaimer says the distinction reflects subjective end-user reviews and a documented methodology; it is not Gartner's endorsement.

### Source excerpt

Fivetran customers have spoken! With a 4.4/5 rating on Gartner Peer Insights as of November 20, 2019, we've been recognized in data integration tools.

## Batch processing patterns for workflow automation at scale

DevFeed: [Batch processing patterns for workflow automation at scale](<https://devfeed.tech/articles/batch-processing-patterns-for-workflow-automation-at-scale-128022.md>)

Original publisher: [Read original article](<https://blog.n8n.io/batch-processing/>)

Author: Yulia Dmitrievna

Published: 2026-11-10T20:36:22Z

Content type: article

Language: en

Sources: [n8n](<https://devfeed.tech/sources/n8n-blog.md>)

Topics: [workflow automation](<https://devfeed.tech/topics/workflow-automation.md>), [n8n](<https://devfeed.tech/topics/n8n.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Error Handling](<https://devfeed.tech/topics/error-handling.md>), [stream-processing](<https://devfeed.tech/topics/stream-processing.md>), [scheduling](<https://devfeed.tech/topics/scheduling.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>)

Tags: [added](<https://devfeed.tech/tags/added.md>), [aggregate](<https://devfeed.tech/tags/aggregate.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-native](<https://devfeed.tech/tags/ai-native.md>), [also](<https://devfeed.tech/tags/also.md>), [api](<https://devfeed.tech/tags/api.md>), [apis](<https://devfeed.tech/tags/apis.md>), [automation](<https://devfeed.tech/tags/automation.md>), [batch](<https://devfeed.tech/tags/batch.md>), [batch-processing](<https://devfeed.tech/tags/batch-processing.md>), [guide](<https://devfeed.tech/tags/guide.md>), [itops](<https://devfeed.tech/tags/itops.md>), [learn](<https://devfeed.tech/tags/learn.md>), [limits](<https://devfeed.tech/tags/limits.md>), [patterns](<https://devfeed.tech/tags/patterns.md>), [processing](<https://devfeed.tech/tags/processing.md>), [retries](<https://devfeed.tech/tags/retries.md>), [scale](<https://devfeed.tech/tags/scale.md>), [tools](<https://devfeed.tech/tags/tools.md>), [workflow](<https://devfeed.tech/tags/workflow.md>), [workflow-automation](<https://devfeed.tech/tags/workflow-automation.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

For large workflows, chunk records to control memory and downstream load, pace batches to stay within API rate limits, and handle failures per item so successful work need not be repeated. In n8n, Loop Over Items (Split in Batches) controls batch size, Wait adds pauses, and Remove Duplicates filters repeats; Split Out and Aggregate convert between grouped and individual items. The excerpt also recommends idempotent operations, such as database upserts, and checkpoints to make reruns safer. Sub-workflows can help manage memory; queue mode distributes executions across workers for larger self-hosted workloads. Choose batch size and speed based on available resources, API limits, and realistic load, then tune as conditions change. Batch fits jobs where delay is acceptable; streaming suits time-critical data but requires always-on infrastructure and adds operational complexity. n8n reports testing up to 220 workflow executions per second on a single c5a.large instance with a two-node workflow.

### Source excerpt

Learn batch processing patterns for scalable workflows, including chunking, rate limits, retries. Discover the tools that put these patterns into practice.

## Portworx Unveils Advanced AI and VM Capabilities on Kubernetes; Everpure Named a Leader in 2026 IDC MarketScape Report

DevFeed: [Portworx Unveils Advanced AI and VM Capabilities on Kubernetes; Everpure Named a Leader in 2026 IDC MarketScape Report](<https://devfeed.tech/articles/portworx-unveils-advanced-ai-and-vm-capabilities-on-kubernetes-everpure-named-a-leader-in-2026-idc-marketscape-report-129055.md>)

Original publisher: [Read original article](<https://blog.everpuredata.com/news-events/portworx-unveils-advanced-ai-and-vm-capabilities-on-kubernetes/>)

Author: Everpure

Published: 2026-11-10T14:00:00Z

Content type: release

Language: en

Sources: [Everpure](<https://devfeed.tech/sources/everpure.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-inference](<https://devfeed.tech/tags/ai-inference.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [backup](<https://devfeed.tech/tags/backup.md>), [containerized](<https://devfeed.tech/tags/containerized.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [data-management](<https://devfeed.tech/tags/data-management.md>), [disaster-recovery](<https://devfeed.tech/tags/disaster-recovery.md>), [enterprise-storage](<https://devfeed.tech/tags/enterprise-storage.md>), [everpure](<https://devfeed.tech/tags/everpure.md>), [idc](<https://devfeed.tech/tags/idc.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [leader](<https://devfeed.tech/tags/leader.md>), [news-events](<https://devfeed.tech/tags/news-events.md>), [portworx](<https://devfeed.tech/tags/portworx.md>), [red-hat-openshift-virtualization](<https://devfeed.tech/tags/red-hat-openshift-virtualization.md>), [report](<https://devfeed.tech/tags/report.md>), [vm](<https://devfeed.tech/tags/vm.md>)

### AI overview

At KubeCon 2026, Portworx announced Kubernetes storage updates for AI, VMs and containers. Pre-staged volumes are intended to speed AI workload startup by keeping warm local copies of volume data across cluster nodes; storage policies can select a local copy when a workload starts or moves. They are expected in Q1 2027. Kube Datastore is generally available on supported SAN arrays, with dynamic and static pools for predictable placement and capacity controls. It supports Kubernetes-native rebalancing and maintenance, fast failover, and VM workflows such as storage mobility. Portworx also added operations-center visibility into pool inventory, live migration and hyperconvergence, and is expanding support for third-party backup tools. It is an OpenShift 5 launch partner and is available for deployments. The post also reports Everpure's designation as a Leader in the 2026 IDC MarketScape; the quoted assessment highlights mission-critical workloads across Kubernetes distributions or mixed storage and integrated backup and disaster recovery.

### Source excerpt

Portworx Unveils Advanced AI and VM Capabilities on Kubernetes; Everpure Named a Leader in 2026 IDC MarketScape Report by Everpure Blog Discover Portworx innovations for AI and VM workloads on Kubernetes, and learn why Everpure was named a 2026 IDC MarketScape Leader. The post Portworx Unveils Advanced AI and VM Capabilities on Kubernetes; Everpure Named a Leader in 2026 IDC MarketScape Report appeared first on Everpure Blog.

## Dropbox Buys Tigris Data for About $350M and Launches DBX Agent Cloud, S3-Compatible Object Storage for AI Agents

DevFeed: [Dropbox Buys Tigris Data for About $350M and Launches DBX Agent Cloud, S3-Compatible Object Storage for AI Agents](<https://devfeed.tech/articles/dropbox-buys-tigris-data-for-about-350m-and-launches-dbx-agent-cloud-s3-compatible-object-storage-for-ai-agents-122667.md>)

Original publisher: [Read original article](<https://www.storagereview.com/news/dropbox-tigris-data-acquisition-350m-dbx-agent-cloud>)

Author: Harold Fritts

Published: 2026-11-08T18:58:34Z

Content type: news

Language: en

Sources: [StorageReview.com](<https://devfeed.tech/sources/storagereview-com.md>)

Topics: [dropbox](<https://devfeed.tech/topics/dropbox.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [applications](<https://devfeed.tech/tags/applications.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [dbx-agent-cloud](<https://devfeed.tech/tags/dbx-agent-cloud.md>), [deal](<https://devfeed.tech/tags/deal.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [dropbox](<https://devfeed.tech/tags/dropbox.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-storage](<https://devfeed.tech/tags/enterprise-storage.md>), [launches](<https://devfeed.tech/tags/launches.md>), [object](<https://devfeed.tech/tags/object.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [s3](<https://devfeed.tech/tags/s3.md>), [service](<https://devfeed.tech/tags/service.md>), [storage](<https://devfeed.tech/tags/storage.md>), [tigris-data](<https://devfeed.tech/tags/tigris-data.md>)

### AI overview

Dropbox agreed to acquire Tigris Data for about $350 million in cash and use its globally distributed, S3-compatible object storage as the first component of DBX Agent Cloud, a planned infrastructure service for AI applications. The standalone storage is intended to let applications access datasets and other content through one S3-compatible endpoint across compute environments. Dropbox has not announced its pricing, egress terms, or availability date; filesystem and content-processing features are planned without timelines. The acquisition is expected to close in Q4 2026, subject to customary conditions. Separately, Dropbox's updated experience can perform file tasks after customer approval, within existing permissions, with actions recorded and supported actions undoable. It has rolled out to over 70,000 teams; the initial eligible-team rollout covers the US, UK, and Australia in English, with broader availability planned for 2027.

### Source excerpt

Dropbox is buying Tigris Data, a globally distributed S3-compatible object storage provider founded by former Uber engineers, for about $350 million in cash, and is using the deal to launch DBX Agent Cloud, a storage and data infrastructure service for AI applications and agents. The first piece of DBX Agent Cloud is standalone S3-compatible object The post Dropbox Buys Tigris Data for About $350M and Launches DBX Agent Cloud, S3-Compatible Object Storage for AI Agents appeared first on StorageReview.com.

## Best Tools for AI Data Privacy and Compliance for Banks

DevFeed: [Best Tools for AI Data Privacy and Compliance for Banks](<https://devfeed.tech/articles/best-tools-for-ai-data-privacy-and-compliance-for-banks-120981.md>)

Original publisher: [Read original article](<https://www.lyzr.ai/blog/best-tools-for-ai-data-privacy-for-banks/>)

Author: Lyzr Team

Published: 2026-11-06T09:14:34Z

Content type: comparison

Language: en

Sources: [Lyzr.ai](<https://devfeed.tech/sources/lyzr-ai.md>)

Topics: [responsible-ai](<https://devfeed.tech/topics/responsible-ai.md>), [Security, Privacy and Abuse Prevention](<https://devfeed.tech/topics/security-privacy-and-abuse-prevention.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [audit](<https://devfeed.tech/topics/audit.md>), [sensitive data](<https://devfeed.tech/topics/sensitive-data.md>), [soc 2](<https://devfeed.tech/topics/soc-2.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [2026](<https://devfeed.tech/tags/2026.md>), [agents](<https://devfeed.tech/tags/agents.md>), [agents-in-production](<https://devfeed.tech/tags/agents-in-production.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-data](<https://devfeed.tech/tags/ai-data.md>), [ai-data-privacy](<https://devfeed.tech/tags/ai-data-privacy.md>), [ai-inventory](<https://devfeed.tech/tags/ai-inventory.md>), [bank](<https://devfeed.tech/tags/bank.md>), [banks](<https://devfeed.tech/tags/banks.md>), [best](<https://devfeed.tech/tags/best.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [data](<https://devfeed.tech/tags/data.md>), [data-privacy](<https://devfeed.tech/tags/data-privacy.md>), [job](<https://devfeed.tech/tags/job.md>), [operations](<https://devfeed.tech/tags/operations.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [sensitive-data](<https://devfeed.tech/tags/sensitive-data.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tools](<https://devfeed.tech/tags/tools.md>)

### AI overview

The guide finds that banks usually need two or three tools because privacy and AI compliance span distinct jobs. Madison connects US banking rules to obligations, policies, controls, tests, evidence and named human sign-off; it does not discover data, handle privacy requests or monitor models. BigID focuses on finding and classifying sensitive data, while Databricks Unity Catalog governs data and AI assets already on Databricks through access controls, lineage and logs. OneTrust, TrustArc and DataGrail address privacy operations, with described capabilities and evidence varying by source and date. Credo AI provides an AI system and agent registry with risk assessments and policy packs; Fiddler monitors production models and agents with observability, guardrails and explanations. The guide recommends choosing by the bank's primary gap, checking current bank-specific evidence and deployment requirements, and piloting shortlisted tools on the bank's own documents and inventory. Its comparisons rely on vendor pages, dated launch material, documentation and one third-party listing, so capabilities should be confirmed.

### Source excerpt

The best tool for AI data privacy and compliance at a bank depends on the job: finding and controlling sensitive data, running privacy operations, governing...

## Why enterprise AI needs unified metadata infrastructure

DevFeed: [Why enterprise AI needs unified metadata infrastructure](<https://devfeed.tech/articles/why-enterprise-ai-needs-unified-metadata-infrastructure-118719.md>)

Original publisher: [Read original article](<https://www.infoworld.com/article/4244836/why-enterprise-ai-needs-unified-metadata-infrastructure.html>)

Author: Christian Bremeau

Published: 2026-11-05T09:00:00Z

Content type: opinion

Language: en

Sources: [InfoWorld](<https://devfeed.tech/sources/infoworld.md>)

Topics: [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Production Engineering](<https://devfeed.tech/topics/production-engineering.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-frameworks](<https://devfeed.tech/tags/agent-frameworks.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-application](<https://devfeed.tech/tags/ai-application.md>), [analyst](<https://devfeed.tech/tags/analyst.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analytics-artificial-intelligence-data-management-generative-ai](<https://devfeed.tech/tags/analytics-artificial-intelligence-data-management-generative-ai.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [bi](<https://devfeed.tech/tags/bi.md>), [business](<https://devfeed.tech/tags/business.md>), [churn](<https://devfeed.tech/tags/churn.md>), [customer](<https://devfeed.tech/tags/customer.md>), [dashboard](<https://devfeed.tech/tags/dashboard.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data](<https://devfeed.tech/tags/data.md>), [data-management](<https://devfeed.tech/tags/data-management.md>), [databases](<https://devfeed.tech/tags/databases.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [finance](<https://devfeed.tech/tags/finance.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [governance](<https://devfeed.tech/tags/governance.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [language-en](<https://devfeed.tech/tags/language-en.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [storytype-opinion](<https://devfeed.tech/tags/storytype-opinion.md>)

### AI overview

The excerpt argues that enterprise AI depends on a shared, governed account of business meaning, because models can act on conflicting definitions with equal confidence and spread errors through automated workflows. It says many organizations have separate catalog, lineage, governance, and semantic tools whose definitions can drift from the systems that enforce them. The proposed direction is a vendor-neutral metadata foundation that connects definitions to implementations, ownership, version history, and lineage across platforms. The article describes a second generation of metadata management focused on execution: definitions are version-controlled, moved through development pipelines, and impact-tested before deployment. It calls this practice MetadataOps, distinguishing it from context engineering, which selects what reaches an agent, while MetadataOps governs what definitions exist for retrieval.

### Source excerpt

Enterprise AI has produced a lot of noise about models, GPUs, vector databases, and agent frameworks. Those conversations matter. But the shift that will decide whether enterprise AI works is happening underneath the models. For decades, metadata meant documentation. Teams built catalogs so people could find data sets, governance programs recorded definitions and ownership, and lineage helped reconstruct what broke, after it broke. Metadata described the business. AI expects metadata to run it. That gap is bigger than it sounds. An AI system doesn't inherit the years of institutional knowledge a senior analyst holds in their head. It doesn't know that finance's definition of revenue excludes returns while sales' definition includes them. It doesn't know a customer ID became unreliable after a migration three years ago. It doesn't know churn got redefined last quarter. People pick that up over time, usually by getting burned once. AI simply answers using whatever definition it happens to land on, with no burned-once memory to fall back on. That's what turns metadata from documentation into infrastructure. Business meaning is now infrastructure Infrastructure is anything every application depends on without thinking about it: the network, identity, storage. Every application assumes it exists. Business meaning belongs on that list now too. Every AI application depends on the same definitions of customer, revenue, product, contract, and risk holding steady across systems. When they don't, AI scales the inconsistency faster than any team of humans ever could. BI showed us this problem first. Two dashboards would return two different numbers because two tools implemented the same metric two different ways. Most organizations learned to live with it: reconciliation meetings, spreadsheet showdowns, a standing argument about whose report is right. AI broke the tolerance for semantic inconsistency. A wrong number on a dashboard gets caught by someone in the room. A wrong num

## Axon Sued Over AI-Powered License Plate Reader Network

DevFeed: [Axon Sued Over AI-Powered License Plate Reader Network](<https://devfeed.tech/articles/axon-sued-over-ai-powered-license-plate-reader-network-117896.md>)

Original publisher: [Read original article](<https://yro.slashdot.org/story/26/11/04/2319208/axon-sued-over-ai-powered-license-plate-reader-network>)

Author: BeauHD

Published: 2026-11-05T00:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [digital sovereignty](<https://devfeed.tech/topics/digital-sovereignty.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-powered](<https://devfeed.tech/tags/ai-powered.md>), [axon](<https://devfeed.tech/tags/axon.md>), [lawsuit](<https://devfeed.tech/tags/lawsuit.md>), [license-plate](<https://devfeed.tech/tags/license-plate.md>), [network](<https://devfeed.tech/tags/network.md>)

### AI overview

A proposed class action filed in federal court in San Francisco accuses Axon of collecting and storing California drivers' license plate data without disclosing how it collects, uses, and shares the information, allegedly violating a state privacy provision. The suit says Axon has more than 1,000 cameras in California: some capture plates in high-traffic areas, while others are mounted in police vehicles. The proposed class covers drivers whose plates were captured by an automated reader in California and processed or stored by Axon since 2023. Plaintiffs seek more than $5 million in damages and a court order halting the alleged practices. Axon had not immediately responded to a request for comment, according to the excerpt; the claims remain allegations.

### Source excerpt

Axon has been sued in a proposed class action accusing the Taser and police body-camera maker of illegally collecting and storing license plate data on millions of California drivers through its AI-powered surveillance network. Reuters reports the details: - The lawsuit (PDF), filed on Tuesday in federal court in San Francisco by law firms Hausfeld and Gibbs Mura, alleges Axon has failed to comply with a California privacy provision by not disclosing how it collects, uses and shares plate data gathered through its camera systems - "Axon has created a mass-surveillance infrastructure that is practically impossible to avoid," the lawsuit said - Scottsdale, Arizona-based Axon did not immediately respond to a request for comment. The lawsuit said the company has more than 1,000 cameras in California and alleges millions of drivers may have been affected - Some Axon cameras are installed in high-traffic areas and collect plate information as vehicles pass by. Other cameras are placed inside police vehicles, the lawsuit said - The proposed class covers drivers whose vehicle plate information was captured by an automated license plate reader in California and processed or stored by Axon's system since 2023 - The lawsuit seeks more than $5 million in damages, in addition to a court order stopping Axon from its allegedly unlawful practices Read more of this story at Slashdot.

## Fivetran Recognized as a Leader in the 2026 Gartner® Magic Quadrant™ for Data Integration Tools | Blog | Fivetran

DevFeed: [Fivetran Recognized as a Leader in the 2026 Gartner® Magic Quadrant™ for Data Integration Tools | Blog | Fivetran](<https://devfeed.tech/articles/fivetran-recognized-as-a-leader-in-the-2026-gartner-magic-quadranttm-for-data-integration-tools-blog-fivetran-116601.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/fivetran-recognized-as-a-leader-in-the-2026-gartner-r-magic-quadrant-tm-for-data-integration-tools>)

Author: Anjan Kundavaram

Published: 2026-11-04T16:15:01Z

Content type: news

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [DataOps](<https://devfeed.tech/topics/dataops.md>), [databricks](<https://devfeed.tech/topics/databricks.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [2026](<https://devfeed.tech/tags/2026.md>), [3](<https://devfeed.tech/tags/3.md>), [ai](<https://devfeed.tech/tags/ai.md>), [blog](<https://devfeed.tech/tags/blog.md>), [data](<https://devfeed.tech/tags/data.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [foundation](<https://devfeed.tech/tags/foundation.md>), [gartner](<https://devfeed.tech/tags/gartner.md>), [gartner-magic-quadranttm](<https://devfeed.tech/tags/gartner-magic-quadranttm.md>), [integration](<https://devfeed.tech/tags/integration.md>), [labs](<https://devfeed.tech/tags/labs.md>), [leader](<https://devfeed.tech/tags/leader.md>), [magic](<https://devfeed.tech/tags/magic.md>), [tools](<https://devfeed.tech/tags/tools.md>), [trusted-data](<https://devfeed.tech/tags/trusted-data.md>)

### AI overview

Fivetran says it was named a Leader in the 2026 Gartner Magic Quadrant for Data Integration Tools for the seventh consecutive year, with improved positions in Ability to Execute and Completeness of Vision. The article presents the June 2026 merger with dbt Labs as a way to connect data movement, transformation, business definitions, activation, and context for analytics and AI. It highlights 750+ managed connectors, dbt's framework for tested and documented transformations, semantic definitions, a Context Layer for AI, and dbt State's change awareness to avoid unnecessary processing. It also describes AI-assisted tools for dbt modeling and connector development, alongside open standards and customer choice of platforms. The stated aims are trusted, reusable data, lower processing costs, and flexibility as AI tools change; these are company claims and goals, not measured outcomes in the excerpt.

### Source excerpt

Fivetran + dbt Labs is the trusted data foundation for enterprise AI.

## Salesforce acquires Rune Technologies to add offline capabilities to Missionforce

DevFeed: [Salesforce acquires Rune Technologies to add offline capabilities to Missionforce](<https://devfeed.tech/articles/salesforce-acquires-rune-technologies-to-add-offline-capabilities-to-missionforce-112550.md>)

Original publisher: [Read original article](<https://www.cio.com/article/4243245/salesforce-acquires-rune-technologies-to-add-offline-capabilities-to-missionforce.html>)

Author: Anirban Ghoshal

Published: 2026-11-02T12:58:03Z

Content type: news

Language: en

Sources: [CIO](<https://devfeed.tech/sources/cio.md>)

Topics: [Local-First](<https://devfeed.tech/topics/local-first.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [distributed algorithm](<https://devfeed.tech/topics/distributed-algorithm.md>), [consistency](<https://devfeed.tech/topics/consistency.md>), [Access Control](<https://devfeed.tech/topics/access-control.md>)

Tags: [acquisition](<https://devfeed.tech/tags/acquisition.md>), [aerospace](<https://devfeed.tech/tags/aerospace.md>), [agentforce](<https://devfeed.tech/tags/agentforce.md>), [defense](<https://devfeed.tech/tags/defense.md>), [defense-tech](<https://devfeed.tech/tags/defense-tech.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [edition-us](<https://devfeed.tech/tags/edition-us.md>), [enterprise-applications](<https://devfeed.tech/tags/enterprise-applications.md>), [enterprise-applications-salesforce-vendors-and-providers](<https://devfeed.tech/tags/enterprise-applications-salesforce-vendors-and-providers.md>), [forecast](<https://devfeed.tech/tags/forecast.md>), [government](<https://devfeed.tech/tags/government.md>), [inventory](<https://devfeed.tech/tags/inventory.md>), [language-en](<https://devfeed.tech/tags/language-en.md>), [mesh-network](<https://devfeed.tech/tags/mesh-network.md>), [military](<https://devfeed.tech/tags/military.md>), [nfc](<https://devfeed.tech/tags/nfc.md>), [offline](<https://devfeed.tech/tags/offline.md>), [offline-first](<https://devfeed.tech/tags/offline-first.md>), [optimize](<https://devfeed.tech/tags/optimize.md>), [rune](<https://devfeed.tech/tags/rune.md>), [salesforce](<https://devfeed.tech/tags/salesforce.md>), [storytype-news](<https://devfeed.tech/tags/storytype-news.md>), [system-of-record](<https://devfeed.tech/tags/system-of-record.md>), [transportation](<https://devfeed.tech/tags/transportation.md>), [vehicles](<https://devfeed.tech/tags/vehicles.md>), [vendors-and-providers](<https://devfeed.tech/tags/vendors-and-providers.md>)

### AI overview

Salesforce is acquiring Rune Technologies to bring TyrOS's offline-first logistics capabilities into Missionforce. TyrOS caches last-known inventory, vehicle, and route information using NFC-based hardware so deployed units can forecast supplies, allocate resources, and make operational decisions without continuous connectivity. When connections return, it can exchange prioritized information across distributed nodes over a mesh network and synchronize data, restoring headquarters' visibility. Analysts cited improved continuity as a potential benefit, while warning that offline updates could create conflicting records on reconnection and that data security must be maintained across distributed locations. Salesforce says TyrOS is already deployed with the US Army and Marine Corps; the acquisition is intended to support a 10-year US Army modernization contract with a $5.6 billion ceiling. The deal is expected to close by April 2027.

### Source excerpt

Salesforce is in the process of acquiring US-based defense-tech startup Rune Technologies to add offline capabilities to Missionforce, its Agentforce avatar for national security, defense, aerospace, and government agencies. The startup's TyrOS platform will be used to extend Missionforce into frontline military logistics, enabling deployed units to forecast supply requirements, optimize resource allocation, and make operational decisions even when network connectivity is unavailable, the CRM software provider said in a statement. That is possible due to TyrOS's offline-first architecture that caches last-known information about inventory, vehicles, and transportation routes using NFC-based hardware, allowing deployed units to access operational data without a continuous connection to centralized systems, according to the company's website. The platform can also exchange prioritized information between distributed nodes through a mesh network when connectivity becomes available, the website showed. Currently, Missionforce acts as a system of record for personnel, equipment, and supplies across defense organizations, while providing tools for strategic planning. For CIOs of defense organizations, the acquisition could mean improved operational continuity and better utilization of available resources, said Premal Shah, principal analyst at Avasant. This would be helpful because frontline units could now continue to access critical logistics information and coordinate resource requirements during connectivity disruptions, rather than relying on manual records or waiting for centralized systems to become available, Shah added. Once connectivity is restored, information can be synchronized across distributed nodes, helping headquarters regain visibility into frontline requirements and make more informed decisions about resource allocation and resupply, he further added. However, implementing technologies such as TyrOS comes with its own set of risks, according to Pareekh

## How fixing our data infrastructure before it broke us gave back 6,200 engineering hours

DevFeed: [How fixing our data infrastructure before it broke us gave back 6,200 engineering hours](<https://devfeed.tech/articles/how-fixing-our-data-infrastructure-before-it-broke-us-gave-back-6-200-engineering-hours-113146.md>)

Original publisher: [Read original article](<https://www.infoworld.com/article/4241788/how-fixing-our-data-infrastructure-before-it-broke-us-gave-back-6200-engineering-hours.html>)

Author: John Mitchem

Published: 2026-11-02T09:00:00Z

Content type: opinion

Language: en

Sources: [InfoWorld](<https://devfeed.tech/sources/infoworld.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Big data infrastructure](<https://devfeed.tech/topics/big-data-infrastructure.md>), [digital sovereignty](<https://devfeed.tech/topics/digital-sovereignty.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>), [vendor lock-in](<https://devfeed.tech/topics/vendor-lock-in.md>), [observability](<https://devfeed.tech/topics/observability.md>)

Tags: [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [data-management](<https://devfeed.tech/tags/data-management.md>), [data-management-databases](<https://devfeed.tech/tags/data-management-databases.md>), [databases](<https://devfeed.tech/tags/databases.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [language-en](<https://devfeed.tech/tags/language-en.md>), [observability](<https://devfeed.tech/tags/observability.md>), [platform](<https://devfeed.tech/tags/platform.md>), [storytype-opinion](<https://devfeed.tech/tags/storytype-opinion.md>)

### AI overview

A five-person contact center observability startup faced a prospective bank customer expecting five times its usual traffic, while a flaky hosted Elasticsearch setup and slow vendor support threatened customer commitments. The founders estimated that onboarding the bank without changing course would tie up three engineers in infrastructure work. Before launch, they moved to open source OpenSearch and had NetApp Instaclustr manage it and Postgres, later adding ClickHouse clusters. A key requirement was keeping data within their own environment for regulated customers. They report reclaiming more than 6,200 engineering hours annually, processing over 500 million interactions, and seeing fewer performance scares and routine failovers and upgrades. The author presents early evaluation as a way to make infrastructure choices on a planned schedule, while noting that running infrastructure in-house can be a real advantage for some companies.

### Source excerpt

Just about every CTO at a growth-stage company that I know is carrying an infrastructure problem they are quietly deciding not to look at. The system works, so the problem stays out of sight right up until something drags it into the open. That "something," in our particular case, was a large UK-based bank. The new customer arrived with the expectation of five times our usual traffic. For a nascent startup, the product-market fit really began to feel real. It's also in this moment that what had previously been seen as a technical chore can morph into a business risk. We're a contact center observability platform, so our work runs on processing especially large volumes of real-time interaction data for some of the world's largest contact centers. A couple years ago we were five engineers, and we ran our own data infrastructure. Frankly we were proud of it, enough that it showed up in our pitch. When that bank prospect came along, our reflex was to treat its scale as one more thing we would, and could, handle in-house. The math, for its part, said otherwise, or at least not without breaking something we had promised our customers. The bank did not create that risk, which had been quietly compounding for the better part of a year. We were leaning on a hosted Elasticsearch setup that had gotten flaky, from a vendor who was not fast enough on support for us to honor the promises we were making to our own customers. We knew all of this, but by then had gotten used to working around it like you might ignore the rattle in your car hoping it will just work itself out. What the bank deal did, in an instant, was take away our ability to keep ignoring it. The data infrastructure debt you stop noticing This is the trap that I now watch other teams wander into constantly. The system keeps humming right up until it doesn't, ergo the problem never forces its way onto a roadmap. CTOs and other decision makers end up making the call only once the stakes have climbed high enough that

## Automated Keyword Generation Using LLMs in a High-Volume Data Virtualization Service

DevFeed: [Automated Keyword Generation Using LLMs in a High-Volume Data Virtualization Service](<https://devfeed.tech/articles/automated-keyword-generation-using-llms-in-a-high-volume-data-virtualization-service-112120.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.41893>)

Author: Saiful Khan, Yiwen Xing, Joyraj Chakraborty, Afrah Farea, Philip Beaucamp, Samuel Jackson, Min Chen

Published: 2026-11-02T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [data-virtualization](<https://devfeed.tech/tags/data-virtualization.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [llms](<https://devfeed.tech/tags/llms.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [search](<https://devfeed.tech/tags/search.md>), [strategies](<https://devfeed.tech/tags/strategies.md>)

### AI overview

The proposed keyword generation service uses large language models to help users find existing virtual datasets in high-volume data virtualization services. It tests five strategies for selecting text to process across five application case studies, using three LLM generators and two embedding techniques. Strategy performance depends on the quality of the text descriptions, so the reported results motivate a multi-strategy implementation in an extended DVS. The supplied abstract does not specify individual strategy designs or comparative results.

### Source excerpt

arXiv:2610.41893v1 Announce Type: new Abstract: In modern data infrastructure, a data virtualization service (DVS) allows users to create many versions of source datasets for different processing tasks. For example, a multivariate or multi-modality dataset can be used for different machine learning tasks (e.g., classification, detection, segmentation, forecasting, and so on). Data selection, participation, integration, and preprocessing in different tasks result in many virtual datasets [Khan et al., SSC 2026]. Meanwhile, different users need to discover existing virtual datasets frequently and easily to avoid duplicate efforts. To enable an effective search engine in a DVS, it is desirable to automatically generate keywords for each virtual dataset. In this work, we present a solution for generating keywords for virtual datasets using large language models (LLMs). We propose five strategies for selecting different collections of text data for processing by the LLMs. We applied the five strategies to virtual datasets created in five application case studies with different source datasets. We conducted experiments with three LLM generators and two embedding techniques. The experiments show that the performances of the five strategies depend on the quality of the text descriptions. The results help us adopt a multi-strategy implementation of a new keyword generation service (KGS) as part of an extended DVS. The work demonstrates that the capability of automated keyword generation is indispensable for a high-volume DVS that is dataset-rich and frequently accessed.

## Databricks and SAP unleash end-to-end data & AI capabilities to level up enterprise AI transformation

DevFeed: [Databricks and SAP unleash end-to-end data & AI capabilities to level up enterprise AI transformation](<https://devfeed.tech/articles/databricks-and-sap-unleash-end-to-end-data-ai-capabilities-to-level-up-enterprise-ai-transformation-109746.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/databricks-and-sap-unleash-end-end-data-ai-capabilities-level-enterprise-ai-transformation>)

Author: Sanjay Chheda; Katie Cummiskey; Patrick Werns; Akram Chetibi; Qi Su

Published: 2026-10-30T21:00:00Z

Content type: release

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [data-governance](<https://devfeed.tech/topics/data-governance.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Predictive AI](<https://devfeed.tech/topics/predictive-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-platform](<https://devfeed.tech/tags/ai-platform.md>), [ai-transformation](<https://devfeed.tech/tags/ai-transformation.md>), [ai-value](<https://devfeed.tech/tags/ai-value.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analyze](<https://devfeed.tech/tags/analyze.md>), [application](<https://devfeed.tech/tags/application.md>), [business](<https://devfeed.tech/tags/business.md>), [capabilities](<https://devfeed.tech/tags/capabilities.md>), [data](<https://devfeed.tech/tags/data.md>), [data-ai](<https://devfeed.tech/tags/data-ai.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [models](<https://devfeed.tech/tags/models.md>), [partners](<https://devfeed.tech/tags/partners.md>), [platform](<https://devfeed.tech/tags/platform.md>), [sap](<https://devfeed.tech/tags/sap.md>)

### AI overview

Databricks and SAP plan to bring the expanded Databricks data and enterprise AI capabilities into SAP Databricks within SAP Business Data Cloud (BDC). SAP Application Data Foundation provides cloud-native access to SAP application data through BDC, including SAP Databricks, and is intended to reduce reliance on custom extraction pipelines, lower total cost of ownership, and shorten time to value. The text describes a manufacturer using it to work with years of SAP ECC order history, enrich it with third-party data, and build demand forecasts on SAP business semantics while moving to the cloud. It also reports that SAF-Holland uses SAP BDC and Databricks to unify more than 100 million records and predict delivery schedule reliability; the company says analyses are five times faster than traditional reporting. SAP Databricks and BDC Connect for Databricks are available today; the newly described foundation and expanded capabilities are presented as the next partnership phase.

### Source excerpt

Today's AI models are more capable than ever. What they still lack is the business...

## SPECTRUM: A Strategic Framework and Technical Blueprint for European Exascale Research Data and Compute Infrastructure

DevFeed: [SPECTRUM: A Strategic Framework and Technical Blueprint for European Exascale Research Data and Compute Infrastructure](<https://devfeed.tech/articles/spectrum-a-strategic-framework-and-technical-blueprint-for-european-exascale-research-data-and-compute-infrastructure-107595.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.40493>)

Author: Sergio Andreozzi, Stefano Bagnasco, Florian Berberich, Tommaso Boccali, Concezio Bozzi, Luis Cifuentes, Luca dell'Agnello, Ama\\"el Ellien, Chiara Ferrari, Luciano Gaido, Maria Girone, Hanno Holties, H

Published: 2026-10-30T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Big data infrastructure](<https://devfeed.tech/topics/big-data-infrastructure.md>)

Tags: [actions](<https://devfeed.tech/tags/actions.md>), [astro-ph-im](<https://devfeed.tech/tags/astro-ph-im.md>), [astronomy](<https://devfeed.tech/tags/astronomy.md>), [blueprint](<https://devfeed.tech/tags/blueprint.md>), [compute](<https://devfeed.tech/tags/compute.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [data](<https://devfeed.tech/tags/data.md>), [framework](<https://devfeed.tech/tags/framework.md>), [funding](<https://devfeed.tech/tags/funding.md>), [impact](<https://devfeed.tech/tags/impact.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [innovation](<https://devfeed.tech/tags/innovation.md>), [investment](<https://devfeed.tech/tags/investment.md>), [radio-astronomy](<https://devfeed.tech/tags/radio-astronomy.md>), [research](<https://devfeed.tech/tags/research.md>), [roadmap](<https://devfeed.tech/tags/roadmap.md>), [scale](<https://devfeed.tech/tags/scale.md>), [spectrum](<https://devfeed.tech/tags/spectrum.md>), [strategic-research](<https://devfeed.tech/tags/strategic-research.md>), [technical](<https://devfeed.tech/tags/technical.md>), [use-cases](<https://devfeed.tech/tags/use-cases.md>)

### AI overview

SPECTRUM addresses the coming exabyte-scale data demands of HiLumi LHC, SKA Observatory and LOFAR 2.0 with two linked planning documents. Its Technical Blueprint maps a European compute and data continuum, consolidates gaps across High Energy Physics, Radio Astronomy and related use cases, and recommends actions in eight technical areas. Its Strategic Research, Innovation and Deployment Agenda sets thirteen priorities across four pillars, connects them to investment areas and European funding instruments, and phases them against the facilities' timelines. The paper summarizes both documents, their consultative method and the SRIDA's expected impact.

### Source excerpt

arXiv:2610.40493v1 Announce Type: new Abstract: The HiLumi LHC, the SKA Observatory and LOFAR 2.0 will take High Energy Physics (HEP) and Radio Astronomy (RA) towards exabyte-scale data within the next decade, beyond the capacity of today's infrastructure. The SPECTRUM project responded with two documents built on the same evidence. A Technical Blueprint describes a European compute and data continuum as a capability map, consolidates the gaps found in HEP, RA and related use cases, and recommends technical actions in eight areas. A Strategic Research, Innovation and Deployment Agenda (SRIDA) organises thirteen priorities in four pillars, maps them to investment areas and European funding instruments, and phases them over a roadmap set against the timelines of the three instruments. This paper, by editors and contributors of both documents, summarises them, their consultative method and the impact the SRIDA expects.

## From Spreadsheets to DuckLake: A Data Engineer's Road to DuckDB

DevFeed: [From Spreadsheets to DuckLake: A Data Engineer's Road to DuckDB](<https://devfeed.tech/articles/from-spreadsheets-to-ducklake-a-data-engineer-s-road-to-duckdb-107420.md>)

Original publisher: [Read original article](<https://duckdb.org/2026/10/29/from-spreadsheets-to-ducklake.html>)

Author: Tim Cox

Published: 2026-10-29T00:00:00Z

Content type: article

Language: en

Sources: [DuckDB](<https://devfeed.tech/sources/duckdb.md>)

Topics: [DuckDB](<https://devfeed.tech/topics/duckdb.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [big-data](<https://devfeed.tech/topics/big-data.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [2016](<https://devfeed.tech/tags/2016.md>), [2022](<https://devfeed.tech/tags/2022.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [automated](<https://devfeed.tech/tags/automated.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [big-data](<https://devfeed.tech/tags/big-data.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [complexity](<https://devfeed.tech/tags/complexity.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [duckdb](<https://devfeed.tech/tags/duckdb.md>), [ducklake](<https://devfeed.tech/tags/ducklake.md>), [engineer](<https://devfeed.tech/tags/engineer.md>), [martin](<https://devfeed.tech/tags/martin.md>), [sql](<https://devfeed.tech/tags/sql.md>), [tester](<https://devfeed.tech/tags/tester.md>), [using-duckdb](<https://devfeed.tech/tags/using-duckdb.md>)

### AI overview

Matt Martin's experience suggests many analytical workloads can use DuckDB and DuckLake without the operational overhead he encountered with Spark. DuckDB lets him query local files, S3 data, and combinations of CSV, Parquet, and Iceberg using familiar SQL. For DuckLake, metadata resides in a SQL database; Martin reports catalog operations under a millisecond in his experience, compared with seconds for Iceberg, and says setup on object storage takes two statements. In the v2.0 alpha, he highlights dynamic ATTACH expressions and asynchronous I/O, which cut his S3 file-reading benchmark times by 67%-70% without query changes. He also describes Quack for serving DuckLake remotely. These are his experience and benchmarks; he argues infrastructure should match workload requirements rather than assuming distributed systems are always needed.

### Source excerpt

After nearly two decades working with increasingly sophisticated data infrastructure, data engineer [Matt Martin](https://www.linkedin.com/in/mattmartin14/) discovered DuckDB could handle many of the analytical tasks he cared about without the operational complexity he had come to associate with big data. The same preference for familiar SQL and simpler infrastructure drew him to DuckLake, and he has since become an active tester and advocate of DuckDB's evolving capabilities.

## Dell expands cyber recovery tools to protect identity

DevFeed: [Dell expands cyber recovery tools to protect identity](<https://devfeed.tech/articles/dell-expands-cyber-recovery-tools-to-protect-identity-102656.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/10/27/dell-adds-identity-resilience-cyber-recovery-tools-aicybersecurityandresiliencesummit/>)

Author: Sloane Kali Faye

Published: 2026-10-27T22:16:01Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [cyber resiliency](<https://devfeed.tech/topics/cyber-resiliency.md>), [dell](<https://devfeed.tech/topics/dell.md>), [identity and access management](<https://devfeed.tech/topics/identity-and-access-management.md>), [Disaster Recovery](<https://devfeed.tech/topics/disaster-recovery.md>), [credential-based attacks](<https://devfeed.tech/topics/credential-based-attacks.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Entra ID](<https://devfeed.tech/topics/entra-id.md>), [okta](<https://devfeed.tech/topics/okta.md>)

Tags: [active-directory](<https://devfeed.tech/tags/active-directory.md>), [adam-miller](<https://devfeed.tech/tags/adam-miller.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-identity](<https://devfeed.tech/tags/agentic-identity.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-cybersecurity-and-resilience-summit-2026](<https://devfeed.tech/tags/ai-cybersecurity-and-resilience-summit-2026.md>), [ai-governance](<https://devfeed.tech/tags/ai-governance.md>), [ai-threat-strategies](<https://devfeed.tech/tags/ai-threat-strategies.md>), [aicybersecurityandresiliencesummit](<https://devfeed.tech/tags/aicybersecurityandresiliencesummit.md>), [aicybersecurityandresiliencesummit26eventpage](<https://devfeed.tech/tags/aicybersecurityandresiliencesummit26eventpage.md>), [applications](<https://devfeed.tech/tags/applications.md>), [cube-event-coverage](<https://devfeed.tech/tags/cube-event-coverage.md>), [cyber](<https://devfeed.tech/tags/cyber.md>), [cyber-recovery](<https://devfeed.tech/tags/cyber-recovery.md>), [cyberattack](<https://devfeed.tech/tags/cyberattack.md>), [data](<https://devfeed.tech/tags/data.md>), [data-protection](<https://devfeed.tech/tags/data-protection.md>), [dave-vellante](<https://devfeed.tech/tags/dave-vellante.md>), [dell](<https://devfeed.tech/tags/dell.md>), [dell-ai-factory](<https://devfeed.tech/tags/dell-ai-factory.md>), [dell-cyber-detect](<https://devfeed.tech/tags/dell-cyber-detect.md>), [dell-technologies](<https://devfeed.tech/tags/dell-technologies.md>), [dell-technologies-inc](<https://devfeed.tech/tags/dell-technologies-inc.md>), [entra-id](<https://devfeed.tech/tags/entra-id.md>), [identity](<https://devfeed.tech/tags/identity.md>), [identity-infrastructure](<https://devfeed.tech/tags/identity-infrastructure.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [news](<https://devfeed.tech/tags/news.md>), [nyse-dell](<https://devfeed.tech/tags/nyse-dell.md>), [objectscale](<https://devfeed.tech/tags/objectscale.md>), [okta](<https://devfeed.tech/tags/okta.md>), [powerprotect](<https://devfeed.tech/tags/powerprotect.md>), [powerscale](<https://devfeed.tech/tags/powerscale.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [resilience](<https://devfeed.tech/tags/resilience.md>), [rob-emsley](<https://devfeed.tech/tags/rob-emsley.md>), [secure-ai-foundations](<https://devfeed.tech/tags/secure-ai-foundations.md>), [security-infrastructure](<https://devfeed.tech/tags/security-infrastructure.md>), [siliconangle](<https://devfeed.tech/tags/siliconangle.md>), [thecube](<https://devfeed.tech/tags/thecube.md>)

### AI overview

Dell is extending its PowerProtect cyber recovery portfolio to include resilience for Active Directory, Entra ID and Okta, so trusted identities can be restored before applications and data. Its managed detection and response service is adding identity threat detection and automated responses to suspicious use of legitimate credentials. For AI infrastructure, PowerProtect will be an option in Dell AI Factory, with snapshot orchestration extended to PowerScale and replication to ObjectScale. Dell also recommends making security and resilience part of AI architecture from the start and testing recovery through tabletop exercises and end-to-end ransomware simulations. Miller reports that one customer improved backup-to-recovery efficiency 17 times after restructuring its approach. The account includes Dell-sponsored interview material; these are reported company capabilities and claims.

### Source excerpt

Restoring data after a cyberattack isn't enough if the identity systems that control access are compromised. Dell Technologies Inc. is extending its cyber recovery tools to cover those systems, putting identity resilience alongside data protection. That gap is widening as AI ties data, identity, infrastructure and applications into interdependent systems, making data protection a core [...] The post Dell expands cyber recovery tools to protect identity appeared first on SiliconANGLE.

## What is a data catalog? Types, examples, and tools

DevFeed: [What is a data catalog? Types, examples, and tools](<https://devfeed.tech/articles/what-is-a-data-catalog-types-examples-and-tools-136766.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/data-catalog>)

Author: Kendra Leverette

Published: 2026-10-27T20:00:55Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [data analyst](<https://devfeed.tech/topics/data-analyst.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [bi-tools](<https://devfeed.tech/topics/bi-tools.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-assisted](<https://devfeed.tech/tags/ai-assisted.md>), [ai-readiness](<https://devfeed.tech/tags/ai-readiness.md>), [amazon-athena](<https://devfeed.tech/tags/amazon-athena.md>), [amazon-emr](<https://devfeed.tech/tags/amazon-emr.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [apache](<https://devfeed.tech/tags/apache.md>), [business](<https://devfeed.tech/tags/business.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [compare](<https://devfeed.tech/tags/compare.md>), [data-catalog](<https://devfeed.tech/tags/data-catalog.md>), [examples](<https://devfeed.tech/tags/examples.md>), [right](<https://devfeed.tech/tags/right.md>), [technical](<https://devfeed.tech/tags/technical.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tools](<https://devfeed.tech/tags/tools.md>), [types](<https://devfeed.tech/tags/types.md>), [what-is](<https://devfeed.tech/tags/what-is.md>)

### AI overview

A data catalog is a searchable inventory of data assets that records their location, structure, ownership, and business meaning, helping people and AI agents find suitable data. Technical catalogs emphasize schemas, column-level lineage, and detailed permissions; business catalogs add plain-language definitions, owners, and approval status, with higher-level lineage. The excerpt says growing teams often use both. Examples include AWS Glue Data Catalog and Databricks Unity Catalog for technical use, and Alation, Collibra, and Atlan for business use; Apache Polaris supports Iceberg tables through the Iceberg REST API. When comparing tools, assess source coverage, automated lineage, governance controls, AI-assisted search, and usability for analysts and stewards. Catalog accuracy depends on metadata staying synchronized with source changes.

### Source excerpt

Learn what a data catalog is and how technical and business data catalogs compare. Explore data catalog examples, along with tips to select the right tool.

## What is a data catalog? Types, examples, and tools

DevFeed: [What is a data catalog? Types, examples, and tools](<https://devfeed.tech/articles/what-is-a-data-catalog-types-examples-and-tools-102831.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/data-catalog>)

Author: Kendra Leverette

Published: 2026-10-27T20:00:55Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [bi-tools](<https://devfeed.tech/topics/bi-tools.md>), [data analyst](<https://devfeed.tech/topics/data-analyst.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-readiness](<https://devfeed.tech/tags/ai-readiness.md>), [business](<https://devfeed.tech/tags/business.md>), [data-catalog](<https://devfeed.tech/tags/data-catalog.md>), [examples](<https://devfeed.tech/tags/examples.md>), [technical](<https://devfeed.tech/tags/technical.md>), [tools](<https://devfeed.tech/tags/tools.md>), [types](<https://devfeed.tech/tags/types.md>)

### AI overview

A data catalog is a searchable inventory of datasets that records their location, structure, business meaning, ownership, and related metadata. Search, automated metadata collection, lineage, classification and access controls, and glossaries help teams find approved data, understand dependencies, and manage sensitive fields. Technical catalogs focus on schemas, permissions, and detailed lineage for engineers; business catalogs add definitions, owners, and certification for analysts and stewards, and depend on accurate technical metadata. Examples include AWS Glue Data Catalog, Databricks Unity Catalog, and Apache Polaris for technical use, and Alation, Collibra, and Atlan for business use, with different capabilities described for each. Tool selection criteria include source coverage, automated lineage, governance, AI assisted search, and usability. To create a catalog, list source systems, connect a tool to scan schemas and lineage, then add definitions, owners, and access policies. Catalog accuracy depends on changes in source pipelines reaching it.

### Source excerpt

Learn what a data catalog is and how technical and business data catalogs compare. Explore data catalog examples, along with tips to select the right tool.

## What Okta learned governing context for AI agents at scale

DevFeed: [What Okta learned governing context for AI agents at scale](<https://devfeed.tech/articles/what-okta-learned-governing-context-for-ai-agents-at-scale-101841.md>)

Original publisher: [Read original article](<https://www.getdbt.com/blog/okta-ai-agent-context-governance>)

Author: Daniel Poppy

Published: 2026-10-26T22:14:00Z

Content type: news

Language: en

Sources: [dbt Labs](<https://devfeed.tech/sources/dbt-labs.md>)

Topics: [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [context](<https://devfeed.tech/topics/context.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [business logic](<https://devfeed.tech/topics/business-logic.md>), [okta](<https://devfeed.tech/topics/okta.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [context](<https://devfeed.tech/tags/context.md>), [context-for-ai-agents](<https://devfeed.tech/tags/context-for-ai-agents.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [learn](<https://devfeed.tech/tags/learn.md>), [okta](<https://devfeed.tech/tags/okta.md>), [scale](<https://devfeed.tech/tags/scale.md>), [source](<https://devfeed.tech/tags/source.md>), [source-of-truth](<https://devfeed.tech/tags/source-of-truth.md>)

### AI overview

Okta found that governing what AI agents can see and trust was harder than building the agents. Its early Snowflake semantic views were disconnected from dbt's business logic, lacked an external catalog and auditability, and bundled instructions without distinguishing stable knowledge from information to look up. The team moved governance into a three-layer dbt framework: model and column metadata for safe uses, exclusions and automatic filters; Markdown docs for company facts and domain routing; and PR-reviewed semantic views for facts, dimensions and metrics. A custom skill converts existing Snowflake semantic-view DDL into dbt specs. The layers sync to Agents Schema: Claude reads metadata over MCP and docs as Markdown, while Cortex uses a search service and its own skill configuration. Both therefore use the same context through different interfaces, and a merged dbt change reaches consuming agents without separate config edits. Planned work includes regression tests, broader domain coverage and feedback from agent answers into context docs; these are future plans, not reported capabilities.

### Source excerpt

Okta rebuilt how it governs context for AI agents, using dbt as the single source of truth.

## What Are Data Lineage Tools?

DevFeed: [What Are Data Lineage Tools?](<https://devfeed.tech/articles/what-are-data-lineage-tools-101122.md>)

Original publisher: [Read original article](<https://blog.everpuredata.com/purely-technical/data-lineage-tools/>)

Author: Everpure

Published: 2026-10-26T20:48:46Z

Content type: article

Language: en

Sources: [Everpure](<https://devfeed.tech/sources/everpure.md>)

Topics: [Tool](<https://devfeed.tech/topics/tool.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [airflow](<https://devfeed.tech/tags/airflow.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-flink](<https://devfeed.tech/tags/apache-flink.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [api](<https://devfeed.tech/tags/api.md>), [applications](<https://devfeed.tech/tags/applications.md>), [audit](<https://devfeed.tech/tags/audit.md>), [audits](<https://devfeed.tech/tags/audits.md>), [automated](<https://devfeed.tech/tags/automated.md>), [automated-data-lineage](<https://devfeed.tech/tags/automated-data-lineage.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [bi](<https://devfeed.tech/tags/bi.md>), [build](<https://devfeed.tech/tags/build.md>), [business](<https://devfeed.tech/tags/business.md>), [data-lineage](<https://devfeed.tech/tags/data-lineage.md>), [everpure-engineering](<https://devfeed.tech/tags/everpure-engineering.md>), [tools](<https://devfeed.tech/tags/tools.md>), [types](<https://devfeed.tech/tags/types.md>)

### AI overview

Data lineage tools map data flows and transformations to trace origins and identify downstream impact. They capture lineage by parsing code (including legacy jobs, but not all runtime-generated SQL), collecting runtime events such as OpenLineage (which reflect what ran), or using platform-native query history (thorough within one platform but limited across systems); deployments may combine methods. Column-level and indirect lineage can reveal effects of joins and filters that table-level or direct lineage misses. Tool categories include open-source metadata platforms, governance catalogs, platform-native features, transformation and observability tools, and code-parsing specialists, with differing scope and operational responsibilities. Evaluation depends on connector coverage, granularity, standards support, freshness, technical and business views, context, and export options. Lineage alone does not identify sensitive data or permitted use; discovery and classification supply that context for governance. The article notes that feature sets change and recommends checking current documentation.

### Source excerpt

What Are Data Lineage Tools? by Everpure Blog Explore how data lineage tools map data flows, compare the main tool types, and what to consider when choosing one. The post What Are Data Lineage Tools? appeared first on Everpure Blog.

## Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran

DevFeed: [Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran](<https://devfeed.tech/articles/governing-your-lakehouse-with-fivetran-managed-data-lake-service-blog-fivetran-136781.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/governing-your-lakehouse-with-fivetran-managed-data-lake-service>)

Author: Andrew Madson

Published: 2026-10-13T16:41:32Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Management](<https://devfeed.tech/topics/data-management.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [data ownership](<https://devfeed.tech/topics/data-ownership.md>), [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Security, Identity, & Compliance](<https://devfeed.tech/topics/security-identity-compliance.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [schema-evolution](<https://devfeed.tech/topics/schema-evolution.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-polaris](<https://devfeed.tech/tags/apache-polaris.md>), [athena](<https://devfeed.tech/tags/athena.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [automated](<https://devfeed.tech/tags/automated.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-privatelink](<https://devfeed.tech/tags/aws-privatelink.md>), [azure](<https://devfeed.tech/tags/azure.md>), [biglake](<https://devfeed.tech/tags/biglake.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [governance](<https://devfeed.tech/tags/governance.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [lifecycle](<https://devfeed.tech/tags/lifecycle.md>)

### AI overview

The excerpt presents Fivetran Managed Data Lake governance as a single-source-of-truth model: Fivetran alone writes Iceberg metadata, while query engines read it, and Fivetran republishes the correct version if AWS Glue drifts. Engines can use the Iceberg REST Catalog with OAuth2; Athena and Redshift require Glue integration enabled at destination setup, a permanent choice with regional and naming constraints. Access controls include short-lived, table-scoped S3 credentials, cross-account IAM, and optional KMS, Lake Formation, and Business Critical PrivateLink configuration. Automated retention, metadata version cleanup, biweekly orphan-file removal, compaction, deduplication, and schema evolution address lifecycle work. The excerpt warns against manual catalog changes and raw Parquet queries, and notes cloud-specific catalog requirements, including BigQuery Admin access for GCS BigLake.

### Source excerpt

Lakehouse governance requires observability, access control, data lifecycle management, and more. Fivetran MDLS makes it easy.

## What Is Agentic Data Infrastructure?

DevFeed: [What Is Agentic Data Infrastructure?](<https://devfeed.tech/articles/what-is-agentic-data-infrastructure-84819.md>)

Original publisher: [Read original article](<https://www.starburst.io/blog/what-is-agentic-data-infrastructure>)

Published: 2026-10-06T08:00:12Z

Content type: article

Language: en

Sources: [Starburst Data](<https://devfeed.tech/sources/starburst-data.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [context-architecture](<https://devfeed.tech/topics/context-architecture.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>)

### AI overview

Agentic data infrastructure combines governed federated access, business context for grounding AI agents, and reusable AI-ready data products. This article explains why conventional data platforms can leave agents without trusted data or clear definitions, and outlines how organizations can extend existing platforms with governance, context, and reusable data products.

### Source excerpt

Enterprises are moving past AI copilots that answer questions and into AI agents that take ...

## NetApp's Novus tackles metadata bottlenecks in AI data infrastructure

DevFeed: [NetApp's Novus tackles metadata bottlenecks in AI data infrastructure](<https://devfeed.tech/articles/netapp-s-novus-tackles-metadata-bottlenecks-in-ai-data-infrastructure-65247.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/10/05/netapps-novus-targets-ai-data-infrastructure-zettabyte-scale-netappinsight/>)

Author: Sloane Kali Faye

Published: 2026-10-05T22:58:23Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Big data infrastructure](<https://devfeed.tech/topics/big-data-infrastructure.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [data centers](<https://devfeed.tech/topics/data-centers.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-data-engine](<https://devfeed.tech/tags/ai-data-engine.md>), [ai-data-infrastructure](<https://devfeed.tech/tags/ai-data-infrastructure.md>), [christophe-bertrand](<https://devfeed.tech/tags/christophe-bertrand.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [cube-event-coverage](<https://devfeed.tech/tags/cube-event-coverage.md>), [data](<https://devfeed.tech/tags/data.md>), [enterprise-storage](<https://devfeed.tech/tags/enterprise-storage.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpu-clusters](<https://devfeed.tech/tags/gpu-clusters.md>), [gunna-marripudi](<https://devfeed.tech/tags/gunna-marripudi.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [linux](<https://devfeed.tech/tags/linux.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [nasdaq-ntap](<https://devfeed.tech/tags/nasdaq-ntap.md>), [netapp-inc](<https://devfeed.tech/tags/netapp-inc.md>), [netapp-insight](<https://devfeed.tech/tags/netapp-insight.md>), [netapp-insight-2026](<https://devfeed.tech/tags/netapp-insight-2026.md>), [netapp-novus-data](<https://devfeed.tech/tags/netapp-novus-data.md>), [netapp-s-ai-data-engine](<https://devfeed.tech/tags/netapp-s-ai-data-engine.md>), [netappinsight](<https://devfeed.tech/tags/netappinsight.md>), [news](<https://devfeed.tech/tags/news.md>), [novus-data-director](<https://devfeed.tech/tags/novus-data-director.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [ontap](<https://devfeed.tech/tags/ontap.md>), [parallel-file-systems](<https://devfeed.tech/tags/parallel-file-systems.md>), [peak-aio](<https://devfeed.tech/tags/peak-aio.md>), [pnfs](<https://devfeed.tech/tags/pnfs.md>), [production](<https://devfeed.tech/tags/production.md>), [production-ai](<https://devfeed.tech/tags/production-ai.md>), [rebecca-knight](<https://devfeed.tech/tags/rebecca-knight.md>), [storage](<https://devfeed.tech/tags/storage.md>), [syam-nair](<https://devfeed.tech/tags/syam-nair.md>), [thecube](<https://devfeed.tech/tags/thecube.md>)

### AI overview

NetApp presents Novus as an AI data infrastructure architecture designed to reduce metadata bottlenecks while scaling GPU workloads and making enterprise data accessible to AI models and agents. Its Data Director separates metadata from stored data, enabling independent scaling and a unified view across ONTAP clusters. NetApp says its AI Data Engine can discover, classify and vectorize enterprise data, while planned pNFS technology is intended to work alongside existing systems.

### Source excerpt

AI data infrastructure must support growing GPU clusters while making enterprise data usable for models and agents. NetApp Inc. is tying intelligent data infrastructure to production AI through a unified approach to storage and data management. Fragmented data and governance designed around manually applied policies can prevent enterprises from realizing returns on AI investments, according [...] The post NetApp's Novus tackles metadata bottlenecks in AI data infrastructure appeared first on SiliconANGLE.

[Next page](<https://devfeed.tech/topics/data-infrastructure.md?cursor=WyIyMDI2LTEwLTA1VDIyOjU4OjIzKzAwOjAwIiwgIjFiYWUwZWQxLTM3M2ItNDhkOC04MTk0LTgyN2ZlNzU4ZWZkYyJd>)