# Databricks

The Data and AI Company

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Interactive Databricks Reference Architectures Across 70 Industries

DevFeed: [Interactive Databricks Reference Architectures Across 70 Industries](<https://devfeed.tech/articles/interactive-databricks-reference-architectures-across-70-industries-146371.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/interactive-databricks-reference-architectures-across-70-industries>)

Author: Ashraf Osman; Amr Ali; Shelley Shaffery

Published: 2026-11-20T14:48:28Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [Big data infrastructure](<https://devfeed.tech/topics/big-data-infrastructure.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>)

Tags: [architectures](<https://devfeed.tech/tags/architectures.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [industries](<https://devfeed.tech/tags/industries.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [platform](<https://devfeed.tech/tags/platform.md>)

### AI overview

The Databricks Reference Architecture is a free, interactive board with versions for 70 industries and a standard industry-neutral view. Each board maps sector-specific source systems, data formats, teams, medallion layers, use cases, Genie Agents, dashboards, and apps around the shared Databricks Platform. Simplified and Detailed views serve different levels of detail. Region and release-stage filters show product availability based on public Databricks documentation, which is refreshed before board updates; automated update pipelines are planned. Boards work on Azure, AWS, and GCP, support 16 languages, and can be copied, edited, or exported in formats including PowerPoint, PDF, YAML, and Visio. The article presents each board as a starting point that should be adapted to a company's systems and constraints.

### Source excerpt

Why we built itMost Databricks architecture talks used to start with the same slide: ingestion on the left...

## Why PostgreSQL 19 shipped late

DevFeed: [Why PostgreSQL 19 shipped late](<https://devfeed.tech/articles/why-postgresql-19-shipped-late-144644.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/why-postgresql-19-shipped-late>)

Author: Jonathan Katz; Robert Haas

Published: 2026-11-19T22:04:02Z

Content type: news

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [Calculate Pi](<https://devfeed.tech/topics/calculate-pi.md>), [releases](<https://devfeed.tech/topics/releases.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [bug-fixes](<https://devfeed.tech/tags/bug-fixes.md>), [bugs](<https://devfeed.tech/tags/bugs.md>), [community](<https://devfeed.tech/tags/community.md>), [contributors](<https://devfeed.tech/tags/contributors.md>), [cves](<https://devfeed.tech/tags/cves.md>), [deferred](<https://devfeed.tech/tags/deferred.md>), [delay](<https://devfeed.tech/tags/delay.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [lakebase](<https://devfeed.tech/tags/lakebase.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [postgresql-19](<https://devfeed.tech/tags/postgresql-19.md>)

### AI overview

PostgreSQL 19 shipped several weeks later than usual because contributors spent time fixing a surge of bugs and security issues in supported branches, leaving less time to review the new release. The authors link the surge to people using newer LLMs to find and report bugs: quarterly updates rose from 1-4 CVEs each through November 2025 to 28 in August 2026, while back-patched commits also increased sharply. The project deferred features that were not ready, and a second release candidate included fixes from the November update. The authors describe the delay as a quality decision and say the community is adapting to AI-assisted bug discovery.

### Source excerpt

PostgreSQL 19 is now generally available, and there are some really cool things in...

## Genie One Accuracy: Why Curated Agents Need Governed Context

DevFeed: [Genie One Accuracy: Why Curated Agents Need Governed Context](<https://devfeed.tech/articles/genie-one-accuracy-why-curated-agents-need-governed-context-144361.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/genie-one-accuracy-why-curated-agents-need-governed-context>)

Author: Richa Sethi; Patrick Chan

Published: 2026-11-19T20:15:41Z

Content type: news

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [enhancing AI model accuracy](<https://devfeed.tech/topics/enhancing-ai-model-accuracy.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [1-5](<https://devfeed.tech/tags/1-5.md>), [2025](<https://devfeed.tech/tags/2025.md>), [2027](<https://devfeed.tech/tags/2027.md>), [about](<https://devfeed.tech/tags/about.md>), [access-control](<https://devfeed.tech/tags/access-control.md>), [account](<https://devfeed.tech/tags/account.md>), [added](<https://devfeed.tech/tags/added.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-instructions](<https://devfeed.tech/tags/agent-instructions.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [all](<https://devfeed.tech/tags/all.md>), [also](<https://devfeed.tech/tags/also.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [context](<https://devfeed.tech/tags/context.md>), [data-strategy](<https://devfeed.tech/tags/data-strategy.md>), [finance](<https://devfeed.tech/tags/finance.md>), [genie](<https://devfeed.tech/tags/genie.md>), [governed-context](<https://devfeed.tech/tags/governed-context.md>), [need](<https://devfeed.tech/tags/need.md>), [one](<https://devfeed.tech/tags/one.md>), [ratio](<https://devfeed.tech/tags/ratio.md>)

### AI overview

In the fictional insurance benchmark, Genie One reached 93-95% accuracy when curated team agents were combined with governed Unity Catalog knowledge, compared with 64% using tables alone and 83% for either addition by itself. Agents helped answer questions requiring team documents; Metric Views and Pages supplied authoritative business definitions, reducing reliance on unrelated Pages and making definition answers accurate despite variable routing. Planted draft and prompt-injection documents did not change answers. A smaller retailer benchmark showed overall accuracy rising from 54% to 82% when governed knowledge was added to agents. The excerpt also shows limits: Genie One may answer directly without inheriting agent instructions, documents available only through agent search need agents, and formulas left in agents can become stale after a governed definition changes. The results come from fictional datasets and benchmarks, including a smaller retail check.

### Source excerpt

Ask Finance and Underwriting whether the loss ratio improved from 2024 to 2025, and...

## Four AI Architecture Patterns for Regulated Industries

DevFeed: [Four AI Architecture Patterns for Regulated Industries](<https://devfeed.tech/articles/four-ai-architecture-patterns-for-regulated-industries-144360.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/ai-architecture-patterns-regulated-industries>)

Author: Molly Nagamuthu

Published: 2026-11-19T19:30:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-architecture](<https://devfeed.tech/tags/agent-architecture.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-architecture](<https://devfeed.tech/tags/ai-architecture.md>), [ai-native](<https://devfeed.tech/tags/ai-native.md>), [ai-transformation](<https://devfeed.tech/tags/ai-transformation.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [audit](<https://devfeed.tech/tags/audit.md>), [audit-trail](<https://devfeed.tech/tags/audit-trail.md>), [auditability](<https://devfeed.tech/tags/auditability.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [automated](<https://devfeed.tech/tags/automated.md>), [automation](<https://devfeed.tech/tags/automation.md>), [autonomy](<https://devfeed.tech/tags/autonomy.md>), [control](<https://devfeed.tech/tags/control.md>), [data-strategy](<https://devfeed.tech/tags/data-strategy.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [patterns](<https://devfeed.tech/tags/patterns.md>), [regulated-industries](<https://devfeed.tech/tags/regulated-industries.md>)

### AI overview

The article presents four ways to place agents within regulated systems while keeping controls and decision authority explicit: agents may investigate a deterministic control without deciding its result; generate candidates judged against objective, approved acceptance tests; assemble evidence and recommendations for an accountable human decision; or act within a defined operating envelope, with policy checks and escalation for exceptions. It stresses that passing validation does not prove the acceptance contract covers every production behavior, and that consequential recommendations need traceable evidence and specific explanations. In the access example, deterministic policy services validate conditions before Unity Catalog enforces a time-bound grant; out-of-envelope requests go to a human reviewer. The patterns can be combined. The article also names Databricks components for governance, agent composition, connectivity, and audit evidence, while noting that institution-specific implementations vary.

### Source excerpt

Enterprise AI cannot replace every deterministic control. These four patterns help...

## How partners use Genie's free tier on Azure Databricks

DevFeed: [How partners use Genie's free tier on Azure Databricks](<https://devfeed.tech/articles/how-partners-use-genie-s-free-tier-on-azure-databricks-144119.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/how-partners-use-genies-free-tier-azure-databricks>)

Author: David Meyer; Robert Saxby

Published: 2026-11-19T18:00:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>), [Azure](<https://devfeed.tech/topics/azure.md>)

Tags: [azure](<https://devfeed.tech/tags/azure.md>), [azure-databricks](<https://devfeed.tech/tags/azure-databricks.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [free](<https://devfeed.tech/tags/free.md>), [free-tier](<https://devfeed.tech/tags/free-tier.md>), [genie](<https://devfeed.tech/tags/genie.md>), [partners](<https://devfeed.tech/tags/partners.md>), [platform](<https://devfeed.tech/tags/platform.md>), [unity-catalog](<https://devfeed.tech/tags/unity-catalog.md>)

### AI overview

Every identified Azure Databricks user receives $10 of free monthly Genie usage, resetting on the first; through January 31, 2027, Genie One and Genie Agents are free, so the allowance goes to Genie Code, then is shared across all three. Admins can set shared, per-user or group thresholds for pay-as-you-go usage above the allowance, including alert-only or block settings. Budgets cannot remove the free allowance, but they are near-real-time estimates rather than hard caps: in-flight requests finish, actual spend may vary slightly, and warehouse compute is billed separately. Service principals have no free allowance. Partners can begin with a $0 pay-as-you-go threshold and expand as customers learn where Genie is useful. Genie connects governed Azure Databricks data to Teams, Microsoft 365 Copilot, Excel and Copilot Studio under Unity Catalog permissions; the generally available Genie Plugin adds Genie to Teams and Copilot, while some integrations remain in preview and may need extra setup or licensing. The excerpt says Copilot routes questions Genie can answer to Genie, avoiding those costs on the Copilot side.

### Source excerpt

Every Azure Databricks user gets $10 of free Genie usage each month, usage that many...

## Java4Shell vulnerability (CVE-2026-114938) assessment

DevFeed: [Java4Shell vulnerability (CVE-2026-114938) assessment](<https://devfeed.tech/articles/java4shell-vulnerability-cve-2026-114938-assessment-144121.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/java4shell-vulnerability-cve-2026-114938-assessment>)

Author: Fermín J. Serna

Published: 2026-11-19T17:00:00Z

Content type: news

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [cve remediation](<https://devfeed.tech/topics/cve-remediation.md>)

Tags: [assessment](<https://devfeed.tech/tags/assessment.md>), [cve](<https://devfeed.tech/tags/cve.md>), [cve-2026-114938](<https://devfeed.tech/tags/cve-2026-114938.md>), [disclosure](<https://devfeed.tech/tags/disclosure.md>), [java4shell](<https://devfeed.tech/tags/java4shell.md>), [mitigation](<https://devfeed.tech/tags/mitigation.md>), [openjdk](<https://devfeed.tech/tags/openjdk.md>), [openjdk-vulnerability](<https://devfeed.tech/tags/openjdk-vulnerability.md>), [patched](<https://devfeed.tech/tags/patched.md>), [patching](<https://devfeed.tech/tags/patching.md>), [performance](<https://devfeed.tech/tags/performance.md>), [platform](<https://devfeed.tech/tags/platform.md>), [products](<https://devfeed.tech/tags/products.md>), [products-services](<https://devfeed.tech/tags/products-services.md>), [public](<https://devfeed.tech/tags/public.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [runtimes](<https://devfeed.tech/tags/runtimes.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [services](<https://devfeed.tech/tags/services.md>), [vulnerability](<https://devfeed.tech/tags/vulnerability.md>)

### AI overview

As of November 19 at 10 AM Pacific, Databricks said it had mitigated CVE-2026-114938 across all supported Databricks Runtime versions by disabling the vulnerable code, with no expected meaningful performance impact. To apply the mitigation quickly, it proactively restarted affected clusters. Databricks planned patched Runtime versions as a further precaution: serverless customers would receive them automatically, while classic cluster customers would need to restart; Databricks was also contacting customers using custom images. The company reported no evidence of unauthorized access to its products, services, or customers' data.

### Source excerpt

As of November 19 at 10 AM Pacific Time:Prior to Java4Shell's public disclosure (CVE-2026-114938),...

## PostgreSQL 19 is available on Lakebase

DevFeed: [PostgreSQL 19 is available on Lakebase](<https://devfeed.tech/articles/postgresql-19-is-available-on-lakebase-144643.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/postgresql-19-available-lakebase>)

Author: Savannah Longoria

Published: 2026-11-19T15:31:46Z

Content type: release

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [Insight for DBAs](<https://devfeed.tech/topics/insight-for-dbas.md>), [releases](<https://devfeed.tech/topics/releases.md>)

Tags: [engineering](<https://devfeed.tech/tags/engineering.md>), [lakebase](<https://devfeed.tech/tags/lakebase.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [postgresql-19](<https://devfeed.tech/tags/postgresql-19.md>)

### AI overview

PostgreSQL 19 is available on Lakebase on the day of its general release. The article highlights operational controls: concurrent REPACK can reclaim space and cluster tables while reads and writes continue through most of the job, though it needs extra disk and replication-slot capacity, a suitable replica identity, and a brief final exclusive lock; long transactions can delay that lock, and the described implementation has tuple-change and snapshot-safety limitations. Planner advice can stabilize a diagnosed poor plan, but matching advice does not prove the plan is better. Other changes include parallel index vacuuming and richer diagnostics, logical replication improvements such as sequence synchronization, WAIT FOR LSN for replica read-after-write coordination, and imported remote statistics for postgres_fdw. The article recommends measured adoption, checking required extensions and changed defaults, and notes that PostgreSQL 19.1 is anticipated in February.

### Source excerpt

PostgreSQL 19 reached GA today and it's already available on Lakebase. New major...

## Databricks Wins A-Team Award for AI in Capital Markets

DevFeed: [Databricks Wins A-Team Award for AI in Capital Markets](<https://devfeed.tech/articles/databricks-wins-a-team-award-for-ai-in-capital-markets-142006.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/databricks-wins-team-award-ai-capital-markets-0>)

Author: Andrea DeSosa; Talia Visaggi; Erin Butler; Kim Hatton; Jamie Cosgrove; Eric Storm; Raouf Zaghab

Published: 2026-11-19T03:54:28Z

Content type: opinion

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [a-team](<https://devfeed.tech/tags/a-team.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-bricks](<https://devfeed.tech/tags/agent-bricks.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-apps](<https://devfeed.tech/tags/ai-apps.md>), [ai-assistants](<https://devfeed.tech/tags/ai-assistants.md>), [ai-coworker](<https://devfeed.tech/tags/ai-coworker.md>), [ai-governance](<https://devfeed.tech/tags/ai-governance.md>), [ai-platform](<https://devfeed.tech/tags/ai-platform.md>), [ai-strategy](<https://devfeed.tech/tags/ai-strategy.md>), [algorithmic-trading](<https://devfeed.tech/tags/algorithmic-trading.md>), [alpha](<https://devfeed.tech/tags/alpha.md>), [award](<https://devfeed.tech/tags/award.md>), [capital-markets](<https://devfeed.tech/tags/capital-markets.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [financial-services](<https://devfeed.tech/tags/financial-services.md>), [governance](<https://devfeed.tech/tags/governance.md>), [industries](<https://devfeed.tech/tags/industries.md>)

### AI overview

Databricks won the A-Team Group's 2026 award for Best AI Solution for Data Intelligence & Governance, with the article framing governed access to firms' proprietary data as key to deploying AI in regulated capital markets. RBC Capital Markets built Aiden QuickTakes on Databricks to unify ingestion, analysis and report drafting; the article says it can produce draft research reports up to 95% faster while maintaining security and governance standards. LSEG's partnership makes financial data available within the platform, and a Summit demonstration showed agents querying more than 350,000 investments in plain English. The excerpt also describes Unity Catalog permissions, request logging, inspectable SQL and lineage, and MCP connections to Teams, Excel, Claude and ChatGPT. These are vendor-reported examples; the excerpt does not independently assess outcomes or compare competing platforms.

### Source excerpt

Recognized for AI and governance, together.Capital markets have no shortage of AI...

## What's new for Genie in Microsoft: Copilot Cowork and Chat, Microsoft Teams, and Excel.

DevFeed: [What's new for Genie in Microsoft: Copilot Cowork and Chat, Microsoft Teams, and Excel.](<https://devfeed.tech/articles/what-s-new-for-genie-in-microsoft-copilot-cowork-and-chat-microsoft-teams-and-excel-140785.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/whats-new-genie-microsoft-copilot-cowork-and-chat-microsoft-teams-and-excel>)

Author: Kiriana Stukas; Toussaint Webb

Published: 2026-11-18T16:00:00Z

Content type: release

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Microsoft Teams](<https://devfeed.tech/topics/microsoft-teams.md>), [microsoft 365](<https://devfeed.tech/topics/microsoft-365.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [AI connector platforms](<https://devfeed.tech/topics/ai-connector-platforms.md>)

Tags: [actions](<https://devfeed.tech/tags/actions.md>), [admin](<https://devfeed.tech/tags/admin.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-365](<https://devfeed.tech/tags/agent-365.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-assistants](<https://devfeed.tech/tags/ai-assistants.md>), [calendar](<https://devfeed.tech/tags/calendar.md>), [chat](<https://devfeed.tech/tags/chat.md>), [copilot](<https://devfeed.tech/tags/copilot.md>), [copilot-cowork](<https://devfeed.tech/tags/copilot-cowork.md>), [cowork](<https://devfeed.tech/tags/cowork.md>), [email](<https://devfeed.tech/tags/email.md>), [excel](<https://devfeed.tech/tags/excel.md>), [files](<https://devfeed.tech/tags/files.md>), [genie](<https://devfeed.tech/tags/genie.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [microsoft-copilot](<https://devfeed.tech/tags/microsoft-copilot.md>), [microsoft-teams](<https://devfeed.tech/tags/microsoft-teams.md>), [partners](<https://devfeed.tech/tags/partners.md>), [platform](<https://devfeed.tech/tags/platform.md>), [teams](<https://devfeed.tech/tags/teams.md>), [what-s-new](<https://devfeed.tech/tags/what-s-new.md>)

### AI overview

Genie brings governed Azure Databricks data and business context into Microsoft Copilot Chat and Cowork, Teams, Excel, and Copilot Studio. Genie Ontology combines team-defined semantics such as certified definitions and metric views with context learned from dashboards, queries, and documents; it is described as generally available. Unity Catalog applies each user's data permissions, while Unity Gateway provides MCP policies, traces, and budget controls. In Teams, users can message Genie or mention it in a chat; Genie One is the default, and conversations can be pinned to a Genie Agent to scope answers to that agent's curated data and instructions. Teams setup requires an admin to add the app and set response visibility; users sign in to Databricks and choose a workspace. Private Link requires a context-based ingress policy. The Excel add-in answers plain-English questions with citations and can load results into workbooks. The Copilot Cowork plugin requires users to enable it, connect, and sign in, with no OAuth app registration or manifest edits. The native Teams app is the default choice described; Copilot Studio suits custom agents combining Genie Agents with other tools. Work

### Source excerpt

Most AI assistants can read a person's email, files, and calendar, but it can't tell...

## How AUMOVIO centralized AI access with Databricks Unity Gateway

DevFeed: [How AUMOVIO centralized AI access with Databricks Unity Gateway](<https://devfeed.tech/articles/how-aumovio-centralized-ai-access-with-databricks-unity-gateway-140784.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/how-aumovio-centralized-ai-access-databricks-unity-gateway>)

Author: Louis Rottmeier; Maximilian Fest; Michael Boesl; Michael Weber; Martin Gindler; Kelly Albano

Published: 2026-11-18T14:03:54Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [Access Control](<https://devfeed.tech/topics/access-control.md>), [Single sign-on (SSO)](<https://devfeed.tech/topics/sso.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [internal developer platform](<https://devfeed.tech/topics/internal-developer-platform.md>)

Tags: [adoption](<https://devfeed.tech/tags/adoption.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-coding](<https://devfeed.tech/tags/agentic-coding.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-adoption](<https://devfeed.tech/tags/ai-adoption.md>), [ai-application](<https://devfeed.tech/tags/ai-application.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [ai-cost](<https://devfeed.tech/tags/ai-cost.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-model](<https://devfeed.tech/tags/ai-model.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-platform](<https://devfeed.tech/tags/ai-platform.md>), [ai-spending](<https://devfeed.tech/tags/ai-spending.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [gateway](<https://devfeed.tech/tags/gateway.md>), [industries](<https://devfeed.tech/tags/industries.md>), [language](<https://devfeed.tech/tags/language.md>), [manufacturing](<https://devfeed.tech/tags/manufacturing.md>), [unity-gateway](<https://devfeed.tech/tags/unity-gateway.md>)

### AI overview

AUMOVIO centralized LLM access through Databricks Unity Gateway after separate provider integrations and use case gateways became harder to operate, attribute costs to, and govern consistently. Because its 1ADP data platform already runs on Databricks and uses Microsoft Entra ID, applications can exchange corporate identity tokens for access without separate accounts or distributed API keys. Curated 1adp-* aliases route to approved models across Databricks, Google Vertex AI, Azure OpenAI, AWS Bedrock and others; changing a provider or model does not require consumer code changes. Terraform manages endpoints, routing, fallback order, rate limits and guardrails. Central approvals, policies and usage tracking support governance; payload logging is off by default and requires explicit approved justification. AUMOVIO joins token usage with project or personal cost center assignments for dashboards and chargeback, and maintains its own curated catalog and employee AI app. Teams still test their chosen models, and AUMOVIO remains responsible for architecture, security and application quality. Its next phase is shared agents and managed or bring-your-own MCP connections, raising questions--

### Source excerpt

As AI adoption grew, AUMOVIO teams developed different ways to access large language...

## How we raised Databricks cluster rate limits by 7.5x

DevFeed: [How we raised Databricks cluster rate limits by 7.5x](<https://devfeed.tech/articles/how-we-raised-databricks-cluster-rate-limits-by-7-5-139643.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/how-we-raised-databricks-cluster-rate-limits-75>)

Author: Heqing Ya; Tan Zhang; Ankit Batra; Abhishek Rai

Published: 2026-11-18T02:30:31Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [rate-limiting](<https://devfeed.tech/topics/rate-limiting.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [scheduling](<https://devfeed.tech/topics/scheduling.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [about](<https://devfeed.tech/tags/about.md>), [account](<https://devfeed.tech/tags/account.md>), [adaptive](<https://devfeed.tech/tags/adaptive.md>), [added](<https://devfeed.tech/tags/added.md>), [after](<https://devfeed.tech/tags/after.md>), [aggregate](<https://devfeed.tech/tags/aggregate.md>), [all](<https://devfeed.tech/tags/all.md>), [allows](<https://devfeed.tech/tags/allows.md>), [also](<https://devfeed.tech/tags/also.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-infrastructure](<https://devfeed.tech/tags/cloud-infrastructure.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [compute](<https://devfeed.tech/tags/compute.md>), [compute-platform](<https://devfeed.tech/tags/compute-platform.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [limits](<https://devfeed.tech/tags/limits.md>), [platform](<https://devfeed.tech/tags/platform.md>), [team](<https://devfeed.tech/tags/team.md>)

### AI overview

Databricks raised default cluster-creation request-rate limits 7.5x by adding adaptive concurrency control for the longer provisioning workflows behind each API call. Each active workflow holds a slot through VM provisioning and dependency waits; health signals such as provisioning latency and thread-pool saturation guide the slot limit. When capacity falls, accepted requests queue and start more slowly; as conditions recover, concurrency increases cautiously. The fixed API rate limit remains a guardrail for exceptionally high traffic. This separates capacity management from request-rate enforcement, but a successful API response does not promise an immediate launch or fixed completion time. Queues need bounded size and wait times, and retries need backoff and attempt limits; concurrency limits cannot restore an unavailable dependency. The reported rollout raised default limits 7.5x, reduced cluster-creation rate-limit errors by more than 99.99% in the stated scope, and removed over a hundred customer-specific overrides in scope. Since the increase, few customers have hit the higher limits and no new manual overrides have been added.

### Source excerpt

As part of the Compute Platform team at Databricks, we turn cloud infrastructure...

## Azure Databricks sessions at Microsoft Ignite 2026

DevFeed: [Azure Databricks sessions at Microsoft Ignite 2026](<https://devfeed.tech/articles/azure-databricks-sessions-at-microsoft-ignite-2026-138348.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/azure-databricks-sessions-microsoft-ignite-2026>)

Author: Kiriana Stukas; Alexandra Harris

Published: 2026-11-17T19:00:00Z

Content type: news

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [Azure](<https://devfeed.tech/topics/azure.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Developer Events](<https://devfeed.tech/topics/developer-events.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-ready-data](<https://devfeed.tech/tags/ai-ready-data.md>), [amd](<https://devfeed.tech/tags/amd.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [audit](<https://devfeed.tech/tags/audit.md>), [azure](<https://devfeed.tech/tags/azure.md>), [azure-databricks](<https://devfeed.tech/tags/azure-databricks.md>), [azure-openai](<https://devfeed.tech/tags/azure-openai.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [ignite](<https://devfeed.tech/tags/ignite.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [microsoft-ignite](<https://devfeed.tech/tags/microsoft-ignite.md>), [microsoft-ignite-2026](<https://devfeed.tech/tags/microsoft-ignite-2026.md>), [partners](<https://devfeed.tech/tags/partners.md>), [platform](<https://devfeed.tech/tags/platform.md>), [sessions](<https://devfeed.tech/tags/sessions.md>), [sponsor](<https://devfeed.tech/tags/sponsor.md>)

### AI overview

Azure Databricks' Microsoft Ignite 2026 program focuses on moving AI from pilots into governed production, with Unity Catalog and integrations across Microsoft tools. Sessions include a hands-on walkthrough of fine-tuning NVIDIA Nemotron models with AI Runtime and NVIDIA NeMo, an EY audit use case with a live Genie demo in Teams and Copilot Cowork, and talks on Azure Government, storage, agents, and interoperability with OneLake, Fabric, Foundry and other Microsoft products. The lineup also covers Microsoft-led topics such as Agent 365, Work IQ and Cobalt 200. Attendees can visit Booth #5271R in The Hub November 17-19, use the Ask the Experts kiosk, or book an executive meeting at The Social @ Canopy Hotel November 17-18; no Ignite pass is required for those meetings.

### Source excerpt

Azure Databricks is a Visionary-level sponsor at Microsoft Ignite 2026, November...

## Advancing Catalog Interoperability with Unity Catalog and Google Cloud's Borderless Lakehouse

DevFeed: [Advancing Catalog Interoperability with Unity Catalog and Google Cloud's Borderless Lakehouse](<https://devfeed.tech/articles/advancing-catalog-interoperability-with-unity-catalog-and-google-cloud-s-borderless-lakehouse-138347.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/advancing-catalog-interoperability-unity-catalog-and-google-clouds-borderless-lakehouse>)

Author: Alex Jiang; Parth Desai; John Spencer

Published: 2026-11-17T16:30:00Z

Content type: release

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Databricks Unity Catalog integration](<https://devfeed.tech/topics/databricks-unity-catalog-integration.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [Local AI](<https://devfeed.tech/topics/local-ai.md>)

Tags: [accessible](<https://devfeed.tech/tags/accessible.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [business-context](<https://devfeed.tech/tags/business-context.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [column](<https://devfeed.tech/tags/column.md>), [community](<https://devfeed.tech/tags/community.md>), [context](<https://devfeed.tech/tags/context.md>), [copy](<https://devfeed.tech/tags/copy.md>), [google](<https://devfeed.tech/tags/google.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [governance](<https://devfeed.tech/tags/governance.md>), [interoperability](<https://devfeed.tech/tags/interoperability.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [open](<https://devfeed.tech/tags/open.md>), [partners](<https://devfeed.tech/tags/partners.md>), [platform](<https://devfeed.tech/tags/platform.md>), [unity-catalog](<https://devfeed.tech/tags/unity-catalog.md>)

### AI overview

The described Unity Catalog and Google Cloud Lakehouse integration enables access to the same data across platforms without copying it. Databricks can mount Iceberg tables managed by Google Cloud's Lakehouse runtime catalog through Lakehouse Federation for analysis in Databricks, its serverless data warehouse, or Genie, which answers natural-language questions without code or SQL. In the reverse direction, engines such as BigQuery can read Unity Catalog managed tables. The text also describes Iceberg catalog labels: key-value metadata on tables and columns can travel between catalogs, preserving governance context such as finance or certified tags and sensitive-data markers. The excerpt presents this shared metadata as useful for governance and agent context, but does not specify setup requirements or limitations.

### Source excerpt

The Lakehouse architecture is becoming more open than ever. What started with open...

## How packaged clean rooms bring RampID to your lakehouse

DevFeed: [How packaged clean rooms bring RampID to your lakehouse](<https://devfeed.tech/articles/how-packaged-clean-rooms-bring-rampid-to-your-lakehouse-138351.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/liveramp-rampid-identity-resolution-packaged-clean-rooms>)

Author: Ryan Werth; Johanna Hughes

Published: 2026-11-17T16:30:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [pii](<https://devfeed.tech/topics/pii.md>), [identity and access management](<https://devfeed.tech/topics/identity-and-access-management.md>)

Tags: [about](<https://devfeed.tech/tags/about.md>), [activation](<https://devfeed.tech/tags/activation.md>), [added](<https://devfeed.tech/tags/added.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-workloads](<https://devfeed.tech/tags/ai-workloads.md>), [aliases](<https://devfeed.tech/tags/aliases.md>), [all](<https://devfeed.tech/tags/all.md>), [allows](<https://devfeed.tech/tags/allows.md>), [also](<https://devfeed.tech/tags/also.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [api](<https://devfeed.tech/tags/api.md>), [assets](<https://devfeed.tech/tags/assets.md>), [audience-building](<https://devfeed.tech/tags/audience-building.md>), [audit](<https://devfeed.tech/tags/audit.md>), [audit-trail](<https://devfeed.tech/tags/audit-trail.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [identity](<https://devfeed.tech/tags/identity.md>), [marketing](<https://devfeed.tech/tags/marketing.md>), [partner](<https://devfeed.tech/tags/partner.md>), [partners](<https://devfeed.tech/tags/partners.md>), [pii](<https://devfeed.tech/tags/pii.md>), [platform](<https://devfeed.tech/tags/platform.md>)

### AI overview

LiveRamp Embedded Identity resolves customer records to RampIDs inside a Databricks packaged clean room, avoiding the export-and-match-file round trip. The customer and LiveRamp share Unity Catalog assets read-only through OpenSharing; data stays in each party's storage while provider code and identity graph remain hidden. Unlike an approval-based clean room, the packaged mode has no code-review step, and neither party can see the other's data assets. The customer triggers runs and receives RampID outputs; both parties can see run history and a shared output schema for troubleshooting. Requirements include a LiveRamp agreement and API credentials, a Unity Catalog workspace, CREATE CLEAN ROOM privilege, and prepared PII and metadata tables; SecureConnect is needed for storage behind a firewall or private endpoint. Outputs are retained for 30 days, after which desired results must be copied to customer storage. The clean-room creator pays Jobs Serverless compute for each run.

### Source excerpt

Partner identity resolution used to mean sending your PII to the vendorHistorically on Databricks...

## Built on object storage, served from cache

DevFeed: [Built on object storage, served from cache](<https://devfeed.tech/articles/built-on-object-storage-served-from-cache-138350.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/built-object-storage-served-cache>)

Author: Carlota Soto

Published: 2026-11-17T13:54:05Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Cache](<https://devfeed.tech/topics/cache.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [branch](<https://devfeed.tech/tags/branch.md>), [cache](<https://devfeed.tech/tags/cache.md>), [compute](<https://devfeed.tech/tags/compute.md>), [data](<https://devfeed.tech/tags/data.md>), [database](<https://devfeed.tech/tags/database.md>), [databases](<https://devfeed.tech/tags/databases.md>), [delta](<https://devfeed.tech/tags/delta.md>), [durability](<https://devfeed.tech/tags/durability.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [failover](<https://devfeed.tech/tags/failover.md>), [history](<https://devfeed.tech/tags/history.md>), [image](<https://devfeed.tech/tags/image.md>), [lakebase](<https://devfeed.tech/tags/lakebase.md>), [latency](<https://devfeed.tech/tags/latency.md>), [layer](<https://devfeed.tech/tags/layer.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [postgres](<https://devfeed.tech/tags/postgres.md>), [storage](<https://devfeed.tech/tags/storage.md>)

### AI overview

Lakebase Postgres uses object storage for durable history without putting it on the routine query read path. Reads check the compute node's local cache first, then pageserver NVMe, and reach object storage only on a pageserver miss; each tier caches fetched data. In the reported production sample, compute caches handled about 99.46% of page accesses, pageserver NVMe about 0.54%, and object storage about 39 requests per second--roughly one in 28 million accesses. Object-store fetches mainly served old branches or restores and databases waking after long idle periods; those initial reads become cached. Pageservers reconstruct requested page versions from image and delta layers, while eagerly creating base images reduced the reported p99 replay work to around six deltas. The excerpt also describes quorum-replicated WAL, asynchronous persistence of materialized history, and branching or restores as pointers to an LSN.

### Source excerpt

The common argument against running Postgres on object storage goes like this:Postgres...

## Clean data was never enough: How IFS Copperleaf taught AI its business with Databricks Genie One

DevFeed: [Clean data was never enough: How IFS Copperleaf taught AI its business with Databricks Genie One](<https://devfeed.tech/articles/clean-data-was-never-enough-how-ifs-copperleaf-taught-ai-its-business-with-databricks-genie-one-136416.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/clean-data-was-never-enough-how-ifs-copperleaf-taught-ai-its-business-databricks-genie-one-0>)

Author: Misagh Jebeli; Lisa Richter; Gabriela Cisneros; Sydney Sundell

Published: 2026-11-16T18:30:56Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [business](<https://devfeed.tech/tags/business.md>), [company](<https://devfeed.tech/tags/company.md>), [customers](<https://devfeed.tech/tags/customers.md>), [data](<https://devfeed.tech/tags/data.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [genie](<https://devfeed.tech/tags/genie.md>), [ifs](<https://devfeed.tech/tags/ifs.md>), [one](<https://devfeed.tech/tags/one.md>)

### AI overview

IFS Copperleaf built IONA on Databricks Genie One to let employees ask business questions across nearly 30 systems using shared definitions. Instead of modeling every table first, the team fully models high-stakes areas such as finance and the marketing-to-sales funnel, while letting IONA work with raw data elsewhere; this brought data into use sooner and focused modeling effort where accuracy matters most. Genie Ontology links business definitions to metrics, tables, dashboards and agents. Business owners can refine definitions within guardrails, while existing sign-on and access controls remain in force. IONA is available through Genie One and other workflows, including Teams, Copilot, the Genie mobile app and a Claude MCP plugin, with consistent definitions and permissions. Since its July launch, it has a reported 70% activation rate. In one service-desk workflow, a person approved each access change and 32 of 33 requests were closed in one pass. The excerpt also reports 68% repeat usage in the last 30 days and says released capacity covered running costs within four months.

### Source excerpt

IFS Copperleaf is a leading global provider of Asset Investment Planning (AIP) software...

## Talk to your clinical data: unlocking AWS HealthLake with OpenSharing and Genie One

DevFeed: [Talk to your clinical data: unlocking AWS HealthLake with OpenSharing and Genie One](<https://devfeed.tech/articles/talk-to-your-clinical-data-unlocking-aws-healthlake-with-opensharing-and-genie-one-136420.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/talk-your-clinical-data-unlocking-aws-healthlake-opensharing-and-genie-one>)

Author: Michael McCarthy; Lily Goldstein; Douglas Moore

Published: 2026-11-16T18:30:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>), [API](<https://devfeed.tech/topics/api.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [accelerate](<https://devfeed.tech/tags/accelerate.md>), [access-controls](<https://devfeed.tech/tags/access-controls.md>), [accessible](<https://devfeed.tech/tags/accessible.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-use](<https://devfeed.tech/tags/ai-use.md>), [aws](<https://devfeed.tech/tags/aws.md>), [data](<https://devfeed.tech/tags/data.md>), [genie](<https://devfeed.tech/tags/genie.md>), [healthcare](<https://devfeed.tech/tags/healthcare.md>), [healthcare-and-life-sciences](<https://devfeed.tech/tags/healthcare-and-life-sciences.md>), [healthcare-life-sciences](<https://devfeed.tech/tags/healthcare-life-sciences.md>), [industries](<https://devfeed.tech/tags/industries.md>), [life](<https://devfeed.tech/tags/life.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [manage](<https://devfeed.tech/tags/manage.md>), [one](<https://devfeed.tech/tags/one.md>), [opensharing](<https://devfeed.tech/tags/opensharing.md>), [organizations](<https://devfeed.tech/tags/organizations.md>), [talk](<https://devfeed.tech/tags/talk.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

The described OpenSharing integration lets Databricks query AWS HealthLake's FHIR data directly, avoiding export pipelines and duplicate copies. A custom OpenSharing server deployed as a Databricks App obtains temporary Lake Formation credentials, resolves each table's current Iceberg snapshot, and returns pre-signed data files; Databricks compute reads them directly from S3, so data does not pass through the server. OIDC federation lets AWS trust the app's Databricks identity. Unity Catalog governs shared-catalog access with grants and fine-grained, attribute-based, and role-based controls, and supports auditing. Curated Genie Agents can provide natural-language exploration, generating SQL and returning summarized answers, tables, and charts subject to Unity Catalog permissions. The text presents this as an option for Databricks analytics, notebooks, dashboards, and AI, alongside existing Athena or Redshift paths, and points to a reference implementation deployed as a Declarative Automation Bundle.

### Source excerpt

Many healthcare and life sciences organizations have standardized on AWS HealthLake to manage clinical data...

## Build a real-time next-best-offer recommender using Databricks Feature Views

DevFeed: [Build a real-time next-best-offer recommender using Databricks Feature Views](<https://devfeed.tech/articles/build-a-real-time-next-best-offer-recommender-using-databricks-feature-views-136415.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/build-real-time-next-best-offer-recommender-using-databricks-feature-views>)

Author: Tian Tan; Sixuan He; Nick Joung; Julia Powell

Published: 2026-11-16T17:30:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>), [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>), [real-time](<https://devfeed.tech/topics/real-time.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [after](<https://devfeed.tech/tags/after.md>), [aggregate](<https://devfeed.tech/tags/aggregate.md>), [all](<https://devfeed.tech/tags/all.md>), [also](<https://devfeed.tech/tags/also.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-msk](<https://devfeed.tech/tags/amazon-msk.md>), [best](<https://devfeed.tech/tags/best.md>), [build](<https://devfeed.tech/tags/build.md>), [customers](<https://devfeed.tech/tags/customers.md>), [data-science-and-ml](<https://devfeed.tech/tags/data-science-and-ml.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [feature](<https://devfeed.tech/tags/feature.md>), [financial-services](<https://devfeed.tech/tags/financial-services.md>), [next](<https://devfeed.tech/tags/next.md>), [offer](<https://devfeed.tech/tags/offer.md>), [personalization](<https://devfeed.tech/tags/personalization.md>), [platform](<https://devfeed.tech/tags/platform.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [time](<https://devfeed.tech/tags/time.md>), [using](<https://devfeed.tech/tags/using.md>), [want](<https://devfeed.tech/tags/want.md>)

### AI overview

The accelerator shows how Databricks Feature Views can keep training and online serving feature definitions aligned for a retail banking next-best-offer ranker. Its `create_training_set` point-in-time joins reconstruct historical values without future leakage; for inference, Model Serving retrieves customer features from the online store. The notebooks start with batch features and add Kafka clickstream aggregates, avoiding separate hand-written streaming feature logic. In the stated benchmark setup, the ranking endpoint handled about 56 requests per second and stayed within a 50 ms p95 service budget; adding streaming features increased latency by 3-4 ms. Events became model-visible in about 0.1 seconds. Results used a small, untuned configuration, and scale-to-zero can cause cold starts of tens of seconds. The data is synthetic, so the accelerator does not establish revenue or conversion gains, and teams must add eligibility, consent, suitability, and suppression controls before production. Part 2 requires a Unity Catalog Kafka connection and Amazon MSK connectivity.

### Source excerpt

Real-time personalization depends on understanding what customers want in the moment...

## Tabular foundation models on Databricks AI Runtime

DevFeed: [Tabular foundation models on Databricks AI Runtime](<https://devfeed.tech/articles/tabular-foundation-models-on-databricks-ai-runtime-136419.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/tabular-foundation-models-databricks-ai-runtime>)

Author: Marc Susagna Holgado; Javier Poveda Panter; Puneet Jain; Ryuta Yoshimatsu

Published: 2026-11-16T17:00:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Structured-data](<https://devfeed.tech/topics/structured-data.md>), [ML model versioning](<https://devfeed.tech/topics/ml-model-versioning.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [approach](<https://devfeed.tech/tags/approach.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [attention](<https://devfeed.tech/tags/attention.md>), [batch](<https://devfeed.tech/tags/batch.md>), [boolean](<https://devfeed.tech/tags/boolean.md>), [churn](<https://devfeed.tech/tags/churn.md>), [classification](<https://devfeed.tech/tags/classification.md>), [data](<https://devfeed.tech/tags/data.md>), [data-science-and-ml](<https://devfeed.tech/tags/data-science-and-ml.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [databricks-ai](<https://devfeed.tech/tags/databricks-ai.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [foundation](<https://devfeed.tech/tags/foundation.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [learning](<https://devfeed.tech/tags/learning.md>), [machine](<https://devfeed.tech/tags/machine.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [models](<https://devfeed.tech/tags/models.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [tabular-data](<https://devfeed.tech/tags/tabular-data.md>)

### AI overview

Tabular foundation models (TFMs) use pretrained transformers to predict on new tables without task-specific training: labeled rows serve as context for in-context learning, while specialized tokenizers map numerical, categorical, and boolean values into a shared representation. Fine-tuning on a specific dataset is also possible. Architectures trade scale against attention cost: TabPFNv2 attends across rows and columns but scales poorly, while TabICLv1 compresses each row into four tokens to reduce attention cost; later models extend that approach. TFMs rely heavily on synthetic pretraining data, so benchmark results may not reflect proprietary workloads. Teams should evaluate accuracy and GPU inference cost, which can exceed CPU-based XGBoost costs; memory use also grows with rows and features because the training set is passed at prediction time. The excerpt presents Databricks AI Runtime as managed serverless GPU infrastructure colocated with data, with Unity Catalog governance and examples for zero-shot inference and KumoTabular fine-tuning. The supplied text is an excerpt and omits details of the referenced comparison table.

### Source excerpt

Many of the most valuable predictive machine learning applications rely on tabular data...

## Introducing the Databricks AI Index: The state of enterprise AI tokenomics

DevFeed: [Introducing the Databricks AI Index: The state of enterprise AI tokenomics](<https://devfeed.tech/articles/introducing-the-databricks-ai-index-the-state-of-enterprise-ai-tokenomics-136418.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/introducing-databricks-ai-index-state-enterprise-ai-tokenomics>)

Author: The Databricks AI Product and Engineering Team

Published: 2026-11-16T17:00:00Z

Content type: release

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [ai observability](<https://devfeed.tech/topics/ai-observability.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>)

Tags: [adoption](<https://devfeed.tech/tags/adoption.md>), [agent-harnesses](<https://devfeed.tech/tags/agent-harnesses.md>), [agent-tasks](<https://devfeed.tech/tags/agent-tasks.md>), [agent-workflows](<https://devfeed.tech/tags/agent-workflows.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-adoption](<https://devfeed.tech/tags/ai-adoption.md>), [ai-assistant](<https://devfeed.tech/tags/ai-assistant.md>), [ai-costs](<https://devfeed.tech/tags/ai-costs.md>), [ai-labs](<https://devfeed.tech/tags/ai-labs.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [ai-research](<https://devfeed.tech/tags/ai-research.md>), [coding](<https://devfeed.tech/tags/coding.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [databricks-ai](<https://devfeed.tech/tags/databricks-ai.md>), [developers](<https://devfeed.tech/tags/developers.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [index](<https://devfeed.tech/tags/index.md>), [models](<https://devfeed.tech/tags/models.md>), [platform](<https://devfeed.tech/tags/platform.md>), [tokenomics](<https://devfeed.tech/tags/tokenomics.md>), [unity-gateway](<https://devfeed.tech/tags/unity-gateway.md>)

### AI overview

The Databricks AI Index combines anonymized Unity Gateway usage and spending data from 10,000+ companies with weekly coding-agent benchmarks using Databricks workflows and hidden tests. In its September 21-November 7, 2026 dataset, enterprise token use shifted across providers and versions, open-weight models grew from 7.3% to 30.9% of traffic, and multi-provider use increased. Benchmark results show that model and harness combinations can differ sharply in task success and cost: GPT-6 Luna and Claude Opus 5.5 both scored 89.1%, while average task costs were $0.05 and $1.62. Low token prices do not guarantee low task costs, since extra turns and failed attempts add work. The Index is updated weekly; results reflect evaluated workloads and models and may vary by organization.

### Source excerpt

Developers have more AI models and coding agents to choose from than ever before....

## Teach Genie One your workflows: The ultimate guide for skills in Genie One

DevFeed: [Teach Genie One your workflows: The ultimate guide for skills in Genie One](<https://devfeed.tech/articles/teach-genie-one-your-workflows-the-ultimate-guide-for-skills-in-genie-one-135265.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/teach-genie-one-your-workflows-ultimate-guide-skills-genie-one>)

Author: Noah Solomon

Published: 2026-11-16T12:13:41.473095Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Agent Skills](<https://devfeed.tech/topics/agent-skills.md>), [Tutorial](<https://devfeed.tech/topics/tutorial.md>), [Finance](<https://devfeed.tech/topics/finance.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-skills](<https://devfeed.tech/tags/agent-skills.md>), [agents](<https://devfeed.tech/tags/agents.md>), [asset](<https://devfeed.tech/tags/asset.md>), [assets](<https://devfeed.tech/tags/assets.md>), [audit](<https://devfeed.tech/tags/audit.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [beta](<https://devfeed.tech/tags/beta.md>), [build](<https://devfeed.tech/tags/build.md>), [business](<https://devfeed.tech/tags/business.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [central](<https://devfeed.tech/tags/central.md>), [change](<https://devfeed.tech/tags/change.md>), [changes](<https://devfeed.tech/tags/changes.md>), [channel](<https://devfeed.tech/tags/channel.md>), [chat](<https://devfeed.tech/tags/chat.md>), [finance](<https://devfeed.tech/tags/finance.md>), [genie](<https://devfeed.tech/tags/genie.md>), [genie-ontology](<https://devfeed.tech/tags/genie-ontology.md>), [platform](<https://devfeed.tech/tags/platform.md>), [semantic-layer](<https://devfeed.tech/tags/semantic-layer.md>), [skills](<https://devfeed.tech/tags/skills.md>), [team](<https://devfeed.tech/tags/team.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

Genie One skills capture a team's task-specific workflow--steps, checks, judgment and output format--in reusable plain-language instructions. Genie Ontology supplies business meanings and data context, while a Genie Agent supplies scoped domain knowledge; a skill defines how to perform a particular task. Create one by describing the workflow and asking Genie One to interview you, then make fixed requirements explicit, keep the skill focused, and test it with realistic prompts and fresh chats. The example trading brief was refined to wait for complete monthly data and ignore sales below $50,000; a later run used the latest complete month and investigated notable changes using team emails. Skills are saved as SKILL.md folders, can be edited, shared and governed through Unity Gateway Skills (Beta), and can power scheduled tasks. Scheduled runs need instructions for cases that would normally pause for human review.

### Source excerpt

Every team has "recipes" that govern how they work. The way finance puts together...

## Databricks is a Leader and positioned highest in execution in the 2026 Gartner® Magic Quadrant™ for Data Lakehouse Platforms

DevFeed: [Databricks is a Leader and positioned highest in execution in the 2026 Gartner® Magic Quadrant™ for Data Lakehouse Platforms](<https://devfeed.tech/articles/databricks-is-a-leader-and-positioned-highest-in-execution-in-the-2026-gartner-magic-quadranttm-for-data-lakehouse-platforms-136417.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/databricks-leader-and-positioned-highest-execution-2026-gartnerr-magic-quadranttm-data>)

Author: Kaitlin Baumgardner; Kevin Balaji; Brianna Helm; Jonathan Keller; Susan Pierce

Published: 2026-11-14T18:15:02Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [Transactions](<https://devfeed.tech/topics/transactions.md>), [DataOps](<https://devfeed.tech/topics/dataops.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [2026](<https://devfeed.tech/tags/2026.md>), [3](<https://devfeed.tech/tags/3.md>), [about](<https://devfeed.tech/tags/about.md>), [acid](<https://devfeed.tech/tags/acid.md>), [affiliates](<https://devfeed.tech/tags/affiliates.md>), [ai](<https://devfeed.tech/tags/ai.md>), [company](<https://devfeed.tech/tags/company.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lakehouse](<https://devfeed.tech/tags/data-lakehouse.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [decades](<https://devfeed.tech/tags/decades.md>), [enterprises](<https://devfeed.tech/tags/enterprises.md>), [execution](<https://devfeed.tech/tags/execution.md>), [gartner](<https://devfeed.tech/tags/gartner.md>), [gartner-magic-quadranttm](<https://devfeed.tech/tags/gartner-magic-quadranttm.md>), [lakebase](<https://devfeed.tech/tags/lakebase.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [lakehouse-architecture](<https://devfeed.tech/tags/lakehouse-architecture.md>), [leader](<https://devfeed.tech/tags/leader.md>), [ltap](<https://devfeed.tech/tags/ltap.md>), [magic](<https://devfeed.tech/tags/magic.md>), [operational](<https://devfeed.tech/tags/operational.md>), [platforms](<https://devfeed.tech/tags/platforms.md>)

### AI overview

Databricks argues that AI workloads need operational and analytical data on one governed foundation. Its Lake Transactional/Analytical Processing (LTAP) architecture pairs Lakebase Postgres for ACID transactions with lakehouse engines for analytics, both reading one durable copy in open formats such as Delta Lake and Apache Iceberg under Unity Catalog. The company says this avoids pipelines and mirrored tables while giving analytics fresh application data without slowing transactions. Lakebase Postgres uses separated, serverless compute and storage on cloud object storage, scales compute to zero, and supports instant database branching. Databricks cites PRADA Group's reported KPI delivery at about 130 times faster and infrastructure costs about 50% lower. It also says Gartner named Databricks a Leader with the highest execution scores in its 2026 Data Lakehouse Platforms Magic Quadrant and the only Visionary in its Cloud Operational Database Management Systems Magic Quadrant. These are vendor-reported claims; the text includes Gartner's disclaimer that its research is not an endorsement.

### Source excerpt

AI is pulling analytical and operational data togetherFor decades, enterprises have...

## Apache Spark vs Apache Flink: which should you use?

DevFeed: [Apache Spark vs Apache Flink: which should you use?](<https://devfeed.tech/articles/apache-spark-vs-apache-flink-which-should-you-use-133225.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/spark-vs-flink>)

Author: Databricks Staff

Published: 2026-11-13T20:44:47.516244Z

Content type: comparison

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Apache Flink](<https://devfeed.tech/topics/apache-flink.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>)

Tags: [aggregation](<https://devfeed.tech/tags/aggregation.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-flink](<https://devfeed.tech/tags/apache-flink.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [batch](<https://devfeed.tech/tags/batch.md>), [better](<https://devfeed.tech/tags/better.md>), [choice](<https://devfeed.tech/tags/choice.md>), [data-plus-ai-foundations](<https://devfeed.tech/tags/data-plus-ai-foundations.md>), [etl](<https://devfeed.tech/tags/etl.md>), [flink](<https://devfeed.tech/tags/flink.md>), [spark](<https://devfeed.tech/tags/spark.md>), [sql](<https://devfeed.tech/tags/sql.md>), [teams](<https://devfeed.tech/tags/teams.md>), [vs](<https://devfeed.tech/tags/vs.md>)

### AI overview

Spark and Flink both support exactly-once processing, stateful operators and SQL APIs, but Spark spans batch, streaming, SQL and AI while Flink is stream-native. Spark Real-Time Mode uses a trigger on an existing Structured Streaming query to process continuously at millisecond latency, so teams can move between latency tiers without rewriting query code. The excerpt says Databricks' benchmark found Spark matched Flink on stateless work and had lower p99 latency for stateful aggregation and stream-static joins; results came from different providers and the comparison used Spark's worst run versus Flink's best, so teams should benchmark their own workloads. Flink may fit specialized cases such as very large keyed state, complex event processing, or an existing Flink platform. Real-Time Mode requires update output mode and Kafka or a row-level foreach sink; stateful operators are available on Databricks and are slated for open-source Spark 4.3, according to the excerpt.

### Source excerpt

For most teams, Apache Spark™ is the better choice. Spark runs batch ETL, SQL analytics,...

## OpenAI and Databricks: Enterprise AI on your governed data

DevFeed: [OpenAI and Databricks: Enterprise AI on your governed data](<https://devfeed.tech/articles/openai-and-databricks-enterprise-ai-on-your-governed-data-132463.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/openai-and-databricks-enterprise-ai-your-governed-data>)

Author: Harish Gaur; Sully Clark; Ankith Ede

Published: 2026-11-13T15:30:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [databricks](<https://devfeed.tech/topics/databricks.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [data-governance](<https://devfeed.tech/topics/data-governance.md>), [codex](<https://devfeed.tech/topics/codex.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [enterprise data protection](<https://devfeed.tech/topics/enterprise-data-protection.md>), [gpt-oss](<https://devfeed.tech/topics/gpt-oss.md>)

Tags: [act](<https://devfeed.tech/tags/act.md>), [actions](<https://devfeed.tech/tags/actions.md>), [admin](<https://devfeed.tech/tags/admin.md>), [adoption](<https://devfeed.tech/tags/adoption.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-bricks](<https://devfeed.tech/tags/agent-bricks.md>), [agents](<https://devfeed.tech/tags/agents.md>), [agents-sdk](<https://devfeed.tech/tags/agents-sdk.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-coding](<https://devfeed.tech/tags/ai-coding.md>), [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [ai-tools](<https://devfeed.tech/tags/ai-tools.md>), [co-founder](<https://devfeed.tech/tags/co-founder.md>), [data](<https://devfeed.tech/tags/data.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [governed-data](<https://devfeed.tech/tags/governed-data.md>), [openai](<https://devfeed.tech/tags/openai.md>), [partners](<https://devfeed.tech/tags/partners.md>), [platform](<https://devfeed.tech/tags/platform.md>), [simple](<https://devfeed.tech/tags/simple.md>)

### AI overview

OpenAI and Databricks describe three ways to use OpenAI tools with governed company data: employees can query Databricks through the Genie plugin in ChatGPT, which uses Genie Ontology definitions and permissions and links answers to their sources; engineering teams can route Codex through Unity Gateway, keeping the OpenAI key there while logging requests and enabling team budgets and model selection; and teams can run GPT models next to data under Unity Catalog governance, building agents with Agent Bricks or the OpenAI Agents SDK in Databricks Apps. The text says Databricks Model Serving requires no separate external API key, while Codex uses Databricks credentials. These patterns serve different users and workflows, with access controls and cost visibility presented as shared governance features.

### Source excerpt

Greg Brockman, co-founder and President of OpenAI, has a simple way to describe AI...

[Next page](<https://devfeed.tech/sources/databricks.md?cursor=WyIyMDI2LTExLTEzVDE1OjMwOjAwKzAwOjAwIiwgImEyZTg1OWU3LTFlMzUtNDdkZS05Zjc4LTAyMjk0NDQ5NjY3MiJd>)