# Debezium Connector

A Debezium connector captures database-management-system changes and produces structured change events for applications to consume.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Debezium 3.8.0.Alpha2 Released

DevFeed: [Debezium 3.8.0.Alpha2 Released](<https://devfeed.tech/articles/debezium-3-8-0-alpha2-released-143957.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/11/19/debezium-3-8-alpha2-released/>)

Author: Chris Cranford

Published: 2026-11-19T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Release notes](<https://devfeed.tech/topics/release-notes.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Prometheus](<https://devfeed.tech/topics/prometheus.md>)

Tags: [3](<https://devfeed.tech/tags/3.md>), [announce](<https://devfeed.tech/tags/announce.md>), [bug](<https://devfeed.tech/tags/bug.md>), [bug-fixes](<https://devfeed.tech/tags/bug-fixes.md>), [capture](<https://devfeed.tech/tags/capture.md>), [change](<https://devfeed.tech/tags/change.md>), [changes](<https://devfeed.tech/tags/changes.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [deployments](<https://devfeed.tech/tags/deployments.md>), [details](<https://devfeed.tech/tags/details.md>), [faster](<https://devfeed.tech/tags/faster.md>), [formats](<https://devfeed.tech/tags/formats.md>), [full](<https://devfeed.tech/tags/full.md>), [message](<https://devfeed.tech/tags/message.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [more](<https://devfeed.tech/tags/more.md>), [oracle](<https://devfeed.tech/tags/oracle.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [platform](<https://devfeed.tech/tags/platform.md>)

### AI overview

Debezium 3.8.0.Alpha2 adds initial and initial-only snapshots to the TiDB connector, which capture a consistent view without locking tables before streaming continues. The Oracle connector changes snapshot locking: shared mode holds table locks while data is read, so most DDL waits; extended mode blocks all DDL and pauses writes, subject to `snapshot.lock.timeout.ms`. Remove the no-longer-recognized `snapshot.database.errors.max.retries` setting. For databases using extended strings, a recovery snapshot rebuilds schema history with byte-size data. Other notable changes include configurable pipeline message formats and secured Prometheus monitoring in Debezium Platform; Oracle LogMiner query performance nearly tripled in a 1,000-table benchmark; and MongoDB change-stream buffers gain event and byte limits. This is an alpha preview with Oracle upgrade considerations and many connector fixes.

### Source excerpt

With November in full swing, we're pleased to announce Debezium 3.8.0.Alpha2, the second preview release of the 3.8 series. This release brings initial snapshots to the TiDB connector. Debezium Platform gains configurable message formats for pipelines and monitoring that works with secured Prometheus deployments. Oracle LogMiner users get faster and more reliable change capture, and there are many bug fixes across the connectors. There are a few breaking changes for the Oracle connector to review before upgrading. Read on for the full details!

## Host-Based Pipeline Deployment for Debezium Platform

DevFeed: [Host-Based Pipeline Deployment for Debezium Platform](<https://devfeed.tech/articles/host-based-pipeline-deployment-for-debezium-platform-135926.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/11/16/host-based-pipeline-deployment/>)

Author: Divyanshu Kumar Nayak

Published: 2026-11-16T00:00:00Z

Content type: article

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Deployment](<https://devfeed.tech/topics/deployment.md>), [internal developer platform](<https://devfeed.tech/topics/internal-developer-platform.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [virtual machines](<https://devfeed.tech/topics/virtual-machines.md>), [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-mode](<https://devfeed.tech/tags/agent-mode.md>), [agent-runtime](<https://devfeed.tech/tags/agent-runtime.md>), [ansible](<https://devfeed.tech/tags/ansible.md>), [api](<https://devfeed.tech/tags/api.md>), [bare-metal](<https://devfeed.tech/tags/bare-metal.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [container](<https://devfeed.tech/tags/container.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [deployment-model](<https://devfeed.tech/tags/deployment-model.md>), [example](<https://devfeed.tech/tags/example.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [kubernetes-operator](<https://devfeed.tech/tags/kubernetes-operator.md>), [machines](<https://devfeed.tech/tags/machines.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [platform](<https://devfeed.tech/tags/platform.md>), [ssh](<https://devfeed.tech/tags/ssh.md>), [virtual-machines](<https://devfeed.tech/tags/virtual-machines.md>)

### AI overview

Host-based pipeline deployment lets Debezium Platform run Debezium Server containers on SSH-accessible machines while retaining its Kubernetes operator model. Conductor discovers hosts from an operator-maintained SSH inventory, provisions them through Ansible, selects a ready host and port, and tracks container state and configuration drift. The local PostgreSQL-to-HTTP walkthrough uses Docker Compose for Platform services and deploys to a separate Multipass VM; it verifies delivery of a real change event. Ansible is the default runtime and uses SSH for container and file operations. The optional Host Agent runtime puts those operations behind an authenticated HTTP service; it requires a specified Agent version and a Maven repository containing that artifact. Host mode suits existing VM, bare-metal, or cloud hosts managed over SSH, but does not reproduce every Kubernetes capability: in-process pipeline signals are unavailable. The example uses moving nightly images, so the article cautions against treating that tag as a production version pin.

### Source excerpt

The Debezium Platform deployment model was originally designed with Kubernetes as its primary target environment. Kubernetes remains a strong choice for teams that already operate a cluster, but not every organization needs one simply to run a small number of Debezium Server pipelines. For teams that run workloads on virtual machines, bare-metal servers, or cloud instances, a lighter deployment path can reduce operational overhead while retaining a central place to define and manage pipelines. Host-based pipeline deployment adds that path to the Debezium Platform. It lets the Platform place Debezium Server containers on SSH-accessible hosts while preserving the existing Kubernetes operator deployment model. In this article, we look at the host-based deployment model, run its local example, and explain the choices behind its two container runtimes.

## Extending DBLog-Based Incremental Snapshots to Handle Orphan Rows in CDC Pipelines

DevFeed: [Extending DBLog-Based Incremental Snapshots to Handle Orphan Rows in CDC Pipelines](<https://devfeed.tech/articles/extending-dblog-based-incremental-snapshots-to-handle-orphan-rows-in-cdc-pipelines-125666.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.10810>)

Author: Andreas Andreakis

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>), [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Lean](<https://devfeed.tech/topics/lean.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [after](<https://devfeed.tech/tags/after.md>), [also](<https://devfeed.tech/tags/also.md>), [applications](<https://devfeed.tech/tags/applications.md>), [apply](<https://devfeed.tech/tags/apply.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [based](<https://devfeed.tech/tags/based.md>), [blocking](<https://devfeed.tech/tags/blocking.md>), [bootstrap](<https://devfeed.tech/tags/bootstrap.md>), [but](<https://devfeed.tech/tags/but.md>), [can](<https://devfeed.tech/tags/can.md>), [capture](<https://devfeed.tech/tags/capture.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [change](<https://devfeed.tech/tags/change.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [changes](<https://devfeed.tech/tags/changes.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [cs-lo](<https://devfeed.tech/tags/cs-lo.md>), [handle](<https://devfeed.tech/tags/handle.md>), [incremental](<https://devfeed.tech/tags/incremental.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [snapshots](<https://devfeed.tech/tags/snapshots.md>)

### AI overview

The extension lets DBLog-based CDC snapshots repair orphan rows in an existing sink. During chunk reads, the connector can emit delete events for keys absent from the source range; alternatively, an external drift process can submit suspected orphans for the connector to check and delete only when confirmed absent. The system supports integrated cleanup on full or periodic chunk passes, externally requested repairs, or a combination of both, which the authors recommend. The abstract says the extension is formally verified for safety and convergence in Isabelle/HOL and Lean 4.

### Source excerpt

arXiv:2611.10810v1 Announce Type: new Abstract: Applications use heterogeneous datastores where a source feeds sinks such as search indexes or data warehouses via change data capture (CDC). As transaction logs have limited retention, CDC alone cannot bootstrap sinks, and traditional approaches either stall source writes or hold back log events. DBLog-based incremental snapshots, adopted by Debezium and Flink CDC, read tables in chunks interleaved with the log without blocking writes or long log stalls and resume where they stopped. After the initial bootstrap, a sink can drift when losing change events or receiving unintended writes. Even a repeated bootstrap can leave orphan rows that exist in the sink and not at the source. A common remedy is to populate a new empty sink, but repairing an existing sink avoids parallel pipelines, a switch and serving traffic from a drifted sink until the new sink is ready. In DBLog's original design, each chunk only emits the latest state of the rows the table still contains, so it does not handle orphan rows. We extend DBLog to delete them using what a chunk read already knows, namely the keys that the range select did not return, emitting a new kind of event that sinks apply as deletes. We also add a repair request that an external process calls with orphan candidates, which the connector checks with its own read, emitting these events for keys confirmed absent. This enables three modes. In the fully integrated mode, every chunk pass removes the orphans it finds during full or periodic repairs. In the second mode, an external drift process hands suspected orphans to the connector. The third mode combines both and is what we recommend. Together, they turn DBLog into a complete data synchronization engine whether a sink catches up on live changes or missing rows, holds wrong column values, or contains orphan rows. Their safety and convergence are formally verified in Isabelle/HOL and Lean 4.

## Debezium 3.6.4.Final Released

DevFeed: [Debezium 3.6.4.Final Released](<https://devfeed.tech/articles/debezium-3-6-4-final-released-129189.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/11/10/debezium-3-6-4-final-released/>)

Author: Chris Cranford

Published: 2026-11-10T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>)

Tags: [capture](<https://devfeed.tech/tags/capture.md>), [change](<https://devfeed.tech/tags/change.md>), [cve](<https://devfeed.tech/tags/cve.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [drivers](<https://devfeed.tech/tags/drivers.md>), [events](<https://devfeed.tech/tags/events.md>), [faster](<https://devfeed.tech/tags/faster.md>), [latest](<https://devfeed.tech/tags/latest.md>), [maintenance](<https://devfeed.tech/tags/maintenance.md>), [mongodb](<https://devfeed.tech/tags/mongodb.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [oracle](<https://devfeed.tech/tags/oracle.md>), [published](<https://devfeed.tech/tags/published.md>), [query](<https://devfeed.tech/tags/query.md>), [release](<https://devfeed.tech/tags/release.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [security](<https://devfeed.tech/tags/security.md>), [security-updates](<https://devfeed.tech/tags/security-updates.md>), [series](<https://devfeed.tech/tags/series.md>), [tables](<https://devfeed.tech/tags/tables.md>)

### AI overview

Debezium 3.6.4.Final is a maintenance release with 35 resolved issues, led by Oracle reliability fixes for missed change events on RAC and a more efficient LogMiner query. The query reduces database CPU overhead and streams results faster, with greater benefit for deployments capturing hundreds of tables. The MongoDB Java driver is upgraded to 5.14.0 with no configuration changes required. MySQL Connector/J moves to 26.10.0 to address CVE-2025-30706; most deployments need no changes, but its documented support range starts at MySQL Server 8.4, and custom driver keystores must be local files. The release also includes fixes across Oracle, SQL Server, MySQL, and shared components.

### Source excerpt

We're pleased to announce Debezium 3.6.4.Final, the latest maintenance release of the 3.6 series, focused on stability and reliability. This release is led by a round of fixes for the Oracle connector, resolving several cases where change events could be missed, most notably on Oracle RAC. Oracle deployments that capture many tables also benefit from a faster LogMiner query. Beyond Oracle, the release brings security updates through newer MySQL and MongoDB drivers, including a MySQL driver that addresses a published CVE. Read on for the full details! Read more...

## Debezium 3.7.1.Final Released

DevFeed: [Debezium 3.7.1.Final Released](<https://devfeed.tech/articles/debezium-3-7-1-final-released-126366.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/11/09/debezium-3-7-1-final-released/>)

Author: Chris Cranford

Published: 2026-11-09T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Release notes](<https://devfeed.tech/topics/release-notes.md>), [Oracle Database](<https://devfeed.tech/topics/oracle-database.md>), [event-sourcing](<https://devfeed.tech/topics/event-sourcing.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [cves](<https://devfeed.tech/tags/cves.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [drivers](<https://devfeed.tech/tags/drivers.md>), [events](<https://devfeed.tech/tags/events.md>), [maintenance](<https://devfeed.tech/tags/maintenance.md>), [oracle](<https://devfeed.tech/tags/oracle.md>), [published](<https://devfeed.tech/tags/published.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [series](<https://devfeed.tech/tags/series.md>)

### AI overview

Debezium 3.7.1.Final fixes cases where connector restarts could skip or duplicate change events, restores missing Debezium Server components, updates database drivers to address security findings, and resolves 87 issues. Oracle users should note a snapshot locking change: locks now remain until the initial snapshot finishes, reducing failures caused by concurrent schema changes. The default shared mode still permits reads and writes, though some schema changes wait; extended mode blocks all schema changes and writes, with a configurable lock timeout. Remove the retired snapshot.database.errors.max.retries setting if configured. Other changes include running Oracle column reselection queries on a physical standby, an updated MongoDB driver requiring no configuration changes, and a MySQL driver upgrade whose documented support range starts at MySQL 8.4 and whose SSL keystores must be local files when passed through custom driver properties. The release also includes numerous replication, snapshot, and server fixes.

### Source excerpt

We're pleased to announce Debezium 3.7.1.Final, the first maintenance release of the 3.7 series, focused on stability and reliability. This release resolves a number of cases where change events could be skipped or duplicated after a connector restart, and it restores pieces of the Debezium Server distribution that went missing in 3.7.0.Final. It also brings updated database drivers that address several recently published CVEs. If you use the Oracle connector, be sure to review the breaking changes before upgrading. Read on for the full details! Read more...

## What your CDC pipeline does when a primary key changes

DevFeed: [What your CDC pipeline does when a primary key changes](<https://devfeed.tech/articles/what-your-cdc-pipeline-does-when-a-primary-key-changes-121702.md>)

Original publisher: [Read original article](<https://estuary.dev/blog/cdc-primary-key-changes>)

Author: Dani Pálma

Published: 2026-11-06T05:20:53Z

Content type: article

Language: en

Sources: [Estuary](<https://devfeed.tech/sources/estuary.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>)

Tags: [cdc](<https://devfeed.tech/tags/cdc.md>), [cdc-tools](<https://devfeed.tech/tags/cdc-tools.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [data-privacy](<https://devfeed.tech/tags/data-privacy.md>), [database](<https://devfeed.tech/tags/database.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [delete](<https://devfeed.tech/tags/delete.md>), [docs](<https://devfeed.tech/tags/docs.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [estuary](<https://devfeed.tech/tags/estuary.md>), [key](<https://devfeed.tech/tags/key.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [tests](<https://devfeed.tech/tags/tests.md>), [updates](<https://devfeed.tech/tags/updates.md>)

### AI overview

A CDC pipeline can silently retain a stale row when a primary key changes: the connector must emit a delete for the old key, and the destination must apply it. In tests with MySQL, Debezium 3.0.8's JDBC sink left orphans with its default delete.enabled=false; enabling deletes matched the source. Estuary's MySQL capture handled the tested key changes with both soft-delete and hard-delete Postgres materializations; soft-deleted rows remain stored and must be filtered from live results. FULL row images provide old and new values but add log data, and correctness still depends on connector and sink behavior. To check a pipeline, update a key in staging, compare destination rows with source IDs, then test key swaps and reuse. The text also cautions that incomplete or ambiguous old keys may prevent a safe delete, and before-images can expose sensitive data.

### Source excerpt

A hands-on look at how CDC pipelines handle primary key updates, deletes, and orphan rows, with tests using MySQL, Debezium, and Estuary.

## Push-based CDC into Unity Catalog with Zerobus Ingest and Debezium

DevFeed: [Push-based CDC into Unity Catalog with Zerobus Ingest and Debezium](<https://devfeed.tech/articles/push-based-cdc-into-unity-catalog-with-zerobus-ingest-and-debezium-119591.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/push-based-cdc-unity-catalog-zerobus-ingest-and-debezium>)

Author: Victoria Bukta; Omkar Mehta; Wagner Santos

Published: 2026-11-05T12:48:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data serialization](<https://devfeed.tech/topics/data-serialization.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [broker](<https://devfeed.tech/tags/broker.md>), [bus](<https://devfeed.tech/tags/bus.md>), [capture](<https://devfeed.tech/tags/capture.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [change-feed](<https://devfeed.tech/tags/change-feed.md>), [control](<https://devfeed.tech/tags/control.md>), [database](<https://devfeed.tech/tags/database.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [delta](<https://devfeed.tech/tags/delta.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [ecosystem](<https://devfeed.tech/tags/ecosystem.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [environment](<https://devfeed.tech/tags/environment.md>), [event](<https://devfeed.tech/tags/event.md>), [events](<https://devfeed.tech/tags/events.md>), [unity-catalog](<https://devfeed.tech/tags/unity-catalog.md>)

### AI overview

Debezium Server reads database transaction logs and pushes change events to Zerobus Ingest, which writes directly to Unity Catalog Delta tables. This lets the database-owning team control capture and use outbound connectivity without operating Kafka as an intermediate transport; a traditional Kafka design adds broker capacity and management plus a separate lakehouse ingestion hop. The sink's default typed mode maps events to source columns, while NVIDIA-contributed envelope mode retains full events and source positions for downstream processing. Delivery is at least once: an earlier durable group may be resent after a later failure, so consumers deduplicate using the event idempotency key. Zerobus is append-only; AUTO CDC can merge events into a Type-1 current-state table, sequenced by source LSN, or a Type-2 history table.

### Source excerpt

Data in operational databases drives business decisions, and much of that analysis...

## Debezium 3.8.0.Alpha1 Released

DevFeed: [Debezium 3.8.0.Alpha1 Released](<https://devfeed.tech/articles/debezium-3-8-0-alpha1-released-113312.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/11/02/debezium-3-8-alpha1-released/>)

Author: Chris Cranford

Published: 2026-11-02T05:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [project release](<https://devfeed.tech/topics/project-release.md>)

Tags: [bug-fixes](<https://devfeed.tech/tags/bug-fixes.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [elasticsearch](<https://devfeed.tech/tags/elasticsearch.md>), [improvements](<https://devfeed.tech/tags/improvements.md>), [jdbc](<https://devfeed.tech/tags/jdbc.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [platform](<https://devfeed.tech/tags/platform.md>), [preview](<https://devfeed.tech/tags/preview.md>), [release](<https://devfeed.tech/tags/release.md>)

### AI overview

Debezium 3.8.0.Alpha1 is the first preview of the 3.8 series, with an Elasticsearch sink, claim-check storage for oversized events, and live snapshot progress in Debezium Platform. The Elasticsearch sink supports Elasticsearch 8.x and 9.x, uses stable document IDs for repeat writes, and is incubating, so it is not yet recommended for production; OpenSearch is unsupported. The JDBC sink now defaults to the Shared Sink Framework, which deduplicates by primary key within a batch. Set `buffer.mode=passthrough` to retain writing every event if the old reduction buffer was not enabled. Upgrade checks include MySQL `REAL` columns changing from `FLOAT32` to `FLOAT64`, which may affect schema compatibility, and Kafka sink delivery now defers by default to the producer timeout. The release also adds MongoDB timestamp-based starts and required pre/post-image policies, MySQL schema reconstruction from full binlog metadata without a history topic, and fixes across connectors. The release notes report 206 resolved issues.

### Source excerpt

As the leaves fall and November gets underway, we're pleased to announce Debezium 3.8.0.Alpha1, the first preview release of the 3.8 series. This release introduces a new Elasticsearch sink connector. It also brings snapshot progress monitoring to Debezium Platform, a new default mode for the JDBC sink, and improvements across many connectors. There are also many bug fixes and a few breaking changes to review before upgrading. Read on for the full details! Read more...

## Milvus Source Connector for Debezium: Enabling Event-Driven Vector Architectures

DevFeed: [Milvus Source Connector for Debezium: Enabling Event-Driven Vector Architectures](<https://devfeed.tech/articles/milvus-source-connector-for-debezium-enabling-event-driven-vector-architectures-111256.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/11/02/milvus-source-connector-for-debezium/>)

Author: Kartik Angiras

Published: 2026-11-02T00:00:00Z

Content type: article

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Publish-subscribe pattern](<https://devfeed.tech/topics/pubsub.md>), [event-sourcing](<https://devfeed.tech/topics/event-sourcing.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [elasticsearch](<https://devfeed.tech/tags/elasticsearch.md>), [event](<https://devfeed.tech/tags/event.md>), [event-driven](<https://devfeed.tech/tags/event-driven.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [postgres](<https://devfeed.tech/tags/postgres.md>), [redis](<https://devfeed.tech/tags/redis.md>), [source](<https://devfeed.tech/tags/source.md>), [stream](<https://devfeed.tech/tags/stream.md>), [vector](<https://devfeed.tech/tags/vector.md>), [vector-database](<https://devfeed.tech/tags/vector-database.md>)

### AI overview

The Debezium 3.7 Milvus source connector reads Milvus 2.5's Kafka write stream, uses etcd checkpoints and Milvus gRPC for snapshots and schemas, and emits inserts and deletes as Debezium events with typed vector fields. Timetick watermarks restore commit order across virtual channels, and Kafka Connect sinks can deliver changes to systems such as Postgres, Elasticsearch, or S3. The connector requires a self-hosted deployment using Kafka as its broker; Milvus Lite, Pulsar, RocksMQ, and Milvus 2.6 are unsupported. It is incubating: its default checkpoint key can miss changes at snapshot handoff, and a crash while events await ordering can lose them. It uses at-least-once snapshot delivery, so idempotent sinks are important; deletes have only primary-key before images, and upserts appear as delete/insert pairs.

### Source excerpt

Google Summer of Code 2026 with the Debezium community was the best learning experience I have had as an engineer. Over one summer I built a Kafka Connect source connector from scratch for a database with no documented way to read its changes. Most of the work was taking the database apart to find out where those changes live, writing the design down before building any of it, and carrying each piece through review with the Debezium maintainers. The connector shipped in Debezium 3.7. What came out of that summer is a Debezium source connector that turns Milvus, the open source vector database, into a first-class source of change events. I built it because Milvus has no change stream of its own. If you need its inserts and deletes somewhere else (Elasticsearch for keyword search, Redis as a cache, Postgres for reporting), you either write to both systems from the application and drift apart on the first partial failure, or you run a batch export that cannot see a delete. The connector reads the write stream Milvus already publishes to its message queue, puts the events back in commit order, and emits each insert and delete as a normal Debezium change event with the vector as a typed field. From there any Kafka Connect sink is a Milvus integration, and the service that writes to Milvus never has to know. This post covers how it works and what you can build once Milvus is one. Read more...

## Sink Framework now the default in Debezium 3.8

DevFeed: [Sink Framework now the default in Debezium 3.8](<https://devfeed.tech/articles/sink-framework-now-the-default-in-debezium-3-8-126365.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/10/28/sink-framework-default/>)

Author: René Kerner

Published: 2026-10-28T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [architecture-components](<https://devfeed.tech/topics/architecture-components.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [batch](<https://devfeed.tech/tags/batch.md>), [batch-processing](<https://devfeed.tech/tags/batch-processing.md>), [buffer](<https://devfeed.tech/tags/buffer.md>), [collection](<https://devfeed.tech/tags/collection.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [database](<https://devfeed.tech/tags/database.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [feedback](<https://devfeed.tech/tags/feedback.md>), [fields](<https://devfeed.tech/tags/fields.md>), [framework](<https://devfeed.tech/tags/framework.md>), [functionality](<https://devfeed.tech/tags/functionality.md>), [github](<https://devfeed.tech/tags/github.md>), [key](<https://devfeed.tech/tags/key.md>), [mapping](<https://devfeed.tech/tags/mapping.md>), [processing](<https://devfeed.tech/tags/processing.md>)

### AI overview

Debezium 3.8.0.Alpha1 makes the sink framework the default for new JDBC sink deployments, adding shared buffering and batch processing. With a primary key, `buffer.mode=deduplication` (default) keeps only the latest record per key within a batch; `passthrough` preserves all events and flushes at duplicate-key boundaries. Without a primary key, or for null keys, each record gets a unique sequence number and the modes behave the same. The release also adds `cloud.events.schema.name.pattern` for identifying CloudEvents messages. Operators encountering severe issues can temporarily restore legacy buffering with `internal.enable.sces=false`; the text says the legacy path may be removed in 3.8.0.Final. MongoDB sink implementation is still in progress, with a 3.8.0.Final release planned.

### Source excerpt

Hey community! After a long period of development and testing, we are excited to announce that the sink framework is now the default in Debezium 3.8.0.Alpha1. This framework introduces a new buffer and batch processing layer that lays the groundwork for a unified sink connector architecture across Debezium. It also provides a shared set of functionality for all sink connectors, such as key/payload mapping, filtering fields or collection name mapping. Read more...

## Debezium CLI: A Unified Command-Line Interface for CDC Pipeline Lifecycle Management

DevFeed: [Debezium CLI: A Unified Command-Line Interface for CDC Pipeline Lifecycle Management](<https://devfeed.tech/articles/debezium-cli-a-unified-command-line-interface-for-cdc-pipeline-lifecycle-management-101041.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/10/26/debezium-cli-release/>)

Author: Binayak Das

Published: 2026-10-26T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [assembly](<https://devfeed.tech/tags/assembly.md>), [auditing](<https://devfeed.tech/tags/auditing.md>), [but](<https://devfeed.tech/tags/but.md>), [cache](<https://devfeed.tech/tags/cache.md>), [cache-invalidation](<https://devfeed.tech/tags/cache-invalidation.md>), [capabilities](<https://devfeed.tech/tags/capabilities.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [cli](<https://devfeed.tech/tags/cli.md>), [command](<https://devfeed.tech/tags/command.md>), [command-line](<https://devfeed.tech/tags/command-line.md>), [command-line-interface](<https://devfeed.tech/tags/command-line-interface.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [interface](<https://devfeed.tech/tags/interface.md>), [lifecycle](<https://devfeed.tech/tags/lifecycle.md>), [management](<https://devfeed.tech/tags/management.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>)

### AI overview

The Debezium CLI (`debezium-jbang`) brings local packaging and Debezium Platform management into one terminal tool. Distributed through JBang, it uses a `dbz.yaml` project descriptor to scaffold source and sink settings, validate syntax and environment variables, and assemble layered OCI images without Maven or a running Docker daemon; it can also push those images to registries. For remote workflows, it switches among configured platform environments, reads connector capabilities from the live catalog, validates database connections and discovers schemas, and creates, lists, or signals pipelines. The article presents this as covering core build and orchestration workflows in Debezium 3.7. A terminal dashboard, Kubernetes Operator integration, expanded diagnostics, and more templates are described as future enhancements.

### Source excerpt

Change Data Capture (CDC) has established itself as the gold standard for real-time data streaming, cache invalidation, outbox pattern implementations, and microservice data synchronizations. For years, the Debezium project has empowered engineers worldwide to stream row-level database changes reliably into Apache Kafka, Apache Pulsar, Redis, and dozens of downstream cloud messaging platforms. However, operating CDC pipelines traditionally came with operational friction. Developers had to hand-craft nested JSON connector configurations, deploy them via raw curl commands to Kafka Connect REST endpoints, navigate differing configuration dialects for standalone Debezium Server distributions, or manage complex Kubernetes manifests manually. With the introduction of the Debezium Platform, the ecosystem gained a robust control plane, but developers and platform engineers still needed a fast, intuitive, unified tool right in their terminal. As part of Google Summer of Code (GSoC) 2026, we designed and built the Debezium CLI (debezium-jbang): a modern, zero-dependency command-line interface that covers the entire lifecycle of Debezium pipelines, from local scaffolding and daemonless container image assembly to real-time schema discovery and remote platform orchestration. In this post, we explore the motivation, architecture, key capabilities, and hands-on workflows powered by the new Debezium CLI. Why a Unified CLI? The primary design principle behind Debezium CLI is developer velocity without infrastructure overhead. Whether an engineer is prototyping a new pipeline locally on their laptop or an SRE is auditing pipelines across multiple Kubernetes clusters, the CLI delivers: Zero-Friction Installation: Powered by JBang, the CLI requires no manual Java compilation, package manager friction, or Maven installation. It runs everywhere Java or JBang is present, and supports instant execution via the Debezium catalog: jbang debezium@debezium. Daemonless Distribution and Containe

## Native Support for Debezium in Apache Beam

DevFeed: [Native Support for Debezium in Apache Beam](<https://devfeed.tech/articles/native-support-for-debezium-in-apache-beam-92451.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/10/21/native-support-for-debezium-in-apache-beam/>)

Author: Ilyas Ahsan

Published: 2026-10-21T00:00:00Z

Content type: tutorial

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Cloud Dataflow](<https://devfeed.tech/topics/cloud-dataflow.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>)

Tags: [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [beam](<https://devfeed.tech/tags/beam.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [mysql](<https://devfeed.tech/tags/mysql.md>)

### AI overview

Apache Beam's DebeziumIO runs Debezium change capture inside a Beam pipeline, without requiring Kafka or Kafka Connect. The excerpt demonstrates a Java pipeline that reads MySQL changes, converts each event to a BigQuery row, and appends it using either the Direct runner or Dataflow. It requires Java 17, Gradle, Docker, and a Google Cloud project with BigQuery enabled; the destination table must exist beforehand. DebeziumIO is available in Beam 2.76.0, supports Debezium 3.5, and the excerpt lists MySQL, PostgreSQL, SQL Server, and Db2 as supported databases. The feature is described as experimental. A noted limitation is that its metadata omits binlog position and row number, which the example says are needed for reliable deduplication, as well as the database commit timestamp useful for debugging.

### Source excerpt

Apache Beam has a built-in connector for Debezium called DebeziumIO. It lets you capture changes from your database and process them directly inside a Beam pipeline. You don't need to run Apache Kafka or Kafka Connect. In this post, we'll build an example pipeline that streams changes from MySQL into Google BigQuery. The complete example is available in the debezium-examples repository. Read more...

## Introducing PyDebeziumAI: Real-Time CDC for LangChain and LangGraph

DevFeed: [Introducing PyDebeziumAI: Real-Time CDC for LangChain and LangGraph](<https://devfeed.tech/articles/introducing-pydebeziumai-real-time-cdc-for-langchain-and-langgraph-89911.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/10/19/introducing-pydebeziumai/>)

Author: Kodukulla Mohnish Mythreya

Published: 2026-10-19T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Snowflake streaming data architecture](<https://devfeed.tech/topics/snowflake-streaming-data-architecture.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Langgraph](<https://devfeed.tech/topics/langgraph.md>), [LanceDB vector database](<https://devfeed.tech/topics/lancedb-vector-database.md>), [software development triangle](<https://devfeed.tech/topics/software-development-triangle.md>)

Tags: [batch](<https://devfeed.tech/tags/batch.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [cron](<https://devfeed.tech/tags/cron.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [llm](<https://devfeed.tech/tags/llm.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [rag](<https://devfeed.tech/tags/rag.md>), [retrieval-augmented-generation-rag](<https://devfeed.tech/tags/retrieval-augmented-generation-rag.md>)

### AI overview

PyDebeziumAI is an open-source Python library that uses Debezium change data capture to keep vector stores synchronized with database changes for LangChain and LangGraph applications. It embeds Debezium in the Python process, compacts batched changes, and supports vector store adapters and retriever integrations. The article also describes a MySQL-to-Milvus example and reports benchmark latency in the low hundreds of milliseconds.

### Source excerpt

Retrieval-Augmented Generation (RAG) has become a central pattern in AI application development. The idea is simple: rather than relying solely on an LLM's pre-trained knowledge, you give it fresh context by retrieving relevant documents from a vector store at query time. But there is a catch that most tutorials skip over entirely. Where does that vector data come from, and how do you keep it current? Today, most teams answer that question with a cron job, a nightly batch reload, or a manual re-embedding script. That approach works until the database changes faster than the schedule runs, and your AI starts answering questions based on data that no longer exists or doesn't reflect a new record committed five minutes ago. This is the problem that PyDebeziumAI solves. It is an open-source Python library, developed as part of Google Summer of Code 2026 under the Debezium project, that wires Debezium's Change Data Capture engine directly into LangChain and LangGraph pipelines, ensuring your vector store updates the moment the database does. Read more...

## Event Streaming and CDC Infrastructure at Runpod

DevFeed: [Event Streaming and CDC Infrastructure at Runpod](<https://devfeed.tech/articles/event-streaming-and-cdc-infrastructure-at-runpod-84638.md>)

Original publisher: [Read original article](<https://www.runpod.io/blog/event-streaming-cdc-infrastructure>)

Author: Zack McKenna

Published: 2026-10-10T23:11:54Z

Content type: article

Language: en

Sources: [Runpod Blog.](<https://devfeed.tech/sources/runpod-blog.md>)

Topics: [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>), [event-sourcing](<https://devfeed.tech/topics/event-sourcing.md>), [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [RabbitMQ](<https://devfeed.tech/topics/rabbitmq.md>)

Tags: [approach](<https://devfeed.tech/tags/approach.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [change-feed](<https://devfeed.tech/tags/change-feed.md>), [event-streaming](<https://devfeed.tech/tags/event-streaming.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [outbox](<https://devfeed.tech/tags/outbox.md>)

### AI overview

Runpod describes replacing database polling with a change data capture event pipeline built around a transactional outbox, MySQL binlog, Vitess VStream, and Kinesis. The article explains how domain events feed operational consumers and a Snowflake analytics pipeline, while schema validation and automated migration keep event and warehouse schemas aligned. It also distinguishes deployed components from consumer work still in development.

### Source excerpt

Learn how Runpod built a real-time event streaming platform using Change Data Capture (CDC), the transactional outbox pattern, and the MySQL binlog to replace database polling, simplify consumers, and automate analytics.

## Resolving PostgreSQL replication lag with heartbeat tables in change data capture scenarios

DevFeed: [Resolving PostgreSQL replication lag with heartbeat tables in change data capture scenarios](<https://devfeed.tech/articles/resolving-postgresql-replication-lag-with-heartbeat-tables-in-change-data-capture-scenarios-62866.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/database/resolving-postgresql-replication-lag-with-heartbeat-tables-in-change-data-capture-scenarios/>)

Author: Donghua Luo

Published: 2026-09-30T16:47:04Z

Content type: tutorial

Language: en

Sources: [AWS Database Blog](<https://devfeed.tech/sources/aws-database-blog.md>)

Topics: [PostgreSQL](<https://devfeed.tech/topics/postgresql.md>), [AWS Database Migration Service](<https://devfeed.tech/topics/aws-database-migration-service.md>), [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [data migrations](<https://devfeed.tech/topics/data-migrations.md>)

Tags: [amazon-aurora](<https://devfeed.tech/tags/amazon-aurora.md>), [amazon-cloudwatch](<https://devfeed.tech/tags/amazon-cloudwatch.md>), [aws-database-migration-service](<https://devfeed.tech/tags/aws-database-migration-service.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [postgresql-compatible](<https://devfeed.tech/tags/postgresql-compatible.md>), [rds-for-postgresql](<https://devfeed.tech/tags/rds-for-postgresql.md>), [replication](<https://devfeed.tech/tags/replication.md>), [wal](<https://devfeed.tech/tags/wal.md>)

### AI overview

This tutorial explains how PostgreSQL replication slots can stall during change data capture migrations when tracked tables are quiet even though the database is generating writes elsewhere. It describes using heartbeat tables with AWS Database Migration Service or Debezium to advance replication and prevent WAL accumulation, and mentions CloudWatch and SQL diagnostics for monitoring slot health.

### Source excerpt

Replication lag during a change data capture (CDC) migration can be counterintuitive: the source is busy, yet replication falls behind and WAL piles up. This post shows how to resolve PostgreSQL replication lag with heartbeat tables using AWS DMS or Debezium, and how to monitor replication slot health with Amazon CloudWatch and SQL diagnostics.

## Debezium 3.7 Release Summary

DevFeed: [Debezium 3.7 Release Summary](<https://devfeed.tech/articles/debezium-3-7-release-summary-62758.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/09/29/debezium-3-7-final-released/>)

Author: Chris Cranford

Published: 2026-09-29T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>), [snyk-security-intel](<https://devfeed.tech/topics/snyk-security-intel.md>), [read-replica](<https://devfeed.tech/topics/read-replica.md>), [qwen](<https://devfeed.tech/topics/qwen.md>), [Load Balancing](<https://devfeed.tech/topics/load-balancing.md>), [GitHub Copilot](<https://devfeed.tech/topics/github-copilot.md>), [dogfooding](<https://devfeed.tech/topics/dogfooding.md>)

Tags: [alerting](<https://devfeed.tech/tags/alerting.md>), [bug-fixes](<https://devfeed.tech/tags/bug-fixes.md>), [cockroachdb](<https://devfeed.tech/tags/cockroachdb.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [data](<https://devfeed.tech/tags/data.md>), [deploy](<https://devfeed.tech/tags/deploy.md>), [features](<https://devfeed.tech/tags/features.md>), [general-availability](<https://devfeed.tech/tags/general-availability.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [langgraph](<https://devfeed.tech/tags/langgraph.md>), [mining](<https://devfeed.tech/tags/mining.md>), [oracle](<https://devfeed.tech/tags/oracle.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [release](<https://devfeed.tech/tags/release.md>), [release-summary](<https://devfeed.tech/tags/release-summary.md>), [releases](<https://devfeed.tech/tags/releases.md>), [sqlite](<https://devfeed.tech/tags/sqlite.md>)

### AI overview

Debezium 3.7 is generally available, adding incubating connectors for TiDB, Milvus, and SQLite, graduating the CockroachDB connector from incubation, and introducing the Debezium CLI's first official release. The release also adds platform alerting, pipeline deployment to hosts outside Kubernetes, and PyDebeziumAI support for real-time change data capture in LangChain and LangGraph applications. Oracle continuous mining support has been removed, and the release addresses defects in Oracle connector savepoint rollback handling.

### Source excerpt

As September draws to a close, we're thrilled to announce the general availability of Debezium 3.7, the latest milestone in the Debezium 3.x series. This release brings together everything from the last three months of development, adding a wide range of new features, improvements, and bug fixes across the entire ecosystem. Read more...

## Recent improvements in the Debezium Platform UI

DevFeed: [Recent improvements in the Debezium Platform UI](<https://devfeed.tech/articles/recent-improvements-in-the-debezium-platform-ui-60742.md>)

Original publisher: [Read original article](<https://debezium.io/blog/2026/09/28/platform-stage-ui-improvements/>)

Author: Indra Raj Shukla

Published: 2026-09-28T00:00:00Z

Content type: release

Language: en

Sources: [Debezium](<https://devfeed.tech/sources/debezium-io.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [User interface design](<https://devfeed.tech/topics/ui-design.md>)

Tags: [component](<https://devfeed.tech/tags/component.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [docs](<https://devfeed.tech/tags/docs.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [failed](<https://devfeed.tech/tags/failed.md>), [frontend](<https://devfeed.tech/tags/frontend.md>), [improvements](<https://devfeed.tech/tags/improvements.md>), [platform](<https://devfeed.tech/tags/platform.md>), [postgresql](<https://devfeed.tech/tags/postgresql.md>), [preview](<https://devfeed.tech/tags/preview.md>), [releases](<https://devfeed.tech/tags/releases.md>), [server](<https://devfeed.tech/tags/server.md>), [status](<https://devfeed.tech/tags/status.md>), [ui](<https://devfeed.tech/tags/ui.md>), [update](<https://devfeed.tech/tags/update.md>)

### AI overview

The Debezium Platform UI adds contextual documentation links, pipeline deployment status with error details and restart controls, and transform configuration generated from component descriptors. These changes aim to make pipeline setup and troubleshooting easier within the UI.

### Source excerpt

The Debezium Platform UI gives you a central place to design pipelines, configure sources, transforms, and destinations, and keep an eye on what is running. Over the last few preview releases, we have shipped improvements that make that work faster and clearer, with less need to leave the UI to look something up. This post walks through four of those changes: Quick access to documentation from inside Debezium Platform UI Pipeline status, failure feedback, and restart Transform configuration driven by component descriptors Exporting a Debezium Server configuration from an existing pipeline Read more...

## What is Debezium? CDC architecture and how it works

DevFeed: [What is Debezium? CDC architecture and how it works](<https://devfeed.tech/articles/what-is-debezium-cdc-architecture-and-how-it-works-78461.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/when-to-use-debezium-for-your-database-replication>)

Author: Fivetran

Published: 2026-07-22T21:03:36Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Snowflake streaming data architecture](<https://devfeed.tech/topics/snowflake-streaming-data-architecture.md>), [Messaging](<https://devfeed.tech/topics/messaging.md>), [Cloud Architecture](<https://devfeed.tech/topics/cloud-architecture.md>), [CockroachDB](<https://devfeed.tech/topics/cockroachdb.md>)

Tags: [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [database-replication](<https://devfeed.tech/tags/database-replication.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [sql-server](<https://devfeed.tech/tags/sql-server.md>)

### AI overview

This article explains how Debezium captures database changes from transaction logs and streams them through CDC pipelines. It describes the architecture, supported databases, and Kafka Connect, Debezium Server, and Embedded Engine deployment modes, then compares the operational overhead with Fivetran's managed CDC connectors.

### Source excerpt

Learn what Debezium is, how its CDC architecture and connectors support MySQL and SQL Server, and which of the three deployment modes fits your pipeline.

## What is Debezium? CDC architecture and how it works

DevFeed: [What is Debezium? CDC architecture and how it works](<https://devfeed.tech/articles/what-is-debezium-cdc-architecture-and-how-it-works-136825.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/when-to-use-debezium-for-your-database-replication>)

Author: Fivetran

Published: 2026-07-22T21:03:36Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [architecture-components](<https://devfeed.tech/topics/architecture-components.md>), [event-driven data processing](<https://devfeed.tech/topics/event-driven-data-processing.md>), [Messaging](<https://devfeed.tech/topics/messaging.md>), [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [Publish-subscribe pattern](<https://devfeed.tech/topics/pubsub.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [sql-server](<https://devfeed.tech/topics/sql-server.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [account](<https://devfeed.tech/tags/account.md>), [adapters](<https://devfeed.tech/tags/adapters.md>), [added](<https://devfeed.tech/tags/added.md>), [all](<https://devfeed.tech/tags/all.md>), [alternatives](<https://devfeed.tech/tags/alternatives.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [mysql](<https://devfeed.tech/tags/mysql.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [server](<https://devfeed.tech/tags/server.md>), [sql-server](<https://devfeed.tech/tags/sql-server.md>), [support](<https://devfeed.tech/tags/support.md>), [what-is](<https://devfeed.tech/tags/what-is.md>), [works](<https://devfeed.tech/tags/works.md>)

### AI overview

Debezium captures row changes by reading database transaction logs and streams them to downstream consumers, commonly through Kafka. Its standard architecture uses database-specific connectors running on Kafka Connect, with a schema registry tracking payload changes. The article identifies connectors for MySQL, PostgreSQL, SQL Server, MongoDB, and Oracle. It describes three deployment modes: Kafka Connect offers distributed scaling and fault tolerance but requires Kafka infrastructure; Debezium Server can send events to systems such as Kinesis, Pub/Sub, or Redis Streams with simpler deployment but without Kafka Connect's automatic clustering and failover; and the embedded Java Engine gives applications direct event callbacks while leaving offset management, error handling, and state storage to the implementer. Downstream event processing and operating the infrastructure remain separate responsibilities.

### Source excerpt

Learn what Debezium is, how its CDC architecture and connectors support MySQL and SQL Server, and which of the three deployment modes fits your pipeline.

## Flink CDC for YugabyteDB

DevFeed: [Flink CDC for YugabyteDB](<https://devfeed.tech/articles/flink-cdc-for-yugabytedb-80943.md>)

Original publisher: [Read original article](<https://www.yugabyte.com/blog/flink-cdc-for-yugabytedb/>)

Author: Bakul Gupta

Published: 2026-07-09T11:06:05Z

Content type: tutorial

Language: en

Sources: [The Distributed SQL Blog](<https://devfeed.tech/sources/the-distributed-sql-blog.md>)

Topics: [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>), [Apache Flink](<https://devfeed.tech/topics/apache-flink.md>), [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>)

Tags: [apache-flink](<https://devfeed.tech/tags/apache-flink.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [database](<https://devfeed.tech/tags/database.md>), [distributed-sql](<https://devfeed.tech/tags/distributed-sql.md>), [flink](<https://devfeed.tech/tags/flink.md>), [flink-cdc](<https://devfeed.tech/tags/flink-cdc.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [yugabytedb](<https://devfeed.tech/tags/yugabytedb.md>)

### AI overview

The article describes a YugabyteDB source integration for Flink CDC, which is available as a Tech Preview. It explains how the integration captures database changes, how the connector was adapted for YugabyteDB's distributed behavior, and how to configure a streaming pipeline to PostgreSQL, including known limitations and operational guidance.

### Source excerpt

Flink CDC turns YugabyteDB into a change-data-capture source for Apache Flink, so you can stream every insert, update, and delete to Kafka, a data lake, or another database in real time. This blog explains how Flink CDC works and the changes that led to the YugabyteDB integration reaching Tech Preview. The post Flink CDC for YugabyteDB appeared first on Yugabyte.

## How to Evaluate Change Data Capture (CDC) Solutions: Key Considerations for Buyers

DevFeed: [How to Evaluate Change Data Capture (CDC) Solutions: Key Considerations for Buyers](<https://devfeed.tech/articles/how-to-evaluate-change-data-capture-cdc-solutions-key-considerations-for-buyers-82159.md>)

Original publisher: [Read original article](<https://estuary.dev/blog/how-to-evaluate-cdc-solutions>)

Author: Emily Lucek

Published: 2026-05-02T06:12:50Z

Content type: tutorial

Language: en

Sources: [Estuary](<https://devfeed.tech/sources/estuary.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [internal developer platform automation](<https://devfeed.tech/topics/internal-developer-platform-automation.md>)

Tags: [aws-privatelink](<https://devfeed.tech/tags/aws-privatelink.md>), [batch](<https://devfeed.tech/tags/batch.md>), [byoc-deployment](<https://devfeed.tech/tags/byoc-deployment.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [cdc-tools](<https://devfeed.tech/tags/cdc-tools.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [concurrent](<https://devfeed.tech/tags/concurrent.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data](<https://devfeed.tech/tags/data.md>), [data-movement](<https://devfeed.tech/tags/data-movement.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [use-case](<https://devfeed.tech/tags/use-case.md>)

### AI overview

This guide explains how data teams can evaluate change data capture (CDC) platforms across capture methods, source database impact, latency, delivery guarantees, backfills, schema changes, operations, security, deployment, and cost. It recommends testing representative workloads and failure scenarios in a proof of concept, including bursts, backlog recovery, destination outages, concurrent backfills, and schema changes.

### Source excerpt

Figuring out the correct change data capture (CDC) solution to use can be confusing. Follow these criteria for evaluating CDC tools so you can make the right decision based on your use case and requirements.

## From Always-On to On-Demand: Scaling Kafka Sinks with KEDA

DevFeed: [From Always-On to On-Demand: Scaling Kafka Sinks with KEDA](<https://devfeed.tech/articles/from-always-on-to-on-demand-scaling-kafka-sinks-with-keda-28057.md>)

Original publisher: [Read original article](<https://tech.trivago.com/post/2026-02-18-from-always-on-to-on-demand-scaling-kafka-sinks-with-keda/>)

Author: Armin Aminian SRE; Cloud Native technologies GitHub profile Linkedin profile

Published: 2026-02-18T00:00:00Z

Content type: article

Language: en

Sources: [Trivago](<https://devfeed.tech/sources/trivago.md>)

Topics: [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Deployment & Scaling](<https://devfeed.tech/topics/deployment-scaling.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Cloud Architecture](<https://devfeed.tech/topics/cloud-architecture.md>), [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [about](<https://devfeed.tech/tags/about.md>), [actions](<https://devfeed.tech/tags/actions.md>), [activation](<https://devfeed.tech/tags/activation.md>), [adapters](<https://devfeed.tech/tags/adapters.md>), [aggregate](<https://devfeed.tech/tags/aggregate.md>), [backend](<https://devfeed.tech/tags/backend.md>), [changes](<https://devfeed.tech/tags/changes.md>), [data](<https://devfeed.tech/tags/data.md>), [demand](<https://devfeed.tech/tags/demand.md>), [devops](<https://devfeed.tech/tags/devops.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [features](<https://devfeed.tech/tags/features.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [keep](<https://devfeed.tech/tags/keep.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [services](<https://devfeed.tech/tags/services.md>), [systems](<https://devfeed.tech/tags/systems.md>), [teams](<https://devfeed.tech/tags/teams.md>), [up](<https://devfeed.tech/tags/up.md>), [user](<https://devfeed.tech/tags/user.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

trivago used KEDA's Kafka scaler to run its 50+ Kubernetes sinks on demand, scaling deployments to zero when consumer lag is absent and up as backlogs grow. Sinks process Kafka changes into service-local databases; CPU and memory autoscaling had been poor backlog signals because processing often waits on I/O. The example configuration polls every 30 seconds, uses a lag threshold of 100, a five-minute cooldown, and a fallback of one replica after six consecutive metric failures. Maximum replicas should reflect topic partitions and downstream database capacity, and KEDA and the sink must use the same consumer group. For topics quiet enough that Kafka may delete inactive groups after two weeks, a weekly Cron scaler briefly starts one replica; wake-up times are staggered. The team rolled out from one non-critical sink in one region, monitored it for a week, then expanded gradually while comparing Kafka and KEDA metrics. They report reducing average daily consumption from about 50 replica-hours per region to 1-2, with burst handling driven by lag.

### Source excerpt

Kafka sits at the heart of how we move data between systems at trivago. Many teams publish changes to Kafka, and downstream services consume those changes to keep user-facing features up to date...

## Change Data Capture Isn't Magic: The Reality of Handling CDC Yourself

DevFeed: [Change Data Capture Isn't Magic: The Reality of Handling CDC Yourself](<https://devfeed.tech/articles/change-data-capture-isn-t-magic-the-reality-of-handling-cdc-yourself-82036.md>)

Original publisher: [Read original article](<https://estuary.dev/blog/cdc-magic>)

Author: Emmanuel Ogunwede

Published: 2025-06-11T18:00:52Z

Content type: comparison

Language: en

Sources: [Estuary](<https://devfeed.tech/sources/estuary.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Event-Streaming](<https://devfeed.tech/topics/event-streaming.md>), [schema-evolution](<https://devfeed.tech/topics/schema-evolution.md>)

Tags: [cdc](<https://devfeed.tech/tags/cdc.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [costs](<https://devfeed.tech/tags/costs.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [estuary](<https://devfeed.tech/tags/estuary.md>), [kafka](<https://devfeed.tech/tags/kafka.md>)

### AI overview

The article compares operating change data capture pipelines with Debezium, Kafka Connect, and Kafka against using Estuary's managed service. It examines snapshot recovery, duplicate events, JVM tuning, monitoring, schema evolution, and engineering costs. It argues that managed CDC can reduce operational work while supporting streaming, batch ingestion, backfills, and transformations.

### Source excerpt

Struggling with Debezium and Kafka Connect? Discover the hidden costs of DIY CDC and why managed solutions like Estuary are a smarter choice.

## Debezium for CDC in Production: Pain Points and Limitations

DevFeed: [Debezium for CDC in Production: Pain Points and Limitations](<https://devfeed.tech/articles/debezium-for-cdc-in-production-pain-points-and-limitations-82084.md>)

Original publisher: [Read original article](<https://estuary.dev/blog/debezium-cdc-pain-points>)

Author: Dani Pálma

Published: 2025-04-27T23:16:39Z

Content type: article

Language: en

Sources: [Estuary](<https://devfeed.tech/sources/estuary.md>)

Topics: [Debezium Connector](<https://devfeed.tech/topics/debezium-connector.md>), [Production Engineering](<https://devfeed.tech/topics/production-engineering.md>), [Snowflake streaming data architecture](<https://devfeed.tech/topics/snowflake-streaming-data-architecture.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [libSQL](<https://devfeed.tech/topics/libsql.md>)

Tags: [apache-flink](<https://devfeed.tech/tags/apache-flink.md>), [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [auto-scaling](<https://devfeed.tech/tags/auto-scaling.md>), [automation](<https://devfeed.tech/tags/automation.md>), [availability](<https://devfeed.tech/tags/availability.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [column](<https://devfeed.tech/tags/column.md>), [concurrent](<https://devfeed.tech/tags/concurrent.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [debezium](<https://devfeed.tech/tags/debezium.md>), [operational](<https://devfeed.tech/tags/operational.md>), [production](<https://devfeed.tech/tags/production.md>), [teams](<https://devfeed.tech/tags/teams.md>), [technical](<https://devfeed.tech/tags/technical.md>)

### AI overview

The article reviews operational and technical challenges of running Debezium for change data capture in production. It covers Kafka infrastructure and monitoring demands, scaling and recovery limits, throughput and snapshot constraints, duplicate delivery, schema changes, and connector troubleshooting.

### Source excerpt

Running Debezium for CDC isn't easy. Discover the operational and technical challenges teams face in production.

[Next page](<https://devfeed.tech/topics/debezium-connector.md?cursor=WyIyMDI1LTA0LTI3VDIzOjE2OjM5KzAwOjAwIiwgIjdjYTg3Mzc5LTQ3YjctNDRkOC05OGUzLTEzN2Y1MjFlMDQxMiJd>)