# table format

Published articles for table format.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Apache Iceberg Architecture Explained

DevFeed: [Apache Iceberg Architecture Explained](<https://devfeed.tech/articles/apache-iceberg-architecture-explained-88575.md>)

Original publisher: [Read original article](<https://www.starburst.io/blog/apache-iceberg-architecture-explained>)

Published: 2026-10-16T08:00:04Z

Content type: article

Language: en

Sources: [Starburst Data](<https://devfeed.tech/sources/starburst-data.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [table-partitioning](<https://devfeed.tech/topics/table-partitioning.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-iceberg-architecture](<https://devfeed.tech/tags/apache-iceberg-architecture.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [format](<https://devfeed.tech/tags/format.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [iceberg](<https://devfeed.tech/tags/iceberg.md>), [object](<https://devfeed.tech/tags/object.md>), [object-storage](<https://devfeed.tech/tags/object-storage.md>), [open](<https://devfeed.tech/tags/open.md>), [performance](<https://devfeed.tech/tags/performance.md>), [storage](<https://devfeed.tech/tags/storage.md>), [table](<https://devfeed.tech/tags/table.md>), [table-format](<https://devfeed.tech/tags/table-format.md>)

### AI overview

Apache Iceberg tracks tables through a catalog pointer to immutable metadata and data files, rather than inferring table contents from directory layouts. Reads use snapshot and manifest statistics to prune files; writes create new files and metadata, then use an optimistic, atomic catalog pointer swap. This supports concurrent engine access, snapshots and time travel, while row level deletes and updates use delete files. The document distinguishes v2 position and equality deletes from v3 deletion vectors, which replace position deletes, and notes v3's VARIANT type and other additions. Engine and catalog compatibility must be checked before upgrading. Ongoing maintenance--compaction, snapshot expiration, orphan file removal and manifest optimization--helps control small file fragmentation, metadata growth and storage costs.

### Source excerpt

Apache Iceberg is an open table format designed for high-performance analytics running on object storage. ...

## Apache Iceberg vs Apache Parquet: Table Format or File Format?

DevFeed: [Apache Iceberg vs Apache Parquet: Table Format or File Format?](<https://devfeed.tech/articles/apache-iceberg-vs-apache-parquet-table-format-or-file-format-85691.md>)

Original publisher: [Read original article](<https://www.dremio.com/blog/apache-iceberg-vs-apache-parquet/>)

Author: Alex Merced

Published: 2026-10-12T19:19:33Z

Content type: article

Language: en

Sources: [Dremio](<https://devfeed.tech/sources/dremio.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [parquet](<https://devfeed.tech/topics/parquet.md>)

Tags: [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-parquet](<https://devfeed.tech/tags/apache-parquet.md>), [data-lakehouse](<https://devfeed.tech/tags/data-lakehouse.md>), [dremio-blog-open-data-insights](<https://devfeed.tech/tags/dremio-blog-open-data-insights.md>), [format](<https://devfeed.tech/tags/format.md>), [table](<https://devfeed.tech/tags/table.md>), [table-format](<https://devfeed.tech/tags/table-format.md>)

### AI overview

Apache Iceberg and Apache Parquet serve different layers in an analytics data stack. Parquet organizes data within individual files, while Iceberg tracks table membership, snapshots, schema and partition evolution, and atomic commits. Using both lets query engines prune files through Iceberg metadata and skip data within files through Parquet statistics.

### Source excerpt

Iceberg is a table format and Parquet is a file format. They are different layers of one stack, not alternatives, and an Iceberg table contains Parquet files. The post Apache Iceberg vs Apache Parquet: Table Format or File Format? appeared first on Dremio.

## What is DuckLake? The New Open Table Format Explained

DevFeed: [What is DuckLake? The New Open Table Format Explained](<https://devfeed.tech/articles/what-is-ducklake-the-new-open-table-format-explained-82445.md>)

Original publisher: [Read original article](<https://estuary.dev/blog/what-is-ducklake>)

Author: Emily Lucek

Published: 2025-08-21T16:00:00Z

Content type: article

Language: en

Sources: [Estuary](<https://devfeed.tech/sources/estuary.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Test-driven development](<https://devfeed.tech/topics/tdd.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [Amazon S3 Tables](<https://devfeed.tech/topics/amazon-s3-tables.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [component](<https://devfeed.tech/tags/component.md>), [ducklake](<https://devfeed.tech/tags/ducklake.md>), [format](<https://devfeed.tech/tags/format.md>), [motherduck](<https://devfeed.tech/tags/motherduck.md>), [table-format](<https://devfeed.tech/tags/table-format.md>), [what-is](<https://devfeed.tech/tags/what-is.md>)

### AI overview

This guide explains DuckLake, an open table format that stores metadata in a SQL database while keeping data in object storage. It describes its architecture, ACID transactions, schema evolution, snapshots, security, implementation options, and comparisons with Apache Iceberg and Delta Lake. The article also covers analytical use cases, MotherDuck hosting, data pipeline integration, migration, and planned features.

### Source excerpt

DuckLake is the latest open table format. Learn how it stands out from Iceberg, Delta Lake, and others, and try it out for yourself.

## Explaining Data Lakes, Lakehouses, Table Formats and Catalogs

DevFeed: [Explaining Data Lakes, Lakehouses, Table Formats and Catalogs](<https://devfeed.tech/articles/explaining-data-lakes-lakehouses-table-formats-and-catalogs-82117.md>)

Original publisher: [Read original article](<https://estuary.dev/blog/explaining-data-lakes-lakehouses-catalogs>)

Author: Dani Pálma

Published: 2024-06-27T09:27:35Z

Content type: article

Language: en

Sources: [Estuary](<https://devfeed.tech/sources/estuary.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [Snowflake streaming data architecture](<https://devfeed.tech/topics/snowflake-streaming-data-architecture.md>), [table-partitioning](<https://devfeed.tech/topics/table-partitioning.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [ML model versioning](<https://devfeed.tech/topics/ml-model-versioning.md>), [Amazon S3 Tables](<https://devfeed.tech/topics/amazon-s3-tables.md>), [Parquet files in Amazon S3](<https://devfeed.tech/topics/parquet-files-in-amazon-s3.md>)

Tags: [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [data](<https://devfeed.tech/tags/data.md>), [data-engineers](<https://devfeed.tech/tags/data-engineers.md>), [data-lakes](<https://devfeed.tech/tags/data-lakes.md>), [formats](<https://devfeed.tech/tags/formats.md>), [table-format](<https://devfeed.tech/tags/table-format.md>)

### AI overview

This article explains how data lakes and lakehouses use open table formats, metadata catalogs, and compute engines. It compares Apache Iceberg, Delta Lake, and Apache Hudi, then discusses catalog architecture, interoperability, governance, and query engines such as Trino and DuckDB.

### Source excerpt

Explaining Data Lakes, Data Lakehouses, Table Formats and Catalogs. This article aims to demystify the complexity around how these terms relate to each other to help Data Engineers navigate the scene.