# Amazon Redshift

A fully managed, petabyte-scale cloud data warehouse service for SQL analytics.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## How to Launch Fivetran Through the Amazon Redshift Console | Blog | Fivetran

DevFeed: [How to Launch Fivetran Through the Amazon Redshift Console | Blog | Fivetran](<https://devfeed.tech/articles/how-to-launch-fivetran-through-the-amazon-redshift-console-blog-fivetran-141327.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/how-to-launch-fivetran-through-the-amazon-redshift-console>)

Author: Raman Kaler

Published: 2026-11-18T06:13:15Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [elt](<https://devfeed.tech/topics/elt.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [amazon](<https://devfeed.tech/topics/amazon.md>)

Tags: [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [blog](<https://devfeed.tech/tags/blog.md>), [console](<https://devfeed.tech/tags/console.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [integration](<https://devfeed.tech/tags/integration.md>), [launch](<https://devfeed.tech/tags/launch.md>), [native](<https://devfeed.tech/tags/native.md>), [redshift](<https://devfeed.tech/tags/redshift.md>)

### AI overview

Redshift customers can start a 14-day Fivetran trial from the cluster console, with cluster details prefilled for the connection. The instructions cover creating a cluster if needed, selecting Add AWS Partner integration and Fivetran, completing signup and email verification, then entering the Redshift password and choosing Save & Test. The cluster must be publicly accessible, and Fivetran IPs must be whitelisted in its security group. After choosing a source, setting a destination schema, and validating the connector, start the initial sync; the example uses Fivetran Log and produces a fivetran_logs schema and related tables.

### Source excerpt

Amazon Redshift supports native integration with Fivetran. Here's how to set it up.

## Analysis: Fivetran Is the Fastest-Growing Cloud ELT Provider | Blog | Fivetran

DevFeed: [Analysis: Fivetran Is the Fastest-Growing Cloud ELT Provider | Blog | Fivetran](<https://devfeed.tech/articles/analysis-fivetran-is-the-fastest-growing-cloud-elt-provider-blog-fivetran-141312.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/fivetran-is-fastest-growing-cloud-elt-provider>)

Author: Fivetran

Published: 2026-11-18T06:13:15Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [elt](<https://devfeed.tech/topics/elt.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [data transformation](<https://devfeed.tech/topics/data-transformation.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>)

Tags: [analysis](<https://devfeed.tech/tags/analysis.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [automation](<https://devfeed.tech/tags/automation.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [data-ingestion](<https://devfeed.tech/tags/data-ingestion.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [data-movement](<https://devfeed.tech/tags/data-movement.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [data-teams](<https://devfeed.tech/tags/data-teams.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [elt](<https://devfeed.tech/tags/elt.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [gartner](<https://devfeed.tech/tags/gartner.md>)

### AI overview

The text attributes Fivetran's growth to managed cloud data ingestion and ease of use. It quotes Gartner's 2020 market-share report, which says Fivetran nearly doubled revenue from 2019 to 2020 and identifies it as a vendor of choice for moving data from popular SaaS applications and databases into cloud warehouses. The described service uses prebuilt connectors, self-healing pipelines, minimal infrastructure management, and automatic normalization. It also offers in-warehouse SQL transformations powered by dbt, with version control, testing, and documentation. Gartner is quoted as calling this a more complete offering that could support future enterprise adoption and revenue growth.

### Source excerpt

Gartner recognizes Fivetran as the "vendor of choice" for enterprises looking to modernize their data infrastructure.

## Star Schema vs. OBT for Data Warehouse Performance | Blog | Fivetran

DevFeed: [Star Schema vs. OBT for Data Warehouse Performance | Blog | Fivetran](<https://devfeed.tech/articles/star-schema-vs-obt-for-data-warehouse-performance-blog-fivetran-140258.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/star-schema-vs-obt>)

Author: Michael Kaminsky

Published: 2026-11-18T04:42:41Z

Content type: comparison

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [schema design](<https://devfeed.tech/topics/schema-design.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [database-optimization](<https://devfeed.tech/topics/database-optimization.md>), [etl](<https://devfeed.tech/topics/etl.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [analysis](<https://devfeed.tech/tags/analysis.md>), [analysts](<https://devfeed.tech/tags/analysts.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [bi](<https://devfeed.tech/tags/bi.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [blog](<https://devfeed.tech/tags/blog.md>), [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [customer](<https://devfeed.tech/tags/customer.md>), [customers](<https://devfeed.tech/tags/customers.md>), [data](<https://devfeed.tech/tags/data.md>), [data-mining](<https://devfeed.tech/tags/data-mining.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [performance](<https://devfeed.tech/tags/performance.md>), [schema](<https://devfeed.tech/tags/schema.md>), [star](<https://devfeed.tech/tags/star.md>), [vs](<https://devfeed.tech/tags/vs.md>), [warehouse](<https://devfeed.tech/tags/warehouse.md>)

### AI overview

In BI-style tests using TPC-DS 100 data, a denormalized one big table (OBT) generally returned queries faster than a star schema across Redshift, Snowflake, and BigQuery, with reported gains of roughly 25-50%. Results varied by warehouse: Redshift favored OBT in nine of ten queries; Snowflake showed mixed results, with star schema faster on some simpler queries; BigQuery averaged a 49% improvement for OBT and favored it in every tested category. The benchmark covers selected BI queries within each warehouse, not comparisons between warehouses or arbitrary ad hoc workloads. OBT avoids query-time joins, but takes more disk space: on the tested Redshift setup, materializing it raised usage from just over 30 GB to over 90 GB, and a larger join exceeded available space. The article also cites star schema's clearer organization and easier navigation for analysts.

### Source excerpt

Which data warehouse schema offers better performance? Let's find out.

## Press Release: Introducing Fivetran Transformations | Blog | Fivetran

DevFeed: [Press Release: Introducing Fivetran Transformations | Blog | Fivetran](<https://devfeed.tech/articles/press-release-introducing-fivetran-transformations-blog-fivetran-140264.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/transformations-press-release>)

Author: Fivetran

Published: 2026-11-18T02:47:08Z

Content type: release

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [elt](<https://devfeed.tech/topics/elt.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [2019](<https://devfeed.tech/tags/2019.md>), [automated](<https://devfeed.tech/tags/automated.md>), [data](<https://devfeed.tech/tags/data.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [press-release](<https://devfeed.tech/tags/press-release.md>), [tool](<https://devfeed.tech/tags/tool.md>), [transformation](<https://devfeed.tech/tags/transformation.md>), [warehouse](<https://devfeed.tech/tags/warehouse.md>)

### AI overview

Fivetran Transformations runs SQL inside the data warehouse when new data arrives or on a schedule, extending Fivetran's automated connector platform. The release says keeping transformations in the warehouse preserves original data for restoration and can aid scalability and recovery; integrated pipeline management, logging, and notifications help teams diagnose errors. Snowflake users could trial the feature at launch, while support for BigQuery, Redshift, and Azure was described as forthcoming. These are claims from the 2019 announcement.

### Source excerpt

Fivetran introduces new enterprise-ready automated transformation tool featuring in-warehouse data change.

## Multi-statement transactions for Apache Iceberg tables in Amazon Redshift

DevFeed: [Multi-statement transactions for Apache Iceberg tables in Amazon Redshift](<https://devfeed.tech/articles/multi-statement-transactions-for-apache-iceberg-tables-in-amazon-redshift-133388.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/multi-statement-transactions-for-apache-iceberg-tables-in-amazon-redshift/>)

Author: Shiyu Xu

Published: 2026-11-13T19:32:46Z

Content type: release

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Transactions](<https://devfeed.tech/topics/transactions.md>), [Amazon S3 Tables](<https://devfeed.tech/topics/amazon-s3-tables.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [airflow](<https://devfeed.tech/tags/airflow.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-iceberg-tables](<https://devfeed.tech/tags/apache-iceberg-tables.md>), [atomic](<https://devfeed.tech/tags/atomic.md>), [foundational-100](<https://devfeed.tech/tags/foundational-100.md>), [snapshot](<https://devfeed.tech/tags/snapshot.md>), [transactions](<https://devfeed.tech/tags/transactions.md>)

### AI overview

Amazon Redshift Patch 206 and later can group multiple DML statements against one Apache Iceberg table into a single `BEGIN ... COMMIT`, publishing one atomic snapshot. The transaction can include an audit before commit; failures and rollbacks publish no changes. All writes must target the same table using the same reference name, while reads may include uncommitted writes and each table's version is fixed on its first read. Run Iceberg DDL separately. Uncommitted intermediate files can become orphans; S3 Tables removes unreferenced files by default, while Glue tables require the orphan file deletion optimizer enabled in advance. In the reported test, batching 25 small statements reduced total runtime by 14.77% for INSERT and 11.29% for DELETE; heavy data work showed no meaningful speedup. At 32 concurrent writers, four-INSERT transactions achieved 3.59 times the committed-statement rate of auto-commit. Results vary with statement size, partitioning, and contention.

### Source excerpt

Amazon Redshift now supports multi-statement transactions for Apache Iceberg tables, so you can run several DML statements against one Iceberg table inside a single BEGIN...COMMIT and publish them as one atomic Iceberg snapshot. This post explains why one commit per statement makes multi-step pipelines fragile, what you can run in a transaction, and how it performs.

## Introducing the Workday Data Cloud integration with AWS

DevFeed: [Introducing the Workday Data Cloud integration with AWS](<https://devfeed.tech/articles/introducing-the-workday-data-cloud-integration-with-aws-126347.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/introducing-the-workday-data-cloud-integration-with-aws/>)

Author: Poornima Chand

Published: 2026-11-09T22:21:40Z

Content type: release

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-powered](<https://devfeed.tech/tags/ai-powered.md>), [ai-services](<https://devfeed.tech/tags/ai-services.md>), [amazon-sagemaker-unified-studio](<https://devfeed.tech/tags/amazon-sagemaker-unified-studio.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-integration](<https://devfeed.tech/tags/cloud-integration.md>), [data](<https://devfeed.tech/tags/data.md>), [data-cloud](<https://devfeed.tech/tags/data-cloud.md>), [developers](<https://devfeed.tech/tags/developers.md>), [integration](<https://devfeed.tech/tags/integration.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [money](<https://devfeed.tech/tags/money.md>), [people](<https://devfeed.tech/tags/people.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [services](<https://devfeed.tech/tags/services.md>), [workday](<https://devfeed.tech/tags/workday.md>), [zero-copy](<https://devfeed.tech/tags/zero-copy.md>)

### AI overview

Workday Data Cloud and AWS provide bidirectional, zero-copy access to governed data: Workday can query Iceberg tables in S3 through a federated AWS Glue Data Catalog, while AWS services can query Workday data. For near real-time operational queries, Live Data Query runs SQL within Workday's governed environment and returns results to AWS. For broader analytics, ML training, and exploration, Workday Data Connect exposes data as Apache Iceberg tables; compute runs in AWS while the data stays in Workday. Lake Formation governs AWS-side access, and Workday security controls access to Workday data and federated tables. The article says the integration is generally available and describes setup through SageMaker Unified Studio, Glue, Lake Formation, Athena, EMR, Redshift, and Workday Data Cloud.

### Source excerpt

Workday Data Cloud now integrates with AWS, giving developers bi-directional, zero-copy access to Workday's governed people and money data from the AWS analytics and AI services they already use, without brittle pipelines or data duplication.

## Assess and track your Amazon Redshift RA3 to RG modernization with CUDOS

DevFeed: [Assess and track your Amazon Redshift RA3 to RG modernization with CUDOS](<https://devfeed.tech/articles/assess-and-track-your-amazon-redshift-ra3-to-rg-modernization-with-cudos-126344.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/assess-and-track-your-amazon-redshift-ra3-to-rg-modernization-with-cudos/>)

Author: Alex Peshekhonov

Published: 2026-11-09T20:11:01Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [it modernization](<https://devfeed.tech/topics/it-modernization.md>), [Graviton](<https://devfeed.tech/topics/graviton.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [adoption](<https://devfeed.tech/tags/adoption.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [cost-efficiency](<https://devfeed.tech/tags/cost-efficiency.md>), [dashboard](<https://devfeed.tech/tags/dashboard.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [graviton](<https://devfeed.tech/tags/graviton.md>), [modernization](<https://devfeed.tech/tags/modernization.md>), [redshift](<https://devfeed.tech/tags/redshift.md>)

### AI overview

CUDOS 5.10 adds an Amazon Redshift RA3-to-RG section to assess estimated monthly savings from eligible RA3 resources, track the cost mix shifting between generations, and chart realized efficiency gains on RG. Estimates break down by account, cluster, purchase type, and resource; they use list prices and may differ from actual savings because they exclude performance, data-transfer, and other usage-specific factors. Filters model On-Demand or Reserved pricing (the Reserved view is informational; node-type changes do not alter reservations) and adjust the share of data changing between manual snapshots. Deployment uses CloudFormation or a CID Terraform module, with CUR 2.0 source-account stacks, a separate data-collection account, Quick Sight and about 40 GB of SPICE; stacks should be in the same Region. Initial data delivery or refresh can take up to 24 hours, and backfill may take up to 14 months via Billing Support.

### Source excerpt

The CUDOS 5.10 dashboard adds an Amazon Redshift RA3-to-RG section that helps you assess the cost-efficiency opportunity of moving to Graviton-based RG instances, track adoption as your instance-generation mix shifts, and quantify the gains already achieved on RG.

## Store and process large strings in Amazon Redshift SUPER columns

DevFeed: [Store and process large strings in Amazon Redshift SUPER columns](<https://devfeed.tech/articles/store-and-process-large-strings-in-amazon-redshift-super-columns-122142.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/store-and-process-large-strings-in-amazon-redshift-super-columns/>)

Author: Ritesh Sinha

Published: 2026-11-06T20:19:36Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [data type](<https://devfeed.tech/topics/data-type.md>), [data migrations](<https://devfeed.tech/topics/data-migrations.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [sql-database](<https://devfeed.tech/topics/sql-database.md>), [cloud-migration](<https://devfeed.tech/topics/cloud-migration.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [arrays](<https://devfeed.tech/tags/arrays.md>), [data](<https://devfeed.tech/tags/data.md>), [data-type](<https://devfeed.tech/tags/data-type.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [data-workflows](<https://devfeed.tech/tags/data-workflows.md>), [json](<https://devfeed.tech/tags/json.md>), [migration](<https://devfeed.tech/tags/migration.md>), [semi](<https://devfeed.tech/tags/semi.md>), [simplify](<https://devfeed.tech/tags/simplify.md>), [store](<https://devfeed.tech/tags/store.md>), [strings](<https://devfeed.tech/tags/strings.md>), [structured-data](<https://devfeed.tech/tags/structured-data.md>), [type](<https://devfeed.tech/tags/type.md>)

### AI overview

Amazon Redshift's SUPER enhancements let you store individual strings in semi-structured data up to 16 million bytes, process long strings in memory, and use SUPER in databases with case-insensitive collation. Large-string support requires patch 206 or later and `enable_large_strings_opt_in` set to Yes; provisioned clusters must be rebooted, while Serverless uses a workgroup setting. Cast SUPER values to VARCHAR before applying string functions to avoid errors and truncation. The larger limit applies to in-memory operations, not VARCHAR(MAX) table columns; views, UDFs, and stored procedures created before enabling the setting must be recreated to use it. Case-insensitive database behavior can coexist with SUPER, with `COLLATE` specifying case sensitivity where needed. The text also recommends setting SUPER attribute case handling carefully, explicitly casting values, and aligning the large-string setting across data-sharing warehouses.

### Source excerpt

Storing large semi-structured data such as JSON and arrays in a data warehouse often means splitting or truncating your data. With PartiQL and the SUPER data type, Amazon Redshift is now equipped to handle these issues. In this post, we walk you through three key SUPER data type enhancements that simplify semi-structured data workflows and reduce common migration challenges.

## Why Keep a Data Warehouse If You Are Adopting a Data Lakehouse?

DevFeed: [Why Keep a Data Warehouse If You Are Adopting a Data Lakehouse?](<https://devfeed.tech/articles/why-keep-a-data-warehouse-if-you-are-adopting-a-data-lakehouse-121498.md>)

Original publisher: [Read original article](<https://www.starburst.io/blog/why-keep-a-data-warehouse-if-you-are-adopting-a-data-lakehouse>)

Published: 2026-11-05T22:52:02Z

Content type: article

Language: en

Sources: [Starburst Data](<https://devfeed.tech/sources/starburst-data.md>)

Topics: [data lake](<https://devfeed.tech/topics/data-lake.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [data migrations](<https://devfeed.tech/topics/data-migrations.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [etl](<https://devfeed.tech/topics/etl.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-iceberg-tables](<https://devfeed.tech/tags/apache-iceberg-tables.md>), [batch](<https://devfeed.tech/tags/batch.md>), [bi](<https://devfeed.tech/tags/bi.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [business-intelligence](<https://devfeed.tech/tags/business-intelligence.md>), [cloud-data-warehouse](<https://devfeed.tech/tags/cloud-data-warehouse.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [concurrent](<https://devfeed.tech/tags/concurrent.md>), [cost](<https://devfeed.tech/tags/cost.md>), [costs](<https://devfeed.tech/tags/costs.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lakehouse](<https://devfeed.tech/tags/data-lakehouse.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [warehouse](<https://devfeed.tech/tags/warehouse.md>)

### AI overview

The article recommends keeping a cloud data warehouse and an Iceberg-based lakehouse side by side, matching each workload to its needs and moving workloads gradually. Warehouses such as Snowflake, Redshift, and BigQuery remain suited to small, stable, governed data and high-concurrency BI, where managed performance may justify proprietary storage and indexing. Their costs can grow faster than useful query work due to idle or oversized clusters, egress, and duplicated data and pipelines. Open Iceberg tables add schema enforcement, ACID transactions, and time travel on object storage; they may better fit large or semi-structured data and shared access across teams or platforms. Iceberg's optimistic concurrency suits batch and merge-style writes, so frequent small-row writes need evaluation. The suggested low-risk approach is to query both platforms in place through a federated SQL layer, compare cost and performance on candidate workloads, then migrate incrementally based on evidence.

### Source excerpt

Adopting a data lakehouse doesn't mean retiring the cloud data warehouse on day one. Most ...

## How KOHO built a Claude-powered self-serve analytics tool on years of dbt governance

DevFeed: [How KOHO built a Claude-powered self-serve analytics tool on years of dbt governance](<https://devfeed.tech/articles/how-koho-built-a-claude-powered-self-serve-analytics-tool-on-years-of-dbt-governance-102640.md>)

Original publisher: [Read original article](<https://www.getdbt.com/blog/claude-self-serve-analytics-dbt-governance>)

Author: Daniel Poppy

Published: 2026-10-27T18:44:00Z

Content type: news

Language: en

Sources: [dbt Labs](<https://devfeed.tech/sources/dbt-labs.md>)

Topics: [analytics stack](<https://devfeed.tech/topics/analytics-stack.md>), [metric-standardization](<https://devfeed.tech/topics/metric-standardization.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Claude Code](<https://devfeed.tech/topics/claude-code.md>), [DataOps](<https://devfeed.tech/topics/dataops.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [bedrock](<https://devfeed.tech/tags/bedrock.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-code](<https://devfeed.tech/tags/claude-code.md>), [context](<https://devfeed.tech/tags/context.md>), [context-libraries](<https://devfeed.tech/tags/context-libraries.md>), [culture](<https://devfeed.tech/tags/culture.md>), [data](<https://devfeed.tech/tags/data.md>), [data-team](<https://devfeed.tech/tags/data-team.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fintech](<https://devfeed.tech/tags/fintech.md>), [foundations](<https://devfeed.tech/tags/foundations.md>), [governance](<https://devfeed.tech/tags/governance.md>), [learn](<https://devfeed.tech/tags/learn.md>), [self-serve-analytics](<https://devfeed.tech/tags/self-serve-analytics.md>)

### AI overview

KOHO's KoDa lets employees ask analytics questions in Claude and receive answers from certified dbt marts in Redshift, using Bedrock and Claude. KOHO says the tool depended on years of data culture and governance: its dbt foundation has about 1,400 tested and documented models, with PII removed. KoDa is limited to analytics, uses no raw data, is read-only, and applies shared company-wide metric definitions. It connects a markdown-based "KoDa skill" and pre- and post-hook MCP calls through Claude Code to a Redshift MCP server. The team's substantial work went into evaluation: a library of about 375 real analyst questions supports offline quality checks and weekly human review of logged questions. KOHO still reviews self-serve results intended for the board; the speakers identify company-wide data literacy and knowing when to trust an answer as ongoing challenges.

### Source excerpt

KOHO explains why AI self-serve analytics needs a strong data culture and a governed dbt foundation first.

## Stop Picking T-Shirt Sizes: What Running Adaptive Compute Taught Me

DevFeed: [Stop Picking T-Shirt Sizes: What Running Adaptive Compute Taught Me](<https://devfeed.tech/articles/stop-picking-t-shirt-sizes-what-running-adaptive-compute-taught-me-94018.md>)

Original publisher: [Read original article](<https://medium.com/snowflake/stop-picking-t-shirt-sizes-what-running-adaptive-compute-taught-me-b2b8f4973cdd?source=rss----34b6daafc07---4>)

Author: Vedprakash

Published: 2026-10-22T00:01:03Z

Content type: article

Language: en

Sources: [Snowflake Builders](<https://devfeed.tech/sources/snowflake-builders.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [etl](<https://devfeed.tech/topics/etl.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [adaptive](<https://devfeed.tech/tags/adaptive.md>), [adaptive-compute](<https://devfeed.tech/tags/adaptive-compute.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [automation](<https://devfeed.tech/tags/automation.md>), [aws](<https://devfeed.tech/tags/aws.md>), [bi](<https://devfeed.tech/tags/bi.md>), [bill](<https://devfeed.tech/tags/bill.md>), [code](<https://devfeed.tech/tags/code.md>), [code-review](<https://devfeed.tech/tags/code-review.md>), [compute](<https://devfeed.tech/tags/compute.md>), [config](<https://devfeed.tech/tags/config.md>), [cortex](<https://devfeed.tech/tags/cortex.md>), [cortex-agent](<https://devfeed.tech/tags/cortex-agent.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data](<https://devfeed.tech/tags/data.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [platform-engineering](<https://devfeed.tech/tags/platform-engineering.md>), [running](<https://devfeed.tech/tags/running.md>)

### AI overview

The author's AWS proof of concept found faster queries across BI, dbt ELT, ad hoc analytics, and data loading after moving from Gen1 standard warehouses to Snowflake Adaptive Compute; the trial was too short to establish cost savings. Adaptive Warehouses route account jobs through a dedicated shared compute pool, charge per query, and replace size, cluster, acceleration, and suspend settings with a per-query performance ceiling and a throughput multiplier. The author recommends piloting with derived defaults, comparing query credits and queue time, tuning the multiplier when queuing appears, then expanding in waves with budgets, monitors, and alerts. Conversions run online but temporarily bill old and new compute together. Adaptive requires Enterprise Edition or higher and is not suited to every workload; the excerpt names standard Gen2, interactive, and Snowpark-optimized warehouses as alternatives for particular cases. Per-query metering has up to an hour of latency, may omit very low-usage queries, and lacks an organization-wide view in the described state. Snowflake's throughput-per-dollar benchmark is against Gen2, not the author's Gen1 baseline, and does not mean bills will.」

### Source excerpt

Running Snowflake in the Agent Era, Part 1 of 4. Two dials replaced four knobs, and the hardest decision moved somewhere I did not expect. Fixed warehouse sizes from XS to XL dissolving into one shared compute pool that sizes every query For years, one of the most expensive sentences on my platform was a code review comment that read "bump it to Large?" Every warehouse size was a small bet. Someone looked at a slow dbt model, guessed a size, and that guess sat in config for a year and a half. Multiply that by every warehouse on the account and you get a bill that reflects history rather than workload. This year the bet got harder. Agents started writing SQL. A CoCo session exploring a schema, a Cortex Agent answering a finance question, an automation running a nightly health check: none of them produce the tidy, predictable query shapes we sized for. Cortex Code and Cortex Agents are both generally available, so this is not a future problem. Snowflake made the same point in its GA announcement, describing "agents' dynamic SQL generation" as "naturally spiky and unpredictable". So when Adaptive Compute became generally available on 16 June 2026, I did not treat it as another warehouse type. I treated it as a question: can I stop making sizing bets altogether? I ran a proof of concept against our Gen1 standard warehouses on AWS, across the four workloads we actually run: BI dashboards, ELT with dbt, ad hoc analytics, and data loading. This post is what I found. Why warehouse sizing was always a bet A standard warehouse asks you four questions up front. How big should each cluster be? How many clusters can it scale to? Should Query Acceleration Service (generally available since 2023) help with outliers? When should it suspend? Every answer is a prediction about queries that have not been written yet. Get it wrong in one direction and you pay for idle headroom. Get it wrong in the other and queries queue. Gen2 standard warehouses (generally available since May 2025) ma

## Build a Reliable Analytics Pipeline Before Moving to a Data Warehouse

DevFeed: [Build a Reliable Analytics Pipeline Before Moving to a Data Warehouse](<https://devfeed.tech/articles/build-a-reliable-analytics-pipeline-before-moving-to-a-data-warehouse-92895.md>)

Original publisher: [Read original article](<https://www.sitepoint.com/build-a-reliable-analytics-pipeline-before-moving-to-a-data-warehouse/>)

Author: tbutt4438

Published: 2026-10-21T13:16:13Z

Content type: tutorial

Language: en

Sources: [SitePoint](<https://devfeed.tech/sources/sitepoint.md>)

Topics: [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [metric-standardization](<https://devfeed.tech/topics/metric-standardization.md>), [DataOps](<https://devfeed.tech/topics/dataops.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>)

Tags: [agile-development](<https://devfeed.tech/tags/agile-development.md>), [ai](<https://devfeed.tech/tags/ai.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analytics-pipeline](<https://devfeed.tech/tags/analytics-pipeline.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>)

### AI overview

Define a metric contract and reporting grain before choosing a warehouse. In the example, raw order deliveries are preserved, duplicates and versions are resolved in staging, and reporting includes only each order's latest state. Ranking versions before filtering status prevents a refunded order's older paid version from inflating sales: the example's correct total is 12,500 cents, not 27,500. Add failing-row and behavior tests for conflicting versions, late arrivals, and retries. Incremental pipelines must recompute changed orders and affected old and new reporting groups; deletions need explicit handling. PostgreSQL can prototype the pipeline, dbt can organize maintained SQL models and tests, and Airflow can coordinate dependent jobs and retries. These tools address different responsibilities and do not ensure source completeness. Measure performance, concurrency, freshness, and application impact before migrating, and expose freshness and validation status with dashboard results.

### Source excerpt

null Continue reading Build a Reliable Analytics Pipeline Before Moving to a Data Warehouse on SitePoint.

## dbt and Amazon Redshift Data Sharing: Multi-cluster pipelines without moving a byte

DevFeed: [dbt and Amazon Redshift Data Sharing: Multi-cluster pipelines without moving a byte](<https://devfeed.tech/articles/dbt-and-amazon-redshift-data-sharing-multi-cluster-pipelines-without-moving-a-byte-87722.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/dbt-and-amazon-redshift-data-sharing-multi-cluster-pipelines-without-moving-a-byte/>)

Author: Neela Kulkarni

Published: 2026-10-15T18:01:07Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Test-driven development](<https://devfeed.tech/topics/tdd.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [aws](<https://devfeed.tech/tags/aws.md>), [ci-cd](<https://devfeed.tech/tags/ci-cd.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

A walkthrough shows how to share live data between Amazon Redshift clusters without copying it, then use dbt Cloud to build analytics models on the consumer cluster. It covers datashare setup, access permissions, connectivity, dbt configuration, model materialization, and deployment considerations.

### Source excerpt

Learn how to set up Amazon Redshift Data Sharing between a producer and consumer cluster and use dbt Cloud to transform the shared data into analytics-ready models, with live, zero-copy access and no ETL between clusters.

## Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran

DevFeed: [Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran](<https://devfeed.tech/articles/governing-your-lakehouse-with-fivetran-managed-data-lake-service-blog-fivetran-136781.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/governing-your-lakehouse-with-fivetran-managed-data-lake-service>)

Author: Andrew Madson

Published: 2026-10-13T16:41:32Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Management](<https://devfeed.tech/topics/data-management.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [data ownership](<https://devfeed.tech/topics/data-ownership.md>), [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Security, Identity, & Compliance](<https://devfeed.tech/topics/security-identity-compliance.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [schema-evolution](<https://devfeed.tech/topics/schema-evolution.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-polaris](<https://devfeed.tech/tags/apache-polaris.md>), [athena](<https://devfeed.tech/tags/athena.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [automated](<https://devfeed.tech/tags/automated.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-privatelink](<https://devfeed.tech/tags/aws-privatelink.md>), [azure](<https://devfeed.tech/tags/azure.md>), [biglake](<https://devfeed.tech/tags/biglake.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [governance](<https://devfeed.tech/tags/governance.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [lifecycle](<https://devfeed.tech/tags/lifecycle.md>)

### AI overview

The excerpt presents Fivetran Managed Data Lake governance as a single-source-of-truth model: Fivetran alone writes Iceberg metadata, while query engines read it, and Fivetran republishes the correct version if AWS Glue drifts. Engines can use the Iceberg REST Catalog with OAuth2; Athena and Redshift require Glue integration enabled at destination setup, a permanent choice with regional and naming constraints. Access controls include short-lived, table-scoped S3 credentials, cross-account IAM, and optional KMS, Lake Formation, and Business Critical PrivateLink configuration. Automated retention, metadata version cleanup, biweekly orphan-file removal, compaction, deduplication, and schema evolution address lifecycle work. The excerpt warns against manual catalog changes and raw Parquet queries, and notes cloud-specific catalog requirements, including BigQuery Admin access for GCS BigLake.

### Source excerpt

Lakehouse governance requires observability, access control, data lifecycle management, and more. Fivetran MDLS makes it easy.

## dbt adds Redshift data sharing for cross-database writes and faster runs

DevFeed: [dbt adds Redshift data sharing for cross-database writes and faster runs](<https://devfeed.tech/articles/dbt-now-supports-amazon-redshift-data-sharing-and-your-pipelines-just-got-a-lot-faster-84273.md>)

Original publisher: [Read original article](<https://www.getdbt.com/blog/dbt-now-supports-amazon-redshift-data-sharing>)

Author: Stephen Robb

Published: 2026-10-09T22:02:00Z

Content type: release

Language: en

Sources: [dbt Labs](<https://devfeed.tech/sources/dbt-labs.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [data observability](<https://devfeed.tech/topics/data-observability.md>), [AWS Organizations](<https://devfeed.tech/topics/aws-organizations.md>)

Tags: [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [aws](<https://devfeed.tech/tags/aws.md>), [build](<https://devfeed.tech/tags/build.md>), [ci](<https://devfeed.tech/tags/ci.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [database](<https://devfeed.tech/tags/database.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [partnerships](<https://devfeed.tech/tags/partnerships.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>)

### AI overview

dbt adds native Amazon Redshift data sharing support, allowing models to write across databases and teams to use shared data across clusters without copying it. An adapter metadata API upgrade also improves metadata resolution and run performance, including under high concurrency. The release supports isolated development and CI workflows, with limitations such as consumer-side views being unable to reference datashared tables directly.

### Source excerpt

dbt now supports Amazon Redshift data sharing: write across databases, isolate dev and CI, and run faster without copying data.

## Set Budgets and Alerts for Cloud Data Warehouse Costs

DevFeed: [Set Budgets and Alerts for Cloud Data Warehouse Costs](<https://devfeed.tech/articles/set-budgets-and-alerts-for-cloud-data-warehouse-costs-76961.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/set-budgets-and-alerts-cloud-data-warehouse-costs>)

Author: Shweta Verma; Lingeshwaran Kanniappan

Published: 2026-10-07T19:02:06Z

Content type: tutorial

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [finops](<https://devfeed.tech/topics/finops.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [cloud-data](<https://devfeed.tech/tags/cloud-data.md>), [costs](<https://devfeed.tech/tags/costs.md>), [data-warehousing](<https://devfeed.tech/tags/data-warehousing.md>), [sql](<https://devfeed.tech/tags/sql.md>)

### AI overview

The article presents a five-pillar approach to managing Databricks SQL warehouse costs: attribute usage with warehouse and query tags, set layered budgets and alerts, monitor spending with dashboards, and optimize workloads. It notes that budgets provide monitoring rather than hard spending caps and recommends addressing query and data-layer efficiency.

### Source excerpt

Every analytics team has been here: a month-end invoice arrives, and a single SQL...

## AWS' support for Iceberg materialized views on Redshift could help lower analytics costs

DevFeed: [AWS' support for Iceberg materialized views on Redshift could help lower analytics costs](<https://devfeed.tech/articles/aws-support-for-iceberg-materialized-views-on-redshift-could-help-lower-analytics-costs-66645.md>)

Original publisher: [Read original article](<https://www.infoworld.com/article/4231841/aws-support-for-iceberg-materialized-views-on-redshift-could-help-lower-analytics-costs.html>)

Author: Anirban Ghoshal

Published: 2026-10-07T13:12:26Z

Content type: news

Language: en

Sources: [InfoWorld](<https://devfeed.tech/sources/infoworld.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>)

Tags: [amazon-web-services](<https://devfeed.tech/tags/amazon-web-services.md>), [amazon-web-services-analytics-data-warehousing](<https://devfeed.tech/tags/amazon-web-services-analytics-data-warehousing.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [cloud-data](<https://devfeed.tech/tags/cloud-data.md>), [costs](<https://devfeed.tech/tags/costs.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [data-platforms](<https://devfeed.tech/tags/data-platforms.md>), [data-warehousing](<https://devfeed.tech/tags/data-warehousing.md>), [iceberg](<https://devfeed.tech/tags/iceberg.md>), [redshift](<https://devfeed.tech/tags/redshift.md>)

### AI overview

AWS added support for Iceberg materialized views in Amazon Redshift. The precomputed query results can be reused across analytics engines such as Spark and Athena, reducing duplicated pipelines and repeated compute. The article reports that this interoperability may lower analytics costs, improve metric consistency, and give enterprises more flexibility across data platforms.

### Source excerpt

AWS has added support for Iceberg materialized views to its managed cloud data warehouse service, Amazon Redshift, in an effort to help enterprises lower analytics costs. Materialized views are precomputed, stored results of queries that data warehouses such as Redshift can use to avoid repeatedly running compute-intensive queries when the same analytical workloads are run repeatedly, reducing compute consumption and costs. Redshift's added support for Iceberg materialized views, which are query results stored in Iceberg tables, means enterprises with data spread across multiple warehouses and analytics engines such as Spark and Athena can reuse the same precomputed results from Redshift across those environments without having to replicate data or build separate pipelines, AWS wrote in a blog post. The support also lets Redshift use Iceberg materialized views generated by other analytics engines, giving enterprises greater interoperability across data platforms, it added. Added support could reduce integration complexity That interoperability should reduce the integration burden and complexity on data engineering teams as they don't have to "waste time" copying data and building ETL pipelines, said Pareekh Jain, principal analyst at Pareekh Consulting. The reduced duplication of pipelines could also improve the efficiency and productivity of data teams across an enterprise, according to Amit Chandak, chief analytics officer at IT consulting firm Kanerika. "Enterprise teams often calculate the same business metrics separately for dashboards and data science workloads, with each copy requiring its own pipeline. With support for Iceberg materialized views, the need for duplicate pipelines disappears, along with the confusion over which version of a metric is correct," Chandak said. That reduced confusion is also likely to help enterprises scale agentic applications. With Iceberg materialized views, enterprises can now store the results of frequently used queries, such

## Materialize once, query anywhere: Introducing Iceberg materialized views in Amazon Redshift

DevFeed: [Materialize once, query anywhere: Introducing Iceberg materialized views in Amazon Redshift](<https://devfeed.tech/articles/materialize-once-query-anywhere-introducing-iceberg-materialized-views-in-amazon-redshift-65229.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/materialize-once-query-anywhere-introducing-iceberg-materialized-views-in-amazon-redshift/>)

Author: Sudipta Bagchi

Published: 2026-10-05T21:41:49Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>)

### AI overview

Amazon Redshift can create materialized views stored as standard Apache Iceberg tables in Amazon S3 or S3 Tables, allowing compatible engines such as Athena, Spark, and AWS Glue to query shared precomputed results. The post explains use cases, incremental refresh behavior and limits, setup requirements, cross-engine access, and governance options.

### Source excerpt

Amazon Redshift now supports Iceberg materialized views. Compute an aggregation once in Amazon Redshift and store the result as a standard Apache Iceberg table in Amazon S3, queryable by Amazon Athena, Apache Spark, Amazon SageMaker, and AWS Glue. This post covers use cases, incremental refresh, and a step-by-step getting-started guide.

## ClickHouse Workload for Microsoft Fabric: sub-second analytics on OneLake, now in public preview

DevFeed: [ClickHouse Workload for Microsoft Fabric: sub-second analytics on OneLake, now in public preview](<https://devfeed.tech/articles/clickhouse-workload-for-microsoft-fabric-sub-second-analytics-on-onelake-now-in-public-preview-61657.md>)

Original publisher: [Read original article](<https://clickhouse.com/blog/clickhouse-for-microsoft-fabric>)

Author: Alex Francoeur; Aditya Chidurala

Published: 2026-09-29T07:18:14Z

Content type: release

Language: en

Sources: [ClickHouse Blog](<https://devfeed.tech/sources/clickhouse-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Azure](<https://devfeed.tech/topics/azure.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [azure](<https://devfeed.tech/tags/azure.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data](<https://devfeed.tech/tags/data.md>), [github-copilot](<https://devfeed.tech/tags/github-copilot.md>), [microsoft-fabric](<https://devfeed.tech/tags/microsoft-fabric.md>), [preview](<https://devfeed.tech/tags/preview.md>), [public](<https://devfeed.tech/tags/public.md>)

### AI overview

ClickHouse's public preview workload integrates ClickHouse Cloud into Microsoft Fabric as an acceleration layer for OneLake. It syncs OneLake tables to dedicated compute for sub-second queries, serving AI agents, dashboards, and applications at high concurrency while OneLake remains the source of truth.

### Source excerpt

ClickHouse Workload for Microsoft Fabric brings sub-second analytics to OneLake data through a native Fabric workload, with dedicated ClickHouse Cloud compute for agents, dashboards, and applications.

## Getting started with Apache Iceberg write support in Amazon Redshift - Part 3

DevFeed: [Getting started with Apache Iceberg write support in Amazon Redshift - Part 3](<https://devfeed.tech/articles/getting-started-with-apache-iceberg-write-support-in-amazon-redshift-part-3-61008.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/getting-started-with-apache-iceberg-write-support-in-amazon-redshift-part-3/>)

Author: Raghu Kuppala

Published: 2026-09-28T15:48:35Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [parquet](<https://devfeed.tech/topics/parquet.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-s3-tables](<https://devfeed.tech/tags/amazon-s3-tables.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This tutorial shows how Amazon Redshift supports Apache Iceberg table schema and partition evolution through ALTER operations, including column changes, data type widening, table property updates, and partition field changes without rewriting existing data. It also demonstrates creating an AWS Lake Formation resource link in the Amazon S3 Tables catalog for centralized access governance across analytics engines.

### Source excerpt

Amazon Redshift now supports evolving Apache Iceberg table schemas and partition layouts through ALTER statements, with no data rewrites or pipeline rebuilds. In this final post of the series, you rename, add, drop, and widen columns, evolve partitions, and create AWS Lake Formation resource links for governed cross-engine access to Amazon S3 Tables.

## How United Airlines uses Amazon Redshift and AWS Glue Data Catalog federation to query Databricks-managed data

DevFeed: [How United Airlines uses Amazon Redshift and AWS Glue Data Catalog federation to query Databricks-managed data](<https://devfeed.tech/articles/how-united-airlines-uses-amazon-redshift-and-aws-glue-data-catalog-federation-to-query-databricks-managed-data-49921.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/how-united-airlines-uses-amazon-redshift-and-aws-glue-data-catalog-federation-to-query-databricks-managed-data/>)

Author: Vaibhav Agrawal

Published: 2026-09-15T15:59:48Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [data-platform](<https://devfeed.tech/tags/data-platform.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [governance](<https://devfeed.tech/tags/governance.md>), [queries](<https://devfeed.tech/tags/queries.md>), [query-engine](<https://devfeed.tech/tags/query-engine.md>)

### AI overview

This tutorial explains how United Airlines uses AWS Glue Data Catalog federation to query Databricks Unity Catalog data from Amazon Redshift Serverless without duplicating data. It covers querying Iceberg data in Amazon S3 and using AWS Lake Formation for governance.

### Source excerpt

Learn how United Airlines uses AWS Glue Data Catalog federation to query Databricks Unity Catalog data directly from Amazon Redshift Serverless without duplicating data, using resource links and AWS Lake Formation for governance.

## Every team is a data team -- bring Amazon Redshift analytics to ChatGPT Work

DevFeed: [Every team is a data team -- bring Amazon Redshift analytics to ChatGPT Work](<https://devfeed.tech/articles/every-team-is-a-data-team-bring-amazon-redshift-analytics-to-chatgpt-work-49916.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/every-team-is-a-data-team-bring-amazon-redshift-analytics-to-chatgpt-work/>)

Author: Naresh Chainani

Published: 2026-09-10T15:14:01Z

Content type: release

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [ChatGPT](<https://devfeed.tech/topics/chatgpt.md>), [dashboards](<https://devfeed.tech/topics/dashboards.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>)

Tags: [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [aws](<https://devfeed.tech/tags/aws.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data-analytics](<https://devfeed.tech/tags/data-analytics.md>), [openai](<https://devfeed.tech/tags/openai.md>)

### AI overview

AWS announces an AWS Data Analytics plugin for the Data agent in ChatGPT Work. The plugin lets authorized employees query governed Amazon Redshift warehouse and data lake data in natural language, refine analyses, and create shareable dashboards.

### Source excerpt

AWS is announcing the AWS Data Analytics plugin for the new Data agent in ChatGPT Work. Teams can ask questions in natural language, analyze governed data across their Amazon Redshift data warehouse and data lakes, and build shareable dashboards, all from a conversation in ChatGPT Work.

## How Moovit achieved 33% cost optimization through architectural modernization

DevFeed: [How Moovit achieved 33% cost optimization through architectural modernization](<https://devfeed.tech/articles/how-moovit-achieved-33-cost-optimization-through-architectural-modernization-49918.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/how-moovit-achieved-33-cost-optimization-through-architectural-modernization/>)

Author: Saar Porat

Published: 2026-09-03T16:23:46Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>)

Tags: [amazon-emr](<https://devfeed.tech/tags/amazon-emr.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cost-optimization](<https://devfeed.tech/tags/cost-optimization.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data](<https://devfeed.tech/tags/data.md>), [data-architecture](<https://devfeed.tech/tags/data-architecture.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [data-platform](<https://devfeed.tech/tags/data-platform.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [modernization](<https://devfeed.tech/tags/modernization.md>), [offloading](<https://devfeed.tech/tags/offloading.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [serverless](<https://devfeed.tech/tags/serverless.md>), [spark](<https://devfeed.tech/tags/spark.md>), [sql](<https://devfeed.tech/tags/sql.md>)

### AI overview

Moovit modernized its data platform by using a multi-engine lakehouse architecture. The approach offloaded heavy aggregation workloads from Amazon Redshift to Amazon EMR with Spark SQL, isolated workloads with Amazon Redshift Serverless, and reduced overall data pipeline costs by 33%.

### Source excerpt

Learn how Moovit modernized its data platform with a multi-engine lakehouse architecture: offloading heavy aggregation workloads from Amazon Redshift to Amazon EMR with Spark SQL, isolating workloads with Amazon Redshift Serverless, and cutting overall data pipeline cost by 33%.

## Deliver real-time data to streaming tables for Apache Iceberg with Amazon Kinesis Data Streams

DevFeed: [Deliver real-time data to streaming tables for Apache Iceberg with Amazon Kinesis Data Streams](<https://devfeed.tech/articles/deliver-real-time-data-to-streaming-tables-for-apache-iceberg-with-amazon-kinesis-data-streams-49914.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/deliver-real-time-data-to-streaming-tables-for-apache-iceberg-with-amazon-kinesis-data-streams/>)

Author: Nikit Pednekar

Published: 2026-08-31T23:03:25Z

Content type: release

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Streaming](<https://devfeed.tech/topics/streaming.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Apache Flink](<https://devfeed.tech/topics/apache-flink.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [amazon-kinesis](<https://devfeed.tech/tags/amazon-kinesis.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-s3-tables](<https://devfeed.tech/tags/amazon-s3-tables.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-iceberg-tables](<https://devfeed.tech/tags/apache-iceberg-tables.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [kinesis](<https://devfeed.tech/tags/kinesis.md>), [kinesis-data-streams](<https://devfeed.tech/tags/kinesis-data-streams.md>), [streaming](<https://devfeed.tech/tags/streaming.md>)

### AI overview

Amazon Kinesis Data Streams introduces streaming tables, a fully managed capability that continuously delivers streaming data as queryable Apache Iceberg tables in Amazon S3 Tables. The release highlights lower delivery and query costs through inline compaction, with access from Athena, Redshift, and Spark.

### Source excerpt

Amazon Kinesis Data Streams now supports streaming tables, a fully managed capability that continuously delivers your streaming data as queryable Apache Iceberg tables on Amazon S3 Tables. Streaming tables reduce data delivery costs to S3 Tables by up to 50% compared to self-managed alternatives and reduce downstream query costs by up to 30% through intelligent inline compaction that eliminates the small file problem. You need no custom applications, no self-managed compute, and no operational overhead.

[Next page](<https://devfeed.tech/topics/amazon-redshift.md?cursor=WyIyMDI2LTA4LTMxVDIzOjAzOjI1KzAwOjAwIiwgImQwYjJhNWNjLWZiZTItNGYxOC1hN2ZiLTFkZjY5N2NmN2YyNyJd>)