# AWS Lake Formation

AWS managed service for centrally governing, securing, and sharing data lakes for analytics and machine learning.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Talk to your clinical data: unlocking AWS HealthLake with OpenSharing and Genie One

DevFeed: [Talk to your clinical data: unlocking AWS HealthLake with OpenSharing and Genie One](<https://devfeed.tech/articles/talk-to-your-clinical-data-unlocking-aws-healthlake-with-opensharing-and-genie-one-136420.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/talk-your-clinical-data-unlocking-aws-healthlake-opensharing-and-genie-one>)

Author: Michael McCarthy; Lily Goldstein; Douglas Moore

Published: 2026-11-16T18:30:00Z

Content type: article

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>), [API](<https://devfeed.tech/topics/api.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [accelerate](<https://devfeed.tech/tags/accelerate.md>), [access-controls](<https://devfeed.tech/tags/access-controls.md>), [accessible](<https://devfeed.tech/tags/accessible.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-use](<https://devfeed.tech/tags/ai-use.md>), [aws](<https://devfeed.tech/tags/aws.md>), [data](<https://devfeed.tech/tags/data.md>), [genie](<https://devfeed.tech/tags/genie.md>), [healthcare](<https://devfeed.tech/tags/healthcare.md>), [healthcare-and-life-sciences](<https://devfeed.tech/tags/healthcare-and-life-sciences.md>), [healthcare-life-sciences](<https://devfeed.tech/tags/healthcare-life-sciences.md>), [industries](<https://devfeed.tech/tags/industries.md>), [life](<https://devfeed.tech/tags/life.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [manage](<https://devfeed.tech/tags/manage.md>), [one](<https://devfeed.tech/tags/one.md>), [opensharing](<https://devfeed.tech/tags/opensharing.md>), [organizations](<https://devfeed.tech/tags/organizations.md>), [talk](<https://devfeed.tech/tags/talk.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

The described OpenSharing integration lets Databricks query AWS HealthLake's FHIR data directly, avoiding export pipelines and duplicate copies. A custom OpenSharing server deployed as a Databricks App obtains temporary Lake Formation credentials, resolves each table's current Iceberg snapshot, and returns pre-signed data files; Databricks compute reads them directly from S3, so data does not pass through the server. OIDC federation lets AWS trust the app's Databricks identity. Unity Catalog governs shared-catalog access with grants and fine-grained, attribute-based, and role-based controls, and supports auditing. Curated Genie Agents can provide natural-language exploration, generating SQL and returning summarized answers, tables, and charts subject to Unity Catalog permissions. The text presents this as an option for Databricks analytics, notebooks, dashboards, and AI, alongside existing Athena or Redshift paths, and points to a reference implementation deployed as a Declarative Automation Bundle.

### Source excerpt

Many healthcare and life sciences organizations have standardized on AWS HealthLake to manage clinical data...

## How Samsung Ads federated Snowflake Iceberg tables using Amazon Cognito

DevFeed: [How Samsung Ads federated Snowflake Iceberg tables using Amazon Cognito](<https://devfeed.tech/articles/how-samsung-ads-federated-snowflake-iceberg-tables-using-amazon-cognito-129562.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/how-samsung-ads-federated-snowflake-iceberg-tables-using-amazon-cognito/>)

Author: Balaji Selva Rajan

Published: 2026-11-11T19:48:02Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Cognito](<https://devfeed.tech/topics/amazon-cognito.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Amazon VPC](<https://devfeed.tech/topics/amazon-vpc.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Parquet files in Amazon S3](<https://devfeed.tech/topics/parquet-files-in-amazon-s3.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AWS CloudShell](<https://devfeed.tech/topics/aws-cloudshell.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [ads](<https://devfeed.tech/tags/ads.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-athena](<https://devfeed.tech/tags/amazon-athena.md>), [amazon-cognito](<https://devfeed.tech/tags/amazon-cognito.md>), [amazon-route-53](<https://devfeed.tech/tags/amazon-route-53.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [amazon-vpc](<https://devfeed.tech/tags/amazon-vpc.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-iceberg-tables](<https://devfeed.tech/tags/apache-iceberg-tables.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-cli](<https://devfeed.tech/tags/aws-cli.md>), [aws-cloudformation](<https://devfeed.tech/tags/aws-cloudformation.md>), [aws-cloudshell](<https://devfeed.tech/tags/aws-cloudshell.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [iceberg](<https://devfeed.tech/tags/iceberg.md>), [oauth2](<https://devfeed.tech/tags/oauth2.md>), [samsung](<https://devfeed.tech/tags/samsung.md>), [snowflake](<https://devfeed.tech/tags/snowflake.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

Samsung Ads federated Snowflake-managed Iceberg tables into AWS Lake Formation so Amazon Athena can query the same S3 data without a second copy. An AWS Glue connection obtains OAuth2 client-credentials tokens from Amazon Cognito; a Pre Token Generation Lambda adds the `aud` claim Snowflake requires. The connection reaches Snowflake's Iceberg REST catalog over AWS PrivateLink, while Cognito's public token endpoint requires NAT access. Lake Formation governs access and vends scoped S3 credentials for Athena to read the Parquet files directly. Setup requires Snowflake Business-Critical or higher in the same Region, Snowflake-managed Iceberg tables, and AWS permissions for the Cognito, networking, and Lake Formation resources. The pattern does not apply Snowflake masking or row access policies to Athena reads; those controls must be recreated in Lake Formation and tested. Federate schemas containing only supported Snowflake-managed tables, and explicitly revoke Lake Formation grants when tables are removed. NAT and PrivateLink endpoints incur charges.

### Source excerpt

Learn how Samsung Ads federates Snowflake-managed Apache Iceberg tables into AWS Lake Formation and queries them from Amazon Athena using Amazon Cognito for OAuth2 machine-to-machine authentication, with no second copy of the data to maintain.

## How Intuit migrated from Apache Hive Metastore to AWS Glue Data Catalog

DevFeed: [How Intuit migrated from Apache Hive Metastore to AWS Glue Data Catalog](<https://devfeed.tech/articles/how-intuit-migrated-from-apache-hive-metastore-to-aws-glue-data-catalog-129561.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/how-intuit-migrated-from-apache-hive-metastore-to-aws-glue-data-catalog/>)

Author: Srinivasan Krishnasamy

Published: 2026-11-11T15:43:26Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [rate-limiting](<https://devfeed.tech/topics/rate-limiting.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Apache Flink](<https://devfeed.tech/topics/apache-flink.md>), [Amazon MSK](<https://devfeed.tech/topics/amazon-msk.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Amazon EventBridge](<https://devfeed.tech/topics/amazon-eventbridge.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [access-controls](<https://devfeed.tech/tags/access-controls.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-services](<https://devfeed.tech/tags/ai-services.md>), [amazon-athena](<https://devfeed.tech/tags/amazon-athena.md>), [amazon-aurora](<https://devfeed.tech/tags/amazon-aurora.md>), [amazon-cloudwatch](<https://devfeed.tech/tags/amazon-cloudwatch.md>), [amazon-dynamodb](<https://devfeed.tech/tags/amazon-dynamodb.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache-hive](<https://devfeed.tech/tags/apache-hive.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [data](<https://devfeed.tech/tags/data.md>), [data-catalog](<https://devfeed.tech/tags/data-catalog.md>), [data-discovery](<https://devfeed.tech/tags/data-discovery.md>), [hive](<https://devfeed.tech/tags/hive.md>), [integration](<https://devfeed.tech/tags/integration.md>), [intuit](<https://devfeed.tech/tags/intuit.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>)

### AI overview

Intuit migrated databases, tables, and partitions from Apache Hive Metastore (HMS) to AWS Glue Data Catalog (GDC) using a phased approach: a one-time migration, ongoing synchronization in both directions, hourly parity checks, and targeted repair syncs. A DynamoDB source-of-truth flag per table prevents sync loops. HMS changes flow through Debezium CDC and Kafka, with partition events batched over 10-second windows; GDC changes use EventBridge, Lambda, Kafka, and Flink to order events before applying them to HMS. Before migrating, Intuit recommends auditing unused objects, estimating and load-testing Glue API quotas, batching writes, and using retries with backoff to manage throttling. The migration covered databases, tables, and partitions for S3-backed data; column statistics, privileges, roles, functions, and transactions were out of scope. GDC also does not support database or table renames.

### Source excerpt

How Intuit migrated its data catalog from Apache Hive Metastore to AWS Glue Data Catalog on its journey to an open, secure lakehouse. This post covers the challenges, the phased bidirectional-sync solution, and the benefits: reduced operational overhead, improved data discovery, and tighter integration with AWS analytics services.

## Introducing the Workday Data Cloud integration with AWS

DevFeed: [Introducing the Workday Data Cloud integration with AWS](<https://devfeed.tech/articles/introducing-the-workday-data-cloud-integration-with-aws-126347.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/introducing-the-workday-data-cloud-integration-with-aws/>)

Author: Poornima Chand

Published: 2026-11-09T22:21:40Z

Content type: release

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-powered](<https://devfeed.tech/tags/ai-powered.md>), [ai-services](<https://devfeed.tech/tags/ai-services.md>), [amazon-sagemaker-unified-studio](<https://devfeed.tech/tags/amazon-sagemaker-unified-studio.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-integration](<https://devfeed.tech/tags/cloud-integration.md>), [data](<https://devfeed.tech/tags/data.md>), [data-cloud](<https://devfeed.tech/tags/data-cloud.md>), [developers](<https://devfeed.tech/tags/developers.md>), [integration](<https://devfeed.tech/tags/integration.md>), [intermediate-200](<https://devfeed.tech/tags/intermediate-200.md>), [money](<https://devfeed.tech/tags/money.md>), [people](<https://devfeed.tech/tags/people.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [services](<https://devfeed.tech/tags/services.md>), [workday](<https://devfeed.tech/tags/workday.md>), [zero-copy](<https://devfeed.tech/tags/zero-copy.md>)

### AI overview

Workday Data Cloud and AWS provide bidirectional, zero-copy access to governed data: Workday can query Iceberg tables in S3 through a federated AWS Glue Data Catalog, while AWS services can query Workday data. For near real-time operational queries, Live Data Query runs SQL within Workday's governed environment and returns results to AWS. For broader analytics, ML training, and exploration, Workday Data Connect exposes data as Apache Iceberg tables; compute runs in AWS while the data stays in Workday. Lake Formation governs AWS-side access, and Workday security controls access to Workday data and federated tables. The article says the integration is generally available and describes setup through SageMaker Unified Studio, Glue, Lake Formation, Athena, EMR, Redshift, and Workday Data Cloud.

### Source excerpt

Workday Data Cloud now integrates with AWS, giving developers bi-directional, zero-copy access to Workday's governed people and money data from the AWS analytics and AI services they already use, without brittle pipelines or data duplication.

## Deliver multi-tenant AI analytics at scale with AgentCore and Lake Formation

DevFeed: [Deliver multi-tenant AI analytics at scale with AgentCore and Lake Formation](<https://devfeed.tech/articles/deliver-multi-tenant-ai-analytics-at-scale-with-agentcore-and-lake-formation-119231.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/deliver-multi-tenant-ai-analytics-at-scale-with-agentcore-and-lake-formation/>)

Author: Fortune Hui

Published: 2026-11-05T15:04:59Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon Bedrock AgentCore](<https://devfeed.tech/topics/amazon-bedrock-agentcore.md>), [tenant data protection](<https://devfeed.tech/topics/tenant-data-protection.md>), [Amazon Cognito](<https://devfeed.tech/topics/amazon-cognito.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [access-management](<https://devfeed.tech/tags/access-management.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentcore](<https://devfeed.tech/tags/agentcore.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-analytics](<https://devfeed.tech/tags/ai-analytics.md>), [ai-powered](<https://devfeed.tech/tags/ai-powered.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [amazon-cognito](<https://devfeed.tech/tags/amazon-cognito.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [broker](<https://devfeed.tech/tags/broker.md>), [credential-broker](<https://devfeed.tech/tags/credential-broker.md>), [external](<https://devfeed.tech/tags/external.md>), [lambda](<https://devfeed.tech/tags/lambda.md>), [multi-tenant-data](<https://devfeed.tech/tags/multi-tenant-data.md>), [saas](<https://devfeed.tech/tags/saas.md>), [scale](<https://devfeed.tech/tags/scale.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

The article describes a pattern for isolating external users' data access in an Amazon Bedrock AgentCore analytics agent. Cognito User Pool ID-token claims such as `custom:team` map through an Identity Pool to team-specific IAM roles. AgentCore Gateway validates the access token and forwards the ID token to a minimally privileged Lambda, which brokers temporary user-scoped credentials; Athena queries then run under those credentials, with Lake Formation LF-Tag permissions and data cell filters enforcing table and row access. The Lambda has no Athena, S3, or Glue data permissions. The article contrasts this external-user Cognito model with IAM Identity Center and Trusted Identity Propagation, which it describes as suited to workforce federation. It also outlines CDK deployment prerequisites and a walkthrough that changes Lake Formation grants and filters to extend Team A's access, noting that permission changes may take several minutes to propagate.

### Source excerpt

Governed, multi-tenant data access is a key requirement for SaaS and B2C products that embed AI-powered analytics. This post shows how to combine Amazon Cognito and AWS Lake Formation on Amazon Bedrock AgentCore to enforce row- and column-level data access for external users, with a minimal-privilege Lambda acting as a credential broker.

## Migrate Google BigQuery to an open lakehouse on AWS with Apache Iceberg

DevFeed: [Migrate Google BigQuery to an open lakehouse on AWS with Apache Iceberg](<https://devfeed.tech/articles/migrate-google-bigquery-to-an-open-lakehouse-on-aws-with-apache-iceberg-114202.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/migrate-google-bigquery-to-an-open-lakehouse-on-aws-with-apache-iceberg/>)

Author: Saman Irfan

Published: 2026-11-02T17:21:17Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Amazon S3 Tables](<https://devfeed.tech/topics/amazon-s3-tables.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon Bedrock Knowledge Bases](<https://devfeed.tech/topics/amazon-bedrock-knowledge-bases.md>), [AWS Step Functions](<https://devfeed.tech/topics/aws-step-functions.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [Amazon MSK](<https://devfeed.tech/topics/amazon-msk.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-athena](<https://devfeed.tech/tags/amazon-athena.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [aws](<https://devfeed.tech/tags/aws.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [data](<https://devfeed.tech/tags/data.md>), [design](<https://devfeed.tech/tags/design.md>), [future](<https://devfeed.tech/tags/future.md>), [google](<https://devfeed.tech/tags/google.md>), [google-bigquery](<https://devfeed.tech/tags/google-bigquery.md>), [iceberg](<https://devfeed.tech/tags/iceberg.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [migrate](<https://devfeed.tech/tags/migrate.md>), [migration](<https://devfeed.tech/tags/migration.md>), [open](<https://devfeed.tech/tags/open.md>), [optimize](<https://devfeed.tech/tags/optimize.md>), [over](<https://devfeed.tech/tags/over.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

The article presents a phased path from BigQuery to an AWS lakehouse using Apache Iceberg tables on Amazon S3, with governance through AWS Glue Data Catalog and Lake Formation and engines selected by workload. It recommends assessing tables, query complexity, consumers, volumes, and access controls; designing storage, partitioning, ingestion, and governance; then converting a representative slice and validating results, performance, and cost. For bulk transfer, export BigQuery tables to Parquet in Google Cloud Storage, move them to S3 with AWS DataSync, create or register Iceberg tables, and synchronize incremental changes during transition. Cutover includes parallel validation and deciding whether each consumer will reconnect, be rebuilt, or relay data. The article distinguishes managed S3 Tables, which handle maintenance automatically, from self-managed Iceberg on general-purpose S3, which requires tuning. It also cautions that BigQuery scan-based and Redshift compute-based pricing are not directly comparable, recommending workload-based benchmarks and monthly TCO estimates. Post-migration steps include query and cost optimization.

### Source excerpt

Learn how to migrate Google BigQuery workloads to an open lakehouse on AWS built on Apache Iceberg and Amazon S3. This post explains why an open lakehouse future-proofs your data, presents the target architecture on AWS, and walks through a step-by-step migration: assess, design, convert, migrate, cut over, and optimize.

## Enable cross-Region fine-grained data access with AWS Lake Formation and Trusted Identity Propagation

DevFeed: [Enable cross-Region fine-grained data access with AWS Lake Formation and Trusted Identity Propagation](<https://devfeed.tech/articles/enable-cross-region-fine-grained-data-access-with-aws-lake-formation-and-trusted-identity-propagation-98494.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/enable-cross-region-fine-grained-data-access-with-aws-lake-formation-and-trusted-identity-propagation/>)

Author: Maneesh Sharma

Published: 2026-10-23T19:50:12Z

Content type: article

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [AWS IAM Identity Center](<https://devfeed.tech/topics/aws-iam-identity-center.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Access Control](<https://devfeed.tech/topics/access-control.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [identity and access management](<https://devfeed.tech/topics/identity-and-access-management.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>), [Resource Access Manager (RAM)](<https://devfeed.tech/topics/resource-access-manager-ram.md>), [AWS CloudTrail](<https://devfeed.tech/topics/aws-cloudtrail.md>), [Single sign-on (SSO)](<https://devfeed.tech/topics/sso.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [AWS Organizations](<https://devfeed.tech/topics/aws-organizations.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [auditability](<https://devfeed.tech/tags/auditability.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-cloudtrail](<https://devfeed.tech/tags/aws-cloudtrail.md>), [aws-iam](<https://devfeed.tech/tags/aws-iam.md>), [aws-iam-identity-center](<https://devfeed.tech/tags/aws-iam-identity-center.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [cloudtrail](<https://devfeed.tech/tags/cloudtrail.md>), [control](<https://devfeed.tech/tags/control.md>), [corporate](<https://devfeed.tech/tags/corporate.md>), [cross](<https://devfeed.tech/tags/cross.md>), [data](<https://devfeed.tech/tags/data.md>), [fine](<https://devfeed.tech/tags/fine.md>), [iam](<https://devfeed.tech/tags/iam.md>), [identity](<https://devfeed.tech/tags/identity.md>), [region](<https://devfeed.tech/tags/region.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

AWS IAM Identity Center Trusted Identity Propagation (TIP) lets users query Lake Formation governed data across Regions as their own identities, with Lake Formation authorization and per-user AWS CloudTrail auditability. The producer and consumer accounts must share an organization instance of IAM Identity Center, replicated to the Regions in use. For S3 data queried with Athena, share the Lake Formation catalog and table, accept the AWS RAM share, create a resource link in the consumer's query Region, and grant users Describe access to it; the data stays in the producer Region while the query runs elsewhere. For Redshift data, register a Redshift Serverless namespace in the producer's AWS Glue Data Catalog, share it through Lake Formation, and configure a consumer external schema that references that catalog; no resource link is needed. The engines differ in cross-Region constraints: Athena works across Regions without additional constraints, while a Redshift datashare requires the Redshift query engine to be in the namespace's Region.

### Source excerpt

Trusted Identity Propagation with AWS IAM Identity Center now works across Regions. Learn how to share AWS Lake Formation-governed Amazon S3 and Amazon Redshift data in one Region and query it from another as the actual corporate user, with fine-grained access control and per-user auditability in AWS CloudTrail.

## Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran

DevFeed: [Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran](<https://devfeed.tech/articles/governing-your-lakehouse-with-fivetran-managed-data-lake-service-blog-fivetran-136781.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/governing-your-lakehouse-with-fivetran-managed-data-lake-service>)

Author: Andrew Madson

Published: 2026-10-13T16:41:32Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Management](<https://devfeed.tech/topics/data-management.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [data ownership](<https://devfeed.tech/topics/data-ownership.md>), [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Security, Identity, & Compliance](<https://devfeed.tech/topics/security-identity-compliance.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [schema-evolution](<https://devfeed.tech/topics/schema-evolution.md>), [data-processing](<https://devfeed.tech/topics/data-processing.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-polaris](<https://devfeed.tech/tags/apache-polaris.md>), [athena](<https://devfeed.tech/tags/athena.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [automated](<https://devfeed.tech/tags/automated.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-privatelink](<https://devfeed.tech/tags/aws-privatelink.md>), [azure](<https://devfeed.tech/tags/azure.md>), [biglake](<https://devfeed.tech/tags/biglake.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [governance](<https://devfeed.tech/tags/governance.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [lifecycle](<https://devfeed.tech/tags/lifecycle.md>)

### AI overview

The excerpt presents Fivetran Managed Data Lake governance as a single-source-of-truth model: Fivetran alone writes Iceberg metadata, while query engines read it, and Fivetran republishes the correct version if AWS Glue drifts. Engines can use the Iceberg REST Catalog with OAuth2; Athena and Redshift require Glue integration enabled at destination setup, a permanent choice with regional and naming constraints. Access controls include short-lived, table-scoped S3 credentials, cross-account IAM, and optional KMS, Lake Formation, and Business Critical PrivateLink configuration. Automated retention, metadata version cleanup, biweekly orphan-file removal, compaction, deduplication, and schema evolution address lifecycle work. The excerpt warns against manual catalog changes and raw Parquet queries, and notes cloud-specific catalog requirements, including BigQuery Admin access for GCS BigLake.

### Source excerpt

Lakehouse governance requires observability, access control, data lifecycle management, and more. Fivetran MDLS makes it easy.

## Identity-aware AI data agents with AWS Lake Formation and Trusted Identity Propagation

DevFeed: [Identity-aware AI data agents with AWS Lake Formation and Trusted Identity Propagation](<https://devfeed.tech/articles/identity-aware-ai-data-agents-with-aws-lake-formation-and-trusted-identity-propagation-65873.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/security/identity-aware-ai-data-agents-with-aws-lake-formation-and-trusted-identity-propagation/>)

Author: Thiyagarajan Mani

Published: 2026-10-06T16:07:06Z

Content type: tutorial

Language: en

Sources: [AWS Security Blog](<https://devfeed.tech/sources/aws-security-blog.md>)

Topics: [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Security, Identity, & Compliance](<https://devfeed.tech/topics/security-identity-compliance.md>), [identity and access management](<https://devfeed.tech/topics/identity-and-access-management.md>), [HashiCorp Vault](<https://devfeed.tech/topics/hashicorp-vault.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [amazon-bedrock](<https://devfeed.tech/tags/amazon-bedrock.md>), [amazon-bedrock-agentcore](<https://devfeed.tech/tags/amazon-bedrock-agentcore.md>), [amazon-cognito](<https://devfeed.tech/tags/amazon-cognito.md>), [amazon-simple-storage-service-amazon-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-amazon-s3.md>), [aws-cloudtrail](<https://devfeed.tech/tags/aws-cloudtrail.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-iam](<https://devfeed.tech/tags/aws-iam.md>), [aws-iam-identity-center](<https://devfeed.tech/tags/aws-iam-identity-center.md>), [aws-identity-and-access-management-iam](<https://devfeed.tech/tags/aws-identity-and-access-management-iam.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [identity](<https://devfeed.tech/tags/identity.md>), [security-blog](<https://devfeed.tech/tags/security-blog.md>), [security-identity-compliance](<https://devfeed.tech/tags/security-identity-compliance.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>)

### AI overview

This tutorial presents an AWS Bedrock AgentCore pattern for passing a user's identity through an AI data agent to AWS Lake Formation. A Lambda function exchanges the identity token for user-scoped credentials, allowing Lake Formation to apply existing data grants and CloudTrail to record the user's access. The token travels in HTTP headers rather than the model's prompts or tool arguments.

### Source excerpt

You're building a data agent that lets business users ask questions about lakehouse data in natural language. You've already built governance policies that control who can access which datasets. The challenge is making the agent respect those rules without rebuilding them in your application code. When a user asks a question, the agent maps it [...]

## Inside Canonical's enterprise data lake stack for governed analytics and AI

DevFeed: [Inside Canonical's enterprise data lake stack for governed analytics and AI](<https://devfeed.tech/articles/from-raw-data-to-intelligent-actions-inside-our-next-gen-ai-analytics-data-lake-stack-77108.md>)

Original publisher: [Read original article](<https://canonical.com//blog/inside-our-next-gen-ai-analytics-data-lake-stack>)

Author: Rob Gibbon (Rob Gibbon)

Published: 2026-09-18T12:14:35Z

Content type: article

Language: en

Sources: [Canonical](<https://devfeed.tech/sources/canonical.md>)

Topics: [data lake](<https://devfeed.tech/topics/data-lake.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-factory](<https://devfeed.tech/tags/ai-factory.md>), [airflow](<https://devfeed.tech/tags/airflow.md>), [amazon-aws](<https://devfeed.tech/tags/amazon-aws.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-airflow](<https://devfeed.tech/tags/apache-airflow.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-kafka](<https://devfeed.tech/tags/apache-kafka.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [build](<https://devfeed.tech/tags/build.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [data-lakehouse](<https://devfeed.tech/tags/data-lakehouse.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [gen-ai](<https://devfeed.tech/tags/gen-ai.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [mlops](<https://devfeed.tech/tags/mlops.md>), [next](<https://devfeed.tech/tags/next.md>)

### AI overview

Canonical describes an enterprise data lake stack built on open-source components for governed analytics and AI. It combines storage and compute, data ingestion and processing, federated access controls, business intelligence, machine learning tools, and self-hosted model serving. The post emphasizes deployment control, security, scalability, and operation across on-premises, air-gapped, and cloud environments.

### Source excerpt

At Canonical, we believe organisations should be able to unlock the full value of their data without giving up control. That principle is at the heart of our next-generation enterprise data lake stack. It's designed for organizations that need to build advanced analytics and AI capabilities while maintaining control over their data, infrastructure and technology [...]

## Discover and govern Snowflake data using SageMaker Unified Studio

DevFeed: [Discover and govern Snowflake data using SageMaker Unified Studio](<https://devfeed.tech/articles/discover-and-govern-snowflake-data-using-sagemaker-unified-studio-49915.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/discover-and-govern-snowflake-data-using-sagemaker-unified-studio/>)

Author: Marco Duarte

Published: 2026-09-16T15:19:51Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Access Control](<https://devfeed.tech/topics/access-control.md>), [dataset](<https://devfeed.tech/topics/dataset.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-unified-studio](<https://devfeed.tech/tags/amazon-sagemaker-unified-studio.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [data-catalog](<https://devfeed.tech/tags/data-catalog.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [expert-400](<https://devfeed.tech/tags/expert-400.md>), [integration](<https://devfeed.tech/tags/integration.md>), [sql](<https://devfeed.tech/tags/sql.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

A tutorial on connecting Snowflake to Amazon SageMaker Unified Studio to federate data without moving it. It explains how to catalog assets, query tables, apply AWS Glue Data Quality rules, and publish validated datasets for governed discovery and collaboration.

### Source excerpt

Connect Snowflake to Amazon SageMaker Unified Studio to build a unified data catalog. Query federated Snowflake tables without moving data, publish enriched assets to SageMaker Catalog, and validate data quality with AWS Glue Data Quality, all while keeping data in Snowflake.

## How United Airlines uses Amazon Redshift and AWS Glue Data Catalog federation to query Databricks-managed data

DevFeed: [How United Airlines uses Amazon Redshift and AWS Glue Data Catalog federation to query Databricks-managed data](<https://devfeed.tech/articles/how-united-airlines-uses-amazon-redshift-and-aws-glue-data-catalog-federation-to-query-databricks-managed-data-49921.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/big-data/how-united-airlines-uses-amazon-redshift-and-aws-glue-data-catalog-federation-to-query-databricks-managed-data/>)

Author: Vaibhav Agrawal

Published: 2026-09-15T15:59:48Z

Content type: tutorial

Language: en

Sources: [AWS Big Data Blog](<https://devfeed.tech/sources/aws-big-data-blog.md>)

Topics: [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [AWS Glue](<https://devfeed.tech/topics/aws-glue.md>), [databricks](<https://devfeed.tech/topics/databricks.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [data-platform](<https://devfeed.tech/tags/data-platform.md>), [databricks](<https://devfeed.tech/tags/databricks.md>), [governance](<https://devfeed.tech/tags/governance.md>), [queries](<https://devfeed.tech/tags/queries.md>), [query-engine](<https://devfeed.tech/tags/query-engine.md>)

### AI overview

This tutorial explains how United Airlines uses AWS Glue Data Catalog federation to query Databricks Unity Catalog data from Amazon Redshift Serverless without duplicating data. It covers querying Iceberg data in Amazon S3 and using AWS Lake Formation for governance.

### Source excerpt

Learn how United Airlines uses AWS Glue Data Catalog federation to query Databricks Unity Catalog data directly from Amazon Redshift Serverless without duplicating data, using resource links and AWS Lake Formation for governance.

## How a global payment processor preserved AWS RAM shares and Lake Formation permissions during an AWS Organizations migration

DevFeed: [How a global payment processor preserved AWS RAM shares and Lake Formation permissions during an AWS Organizations migration](<https://devfeed.tech/articles/how-a-global-payment-processor-preserved-aws-ram-shares-and-lake-formation-permissions-during-an-aws-organizations-migration-4642.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/architecture/how-a-global-payment-processor-preserved-aws-ram-shares-and-lake-formation-permissions-during-an-aws-organizations-migration/>)

Author: Sam Mukherjee

Published: 2026-08-24T15:23:21Z

Content type: article

Language: en

Sources: [AWS Architecture Blog](<https://devfeed.tech/sources/aws-architecture-blog.md>)

Topics: [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [migration](<https://devfeed.tech/topics/migration.md>), [Amazon Web Services](<https://devfeed.tech/topics/aws.md>), [Authorization](<https://devfeed.tech/topics/authorization.md>), [Software as a service](<https://devfeed.tech/topics/saas.md>)

Tags: [aws](<https://devfeed.tech/tags/aws.md>), [aws-lake-formation](<https://devfeed.tech/tags/aws-lake-formation.md>), [customer-solutions](<https://devfeed.tech/tags/customer-solutions.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [migration](<https://devfeed.tech/tags/migration.md>), [payment](<https://devfeed.tech/tags/payment.md>), [payments](<https://devfeed.tech/tags/payments.md>), [resource-access-manager-ram](<https://devfeed.tech/tags/resource-access-manager-ram.md>), [saas](<https://devfeed.tech/tags/saas.md>), [us](<https://devfeed.tech/tags/us.md>)

### AI overview

AWS describes a migration pattern for preserving AWS RAM shares and AWS Lake Formation permissions while moving 382 accounts between AWS Organizations. Temporary bridge shares maintain continuity during the move, after which the original shares are restored as durable permission objects.

### Source excerpt

When AWS accounts move between organizations, organization-bound AWS RAM resource shares break and control-plane access is lost. Learn how a global payment processor used temporary bridge shares to preserve AWS Lake Formation permissions across a 382-account AWS Organizations migration, then restored the original shares as the durable source of truth.

## 5 things to know about where Fivetran sends your data | Blog | Fivetran

DevFeed: [5 things to know about where Fivetran sends your data | Blog | Fivetran](<https://devfeed.tech/articles/5-things-to-know-about-where-fivetran-sends-your-data-blog-fivetran-78376.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/5-things-to-know-about-where-fivetran-sends-your-data>)

Author: David Millman

Published: 2026-08-18T20:47:09Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [etl](<https://devfeed.tech/topics/etl.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>)

Tags: [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-polaris](<https://devfeed.tech/tags/apache-polaris.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [cloud-data](<https://devfeed.tech/tags/cloud-data.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [data](<https://devfeed.tech/tags/data.md>), [data-architecture](<https://devfeed.tech/tags/data-architecture.md>)

### AI overview

The article describes Fivetran's data destination features: consistent schemas across platforms, per-table soft-delete and history sync modes, open lake formats with automated catalog registration, reverse ETL activations, and support for multiple destination types. It argues that destination choices shape how data is governed, queried, and reused across analytics and business operations.

### Source excerpt

The destination determines how easily data can be governed, queried, activated, and reused across analytics, AI, and business operations -- making it one of the most important decisions in your data architecture.

## Access Amazon S3 backup data directly using S3 Access Points in AWS Backup

DevFeed: [Access Amazon S3 backup data directly using S3 Access Points in AWS Backup](<https://devfeed.tech/articles/access-amazon-s3-backup-data-directly-using-s3-access-points-in-aws-backup-49886.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/storage/access-amazon-s3-backup-data-directly-using-s3-access-points-in-aws-backup/>)

Author: Shaguna Awasthi

Published: 2026-08-06T21:16:10Z

Content type: tutorial

Language: en

Sources: [AWS Storage Blog](<https://devfeed.tech/sources/aws-storage-blog.md>)

Topics: [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [backups](<https://devfeed.tech/topics/backups.md>), [cloud-infrastructure](<https://devfeed.tech/topics/cloud-infrastructure.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [advanced-300](<https://devfeed.tech/tags/advanced-300.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [amazon-s3-access-points](<https://devfeed.tech/tags/amazon-s3-access-points.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-simple-storage-service-amazon-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-amazon-s3.md>), [amazon-simple-storage-service-s3](<https://devfeed.tech/tags/amazon-simple-storage-service-s3.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-backup](<https://devfeed.tech/tags/aws-backup.md>), [aws-cli](<https://devfeed.tech/tags/aws-cli.md>), [aws-cloud-storage](<https://devfeed.tech/tags/aws-cloud-storage.md>), [aws-sdk](<https://devfeed.tech/tags/aws-sdk.md>), [backup](<https://devfeed.tech/tags/backup.md>), [cli](<https://devfeed.tech/tags/cli.md>), [data-protection](<https://devfeed.tech/tags/data-protection.md>), [data-resiliency](<https://devfeed.tech/tags/data-resiliency.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [recovery](<https://devfeed.tech/tags/recovery.md>), [resilience](<https://devfeed.tech/tags/resilience.md>), [restore](<https://devfeed.tech/tags/restore.md>), [s3-access-points](<https://devfeed.tech/tags/s3-access-points.md>), [snapshot](<https://devfeed.tech/tags/snapshot.md>), [storage](<https://devfeed.tech/tags/storage.md>), [technical-how-to](<https://devfeed.tech/tags/technical-how-to.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>)

### AI overview

AWS Backup for Amazon S3 supports direct read access to backup data through S3 Access Points, allowing teams to use standard S3 APIs without first restoring the data. The post explains access-point creation and demonstrates uses including machine learning workflows, forensic investigations, and compliance audits.

### Source excerpt

AWS Backup for Amazon S3 now lets you access your backup data through Amazon S3 Access Points. You create an access point for a recovery point, and AWS Backup provisions an S3 endpoint with an alias that works anywhere you would use a bucket name. You can then read backup data using standard S3 APIs, [...]

## Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran

DevFeed: [Governing your lakehouse with Fivetran Managed Data Lake Service | Blog | Fivetran](<https://devfeed.tech/articles/governing-your-lakehouse-with-fivetran-managed-data-lake-service-blog-fivetran-78413.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/governing-your-lakehouse-with-fivetran-managed-data-lake-service>)

Author: Andrew Madson

Published: 2026-07-22T17:00:57Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [data lake](<https://devfeed.tech/topics/data-lake.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [access-control](<https://devfeed.tech/tags/access-control.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-polaris](<https://devfeed.tech/tags/apache-polaris.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-glue](<https://devfeed.tech/tags/aws-glue.md>), [aws-privatelink](<https://devfeed.tech/tags/aws-privatelink.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [compaction](<https://devfeed.tech/tags/compaction.md>), [copy-on-write](<https://devfeed.tech/tags/copy-on-write.md>), [data-integrity](<https://devfeed.tech/tags/data-integrity.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [data-lakes](<https://devfeed.tech/tags/data-lakes.md>), [database](<https://devfeed.tech/tags/database.md>), [governance](<https://devfeed.tech/tags/governance.md>)

### AI overview

Fivetran's Managed Data Lake Service governs lakehouse data by maintaining a REST catalog as the metadata source of truth, coordinating access controls across engines and storage, and automating retention, cleanup, compaction, and schema evolution. The article also describes configuration constraints for AWS Glue, Lake Formation, and multi-cloud catalogs.

### Source excerpt

Lakehouse governance requires observability, access control, data lifecycle management, and more. Fivetran MDLS makes it easy.

## Unlocking powerful analytics with Stripe Data Pipeline and Google BigQuery

DevFeed: [Unlocking powerful analytics with Stripe Data Pipeline and Google BigQuery](<https://devfeed.tech/articles/unlocking-powerful-analytics-with-stripe-data-pipeline-and-google-bigquery-81836.md>)

Original publisher: [Read original article](<https://stripe.dev/blog/unlock-powerful-analytics-stripe-data-pipeline-bigquery>)

Author: Sushant Jain

Published: 2025-03-21T00:00:00Z

Content type: tutorial

Language: en

Sources: [Stripe Dot Dev Blog](<https://devfeed.tech/sources/stripe-dot-dev-blog.md>)

Topics: [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [google](<https://devfeed.tech/tags/google.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [software](<https://devfeed.tech/tags/software.md>)

### AI overview

The guide describes integrating Stripe Data Pipeline with Google Cloud Storage and BigQuery to automate data transfers, improve reporting, and support business decisions. The author's bio identifies his work on Stripe's data ingress and egress platforms, which handle large data transfers.

### Source excerpt

Discover how to integrate Stripe Data Pipeline with Google Cloud Storage and BigQuery for powerful analytics. This guide walks you through setting up automated data transfers, optimizing reporting, and unlocking valuable insights to enhance your business decisions.

## 5 Reasons Data Discovery Platforms Are Best For Data Lakes

DevFeed: [5 Reasons Data Discovery Platforms Are Best For Data Lakes](<https://devfeed.tech/articles/5-reasons-data-discovery-platforms-are-best-for-data-lakes-83156.md>)

Original publisher: [Read original article](<https://montecarlo.ai/blog-why-data-discovery-tools-platforms-are-best-for-data-lakes>)

Author: Barr Moses

Published: 2021-04-02T00:22:46Z

Content type: article

Language: en

Sources: [Monte Carlo](<https://devfeed.tech/sources/monte-carlo.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>), [Cybercrime](<https://devfeed.tech/topics/cybercrime.md>)

Tags: [data-discovery](<https://devfeed.tech/tags/data-discovery.md>), [data-discovery-platform](<https://devfeed.tech/tags/data-discovery-platform.md>), [data-engineering-teams](<https://devfeed.tech/tags/data-engineering-teams.md>), [data-mesh](<https://devfeed.tech/tags/data-mesh.md>), [data-observability](<https://devfeed.tech/tags/data-observability.md>), [data-observability-data-discovery](<https://devfeed.tech/tags/data-observability-data-discovery.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [data-stack](<https://devfeed.tech/tags/data-stack.md>)

### AI overview

The article argues that data discovery tools can address shortcomings of traditional, manually maintained catalogs in distributed data lakes. It describes automated lineage, real-time visibility into data health, self-service discovery, and support for governance and pipeline optimization.

### Source excerpt

Here are 5 reasons why using a data discovery platform is a better alternative to data catalogs to ensure your data lake doesn't turn into a data swamp.

## Teradata Launches New 'DataDNA' Data Forensics Tool

DevFeed: [Teradata Launches New 'DataDNA' Data Forensics Tool](<https://devfeed.tech/articles/teradata-launches-new-datadna-data-forensics-tool-80992.md>)

Original publisher: [Read original article](<https://www.teradata.com/press-releases/2020/teradata-launches-new-datadna-data-forensics-tool>)

Author: January Machold

Published: 2020-11-16T08:00:00Z

Content type: news

Language: en

Sources: [Teradata News](<https://devfeed.tech/sources/teradata-news.md>)

Topics: [Data Management](<https://devfeed.tech/topics/data-management.md>), [AWS Lake Formation](<https://devfeed.tech/topics/aws-lake-formation.md>)

Tags: [article](<https://devfeed.tech/tags/article.md>), [cloud-migration](<https://devfeed.tech/tags/cloud-migration.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lineage](<https://devfeed.tech/tags/data-lineage.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [launches](<https://devfeed.tech/tags/launches.md>)

### AI overview

Teradata announced DataDNA, an as-a-service offering that uses metadata to map data lineage and usage across platforms. The service is intended to support data governance, quality, impact analysis, and cloud migration planning.

### Source excerpt

New as-a-service offering automates discovery of cross-platform data lineage so customers can better understand data flow and utilization across their entire data analytics ecosystem