# etl

ETL (extract, transform, and load) is a process that combines data from multiple sources, transforms it, and loads it into a data warehouse or other target store.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Sync Engine: Mirror WorkOS data into your database

DevFeed: [Sync Engine: Mirror WorkOS data into your database](<https://devfeed.tech/articles/sync-engine-mirror-workos-data-into-your-database-146297.md>)

Original publisher: [Read original article](<https://workos.com/blog/sync-engine>)

Author: WorkOS

Published: 2026-11-19T00:00:00Z

Content type: article

Language: en

Sources: [WorkOS](<https://devfeed.tech/sources/workos-blog.md>)

Topics: [Database](<https://devfeed.tech/topics/database.md>), [rdbms](<https://devfeed.tech/topics/rdbms.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [etl](<https://devfeed.tech/topics/etl.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-coding](<https://devfeed.tech/tags/ai-coding.md>), [ai-coding-agent](<https://devfeed.tech/tags/ai-coding-agent.md>), [api](<https://devfeed.tech/tags/api.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [bi-tools](<https://devfeed.tech/tags/bi-tools.md>), [clickhouse](<https://devfeed.tech/tags/clickhouse.md>), [dashboard](<https://devfeed.tech/tags/dashboard.md>), [data](<https://devfeed.tech/tags/data.md>), [database](<https://devfeed.tech/tags/database.md>), [databases](<https://devfeed.tech/tags/databases.md>), [identity](<https://devfeed.tech/tags/identity.md>), [mirror](<https://devfeed.tech/tags/mirror.md>), [organizations](<https://devfeed.tech/tags/organizations.md>), [query](<https://devfeed.tech/tags/query.md>), [records](<https://devfeed.tech/tags/records.md>), [sync](<https://devfeed.tech/tags/sync.md>), [users](<https://devfeed.tech/tags/users.md>), [workos](<https://devfeed.tech/tags/workos.md>)

### AI overview

WorkOS Sync Engine mirrors users, organizations, memberships, permissions, and emitted events into a database you control, letting applications join identity records with their own data in one database query. It supports Postgres, MySQL, MongoDB, and ClickHouse; generated `_live` views omit tombstoned rows, while retained deletion records can support investigation of departures within the records the mirror captured and still retains. Joins should include `_env` because IDs are unique per environment. Install `@workos/sync-engine` and a destination package, run it as a TypeScript library or Docker service, backfill existing records, keep the Events API poller running, and schedule reconciliation separately for supported streams. Polling and database write frequency are configurable within API rate limits. Permissions can be read alongside application data, but access decisions remain on the session token.

### Source excerpt

The WorkOS Sync Engine mirrors users, organizations, and memberships into your database, so you can query identity data alongside your application records.

## A modern dilemma: Consume data from a stream or a lake

DevFeed: [A modern dilemma: Consume data from a stream or a lake](<https://devfeed.tech/articles/a-modern-dilemma-consume-data-from-a-stream-or-a-lake-141161.md>)

Original publisher: [Read original article](<https://medium.com/capital-one-tech/a-modern-dilemma-consume-data-from-a-stream-or-a-lake-296bbb354094?source=rss----3db3a67cb648---4>)

Author: Capital One Tech

Published: 2026-11-18T17:35:14Z

Content type: article

Language: en

Sources: [Capital One Tech](<https://devfeed.tech/sources/capital-one-tech.md>)

Topics: [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [stream-processing](<https://devfeed.tech/topics/stream-processing.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [etl](<https://devfeed.tech/topics/etl.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Apache Flink](<https://devfeed.tech/topics/apache-flink.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [apis](<https://devfeed.tech/tags/apis.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [batch](<https://devfeed.tech/tags/batch.md>), [big-data](<https://devfeed.tech/tags/big-data.md>), [business-processes](<https://devfeed.tech/tags/business-processes.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-computing](<https://devfeed.tech/tags/cloud-computing.md>), [data](<https://devfeed.tech/tags/data.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [data-lakes](<https://devfeed.tech/tags/data-lakes.md>), [delta-lake](<https://devfeed.tech/tags/delta-lake.md>), [enrichment](<https://devfeed.tech/tags/enrichment.md>), [etl](<https://devfeed.tech/tags/etl.md>), [event](<https://devfeed.tech/tags/event.md>), [flink](<https://devfeed.tech/tags/flink.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [latency](<https://devfeed.tech/tags/latency.md>), [legacy](<https://devfeed.tech/tags/legacy.md>), [log](<https://devfeed.tech/tags/log.md>), [mapping](<https://devfeed.tech/tags/mapping.md>), [model-context-protocol](<https://devfeed.tech/tags/model-context-protocol.md>), [software-architecture](<https://devfeed.tech/tags/software-architecture.md>), [software-engineering](<https://devfeed.tech/tags/software-engineering.md>), [stream](<https://devfeed.tech/tags/stream.md>)

### AI overview

Choosing a data consumption pattern early can avoid costly architectural changes later. APIs support synchronous, record-by-record requests and paginated multirecord results, making them suitable for low-latency needs; Model Context Protocol can provide similar access for agents and is often an API wrapper. Event streams, commonly built with Kafka, Flink or Spark Streaming, suit sub-second latency and enable per-event calculations, transformations and enrichment. The excerpt also identifies Delta Change Data Feed (CDF) as a record-by-record pattern and traditional batch ETL as a multirecord pattern, but ends before explaining CDF's mechanics or comparing these approaches further.

### Source excerpt

Data is a critical component of software architecture, providing the foundation for business processes, including those powered by artificial intelligence (AI). Quality, volume, latency, consistency, ordering and duplicates are essential considerations in software design. Modern cloud architectures consume data in various ways, such as through application programming interfaces (APIs), streams and data lakes. You can consume data at the individual event or record level as it arrives or in larger batches. Legacy architectures often process data in scheduled batches, forcing surrounding architecture and business processes to depend on that approach. Getting the data consumption approach right up front is vital, because rearchitecting later is costly. General patterns to consume data There are several general data consumption patterns. These include APIs (record-by-record or multirecord results), event stream consumption (record-by-record), Delta Change Data Feed (CDF) consumption (record-by-record) or traditional batch ETL-extract, transform, load (multirecord results). APIs are ideal for low-latency, record-by-record requirements. They also support multirecord results, typically through pagination. APIs usually follow a synchronous approach, where the client makes a call and waits for a response before moving to the next step. Model Context Protocol is an industry specification for agents to consume data and can support record-by-record or batch results via pagination, similar to APIs. They are often a wrapper on top of APIs. The event stream pattern works well for sub-second latency requirements and typically runs on a tech stack like Kafka, Flink or Spark Streaming. These technologies excel at record-level calculations (like on-the-fly calculation), transformations (like column mapping) or enrichment (like adding data to an existing event). Delta Lake is often used in data lakes and serves as a transaction log to standard Apache Parquet data files (source). CDF is

## How Orkes ParticleDB turns an impressive demo into a remarkable application

DevFeed: [How Orkes ParticleDB turns an impressive demo into a remarkable application](<https://devfeed.tech/articles/how-orkes-particledb-turns-an-impressive-demo-into-a-remarkable-application-140897.md>)

Original publisher: [Read original article](<https://thenewstack.io/orkes-particledb-agentic-database/>)

Author: Chris J. Preimesberger

Published: 2026-11-18T16:54:44Z

Content type: article

Language: en

Sources: [The New Stack](<https://devfeed.tech/sources/the-new-stack.md>)

Topics: [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Transactions](<https://devfeed.tech/topics/transactions.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [ai-development](<https://devfeed.tech/tags/ai-development.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [audit](<https://devfeed.tech/tags/audit.md>), [banking](<https://devfeed.tech/tags/banking.md>), [business](<https://devfeed.tech/tags/business.md>), [business-processes](<https://devfeed.tech/tags/business-processes.md>), [ceo](<https://devfeed.tech/tags/ceo.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [combined](<https://devfeed.tech/tags/combined.md>), [commerce](<https://devfeed.tech/tags/commerce.md>), [company](<https://devfeed.tech/tags/company.md>), [complex](<https://devfeed.tech/tags/complex.md>), [conductor](<https://devfeed.tech/tags/conductor.md>), [controls](<https://devfeed.tech/tags/controls.md>), [data](<https://devfeed.tech/tags/data.md>), [databases](<https://devfeed.tech/tags/databases.md>), [orkes](<https://devfeed.tech/tags/orkes.md>), [podcast](<https://devfeed.tech/tags/podcast.md>), [sponsor-orkes](<https://devfeed.tech/tags/sponsor-orkes.md>), [sponsored](<https://devfeed.tech/tags/sponsored.md>), [sponsored-podcast](<https://devfeed.tech/tags/sponsored-podcast.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

Orkes presents ParticleDB, previewed at its Shift conference, as a common engine for relational, key-value, vector and analytical data intended to reduce the ETL and integration burden of using multiple systems. Paired with Conductor, it is designed to keep agents, applications and data within customers' cloud boundaries, supplying agents with needed context without freely exposing sensitive enterprise systems. Conductor provides workflow orchestration, recovery mechanisms, security controls and audit trails for long-running agent workflows. The approach combines agents for ambiguous work, such as interpreting refund complaints, with conventional workflows for predictable actions like issuing refunds and updating records; unusual or high-risk cases can go to humans. The excerpt describes these as intended capabilities and design principles, not measured product results.

### Source excerpt

Building an AI agent that performs an impressive demonstration is one thing. Building one that can reliably process financial transactions, The post How Orkes ParticleDB turns an impressive demo into a remarkable application appeared first on The New Stack.

## Simplify Brand Awareness Analysis With Fivetran Data Models | Blog | Fivetran

DevFeed: [Simplify Brand Awareness Analysis With Fivetran Data Models | Blog | Fivetran](<https://devfeed.tech/articles/simplify-brand-awareness-analysis-with-fivetran-data-models-blog-fivetran-141338.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/simplify-brand-awareness-analysis-with-fivetran-data-models>)

Author: Joe Markiewicz

Published: 2026-11-18T06:13:15Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [etl](<https://devfeed.tech/topics/etl.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Instagram](<https://devfeed.tech/topics/instagram.md>)

Tags: [advertising](<https://devfeed.tech/tags/advertising.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [awareness](<https://devfeed.tech/tags/awareness.md>), [brand](<https://devfeed.tech/tags/brand.md>), [brand-awareness](<https://devfeed.tech/tags/brand-awareness.md>), [data](<https://devfeed.tech/tags/data.md>), [engagement](<https://devfeed.tech/tags/engagement.md>), [engagement-metrics](<https://devfeed.tech/tags/engagement-metrics.md>), [facebook](<https://devfeed.tech/tags/facebook.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [instagram](<https://devfeed.tech/tags/instagram.md>), [linkedin](<https://devfeed.tech/tags/linkedin.md>), [marketing-analytics](<https://devfeed.tech/tags/marketing-analytics.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [models](<https://devfeed.tech/tags/models.md>), [twitter](<https://devfeed.tech/tags/twitter.md>)

### AI overview

Fivetran's social media data model combines cleaned, tested, normalized engagement data from Facebook Pages, Instagram Business, Organic Twitter, and LinkedIn Company Pages into one schema and table. It rolls up clicks, impressions, shares, likes, and comments, supports combining multiple accounts on a connector, and helps compare engagement across profiles. Used alongside Fivetran's separate ad reporting model--which aggregates spend, clicks, and impressions across Facebook, Google, Pinterest, Bing, Twitter, and LinkedIn--analysts can compare daily reach and engagement. Both models use shared transformation logic maintained by Fivetran analytics engineers and community contributors.

### Source excerpt

Easily combine engagement metrics from Facebook, Instagram, Twitter and LinkedIn.

## Perform rapid analysis of your app platform data | Blog | Fivetran

DevFeed: [Perform rapid analysis of your app platform data | Blog | Fivetran](<https://devfeed.tech/articles/perform-rapid-analysis-of-your-app-platform-data-blog-fivetran-141335.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/perform-rapid-analysis-of-your-app-platform-data>)

Author: Jamie Rodriguez

Published: 2026-11-18T06:13:15Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Google Play](<https://devfeed.tech/topics/google-play.md>), [etl](<https://devfeed.tech/topics/etl.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>)

Tags: [2022](<https://devfeed.tech/tags/2022.md>), [about](<https://devfeed.tech/tags/about.md>), [aggregation](<https://devfeed.tech/tags/aggregation.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [app](<https://devfeed.tech/tags/app.md>), [app-store](<https://devfeed.tech/tags/app-store.md>), [apple](<https://devfeed.tech/tags/apple.md>), [apple-app-store](<https://devfeed.tech/tags/apple-app-store.md>), [can](<https://devfeed.tech/tags/can.md>), [data](<https://devfeed.tech/tags/data.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [google](<https://devfeed.tech/tags/google.md>), [google-play](<https://devfeed.tech/tags/google-play.md>), [model](<https://devfeed.tech/tags/model.md>), [platform](<https://devfeed.tech/tags/platform.md>), [play](<https://devfeed.tech/tags/play.md>), [rapid](<https://devfeed.tech/tags/rapid.md>), [reporting](<https://devfeed.tech/tags/reporting.md>), [store](<https://devfeed.tech/tags/store.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Fivetran's App Reporting data models standardize Google Play and Apple App Store connector data into a unified schema, aggregating app activity daily by app and across country, OS version, app version, traffic source, and device. The models are intended to reduce the need for teams to learn and join numerous normalized source tables. They include a data dictionary and model lineage graph. With Fivetran Transformations for dbt Core, integrated scheduling (available as of February 2022) runs the reporting model after connector syncs complete, so the resulting models use the latest synced data.

### Source excerpt

With Fivetran's new App Reporting data model, you can easily roll your Apple App Store and Google Play data into a unified schema for seamless reporting.

## Best of 2021: Fivetran's Year in Review | Blog | Fivetran

DevFeed: [Best of 2021: Fivetran's Year in Review | Blog | Fivetran](<https://devfeed.tech/articles/best-of-2021-fivetran-s-year-in-review-blog-fivetran-141301.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/best-of-2021-fivetrans-year-in-review>)

Author: Cat Origitano

Published: 2026-11-18T06:13:15Z

Content type: news

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>), [Security](<https://devfeed.tech/topics/security.md>)

Tags: [2021](<https://devfeed.tech/tags/2021.md>), [access-control](<https://devfeed.tech/tags/access-control.md>), [acquisition](<https://devfeed.tech/tags/acquisition.md>), [acquisitions](<https://devfeed.tech/tags/acquisitions.md>), [airflow](<https://devfeed.tech/tags/airflow.md>), [alerts](<https://devfeed.tech/tags/alerts.md>), [best-of](<https://devfeed.tech/tags/best-of.md>), [blog](<https://devfeed.tech/tags/blog.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [data](<https://devfeed.tech/tags/data.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [integrations](<https://devfeed.tech/tags/integrations.md>), [models](<https://devfeed.tech/tags/models.md>), [partner](<https://devfeed.tech/tags/partner.md>), [partner-integrations](<https://devfeed.tech/tags/partner-integrations.md>), [review](<https://devfeed.tech/tags/review.md>), [security](<https://devfeed.tech/tags/security.md>), [security-and-compliance](<https://devfeed.tech/tags/security-and-compliance.md>), [year-in-review](<https://devfeed.tech/tags/year-in-review.md>)

### AI overview

Fivetran reports that in 2021 it added 40 connectors, bringing its total to more than 180, and launched 14 prebuilt data models. It also introduced integrated scheduling with dbt Core; Business Critical features including AWS or Azure PrivateLink, customer-managed keys, cloud and region selection, and PCI DSS Level 1 qualification; and governance tools such as granular RBAC, Okta and AzureAD user provisioning, and column masking across all connectors. The company says it averaged over 99.9% pipeline uptime and handled more than one million daily syncs. Other changes included integrations with Airflow, Terraform, Prefect, and Dagster, expanded cloud partnerships, interface and documentation updates, and the HVR and Teleport Data acquisitions. The article presents a company year-in-review, not independent evaluation of these claims.

### Source excerpt

Dozens of new connectors, partner integrations, security and compliance enhancements -- and the Fivetran data models you love.

## New Connector: Airtable | Blog | Fivetran

DevFeed: [New Connector: Airtable | Blog | Fivetran](<https://devfeed.tech/articles/new-connector-airtable-blog-fivetran-141334.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/new-connector-airtable>)

Author: Fivetran

Published: 2026-11-18T06:13:15Z

Content type: release

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [etl](<https://devfeed.tech/topics/etl.md>), [analytics stack](<https://devfeed.tech/topics/analytics-stack.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [data transformation](<https://devfeed.tech/topics/data-transformation.md>)

Tags: [airtable](<https://devfeed.tech/tags/airtable.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [blog](<https://devfeed.tech/tags/blog.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [spreadsheets](<https://devfeed.tech/tags/spreadsheets.md>)

### AI overview

Fivetran's Airtable connector uses an API key to access tables in Airtable bases and their metadata, with webhooks enabling incremental table updates. The text says Fivetran's partnership with Airtable allows it to retrieve additional fields beyond the standard API and provide higher throughput for faster syncs. Airtable's flexible structure means organizations may use it differently across departments; examples cited include product launch tracking, marketing campaigns, and accounts payable and receivable monitoring.

### Source excerpt

Bring disparate spreadsheets into your centralized analytics destination.

## How to Develop a Data-Driven Marketing Culture | Blog | Fivetran

DevFeed: [How to Develop a Data-Driven Marketing Culture | Blog | Fivetran](<https://devfeed.tech/articles/how-to-develop-a-data-driven-marketing-culture-blog-fivetran-141326.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/how-to-develop-a-data-driven-marketing-culture>)

Author: Cat Origitano

Published: 2026-11-18T06:13:15Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [business-intelligence](<https://devfeed.tech/topics/business-intelligence.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [2022](<https://devfeed.tech/tags/2022.md>), [actions](<https://devfeed.tech/tags/actions.md>), [ads](<https://devfeed.tech/tags/ads.md>), [advertising](<https://devfeed.tech/tags/advertising.md>), [agile](<https://devfeed.tech/tags/agile.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [analysts](<https://devfeed.tech/tags/analysts.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analyze](<https://devfeed.tech/tags/analyze.md>), [blog](<https://devfeed.tech/tags/blog.md>), [culture](<https://devfeed.tech/tags/culture.md>), [data](<https://devfeed.tech/tags/data.md>), [data-driven](<https://devfeed.tech/tags/data-driven.md>), [develop](<https://devfeed.tech/tags/develop.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [help](<https://devfeed.tech/tags/help.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [marketing](<https://devfeed.tech/tags/marketing.md>), [skills](<https://devfeed.tech/tags/skills.md>), [team](<https://devfeed.tech/tags/team.md>)

### AI overview

The article argues that data-driven marketing requires organizational change alongside analytics tools. As third-party cookies disappear and first-party data remains scattered across teams, it recommends setting measurable goals for data culture, securing leadership support, holding teams accountable for evidence-based decisions, and sharing lessons from wins and failures. Practical steps include reducing silos through embedded or rotating analysts, assessing marketers' skills and planning training, and ensuring analytics cover six source categories: email, CRM, paid digital advertising, organic social and digital, conversions, and website or engagement analytics. For cross-platform analysis, it recommends a modern data stack: source platforms, an automated pipeline such as Fivetran, a cloud warehouse such as Snowflake, and a BI tool such as Looker or Tableau. This can replace error-prone, stale manual spreadsheet merging, though the article presents centralization as a foundation rather than a guarantee of effective decisions.

### Source excerpt

Help your team develop the appropriate skills to win in the age of data-driven marketing.

## ETL Platform Alternatives: Fivetran vs. Informatica and More | Blog | Fivetran

DevFeed: [ETL Platform Alternatives: Fivetran vs. Informatica and More | Blog | Fivetran](<https://devfeed.tech/articles/etl-platform-alternatives-fivetran-vs-informatica-and-more-blog-fivetran-141305.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/etl-platform-alternatives-fivetran-vs-informatica-and-more>)

Author: Charles Wang

Published: 2026-11-18T06:13:15Z

Content type: comparison

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [etl](<https://devfeed.tech/topics/etl.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>)

Tags: [alternatives](<https://devfeed.tech/tags/alternatives.md>), [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [business-intelligence](<https://devfeed.tech/tags/business-intelligence.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [compare](<https://devfeed.tech/tags/compare.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data](<https://devfeed.tech/tags/data.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [etl](<https://devfeed.tech/tags/etl.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [informatica](<https://devfeed.tech/tags/informatica.md>), [integration](<https://devfeed.tech/tags/integration.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [security](<https://devfeed.tech/tags/security.md>), [sources](<https://devfeed.tech/tags/sources.md>), [tools](<https://devfeed.tech/tags/tools.md>)

### AI overview

The excerpt compares ETL platforms on destinations, connectors, pricing, trials, compliance and replication behavior. It says Informatica has opaque, sales-led pricing and a 30-day trial; Matillion has just over 100 connectors across five destinations, usage-based tiers and a 14-day trial; Xplenty offers almost 100 integrations and broad destination types but charges per source-destination connection and lacks change data capture; Stitch offers 130+ connectors, consumption-based tiers and a 14-day trial. The article also recommends testing platforms with live data for volume, speed, types, record structures and documentation, and asking how they handle source schema changes at the destination. It claims Fivetran supports 700+ sources and 15+ destinations, uses monthly-active-row pricing, and automatically migrates warehouse schemas when source schemas change.

### Source excerpt

Compare popular data integration tools on cost, security, reliability and number of supported sources.

## New Destination: Microsoft Azure Synapse | Blog | Fivetran

DevFeed: [New Destination: Microsoft Azure Synapse | Blog | Fivetran](<https://devfeed.tech/articles/new-destination-microsoft-azure-synapse-blog-fivetran-141300.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/azure-dwh-launch>)

Author: Fivetran

Published: 2026-11-18T06:13:15Z

Content type: release

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Azure](<https://devfeed.tech/topics/azure.md>), [etl](<https://devfeed.tech/topics/etl.md>)

Tags: [azure](<https://devfeed.tech/tags/azure.md>), [azure-synapse](<https://devfeed.tech/tags/azure-synapse.md>), [blog](<https://devfeed.tech/tags/blog.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>)

### AI overview

Fivetran can replicate and sync data from applications, databases, event logs, and file stores into Microsoft Azure Synapse. The article says it automatically fetches data from more than 90 sources, including Marketo, Oracle on Amazon RDS, Azure Blob Storage, and Salesforce, so analysts can query the warehouse with SQL or BI tools. It describes Synapse Gen 2's performance in terms of 2018 benchmark results and per-node data movement rates of up to 1 GB per second. Fivetran also lists Snowflake, Google BigQuery, and Amazon Redshift as supported destinations and states that it follows industry-leading security standards; setup details are deferred to a guide.

### Source excerpt

Use Fivetran to replicate and sync your applications, databases, event logs and file stores into your central Microsoft Azure Synapse.

## Fivetran vs. Supermetrics | Blog | Fivetran

DevFeed: [Fivetran vs. Supermetrics | Blog | Fivetran](<https://devfeed.tech/articles/fivetran-vs-supermetrics-blog-fivetran-140232.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/fivetran-vs-supermetrics>)

Author: Zarmina Niazie

Published: 2026-11-18T05:58:59Z

Content type: comparison

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [etl](<https://devfeed.tech/topics/etl.md>), [elt](<https://devfeed.tech/topics/elt.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [Data visualization](<https://devfeed.tech/topics/data-visualization.md>)

Tags: [amazon-redshift](<https://devfeed.tech/tags/amazon-redshift.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [api](<https://devfeed.tech/tags/api.md>), [applications](<https://devfeed.tech/tags/applications.md>), [automated](<https://devfeed.tech/tags/automated.md>), [automatically](<https://devfeed.tech/tags/automatically.md>), [aws](<https://devfeed.tech/tags/aws.md>), [azure](<https://devfeed.tech/tags/azure.md>), [azure-synapse](<https://devfeed.tech/tags/azure-synapse.md>), [blog](<https://devfeed.tech/tags/blog.md>), [cloud-data-warehouse](<https://devfeed.tech/tags/cloud-data-warehouse.md>), [company](<https://devfeed.tech/tags/company.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [comparisons](<https://devfeed.tech/tags/comparisons.md>), [data](<https://devfeed.tech/tags/data.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [integrate](<https://devfeed.tech/tags/integrate.md>), [marketing](<https://devfeed.tech/tags/marketing.md>), [sources](<https://devfeed.tech/tags/sources.md>), [vs](<https://devfeed.tech/tags/vs.md>)

### AI overview

The article contrasts Supermetrics' emphasis on moving marketing data to Excel, Google Sheets, and CSV-based workflows with Fivetran's automated pipelines into data warehouses. It says Supermetrics also supports some warehouse and cloud storage destinations, but connector compatibility, warehouse pricing, and a limited warehouse selection may matter; premium connectors can add costs. Fivetran describes incremental loads designed around warehouse APIs, query-ready schemas, adjustable sync intervals, and a broader set of application, file, and database connectors for combining marketing data with finance, sales, or product data. The article also highlights Fivetran's connector documentation and support, while acknowledging both platforms serve different needs and recommending trialing a solution before buying. These are claims from Fivetran's comparison article.

### Source excerpt

Trying to integrate your marketing data sources? Here are the fundamental differences between Fivetran and Supermetrics.

## Understanding Enterprise Customer Engagement With the Modern Data Stack | Blog | Fivetran

DevFeed: [Understanding Enterprise Customer Engagement With the Modern Data Stack | Blog | Fivetran](<https://devfeed.tech/articles/understanding-enterprise-customer-engagement-with-the-modern-data-stack-blog-fivetran-140265.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/understanding-enterprise-customer-engagement-with-the-modern-data-stack>)

Author: Ross Katz

Published: 2026-11-18T05:58:59Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [analytics stack](<https://devfeed.tech/topics/analytics-stack.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [elt](<https://devfeed.tech/topics/elt.md>), [etl](<https://devfeed.tech/topics/etl.md>), [schema-evolution](<https://devfeed.tech/topics/schema-evolution.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>)

Tags: [analytics-workloads](<https://devfeed.tech/tags/analytics-workloads.md>), [api](<https://devfeed.tech/tags/api.md>), [azure-synapse](<https://devfeed.tech/tags/azure-synapse.md>), [b2b](<https://devfeed.tech/tags/b2b.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [cloud-data-warehouse](<https://devfeed.tech/tags/cloud-data-warehouse.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [crm](<https://devfeed.tech/tags/crm.md>), [customer-engagement](<https://devfeed.tech/tags/customer-engagement.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [modern-data-stack](<https://devfeed.tech/tags/modern-data-stack.md>)

### AI overview

Companies serving both individual and enterprise customers need separate, evolving data models and processes to understand leads, customer journeys, renewals, and retention. The article argues that operational databases, CRMs, and ERPs are built to drive actions, so customizing them for changing analytics needs can increase overhead, maintenance, and performance problems. It recommends moving operational data into a cloud data warehouse, analyzing it there, and sending useful results back to business systems. Custom pipelines can require substantial setup and upkeep, with challenges including API limits, change data capture, source schema changes, and expanding access needs. The proposed Modern Data Stack uses Fivetran connectors to load source data into warehouses such as BigQuery, Snowflake, Redshift, or Azure Synapse, alongside analytics tools and reverse ETL. This can shift engineering effort from migration plumbing to analysis, though the article presents these benefits as its recommendation rather than quantified results.

### Source excerpt

Companies with B2B and B2C channels face complex management challenges that a modern data stack can solve.

## How To Build a Data Pipeline: A Step-by-Step Guide

DevFeed: [How To Build a Data Pipeline: A Step-by-Step Guide](<https://devfeed.tech/articles/how-to-build-a-data-pipeline-a-step-by-step-guide-140200.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/build-a-data-pipeline>)

Author: Fivetran

Published: 2026-11-18T04:57:01Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [elt](<https://devfeed.tech/topics/elt.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [automation](<https://devfeed.tech/tags/automation.md>), [batch](<https://devfeed.tech/tags/batch.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [cloud-based](<https://devfeed.tech/tags/cloud-based.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [how-to](<https://devfeed.tech/tags/how-to.md>)

### AI overview

A data pipeline moves data from sources through ingestion, processing, storage and workflows, with monitoring to catch system and data quality problems. The guide recommends inventorying sources, choosing batch or streaming ingestion based on needs, validating and transforming data, selecting destinations such as a warehouse, lake or lakehouse, and monitoring health, anomalies, alerts and logs. It contrasts ETL, which transforms before storage and can support masking before loading but becomes harder to scale as sources grow, with ELT, which loads first for faster availability and easier cloud scaling but can analyze large volumes more slowly. It also highlights automation, performance, reliability, scalability and security; ELT can still protect sensitive data through isolation, encryption and blocking or hashing before storage. The excerpt concludes that many organizations buy managed pipelines because building and maintaining connectors and components is labor-intensive.

### Source excerpt

Learn what a data pipeline is and how to build one.

## Star Schema vs. OBT for Data Warehouse Performance | Blog | Fivetran

DevFeed: [Star Schema vs. OBT for Data Warehouse Performance | Blog | Fivetran](<https://devfeed.tech/articles/star-schema-vs-obt-for-data-warehouse-performance-blog-fivetran-140258.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/star-schema-vs-obt>)

Author: Michael Kaminsky

Published: 2026-11-18T04:42:41Z

Content type: comparison

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [schema design](<https://devfeed.tech/topics/schema-design.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [database-optimization](<https://devfeed.tech/topics/database-optimization.md>), [etl](<https://devfeed.tech/topics/etl.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [analysis](<https://devfeed.tech/tags/analysis.md>), [analysts](<https://devfeed.tech/tags/analysts.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [bi](<https://devfeed.tech/tags/bi.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [blog](<https://devfeed.tech/tags/blog.md>), [cache](<https://devfeed.tech/tags/cache.md>), [caching](<https://devfeed.tech/tags/caching.md>), [customer](<https://devfeed.tech/tags/customer.md>), [customers](<https://devfeed.tech/tags/customers.md>), [data](<https://devfeed.tech/tags/data.md>), [data-mining](<https://devfeed.tech/tags/data-mining.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [performance](<https://devfeed.tech/tags/performance.md>), [schema](<https://devfeed.tech/tags/schema.md>), [star](<https://devfeed.tech/tags/star.md>), [vs](<https://devfeed.tech/tags/vs.md>), [warehouse](<https://devfeed.tech/tags/warehouse.md>)

### AI overview

In BI-style tests using TPC-DS 100 data, a denormalized one big table (OBT) generally returned queries faster than a star schema across Redshift, Snowflake, and BigQuery, with reported gains of roughly 25-50%. Results varied by warehouse: Redshift favored OBT in nine of ten queries; Snowflake showed mixed results, with star schema faster on some simpler queries; BigQuery averaged a 49% improvement for OBT and favored it in every tested category. The benchmark covers selected BI queries within each warehouse, not comparisons between warehouses or arbitrary ad hoc workloads. OBT avoids query-time joins, but takes more disk space: on the tested Redshift setup, materializing it raised usage from just over 30 GB to over 90 GB, and a larger join exceeded available space. The article also cites star schema's clearer organization and easier navigation for analysts.

### Source excerpt

Which data warehouse schema offers better performance? Let's find out.

## Automating credit card fraud detection with Google BigQuery ML and Fivetran

DevFeed: [Automating credit card fraud detection with Google BigQuery ML and Fivetran](<https://devfeed.tech/articles/automating-credit-card-fraud-detection-with-google-bigquery-ml-and-fivetran-140197.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/automating-credit-card-fraud-detection-with-google-bigquery-ml-and-fivetran>)

Author: Kelly Kohlleffel

Published: 2026-11-18T04:42:41Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [online-fraud-prevention](<https://devfeed.tech/topics/online-fraud-prevention.md>), [etl](<https://devfeed.tech/topics/etl.md>)

Tags: [automated](<https://devfeed.tech/tags/automated.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [change-detection](<https://devfeed.tech/tags/change-detection.md>), [class](<https://devfeed.tech/tags/class.md>), [classification](<https://devfeed.tech/tags/classification.md>), [cloud-data-warehouse](<https://devfeed.tech/tags/cloud-data-warehouse.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [credit-card](<https://devfeed.tech/tags/credit-card.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [data-movement](<https://devfeed.tech/tags/data-movement.md>), [data-privacy](<https://devfeed.tech/tags/data-privacy.md>), [database](<https://devfeed.tech/tags/database.md>), [databases](<https://devfeed.tech/tags/databases.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [fraud](<https://devfeed.tech/tags/fraud.md>), [fraud-detection](<https://devfeed.tech/tags/fraud-detection.md>), [ml](<https://devfeed.tech/tags/ml.md>)

### AI overview

The article demonstrates moving a SQL Server credit card transactions table into BigQuery with Fivetran, then training and querying a fraud classifier with BigQuery ML. It selects a single schema and table, configures log-free change detection, and allows schema changes to sync automatically. Fivetran supports incremental updates and defaults to six-hour polling, configurable from one minute to 24 hours; the described setup uses TLS in transit and AES256 for data temporarily stored by the service. The example dataset has 284,807 transactions and 492 fraud cases. Its logistic regression model applies a log transform to Amount, uses Class as the label, enables automatic class weights for imbalance, and splits data sequentially by Time. ML.PREDICT returns predicted class probabilities alongside transaction amount and actual Class for a selected timestamp.

### Source excerpt

Exploring fraud detection with automated data integration in a cloud data warehouse: part two of two.

## Moving data and powering innovation with Fivetran and Snowflake

DevFeed: [Moving data and powering innovation with Fivetran and Snowflake](<https://devfeed.tech/articles/moving-data-and-powering-innovation-with-fivetran-and-snowflake-140244.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/moving-data-and-powering-innovation-with-fivetran-and-snowflake>)

Author: Charles Wang

Published: 2026-11-18T04:00:45Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [etl](<https://devfeed.tech/topics/etl.md>), [data-architecture](<https://devfeed.tech/topics/data-architecture.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Data visualization](<https://devfeed.tech/topics/data-visualization.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [account](<https://devfeed.tech/tags/account.md>), [activation](<https://devfeed.tech/tags/activation.md>), [after](<https://devfeed.tech/tags/after.md>), [aggregation](<https://devfeed.tech/tags/aggregation.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-ml](<https://devfeed.tech/tags/ai-ml.md>), [all](<https://devfeed.tech/tags/all.md>), [also](<https://devfeed.tech/tags/also.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [data](<https://devfeed.tech/tags/data.md>), [data-cloud](<https://devfeed.tech/tags/data-cloud.md>), [data-movement](<https://devfeed.tech/tags/data-movement.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [moving](<https://devfeed.tech/tags/moving.md>), [snowflake](<https://devfeed.tech/tags/snowflake.md>), [snowflake-data-cloud](<https://devfeed.tech/tags/snowflake-data-cloud.md>), [with](<https://devfeed.tech/tags/with.md>)

### AI overview

Fivetran centralizes data from SaaS applications and databases in Snowflake, reducing the integration work described in the article. For analytics, the workflow is to load data with Fivetran, transform it with Fivetran, dbt and/or SnowSQL, then build reports with third-party BI platforms or Snowpark. For AI/ML, Cortex supports built-in models for forecasting, anomaly detection, root cause analysis and classification, and RAG using vectors in a chosen vector database; Snowpark and Streamlit can provide an application backend and user interface. To start through Snowflake Partner Connect, find and connect to Fivetran in the Snowflake dashboard, activate the account, create a password, then add and sync a connector. The 14-day free trial begins after the initial sync and requires no credit card.

### Source excerpt

Accelerate data movement into the Snowflake Data Cloud to execute analytic workloads, AI and GenAI.

## Fivetran value guide: What you're really getting

DevFeed: [Fivetran value guide: What you're really getting](<https://devfeed.tech/articles/fivetran-value-guide-what-you-re-really-getting-140229.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/fivetran-value-guide-what-youre-really-getting>)

Author: Shira Krishnan

Published: 2026-11-18T04:00:44Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [etl](<https://devfeed.tech/topics/etl.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-copilots](<https://devfeed.tech/tags/ai-copilots.md>), [airbyte](<https://devfeed.tech/tags/airbyte.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [automate](<https://devfeed.tech/tags/automate.md>), [automated](<https://devfeed.tech/tags/automated.md>), [automation](<https://devfeed.tech/tags/automation.md>), [availability](<https://devfeed.tech/tags/availability.md>), [business](<https://devfeed.tech/tags/business.md>), [business-value](<https://devfeed.tech/tags/business-value.md>), [can](<https://devfeed.tech/tags/can.md>), [capabilities](<https://devfeed.tech/tags/capabilities.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [change-data-capture](<https://devfeed.tech/tags/change-data-capture.md>), [clinical-trials](<https://devfeed.tech/tags/clinical-trials.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [etl](<https://devfeed.tech/tags/etl.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [roi](<https://devfeed.tech/tags/roi.md>), [tco](<https://devfeed.tech/tags/tco.md>)

### AI overview

Fivetran's value proposition is to reduce the labor and maintenance involved in moving data through a fully managed platform. The source cites 700+ prebuilt connectors, change data capture, automated schema drift handling, recovery from failed syncs, and destinations including warehouses, lakes, and vector databases. Its usage-based pricing charges for Monthly Active Rows per connector; initial and historical syncs are free, and volume and annual-contract discounts may apply. The guide contrasts this with DIY pipelines, which require ongoing engineering, and open source or budget tools, which it says can leave support, compliance, monitoring, or advanced features to the customer. Examples include National Australia Bank's reported 50% reduction in ingestion costs and New Relic's estimated $500,000 savings. These are vendor-presented claims; the excerpt provides no independent comparison methodology.

### Source excerpt

Fivetran is more than another ETL tool: It radically lowers the TCO of data integration and delivers ROI across your enterprise.

## Why Your Customer Data Platform Should Be the Data Warehouse | Blog | Fivetran

DevFeed: [Why Your Customer Data Platform Should Be the Data Warehouse | Blog | Fivetran](<https://devfeed.tech/articles/why-your-customer-data-platform-should-be-the-data-warehouse-blog-fivetran-140207.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/customer-data-platform-data-warehouse>)

Author: Tejas Manohar

Published: 2026-11-18T03:38:23Z

Content type: opinion

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Management](<https://devfeed.tech/topics/data-management.md>), [etl](<https://devfeed.tech/topics/etl.md>), [schema design](<https://devfeed.tech/topics/schema-design.md>), [vendor lock-in](<https://devfeed.tech/topics/vendor-lock-in.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [2019](<https://devfeed.tech/tags/2019.md>), [3](<https://devfeed.tech/tags/3.md>), [about](<https://devfeed.tech/tags/about.md>), [accessible](<https://devfeed.tech/tags/accessible.md>), [account](<https://devfeed.tech/tags/account.md>), [blog](<https://devfeed.tech/tags/blog.md>), [consider](<https://devfeed.tech/tags/consider.md>), [customer](<https://devfeed.tech/tags/customer.md>), [customer-data](<https://devfeed.tech/tags/customer-data.md>), [customer-data-platform](<https://devfeed.tech/tags/customer-data-platform.md>), [data](<https://devfeed.tech/tags/data.md>), [data-platform](<https://devfeed.tech/tags/data-platform.md>), [data-platforms](<https://devfeed.tech/tags/data-platforms.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [instead](<https://devfeed.tech/tags/instead.md>), [platform](<https://devfeed.tech/tags/platform.md>), [platforms](<https://devfeed.tech/tags/platforms.md>), [warehouse](<https://devfeed.tech/tags/warehouse.md>)

### AI overview

The article argues that a data warehouse can serve as a company's customer data platform by keeping customer information and trusted definitions centralized, modeling flexible relational data in SQL, and syncing warehouse data to business tools. It says general-purpose CDPs can impose rigid data models, limit access and portability, and separate marketing workflows from data-team oversight. The proposed warehouse approach uses tools such as Hightouch for SQL-based syncs and audience building, with data teams modeling data and marketers creating segments. The article sees vertical CDPs as useful for specialized needs, and off-the-shelf CDPs as reasonable when SQL expertise or a modern data stack is lacking, or when near-real-time capabilities are essential. It cautions that some CDPs' real-time functions may still be constrained by warehouse technology.

### Source excerpt

Off-the-shelf customer data platforms have serious shortcomings. Consider data warehouses instead.

## Introducing the Fivetran dbt Packages for GitHub | Blog | Fivetran

DevFeed: [Introducing the Fivetran dbt Packages for GitHub | Blog | Fivetran](<https://devfeed.tech/articles/introducing-the-fivetran-dbt-packages-for-github-blog-fivetran-140218.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/fivetran-dbt-github>)

Author: Fivetran

Published: 2026-11-18T03:07:10Z

Content type: release

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [GitHub](<https://devfeed.tech/topics/github.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [etl](<https://devfeed.tech/topics/etl.md>), [elt](<https://devfeed.tech/topics/elt.md>), [GitHub Issues](<https://devfeed.tech/topics/github-issues.md>)

Tags: [advanced](<https://devfeed.tech/tags/advanced.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [api](<https://devfeed.tech/tags/api.md>), [challenges](<https://devfeed.tech/tags/challenges.md>), [code](<https://devfeed.tech/tags/code.md>), [completion](<https://devfeed.tech/tags/completion.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [dependencies](<https://devfeed.tech/tags/dependencies.md>), [development](<https://devfeed.tech/tags/development.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [github](<https://devfeed.tech/tags/github.md>), [github-api](<https://devfeed.tech/tags/github-api.md>), [github-issues](<https://devfeed.tech/tags/github-issues.md>), [package](<https://devfeed.tech/tags/package.md>), [packages](<https://devfeed.tech/tags/packages.md>), [software](<https://devfeed.tech/tags/software.md>), [software-delivery](<https://devfeed.tech/tags/software-delivery.md>)

### AI overview

The Fivetran dbt package for GitHub joins API data about issues, pull requests, assignments, reviewers, and history to support engineering workflow metrics. Its outputs include enriched issue and pull request records plus daily, weekly, monthly, and quarterly counts of items opened and closed. The models expose measures such as time to completion and durations between review requests, reviews, and merges, which can help teams track workload balance, PR lifecycle, and completion trends. The package relies on Fivetran's GitHub connector and a separate dbt source package, which is downloaded with it; that source package lightly cleans data, defines tables and columns, and tests source data. GitHub data can also be combined with Jira or Asana for a broader software delivery view.

### Source excerpt

Transform your GitHub data integrated through Fivetran with this dbt package to gain insight into the state of code issues and the complete software delivery process.

## In uncertain markets, businesses invest in data | Blog | Fivetran

DevFeed: [In uncertain markets, businesses invest in data | Blog | Fivetran](<https://devfeed.tech/articles/in-uncertain-markets-businesses-invest-in-data-blog-fivetran-140240.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/in-uncertain-markets-businesses-invest-in-data>)

Author: Fivetran

Published: 2026-11-18T03:07:10Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [analytics stack](<https://devfeed.tech/topics/analytics-stack.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [data](<https://devfeed.tech/topics/data.md>), [elt](<https://devfeed.tech/topics/elt.md>), [etl](<https://devfeed.tech/topics/etl.md>)

Tags: [agile](<https://devfeed.tech/tags/agile.md>), [andreessen-horowitz](<https://devfeed.tech/tags/andreessen-horowitz.md>), [aws](<https://devfeed.tech/tags/aws.md>), [business-operations](<https://devfeed.tech/tags/business-operations.md>), [c-suite](<https://devfeed.tech/tags/c-suite.md>), [career](<https://devfeed.tech/tags/career.md>), [cio](<https://devfeed.tech/tags/cio.md>), [cios](<https://devfeed.tech/tags/cios.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-data](<https://devfeed.tech/tags/cloud-data.md>), [construction](<https://devfeed.tech/tags/construction.md>), [customer](<https://devfeed.tech/tags/customer.md>), [customer-experience](<https://devfeed.tech/tags/customer-experience.md>), [customers](<https://devfeed.tech/tags/customers.md>), [data](<https://devfeed.tech/tags/data.md>), [data-stack](<https://devfeed.tech/tags/data-stack.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [invest](<https://devfeed.tech/tags/invest.md>), [markets](<https://devfeed.tech/tags/markets.md>), [modern-data-stack](<https://devfeed.tech/tags/modern-data-stack.md>)

### AI overview

The article argues that accurate, current data consolidated for holistic analysis can help businesses respond to volatile markets by improving efficiency, identifying growth opportunities and speeding decisions across an organization. It describes Schüttflix centralizing customer, supplier and partner data to improve supply chain coverage and efficiency; 1-800-Flowers combining internal and purchased data to personalize customer experiences and find cross-sell and upsell opportunities; and a sportswear brand joining apparel and fitness-app data to build customer profiles. A logistics customer used broad, rapid data access to involve more employees in decisions. These are company-reported examples; the excerpt does not quantify results or compare data platforms.

### Source excerpt

Fivetran and our modern data stack partners are poised to thrive.

## Why a Monolithic Data Warehouse Is the Right Choice for Most Organizations | Blog | Fivetran

DevFeed: [Why a Monolithic Data Warehouse Is the Right Choice for Most Organizations | Blog | Fivetran](<https://devfeed.tech/articles/why-a-monolithic-data-warehouse-is-the-right-choice-for-most-organizations-blog-fivetran-140272.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/why-a-monolithic-data-warehouse-is-the-right-choice-for-most-organizations>)

Author: George Fraser

Published: 2026-11-18T02:46:08Z

Content type: opinion

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [etl](<https://devfeed.tech/topics/etl.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [schema-evolution](<https://devfeed.tech/topics/schema-evolution.md>), [schema design](<https://devfeed.tech/topics/schema-design.md>), [elt](<https://devfeed.tech/topics/elt.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [api](<https://devfeed.tech/tags/api.md>), [apis](<https://devfeed.tech/tags/apis.md>), [changelog](<https://devfeed.tech/tags/changelog.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-native](<https://devfeed.tech/tags/cloud-native.md>), [complex](<https://devfeed.tech/tags/complex.md>), [connect](<https://devfeed.tech/tags/connect.md>), [data](<https://devfeed.tech/tags/data.md>), [data-gravity](<https://devfeed.tech/tags/data-gravity.md>), [data-movement](<https://devfeed.tech/tags/data-movement.md>), [data-virtualization](<https://devfeed.tech/tags/data-virtualization.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [database](<https://devfeed.tech/tags/database.md>), [databases](<https://devfeed.tech/tags/databases.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-data](<https://devfeed.tech/tags/enterprise-data.md>), [environments](<https://devfeed.tech/tags/environments.md>), [etl](<https://devfeed.tech/tags/etl.md>), [etl-pipeline](<https://devfeed.tech/tags/etl-pipeline.md>)

### AI overview

The article argues that common enterprise data warehouse problems stem from snapshot-based ETL, not from a centralized warehouse itself. It proposes separating replication from transformation: replicate source changes using native changelogs, then transform the replicated data with SQL inside the warehouse. The article says this reduces latency and data movement, makes schema development faster and incremental, and can include non-relational sources. It contrasts this approach with query federation, which it says is too slow for most real-world sources; data virtualization, which it says works in practice only with high-bandwidth sources such as HDFS or S3; and HTAP, which it says is rarely used because organizations cannot realistically run all tools on one database. Accurate changelog replication is described as the hardest part, sometimes requiring additional API calls or queries for context.

### Source excerpt

Most problems associated with the EDW are actually problems with ETL. The foundation of a successful data warehouse is proper separation of concerns.

## Use Fivetran, Snowflake and Tableau to Get a Handle on NetSuite Data | Blog | Fivetran

DevFeed: [Use Fivetran, Snowflake and Tableau to Get a Handle on NetSuite Data | Blog | Fivetran](<https://devfeed.tech/articles/use-fivetran-snowflake-and-tableau-to-get-a-handle-on-netsuite-data-blog-fivetran-140246.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/netsuite-tableau>)

Author: Charles Wang

Published: 2026-11-18T02:46:08Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [business-intelligence](<https://devfeed.tech/topics/business-intelligence.md>), [Data visualization](<https://devfeed.tech/topics/data-visualization.md>), [dashboards](<https://devfeed.tech/topics/dashboards.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [business-intelligence](<https://devfeed.tech/tags/business-intelligence.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [netsuite](<https://devfeed.tech/tags/netsuite.md>), [snowflake](<https://devfeed.tech/tags/snowflake.md>), [tableau](<https://devfeed.tech/tags/tableau.md>)

### AI overview

The excerpt gives a setup path for analyzing NetSuite data in Tableau: connect Fivetran to Snowflake through Partner Connect, add a NetSuite Suite Analytics connector, choose tables (including a stated minimum set), and wait for the initial sync, which may take minutes to hours depending on data size. Then download the provided Tableau workbook, edit its named connection in a text editor with Snowflake details--including account, schema, role, username, and warehouse--and sign in to populate the dashboards. Fivetran is described as extracting, lightly normalizing and cleaning, then loading source data into a chosen warehouse for BI access. The example uses Snowflake and Tableau, though the excerpt says other warehouses and BI tools can be used.

### Source excerpt

NetSuite is essential but complicated. Use this guide to set up dashboards for all your NetSuite data.

## Use Fivetran, BigQuery, and Looker to Get a Handle on NetSuite Data | Blog | Fivetran

DevFeed: [Use Fivetran, BigQuery, and Looker to Get a Handle on NetSuite Data | Blog | Fivetran](<https://devfeed.tech/articles/use-fivetran-bigquery-and-looker-to-get-a-handle-on-netsuite-data-blog-fivetran-140245.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/netsuite-looker>)

Author: Charles Wang

Published: 2026-11-18T02:46:08Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [business-intelligence](<https://devfeed.tech/topics/business-intelligence.md>), [Data visualization](<https://devfeed.tech/topics/data-visualization.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [looker](<https://devfeed.tech/topics/looker.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [bi-tools](<https://devfeed.tech/tags/bi-tools.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [business-intelligence](<https://devfeed.tech/tags/business-intelligence.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-platform](<https://devfeed.tech/tags/cloud-platform.md>), [connectors](<https://devfeed.tech/tags/connectors.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data](<https://devfeed.tech/tags/data.md>), [data-integration](<https://devfeed.tech/tags/data-integration.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [example](<https://devfeed.tech/tags/example.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [github](<https://devfeed.tech/tags/github.md>), [google](<https://devfeed.tech/tags/google.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [google-cloud-platform](<https://devfeed.tech/tags/google-cloud-platform.md>), [looker](<https://devfeed.tech/tags/looker.md>), [netsuite](<https://devfeed.tech/tags/netsuite.md>)

### AI overview

Fivetran extracts NetSuite data, applies normalization and light cleaning, and loads it into a data warehouse, where BI tools can access, transform, and visualize it. The example template combines Fivetran, BigQuery, and Looker. Setup includes connecting NetSuite through the Google Cloud Platform marketplace connector, syncing at least the listed accounting, customer, transaction, and vendor tables, then using the warehouse-specific LookML from the analytics-templates GitHub repository in Looker and converting its dashboards to user-defined dashboards. The guide presents this as a starting point for custom reports; it notes that SQL dialects differ by warehouse.

### Source excerpt

NetSuite is essential but complicated. Use this guide to set up dashboards for your NetSuite data using Fivetran, BigQuery, and Looker.

## The Evolution of Data Engineering | Blog | Fivetran

DevFeed: [The Evolution of Data Engineering | Blog | Fivetran](<https://devfeed.tech/articles/the-evolution-of-data-engineering-blog-fivetran-140260.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/the-evolution-of-data-engineering>)

Author: Fivetran

Published: 2026-11-18T02:45:59Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [analysts](<https://devfeed.tech/tags/analysts.md>), [business-intelligence](<https://devfeed.tech/tags/business-intelligence.md>), [career](<https://devfeed.tech/tags/career.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-based](<https://devfeed.tech/tags/cloud-based.md>), [data](<https://devfeed.tech/tags/data.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [data-engineers](<https://devfeed.tech/tags/data-engineers.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [etl](<https://devfeed.tech/tags/etl.md>), [evolution](<https://devfeed.tech/tags/evolution.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [tools](<https://devfeed.tech/tags/tools.md>)

### AI overview

At Rent the Runway, cloud-based automation has freed data engineers to focus beyond ETL on reusable frameworks, self-service data access and strategic guidance. Danielle Dalton's team partners with five specialized data engineering teams to understand project goals, surface resource and cost tradeoffs, and communicate regularly so work can adapt as requirements emerge. The team is also supporting analysts' rollout of Looker. The excerpt stresses that self-service depends on reliable underlying data: teams should invest in that foundation and build trust by rolling out models gradually, since a new tool alone cannot fix poor data.

### Source excerpt

As cloud-based tools increasingly handle the grunt work of ETL, data engineers can start thinking bigger.

[Next page](<https://devfeed.tech/topics/etl.md?cursor=WyIyMDI2LTExLTE4VDAyOjQ1OjU5KzAwOjAwIiwgImM0ZjY0Y2QzLTQ3ZjQtNGQyYy05MzYzLWNkN2E5ZDYyMDFiNCJd>)