# dagster

Published articles for dagster.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## How dbt works, and why orchestrators shouldn't split it into tasks

DevFeed: [How dbt works, and why orchestrators shouldn't split it into tasks](<https://devfeed.tech/articles/how-dbt-works-and-why-orchestrators-shouldn-t-split-it-into-tasks-30714.md>)

Original publisher: [Read original article](<https://www.windmill.dev/blog/how-dbt-works-and-its-orchestrators>)

Author: Ruben Fiszel

Published: 2026-08-20T00:00:00Z

Content type: article

Language: en

Sources: [Windmill Blog](<https://devfeed.tech/sources/windmill-blog.md>)

Topics: [Compiler](<https://devfeed.tech/topics/compiler.md>), [Job](<https://devfeed.tech/topics/job.md>), [airflow](<https://devfeed.tech/topics/airflow.md>), [data](<https://devfeed.tech/topics/data.md>), [Command-line interface](<https://devfeed.tech/topics/cli.md>)

Tags: [airflow](<https://devfeed.tech/tags/airflow.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [cli](<https://devfeed.tech/tags/cli.md>), [dagster](<https://devfeed.tech/tags/dagster.md>), [data](<https://devfeed.tech/tags/data.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [dbt-data-pipelines-airflow-dagster-orchestration](<https://devfeed.tech/tags/dbt-data-pipelines-airflow-dagster-orchestration.md>), [job](<https://devfeed.tech/tags/job.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [scheduler](<https://devfeed.tech/tags/scheduler.md>), [series](<https://devfeed.tech/tags/series.md>)

### AI overview

This primer explains dbt's architecture and examines five ways teams orchestrate it in production. It argues that running a project as one dbt command, while reading dbt's per-model execution state, is generally more efficient and less fragile than creating one orchestrator task per model. It discusses Dagster and astronomer-cosmos's convergence on this approach, including a reported cost comparison.

### Source excerpt

How is dbt actually orchestrated, and why does running it as one job beat one task per model? A primer on dbt as a compiler with a scheduler attached, the five ways teams wrap it, and why both Dagster and astronomer-cosmos converged on a single dbt invocation with per-model state projected out of it.

## How we Use Dagster Automations in our Data Pipeline

DevFeed: [How we Use Dagster Automations in our Data Pipeline](<https://devfeed.tech/articles/how-we-use-dagster-automations-in-our-data-pipeline-29999.md>)

Original publisher: [Read original article](<https://engineering.freeagent.com/2025/12/10/how-we-use-dagster-automations-in-our-data-pipeline/>)

Author: Delphine Rabiller

Published: 2025-12-10T11:32:42Z

Content type: article

Language: en

Sources: [FreeAgent](<https://devfeed.tech/sources/freeagent.md>)

Topics: [Automation](<https://devfeed.tech/topics/automation.md>), [data](<https://devfeed.tech/topics/data.md>), [migration](<https://devfeed.tech/topics/migration.md>)

Tags: [analytics-engineering](<https://devfeed.tech/tags/analytics-engineering.md>), [automation](<https://devfeed.tech/tags/automation.md>), [dagster](<https://devfeed.tech/tags/dagster.md>), [data-ml](<https://devfeed.tech/tags/data-ml.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [declarative](<https://devfeed.tech/tags/declarative.md>), [migration](<https://devfeed.tech/tags/migration.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [scheduled](<https://devfeed.tech/tags/scheduled.md>), [sensors](<https://devfeed.tech/tags/sensors.md>), [tooling](<https://devfeed.tech/tags/tooling.md>), [triggers](<https://devfeed.tech/tags/triggers.md>)

### AI overview

This engineering post explains how FreeAgent is migrating data pipelines to Dagster and re-architecting its automation logic. It describes three approaches to automating asset materialization: schedules, declarative automation, and asset sensors, including when schedules are appropriate and how declarative automation uses asset dependencies and materialization status.

### Source excerpt

Introduction The heart of a reliable data platform are robust and automated data pipelines. As our team migrates our data pipelines to Dagster, re-architecting our automation logic is a crucial task. Dagster offers condition-based approaches to creating or updating a data asset (table or file), moving us toward a modern, asset-centric view of data. This [...]

## Windmill for Supporting Indigenous Communities - Conservation Metrics Case Study

DevFeed: [Windmill for Supporting Indigenous Communities - Conservation Metrics Case Study](<https://devfeed.tech/articles/windmill-for-supporting-indigenous-communities-conservation-metrics-case-study-30712.md>)

Original publisher: [Read original article](<https://www.windmill.dev/blog/conservation-metrics-case-study>)

Author: Rudo Kemper

Published: 2025-06-03T00:00:00Z

Content type: article

Language: en

Sources: [Windmill Blog](<https://devfeed.tech/sources/windmill-blog.md>)

Topics: [data-processing](<https://devfeed.tech/topics/data-processing.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [brazil](<https://devfeed.tech/tags/brazil.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [case-study-testimonial-tech-for-good](<https://devfeed.tech/tags/case-study-testimonial-tech-for-good.md>), [dagster](<https://devfeed.tech/tags/dagster.md>), [dashboards](<https://devfeed.tech/tags/dashboards.md>), [data](<https://devfeed.tech/tags/data.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [etl](<https://devfeed.tech/tags/etl.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-software](<https://devfeed.tech/tags/open-source-software.md>), [tech-for-good](<https://devfeed.tech/tags/tech-for-good.md>), [testimonial](<https://devfeed.tech/tags/testimonial.md>), [whatsapp](<https://devfeed.tech/tags/whatsapp.md>), [windmill](<https://devfeed.tech/tags/windmill.md>), [work](<https://devfeed.tech/tags/work.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

This case study describes how Conservation Metrics uses Windmill to support environmental monitoring and data sovereignty initiatives with indigenous communities. The workflows collect data from field applications and wildlife sensors, process and load it into databases, generate reports and alerts, notify communities through WhatsApp, and update monitoring dashboards.

### Source excerpt

This is a testimonial from Rudo Kemper from Conservation Metrics about how Windmill has helped them build open-source software for indigenous communities, enabling automated data processing and critical alerts for environmental protection.