# Data & ML

Published articles for Data & ML.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Fine-tuning a DistilBERT classifier with numerical and text inputs

DevFeed: [Fine-tuning a DistilBERT classifier with numerical and text inputs](<https://devfeed.tech/articles/fine-tuning-a-distilbert-classifier-with-numerical-and-text-inputs-30004.md>)

Original publisher: [Read original article](<https://engineering.freeagent.com/2026/04/10/fine-tuning-a-distilbert-classifier-with-numerical-and-text-inputs/>)

Author: Paloma Jol

Published: 2026-04-10T10:04:33Z

Content type: tutorial

Language: en

Sources: [FreeAgent](<https://devfeed.tech/sources/freeagent.md>)

Topics: [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Kaggle](<https://devfeed.tech/topics/kaggle.md>), [scikit-learn](<https://devfeed.tech/topics/scikit-learn.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [aws](<https://devfeed.tech/tags/aws.md>), [data](<https://devfeed.tech/tags/data.md>), [data-ml](<https://devfeed.tech/tags/data-ml.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [encoding](<https://devfeed.tech/tags/encoding.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [kaggle](<https://devfeed.tech/tags/kaggle.md>), [llms](<https://devfeed.tech/tags/llms.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [performance](<https://devfeed.tech/tags/performance.md>), [text-classification](<https://devfeed.tech/tags/text-classification.md>), [training-data](<https://devfeed.tech/tags/training-data.md>), [validation](<https://devfeed.tech/tags/validation.md>)

### AI overview

This tutorial explains how to fine-tune a DistilBERT text classifier while incorporating a numerical feature into the same network. It uses the Kaggle wine reviews dataset, combining review descriptions with price and preprocessing the data for training, validation, and testing.

### Source excerpt

Text classification is often done through fine-tuning of a pretrained foundation model with domain-specific data. In FreeAgent we use transformer based models to automatically classify incoming bank transactions. Specifically we use a DistilBERT model that is fine-tuned on hundreds of millions of bank transactions with customer-labelled accounting categories. The model inputs are currently text-based, built from a combination of bank transaction descriptions and amounts. In this post we describe an approach to fine-tuning the DistilBERT model and training the classifier including the numerical amount feature as a single network.

## Structured outputs with Pydantic AI

DevFeed: [Structured outputs with Pydantic AI](<https://devfeed.tech/articles/structured-outputs-with-pydantic-ai-30003.md>)

Original publisher: [Read original article](<https://engineering.freeagent.com/2026/03/24/structured-outputs-with-pydantic-ai/>)

Author: Ed Berry

Published: 2026-03-24T10:34:08Z

Content type: tutorial

Language: en

Sources: [FreeAgent](<https://devfeed.tech/sources/freeagent.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [JSON Schema](<https://devfeed.tech/topics/json-schema.md>), [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [Pydantic](<https://devfeed.tech/topics/pydantic.md>), [Python](<https://devfeed.tech/topics/python.md>), [Structured-data](<https://devfeed.tech/topics/structured-data.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [data](<https://devfeed.tech/tags/data.md>), [data-ml](<https://devfeed.tech/tags/data-ml.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [data-validation](<https://devfeed.tech/tags/data-validation.md>), [genai](<https://devfeed.tech/tags/genai.md>), [json-schema](<https://devfeed.tech/tags/json-schema.md>), [llms](<https://devfeed.tech/tags/llms.md>), [prompt-engineering](<https://devfeed.tech/tags/prompt-engineering.md>), [python](<https://devfeed.tech/tags/python.md>), [schema](<https://devfeed.tech/tags/schema.md>), [structured-output](<https://devfeed.tech/tags/structured-output.md>)

### AI overview

This article explains structured outputs for LLMs using Pydantic AI. It introduces the relationship between Python type hints, static analysis, Pydantic, and runtime data validation, while noting that Pydantic AI is model-agnostic.

### Source excerpt

One of the challenges of working with LLMs is getting them to respond with a consistent format, such as a given JSON schema. Anyone who has tried to solve this issue with prompt engineering knows how frustrating it can be. You add a 'MUST' here and an 'always return JSON' there, but still the output [...]

## How we Use Dagster Automations in our Data Pipeline

DevFeed: [How we Use Dagster Automations in our Data Pipeline](<https://devfeed.tech/articles/how-we-use-dagster-automations-in-our-data-pipeline-29999.md>)

Original publisher: [Read original article](<https://engineering.freeagent.com/2025/12/10/how-we-use-dagster-automations-in-our-data-pipeline/>)

Author: Delphine Rabiller

Published: 2025-12-10T11:32:42Z

Content type: article

Language: en

Sources: [FreeAgent](<https://devfeed.tech/sources/freeagent.md>)

Topics: [Automation](<https://devfeed.tech/topics/automation.md>), [data](<https://devfeed.tech/topics/data.md>), [migration](<https://devfeed.tech/topics/migration.md>)

Tags: [analytics-engineering](<https://devfeed.tech/tags/analytics-engineering.md>), [automation](<https://devfeed.tech/tags/automation.md>), [dagster](<https://devfeed.tech/tags/dagster.md>), [data-ml](<https://devfeed.tech/tags/data-ml.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [declarative](<https://devfeed.tech/tags/declarative.md>), [migration](<https://devfeed.tech/tags/migration.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [scheduled](<https://devfeed.tech/tags/scheduled.md>), [sensors](<https://devfeed.tech/tags/sensors.md>), [tooling](<https://devfeed.tech/tags/tooling.md>), [triggers](<https://devfeed.tech/tags/triggers.md>)

### AI overview

This engineering post explains how FreeAgent is migrating data pipelines to Dagster and re-architecting its automation logic. It describes three approaches to automating asset materialization: schedules, declarative automation, and asset sensors, including when schedules are appropriate and how declarative automation uses asset dependencies and materialization status.

### Source excerpt

Introduction The heart of a reliable data platform are robust and automated data pipelines. As our team migrates our data pipelines to Dagster, re-architecting our automation logic is a crucial task. Dagster offers condition-based approaches to creating or updating a data asset (table or file), moving us toward a modern, asset-centric view of data. This [...]

## How to Choose a Data or Machine Learning Project for Your Portfolio

DevFeed: [How to Choose a Data or Machine Learning Project for Your Portfolio](<https://devfeed.tech/articles/how-to-build-a-data-project-to-10x-your-chances-of-landing-an-interview-39162.md>)

Original publisher: [Read original article](<https://merinova.substack.com/p/how-to-build-a-data-project-to-10x>)

Author: Meri Nova

Published: 2024-04-16T17:27:02Z

Content type: tutorial

Language: en

Sources: [Meri Nova](<https://devfeed.tech/sources/meri-nova.md>)

Topics: [Data Science](<https://devfeed.tech/topics/data-science.md>), [data](<https://devfeed.tech/topics/data.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [A/B Testing](<https://devfeed.tech/topics/a-b-testing.md>)

Tags: [data-ml](<https://devfeed.tech/tags/data-ml.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [pitfalls](<https://devfeed.tech/tags/pitfalls.md>), [project](<https://devfeed.tech/tags/project.md>)

### AI overview

This tutorial presents a six-step framework for choosing a data or machine learning project and building a first data portfolio. It emphasizes aligning projects with target roles, selecting work that sustains motivation, and using messy, realistic datasets instead of only popular clean datasets.

### Source excerpt

Follow the 6-step framework to save 20+ hours and gain clarity in your approach.

## Algo Hour - Large Scale Data & ML Monitoring with whylogs | Alessya Visnjic

DevFeed: [Algo Hour - Large Scale Data & ML Monitoring with whylogs | Alessya Visnjic](<https://devfeed.tech/articles/algo-hour-large-scale-data-ml-monitoring-with-whylogs-alessya-visnjic-29338.md>)

Original publisher: [Read original article](<https://multithreaded.stitchfix.com/blog/2022/09/29/alessya-algo-hour-announcement/>)

Published: 2022-09-29T09:00:00Z

Content type: article

Language: en

Sources: [Stitch Fix](<https://devfeed.tech/sources/stitch-fix.md>)

Topics: [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [data observability](<https://devfeed.tech/topics/data-observability.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [ai observability](<https://devfeed.tech/topics/ai-observability.md>)

Tags: [data](<https://devfeed.tech/tags/data.md>), [data-ml](<https://devfeed.tech/tags/data-ml.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [observability](<https://devfeed.tech/tags/observability.md>), [open-source](<https://devfeed.tech/tags/open-source.md>)

### AI overview

This talk explains how the open-source whylogs library supports end-to-end data quality and monitoring across machine learning pipelines. It covers whylogs' lightweight statistical data collection, language- and platform-agnostic approach, architecture, and application to existing data and ML pipelines.

### Source excerpt

Title: Large Scale Data & ML Monitoring with whylogs Talk Abstract: In the era of microservices, decentralized ML architectures and complex data pipelines, data quality has become a bigger challenge than ever. When data is involved in complex business processes and decisions, bad data can, and will, affect the bottom line. As a result, ensuring data quality across the entire ML pipeline is both costly, and cumbersome while data monitoring is often fragmented and performed ad hoc. An open source library called whylogs is built to address these challenges. It is a lightweight data profiling library that enables end-to-end data monitoring across the entire software stack. The library implements a language and platform agnostic approach to data quality and data monitoring. It's been deployed at massive-scale data environments, on structured and unstructured data modalities, and across a range of points in the ML lifecycle. In this talk, we will provide an overview of the whylogs architecture, including its lightweight statistical data collection approach and we will show how users can apply this library to existing data and ML pipelines. Date and Time: The talk will be held on Tuesday, October 11th at 1:00PM PDT. Recording Info: This talk was recorded live and is viewable below: Speaker Info: Alessya Visnjic is the CEO of WhyLabs, the AI Observability company building tools that power robust and responsible AI deployment. Prior to WhyLabs, Alessya was a CTO-in-residence at the Allen Institute for AI, where she evaluated commercial potential for the latest AI research. Earlier, Alessya spent 9 years at Amazon leading ML initiatives, including forecasting and data science platforms. Alessya is also the founder of Rsqrd AI, a global community of 1,000+ AI practitioners who are committed to making enterprise AI technology responsible.