# Data Quality

Data quality measures how well a dataset meets criteria such as accuracy, completeness, validity, consistency, uniqueness, timeliness, and fitness for purpose.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## LightGBM vs. a Four-Week Average for Forecasting Bike-Share Rentals

DevFeed: [LightGBM vs. a Four-Week Average for Forecasting Bike-Share Rentals](<https://devfeed.tech/articles/lightgbm-vs-a-four-week-average-for-forecasting-bike-share-rentals-146443.md>)

Original publisher: [Read original article](<https://towardsdatascience.com/lightgbm-vs-a-four-week-average-for-forecasting-bike-share-rentals/>)

Author: Nahid Ahmadvand

Published: 2026-11-20T16:30:00Z

Content type: article

Language: en

Sources: [Towards Data Science](<https://devfeed.tech/sources/towards-data-science.md>)

Topics: [Time Series](<https://devfeed.tech/topics/time-series.md>), [Feature Engineering](<https://devfeed.tech/topics/feature-engineering.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [scikit-learn](<https://devfeed.tech/topics/scikit-learn.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [bike-share](<https://devfeed.tech/tags/bike-share.md>), [editor-s-picks](<https://devfeed.tech/tags/editor-s-picks.md>), [forecasting](<https://devfeed.tech/tags/forecasting.md>), [lightgbm](<https://devfeed.tech/tags/lightgbm.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [python](<https://devfeed.tech/tags/python.md>), [time-series-forecasting](<https://devfeed.tech/tags/time-series-forecasting.md>)

### AI overview

In a 48-hour-ahead Capital Bikeshare forecasting experiment, a four-week seasonal average proved difficult to beat during development: LightGBM's MAE was 49.025 versus 49.856, and paired tests did not establish a difference. On 30 later November-December forecast paths, the selected LightGBM pipeline with lagged weather had 19.6% lower MAE than the baseline, though the author did not test that difference for statistical significance and cannot identify what caused the change. The workflow reconstructed 159 missing development hours as zeros after hourly sums matched daily totals, while distinguishing recorded rentals from actual demand; it excluded nonexistent daylight-saving hours from scoring and constrained features to information available at midnight. Future observed weather sharply reduced error but was unavailable at forecast time. LightGBM relied heavily on weekly summaries, and it struggled during Hurricane Sandy. Empirical prediction intervals came close to target coverage during development but fell short in the later period. The experiment did not compare foundation models.

### Source excerpt

A 48-hour Capital Bikeshare experiment pits XGBoost, Ridge, SARIMA, and Prophet against simple baselines, with care for missing hours and leakage. The post LightGBM vs. a Four-Week Average for Forecasting Bike-Share Rentals appeared first on Towards Data Science.

## How to Generate Synthetic Healthcare Data Using Synthea: A Hands On Tutorial

DevFeed: [How to Generate Synthetic Healthcare Data Using Synthea: A Hands On Tutorial](<https://devfeed.tech/articles/how-to-generate-synthetic-healthcare-data-using-synthea-a-hands-on-tutorial-144721.md>)

Original publisher: [Read original article](<https://www.freecodecamp.org/news/how-to-generate-synthetic-healthcare-data-using-synthea-a-hands-on-tutorial/>)

Author: Lakshmi Mahabaleshwara

Published: 2026-11-19T22:00:42Z

Content type: tutorial

Language: en

Sources: [Free Code Camp](<https://devfeed.tech/sources/freecodecamp-programming-tutorials-python-javascript-git-more.md>)

Topics: [Tutorial](<https://devfeed.tech/topics/tutorial.md>), [Data science and engineering](<https://devfeed.tech/topics/data-science-and-engineering.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Structured-data](<https://devfeed.tech/topics/structured-data.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [reproducibility](<https://devfeed.tech/topics/reproducibility.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analytics-pipeline](<https://devfeed.tech/tags/analytics-pipeline.md>), [applications](<https://devfeed.tech/tags/applications.md>), [csv](<https://devfeed.tech/tags/csv.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [dataengineering](<https://devfeed.tech/tags/dataengineering.md>), [generate](<https://devfeed.tech/tags/generate.md>), [healthcare](<https://devfeed.tech/tags/healthcare.md>), [healthcareai](<https://devfeed.tech/tags/healthcareai.md>), [healthcaredata](<https://devfeed.tech/tags/healthcaredata.md>), [healthtech](<https://devfeed.tech/tags/healthtech.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [synthetichealthcaredata](<https://devfeed.tech/tags/synthetichealthcaredata.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>), [using](<https://devfeed.tech/tags/using.md>)

### AI overview

Synthea simulates longitudinal patient records, making it useful for prototyping and testing healthcare data workflows without using real patient histories. The tutorial shows how to build it with Java 17 or newer, generate about 100 patients, enable CSV export explicitly, and explore linked patient, encounter, condition, observation, medication, and procedure files with Python and Pandas. A fixed seed helps reproduce runs; version, configuration, and reference date also affect results. Default population overflow can produce more records than requested (115 in the described run); disabling it targets the requested count but may change how closely survivor demographics match population targets. The tutorial demonstrates basic relationship and missing-value checks and reconstructing a patient's timeline. Synthetic data is not necessarily representative, clinically accurate, unbiased, or suitable evidence for real-world model performance, so validate concepts, data quality, and representativeness before use.

### Source excerpt

Healthcare generates huge amounts of data every day, from patient visits and lab results to diagnoses, medications, and medical imaging. For developers and data engineers building healthcare applicati

## Genie One Accuracy: Why Curated Agents Need Governed Context

DevFeed: [Genie One Accuracy: Why Curated Agents Need Governed Context](<https://devfeed.tech/articles/genie-one-accuracy-why-curated-agents-need-governed-context-144361.md>)

Original publisher: [Read original article](<https://www.databricks.com/blog/genie-one-accuracy-why-curated-agents-need-governed-context>)

Author: Richa Sethi; Patrick Chan

Published: 2026-11-19T20:15:41Z

Content type: news

Language: en

Sources: [Databricks](<https://devfeed.tech/sources/databricks.md>)

Topics: [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [enhancing AI model accuracy](<https://devfeed.tech/topics/enhancing-ai-model-accuracy.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [1-5](<https://devfeed.tech/tags/1-5.md>), [2025](<https://devfeed.tech/tags/2025.md>), [2027](<https://devfeed.tech/tags/2027.md>), [about](<https://devfeed.tech/tags/about.md>), [access-control](<https://devfeed.tech/tags/access-control.md>), [account](<https://devfeed.tech/tags/account.md>), [added](<https://devfeed.tech/tags/added.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-instructions](<https://devfeed.tech/tags/agent-instructions.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [all](<https://devfeed.tech/tags/all.md>), [also](<https://devfeed.tech/tags/also.md>), [best-practices](<https://devfeed.tech/tags/best-practices.md>), [context](<https://devfeed.tech/tags/context.md>), [data-strategy](<https://devfeed.tech/tags/data-strategy.md>), [finance](<https://devfeed.tech/tags/finance.md>), [genie](<https://devfeed.tech/tags/genie.md>), [governed-context](<https://devfeed.tech/tags/governed-context.md>), [need](<https://devfeed.tech/tags/need.md>), [one](<https://devfeed.tech/tags/one.md>), [ratio](<https://devfeed.tech/tags/ratio.md>)

### AI overview

In the fictional insurance benchmark, Genie One reached 93-95% accuracy when curated team agents were combined with governed Unity Catalog knowledge, compared with 64% using tables alone and 83% for either addition by itself. Agents helped answer questions requiring team documents; Metric Views and Pages supplied authoritative business definitions, reducing reliance on unrelated Pages and making definition answers accurate despite variable routing. Planted draft and prompt-injection documents did not change answers. A smaller retailer benchmark showed overall accuracy rising from 54% to 82% when governed knowledge was added to agents. The excerpt also shows limits: Genie One may answer directly without inheriting agent instructions, documents available only through agent search need agents, and formulas left in agents can become stale after a governed definition changes. The results come from fictional datasets and benchmarks, including a smaller retail check.

### Source excerpt

Ask Finance and Underwriting whether the loss ratio improved from 2024 to 2025, and...

## What Is BIO Tagging and How to Use It for Document AI Training Data

DevFeed: [What Is BIO Tagging and How to Use It for Document AI Training Data](<https://devfeed.tech/articles/what-is-bio-tagging-and-how-to-use-it-for-document-ai-training-data-146784.md>)

Original publisher: [Read original article](<https://www.sitepoint.com/what-is-bio-tagging-and-how-to-use-it-for-document-ai-training-data/>)

Author: Bilal Ahmad

Published: 2026-11-19T12:24:33Z

Content type: tutorial

Language: en

Sources: [SitePoint](<https://devfeed.tech/sources/sitepoint.md>)

Topics: [document ai](<https://devfeed.tech/topics/document-ai.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [ai-training-data](<https://devfeed.tech/tags/ai-training-data.md>), [bio](<https://devfeed.tech/tags/bio.md>), [data](<https://devfeed.tech/tags/data.md>), [document-ai](<https://devfeed.tech/tags/document-ai.md>)

### AI overview

BIO tagging labels each token as the beginning (B), continuation (I), or outside (O) of an entity. For document AI, the article pairs token labels with normalized bounding boxes so models such as LayoutLMv3 can learn both text and page position. It recommends defining a consistent, fine-grained label taxonomy before annotation, extracting words and coordinates from PDFs or OCR, assigning BIO labels, and formatting parallel words, boxes, and labels for training. Regex pre-labeling can cover some predictable fields, while active learning and auto-labeling platforms shift effort toward review; names, addresses, and line descriptions still need human judgment. Validate entity boundaries, BIO sequences, label balance, and bounding boxes before training. The article suggests starting with 50-100 labeled documents, fine-tuning a pretrained checkpoint, then checking errors before scaling; its stated accuracy ranges depend on document diversity and assume pretrained fine-tuning.

### Source excerpt

null Continue reading What Is BIO Tagging and How to Use It for Document AI Training Data on SitePoint.

## How to Generate Synthetic Test Data for AI Agent Evaluation on Microsoft Foundry

DevFeed: [How to Generate Synthetic Test Data for AI Agent Evaluation on Microsoft Foundry](<https://devfeed.tech/articles/how-to-generate-synthetic-test-data-for-ai-agent-evaluation-on-microsoft-foundry-143752.md>)

Original publisher: [Read original article](<https://www.lyzr.ai/blog/generate-synthetic-test-data-for-ai-agent-evaluation/>)

Author: Lyzr Team

Published: 2026-11-19T09:14:00Z

Content type: tutorial

Language: en

Sources: [Lyzr.ai](<https://devfeed.tech/sources/lyzr-ai.md>)

Topics: [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [test data](<https://devfeed.tech/topics/test-data.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-evaluation](<https://devfeed.tech/tags/agent-evaluation.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent-evaluation](<https://devfeed.tech/tags/ai-agent-evaluation.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [foundry](<https://devfeed.tech/tags/foundry.md>), [generate](<https://devfeed.tech/tags/generate.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [microsoft-foundry](<https://devfeed.tech/tags/microsoft-foundry.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [test](<https://devfeed.tech/tags/test.md>), [test-data](<https://devfeed.tech/tags/test-data.md>)

### AI overview

Microsoft Foundry can generate evaluation data from an agent, prompt, or reference file through three paths: reusable dataset jobs, generate-and-score evaluation runs, and multi-turn simulations. Only dataset-job Simple QnA documents ground-truth answers. The feature is in public preview, supports 15-1,000 samples per job, requires a Responses API-capable Azure OpenAI deployment, and has no SLA. For stronger coverage, plan slices across intents, personas, and difficulty; explicitly include edge cases, then inspect the first 15 rows for leakage, incorrect answers, or personal data. Use versioned datasets for repeat evaluations and combine synthetic cases with production traces once available. The article notes that Foundry scores alone do not enforce release decisions; it describes Opencontroller as an added release-control layer, while adversarial testing on new projects uses the preview AI Red Teaming Agent.

### Source excerpt

TL;DR A claims agent scored 94% on 500 generated questions (a composite scenario). But, every test question was easy: polite, about one thing, and answerable...

## Shapley meets Rawls: an integrated framework for measuring and explaining unfairness

DevFeed: [Shapley meets Rawls: an integrated framework for measuring and explaining unfairness](<https://devfeed.tech/articles/shapley-meets-rawls-an-integrated-framework-for-measuring-and-explaining-unfairness-143246.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2603.26476>)

Author: Fadoua Amri-Jouidel, Emmanuel Kemel, St\\'ephane Mussard

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [arxiv](<https://devfeed.tech/tags/arxiv.md>), [bootstrap](<https://devfeed.tech/tags/bootstrap.md>), [census](<https://devfeed.tech/tags/census.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [esl](<https://devfeed.tech/tags/esl.md>), [explain](<https://devfeed.tech/tags/explain.md>), [explainability](<https://devfeed.tech/tags/explainability.md>), [fairness](<https://devfeed.tech/tags/fairness.md>), [features](<https://devfeed.tech/tags/features.md>), [framework](<https://devfeed.tech/tags/framework.md>), [gender](<https://devfeed.tech/tags/gender.md>), [generate](<https://devfeed.tech/tags/generate.md>), [inference](<https://devfeed.tech/tags/inference.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [measuring](<https://devfeed.tech/tags/measuring.md>), [robust](<https://devfeed.tech/tags/robust.md>), [shows](<https://devfeed.tech/tags/shows.md>), [standard](<https://devfeed.tech/tags/standard.md>), [tests](<https://devfeed.tech/tags/tests.md>), [time](<https://devfeed.tech/tags/time.md>)

### AI overview

The paper presents Shapley values as a way to both measure unfairness under standard group fairness criteria and identify contributing features, combining fairness assessment with explanation. It extends the approach to Efficient-Symmetric-Linear (ESL) values, which the abstract says can offer more robust fairness definitions and shorter computation times. In an illustration using the UCI Census Income dataset, the authors identify Age, Number of hours, and Marital status as generating gender unfairness, with shorter computation time than traditional Bootstrap tests.

### Source excerpt

arXiv:2603.26476v3 Announce Type: replace Abstract: Explainability and fairness have mainly been considered separately, with recent exceptions trying the explain the sources of unfairness. This paper shows that the Shapley value can be used to both define and explain unfairness, under standard group fairness criteria. This offers an integrated framework to estimate and derive inference on unfairness as-well-as the features that contribute to it. Our framework can also be extended from Shapley values to the family of Efficient-Symmetric-Linear (ESL) values, some of which offer more robust definitions of fairness, and shorter computation times. An illustration is run on the Census Income dataset from the UCI Machine Learning Repository. Our approach shows that ``Age", ``Number of hours" and ``Marital status" generate gender unfairness, using shorter computation time than traditional Bootstrap tests.

## CAFE-AQI: Coverage-Aware Day-Ahead AQI Forecasting with Early Warning and Conformal Uncertainty in Bangladesh

DevFeed: [CAFE-AQI: Coverage-Aware Day-Ahead AQI Forecasting with Early Warning and Conformal Uncertainty in Bangladesh](<https://devfeed.tech/articles/cafe-aqi-coverage-aware-day-ahead-aqi-forecasting-with-early-warning-and-conformal-uncertainty-in-bangladesh-143450.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23815>)

Author: Md Rafid Islam, Rafsan Jany, Rafid Bin Zaman, Mohammad Fahim Islam, Hafiz Abdur Rahman

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Time Series](<https://devfeed.tech/topics/time-series.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [2022](<https://devfeed.tech/tags/2022.md>), [2023](<https://devfeed.tech/tags/2023.md>), [2025](<https://devfeed.tech/tags/2025.md>), [air-quality](<https://devfeed.tech/tags/air-quality.md>), [bangladesh](<https://devfeed.tech/tags/bangladesh.md>), [conditional](<https://devfeed.tech/tags/conditional.md>), [coverage](<https://devfeed.tech/tags/coverage.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [early-warning](<https://devfeed.tech/tags/early-warning.md>), [forecasting](<https://devfeed.tech/tags/forecasting.md>), [spatial](<https://devfeed.tech/tags/spatial.md>), [stat-ap](<https://devfeed.tech/tags/stat-ap.md>), [temporal](<https://devfeed.tech/tags/temporal.md>), [testing](<https://devfeed.tech/tags/testing.md>), [training](<https://devfeed.tech/tags/training.md>), [uncertainty](<https://devfeed.tech/tags/uncertainty.md>), [warning](<https://devfeed.tech/tags/warning.md>)

### AI overview

CAFE-AQI forecasts next-day maximum AQI and the probability of unhealthy-or-worse air (AQI >=151), addressing uneven data coverage and duplicate city records. The Bangladesh dataset audit found that 103 city labels represented 61 unique AQI trajectories; identical trajectories were weighted to limit their influence. The framework combines temporal and pollutant features with five-neighbor spatial context, a class-balanced warning head, and risk-conditional conformal calibration. On duplicate-balanced 2025 test data, it achieved MAE 9.76, RMSE 15.04, and R² 0.910, with MAE 3.63 AQI below persistence (95% CI 3.49-3.76) and lower errors across all 61 trajectory groups. Warning performance was F1 0.908 and AUROC 0.982; nominal 90% intervals covered 92.09% of observations. Excluding a spatial block during training yielded MAE 10.66, indicating transfer to unseen locations in this evaluation.

### Source excerpt

arXiv:2611.23815v1 Announce Type: new Abstract: Next-day air quality forecasting often assumes city records are equally complete and independent. However, an audit of a large Bangladesh dataset revealed a sharp coverage expansion after August 2022 and showed that 103 city labels correspond to only 61 unique AQI trajectories. To address these issues, this paper presents CAFE-AQI, a coverage-aware framework for forecasting next-day maximum AQI. It also estimates the probability of Unhealthy-or-worse conditions (AQI >= 151). Data were divided chronologically into training (2022-2023), calibration (2024), and testing (2025). To prevent duplicate records from dominating training and evaluation, identical trajectories were weighted. The framework combines temporal and pollutant features with a five-neighbor spatial context. It also includes a class-balanced warning head and risk-conditional conformal calibration aimed at providing early warnings and prediction intervals. Evaluation on the duplicate-balanced 2025 data gave an MAE of 9.76, an RMSE of 15.04, and an R-squared value of 0.910 for CAFE-AQI. Its MAE was 3.63 AQI lower than persistence (95% CI: 3.49-3.76), with lower errors in each of the 61 trajectory groups. For unhealthy-air warnings, the F1-score was 0.908 and the AUROC was 0.982. The nominal 90% intervals covered 92.09% of observations. When an entire spatial block was excluded from training, the MAE remained 10.66, showing that the lightweight model transferred reasonably well to unseen locations.

## CratesBump: A Version-Bump Dataset for the Rust Ecosystem

DevFeed: [CratesBump: A Version-Bump Dataset for the Rust Ecosystem](<https://devfeed.tech/articles/cratesbump-a-version-bump-dataset-for-the-rust-ecosystem-142191.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23664>)

Author: Muhammad Hassnain

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>), [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [versioning](<https://devfeed.tech/topics/versioning.md>), [Rust](<https://devfeed.tech/topics/rust.md>), [Feature Engineering](<https://devfeed.tech/topics/feature-engineering.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [cargo](<https://devfeed.tech/tags/cargo.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [ecosystem](<https://devfeed.tech/tags/ecosystem.md>), [pairs](<https://devfeed.tech/tags/pairs.md>), [release-cadence](<https://devfeed.tech/tags/release-cadence.md>), [repository](<https://devfeed.tech/tags/repository.md>), [rust](<https://devfeed.tech/tags/rust.md>), [version](<https://devfeed.tech/tags/version.md>)

### AI overview

CratesBump provides over two million consecutive release pairs from about 220,000 Rust crates, with 41 features spanning AST code diffs, dependency changes, complexity, release cadence, and GitHub activity. Each pair has two version-bump labels: the literal MAJOR.MINOR.PATCH interpretation and Cargo's rule that a 0.y bump is breaking. The accompanying semver-extract tool rebuilds the dataset using public crates.io data and the GitHub API. In held-out repository benchmarks, bump prediction was learnable but far from solved, with lower scores on later releases. The study also examines feature signals, whether declared dependency ranges shield dependents from pre-1.0 breaks, and a sample of releases where cargo-semver-checks found public API breaks in minor or patch releases. The dataset and tool are released under open licenses.

### Source excerpt

arXiv:2611.23664v1 Announce Type: new Abstract: We release CratesBump, the first public dataset for predicting version bumps in the Rust ecosystem, together with semver-extract, the tool that builds it. CratesBump is built from every crate on crates.io with at least two releases before 14 September 2026 (about 220,000 crates), giving over two million consecutive release pairs. Each pair has 41 features (code changes from AST diffs, dependency changes, complexity, release cadence, GitHub commit and issue activity), its source repository where listed, and two labels: the literal reading of MAJOR.MINOR.PATCH, and Cargo's rule, under which a 0.y bump is a breaking change. semver-extract regenerates the dataset from public crates.io data and the GitHub API. To illustrate its use we (i) benchmark bump predictors on held-out repositories, finding the task learnable but far from solved, with lower scores on later releases; (ii) measure which feature groups carry the signal; (iii) check, against declared dependency ranges, how often Cargo's rule shields dependents from pre-1.0 breaking releases; and (iv) audit a sample of releases with cargo-semver-checks, finding minor and patch releases that break the public API despite their version number. Dataset and tool are released under open licenses.

## Confidence-Based Materials Data Quality Assessment via Domain Knowledge and Graph-Structured Learning

DevFeed: [Confidence-Based Materials Data Quality Assessment via Domain Knowledge and Graph-Structured Learning](<https://devfeed.tech/articles/confidence-based-materials-data-quality-assessment-via-domain-knowledge-and-graph-structured-learning-142639.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23342>)

Author: Sihan Liaing, Ji Zhang, Kehan Wang, Zihao Gao, Wei Ma, Yangang Wang, Zongguo Wang

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [outlier-detection](<https://devfeed.tech/topics/outlier-detection.md>), [Physics-guided deep learning](<https://devfeed.tech/topics/physics-guided-deep-learning.md>)

Tags: [cond-mat-mtrl-sci](<https://devfeed.tech/tags/cond-mat-mtrl-sci.md>), [confidence](<https://devfeed.tech/tags/confidence.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [graph](<https://devfeed.tech/tags/graph.md>), [learning](<https://devfeed.tech/tags/learning.md>), [materials](<https://devfeed.tech/tags/materials.md>), [quality-assessment](<https://devfeed.tech/tags/quality-assessment.md>)

### AI overview

The proposed framework scores materials data quality as continuous sample confidence, combining a nine-dimensional feature-quality prior calibrated with domain rules and statistical evidence, duplicate-aware initialization, sample-feature graph propagation, weakly supervised graph attention, and Memory-GAT historical reference scoring. On 23 ODDS datasets, its generic module reports mean AUC-ROC of 0.866. In repeated mp_20 experiments, rule calibration raised HistGradientBoostingRegressor test R² from 0.538±0.008 to 0.616±0.014; graph refinement raised average precision from 0.943±0.004 to 0.953±0.004. Rule-based screening raised R² from 0.590±0.053 to 0.880±0.027 in MACE subset experiments. These are reported experimental results; the supplied text does not establish broader performance.

### Source excerpt

arXiv:2611.23342v1 Announce Type: cross Abstract: The rapid development of materials machine learning relies on large-scale, heterogeneous datasets, yet model reliability is often compromised by imperfect data from diverse experiments, simulations, and database integration. Real-world materials databases may contain measurement errors, failed calculations, missing or duplicate records, and hidden violations of physicochemical constraints. Such problems are difficult to identify because corrupted samples may remain statistically plausible rather than appearing as explicit outliers. In this paper, we propose a confidence-based materials data quality assessment framework that integrates domain knowledge with graph-structured learning. Data quality is formulated as a continuous confidence estimation problem rather than a binary anomaly identification task, enabling sample-level assessment and historical-reference-based batch comparison. A nine-dimensional feature-quality prior and duplicate-aware sample initialization are calibrated using materials domain rules and statistical evidence. Confidence is further refined through sample-feature bipartite graph propagation and weakly supervised graph attention, while a Memory-GAT module provides historical reference scoring. Experiments on 23 ODDS benchmark datasets show that the generic module achieves an average AUC-ROC of 0.866. In five repeated mixed-contamination experiments on mp\_20, rule calibration improves HistGradientBoostingRegressor test $R^2$ from $0.538\pm0.008$ to $0.616\pm0.014$. Graph refinement increases average precision from $0.943\pm0.004$ to 0.953\pm0.004$, while the rule-calibrated configuration has the highest mean test $R^2$ among the evaluated screening configurations. Five repeated MACE subset experiments further show an increase in $R^2$ from $0.590\pm0.053$ to $0.880\pm0.027$ after rule-based screening.

## On Evaluating User Simulators for Interactive Agents

DevFeed: [On Evaluating User Simulators for Interactive Agents](<https://devfeed.tech/articles/on-evaluating-user-simulators-for-interactive-agents-143578.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24892>)

Author: Hengguang Zhou, I-Hung Hsu, Li Chen, Priyanshi Shrivastava, Anastasios Angelopoulos, Wei-Lin Chiang, Ion Stoica, Cho-Jui Hsieh

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Interactive AI Systems](<https://devfeed.tech/topics/interactive-ai-systems.md>), [harvestbench](<https://devfeed.tech/topics/harvestbench.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [acceptance](<https://devfeed.tech/tags/acceptance.md>), [agents](<https://devfeed.tech/tags/agents.md>), [artifacts](<https://devfeed.tech/tags/artifacts.md>), [assets](<https://devfeed.tech/tags/assets.md>), [automated](<https://devfeed.tech/tags/automated.md>), [behavior](<https://devfeed.tech/tags/behavior.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [combines](<https://devfeed.tech/tags/combines.md>), [constraint](<https://devfeed.tech/tags/constraint.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [detection](<https://devfeed.tech/tags/detection.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [failures](<https://devfeed.tech/tags/failures.md>), [frameworks](<https://devfeed.tech/tags/frameworks.md>), [full-stack](<https://devfeed.tech/tags/full-stack.md>), [games](<https://devfeed.tech/tags/games.md>), [goals](<https://devfeed.tech/tags/goals.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [languages](<https://devfeed.tech/tags/languages.md>), [user](<https://devfeed.tech/tags/user.md>)

### AI overview

Existing user-simulator evaluation methods may give misleadingly positive results: metrics from three prior studies detected only 5-6 of 10 deliberate replay failures, and their combined scores favored simulations instructed to accept broken work over unmodified controls. The proposed suite combines agent-evaluation utility with population-level fidelity to collective interaction patterns and trace-level fidelity to individual users' goals, constraints, and persona; it detected all 10 perturbations. In tests of six simulators on 351 real multi-turn sessions involving 348 users across 23 languages, population-level measures sometimes missed wrong goals, ignored constraints, or out-of-character behavior, underscoring the value of assessing fidelity at both levels.

### Source excerpt

arXiv:2611.24892v1 Announce Type: new Abstract: User simulators offer a scalable way to evaluate interactive agents, but how to assess their quality remains underexplored. In particular, it is unclear whether existing user simulator evaluation frameworks reliably detect meaningful failures in simulated user behavior. This uncertainty makes it difficult to interpret simulator evaluation. To understand what a high benchmark score tells us about simulator quality, we (meta-)evaluate the metrics themselves. To instantiate this meta-evaluation, we deliberately perturb simulated replays to induce failures such as altered goals, omitted constraints, premature stopping, and acceptance of broken work, then test whether the metrics penalize these failures. Evaluation methods from three prior studies detect only 5-6 of the 10 perturbations; their combined scores even favor populations instructed to accept broken work over unmodified controls. Motivated by these gaps, we propose a new evaluation suite that combines utility of user simulators for evaluating agents and two measures of fidelity to real users: population-level fidelity assesses collective interaction patterns, while trace-level fidelity assesses the preservation of individual users' goals, constraints, and persona. Under the same detection criterion, our evaluation suite detects all 10 perturbations. Evaluating six user simulators on 351 real multi-turn sessions in which 348 distinct users across 23 languages and agents work together to create and refine artifacts such as full-stack web apps, games, design assets, and automated workflows, we find that population-level measures can miss when a simulated user pursues the wrong goal, ignores a constraint, or behaves out of character, highlighting the need to assess fidelity at comprehensive granularities.

## CaDO: Formal Verification-Guided Multi-Agent Framework for Causal Dataset Repair and Generation

DevFeed: [CaDO: Formal Verification-Guided Multi-Agent Framework for Causal Dataset Repair and Generation](<https://devfeed.tech/articles/cado-formal-verification-guided-multi-agent-framework-for-causal-dataset-repair-and-generation-142791.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24406>)

Author: Songli Yu, Qi Luo

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-framework](<https://devfeed.tech/tags/agent-framework.md>), [annotations](<https://devfeed.tech/tags/annotations.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ma](<https://devfeed.tech/tags/cs-ma.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [formal](<https://devfeed.tech/tags/formal.md>), [formal-verification](<https://devfeed.tech/tags/formal-verification.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generation](<https://devfeed.tech/tags/generation.md>), [multi-agent](<https://devfeed.tech/tags/multi-agent.md>), [repair](<https://devfeed.tech/tags/repair.md>), [verification](<https://devfeed.tech/tags/verification.md>)

### AI overview

CaDO repairs and expands causal reasoning datasets through three stages: a Formalizer Agent converts natural-language questions into formal causal queries; independent Critic Agents identify sample errors and dataset-level imbalances in query coverage and label distributions; then formal-semantics-based operators repair samples while Explorer and Expander Agents generate new ones. The abstract reports that CaDO beats the strongest of five cleaning baselines in 16 of 18 settings, raising downstream accuracy by up to 9.1%. At least 95% of flagged samples were defective, and on CLadder it incorrectly changed 92.2% fewer correct labels than an LLM-based judge. These are abstract-reported results; details of the evaluation are not included in the supplied evidence.

### Source excerpt

arXiv:2611.24406v1 Announce Type: new Abstract: High-quality causal reasoning datasets are essential for developing models with reliable causal understanding, particularly in specialized domains. However, existing datasets frequently suffer from incorrect annotations and structural imbalances, which can lead to biased predictions and limited generalization. To address this issue, we propose CaDO (Causal-Engine-Guided Multi-Agent Data Optimization), a multi-agent framework for automated diagnosis and repair of causal reasoning datasets. Our framework consists of three key stages: formal causal reasoning, multi-level diagnosis, and automated data repair and generation. First, a Formalizer Agent translates natural language questions into formal causal queries to minimize semantic deviations and make retrieval and verification more explicit and tractable. Second, a dual-level diagnosis mechanism employs independent Critic Agents to identify sample-level errors while analyzing query-type coverage and label distributions to detect dataset-level structural imbalances. Finally, the framework employs reusable repair operators grounded in formal causal semantics to correct erroneous samples, while Explorer and Expander Agent collaboratively produce diverse and semantically consistent new samples. Experimental results show that CaDO significantly outperforms the strongest of five data cleaning baselines in 16 out of 18 experimental settings, improving downstream model accuracy by up to 9.1%. Moreover, at least 95% of the samples flagged by CaDO are defective, and on CLadder, CaDO incorrectly modifies 92.2% fewer correct labels than an LLM-based judge, demonstrating its effectiveness and reliability. Our code and data are publicly available at https://github.com/thisissyu/cado.

## How Datadog resolves evolving OpenTelemetry semantics at query time

DevFeed: [How Datadog resolves evolving OpenTelemetry semantics at query time](<https://devfeed.tech/articles/how-datadog-resolves-evolving-opentelemetry-semantics-at-query-time-144196.md>)

Original publisher: [Read original article](<https://www.datadoghq.com/blog/engineering/semantic-translation-otel/>)

Author: Francisco Paulo

Published: 2026-11-19T00:00:00Z

Content type: article

Language: en

Sources: [Datadog](<https://devfeed.tech/sources/datadog.md>), [Datadog](<https://devfeed.tech/sources/datadog-the-monitor-blog.md>)

Topics: [OpenTelemetry](<https://devfeed.tech/topics/opentelemetry.md>), [datadog](<https://devfeed.tech/topics/datadog.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [apm](<https://devfeed.tech/tags/apm.md>), [conditional](<https://devfeed.tech/tags/conditional.md>), [data](<https://devfeed.tech/tags/data.md>), [data-validation](<https://devfeed.tech/tags/data-validation.md>), [datadog](<https://devfeed.tech/tags/datadog.md>), [graph](<https://devfeed.tech/tags/graph.md>), [knowledge-graph](<https://devfeed.tech/tags/knowledge-graph.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [observability](<https://devfeed.tech/tags/observability.md>), [opentelemetry](<https://devfeed.tech/tags/opentelemetry.md>), [query](<https://devfeed.tech/tags/query.md>), [semantics](<https://devfeed.tech/tags/semantics.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>), [translation](<https://devfeed.tech/tags/translation.md>)

### AI overview

Datadog's Semantic Core models telemetry equivalences as a knowledge graph with conditions such as tags, units, metric types, and query operations. This handles cases a flat name map cannot: for example, mapping OTel `system.cpu.utilization` to Datadog `system.cpu.user` requires a `state:user` filter and scaling from a 0-1 ratio to a 0-100 percentage; histogram-to-distribution equivalence may work for percentiles but not raw counts or sums. A precomputed configuration feeds the Semantics SDK, which rewrites queries in memory, expands them to equivalent expressions, and normalizes results to the query's vocabulary. Domain teams define equivalences, while an external validator submits real telemetry across OTel-only, Datadog-only, and hybrid setups and checks that queries in both vocabularies return consistent results. The Semantic Core also tracks convention changes and distributes updates dynamically.

### Source excerpt

OpenTelemetry conventions evolve, but queries still need to work across old, current, and Datadog-native telemetry. Learn how Datadog uses a knowledge graph and query-time translation to resolve conditional semantic equivalences and validate them against real data.

## What Is an Embedding? How AI Turns Meaning Into Numbers

DevFeed: [What Is an Embedding? How AI Turns Meaning Into Numbers](<https://devfeed.tech/articles/what-is-an-embedding-how-ai-turns-meaning-into-numbers-141932.md>)

Original publisher: [Read original article](<https://montecarlo.ai/blog-embedding>)

Author: Ruslan Sultanov

Published: 2026-11-18T18:58:12Z

Content type: article

Language: en

Sources: [Monte Carlo](<https://devfeed.tech/sources/monte-carlo.md>)

Topics: [vector embeddings in AI](<https://devfeed.tech/topics/vector-embeddings-in-ai.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [cosine similarity search](<https://devfeed.tech/topics/cosine-similarity-search.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [clustering](<https://devfeed.tech/topics/clustering.md>)

Tags: [agent-trust](<https://devfeed.tech/tags/agent-trust.md>), [agent-trust-glossary](<https://devfeed.tech/tags/agent-trust-glossary.md>), [ai](<https://devfeed.tech/tags/ai.md>), [cosine-similarity](<https://devfeed.tech/tags/cosine-similarity.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embedding-model](<https://devfeed.tech/tags/embedding-model.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [embeddings-in-machine-learning](<https://devfeed.tech/tags/embeddings-in-machine-learning.md>), [embeddings-rag](<https://devfeed.tech/tags/embeddings-rag.md>), [glossary](<https://devfeed.tech/tags/glossary.md>), [meaning](<https://devfeed.tech/tags/meaning.md>), [text-embeddings](<https://devfeed.tech/tags/text-embeddings.md>), [vector-database](<https://devfeed.tech/tags/vector-database.md>), [vector-embeddings](<https://devfeed.tech/tags/vector-embeddings.md>), [what-is-an-embedding](<https://devfeed.tech/tags/what-is-an-embedding.md>)

### AI overview

Embeddings represent text, images, or other data as numeric vectors, placing semantically similar items near each other so systems can retrieve by meaning rather than exact wording. In a typical RAG pipeline, documents are split into chunks, embedded and indexed with metadata; a query is embedded to retrieve nearby passages for an LLM. Vectors are meaningful only within the model that produced them, and they become outdated when source content changes. Production reliability therefore depends on versioning vectors, re-embedding changed documents, removing deleted content, monitoring index freshness and evaluating and tracing retrieval. Stale or missing passages can lead an agent to give confident but outdated answers.

### Source excerpt

A customer types "can I send this back?" Your help center never uses that phrase. It talks about the "return window" and the "refund policy." Keyword search finds nothing. Yet a modern AI agent pulls up the right policy in milliseconds, because it isn't matching words. It's matching meaning. That's what embeddings do. This guide ...

## A modern dilemma: Consume data from a stream or a lake

DevFeed: [A modern dilemma: Consume data from a stream or a lake](<https://devfeed.tech/articles/a-modern-dilemma-consume-data-from-a-stream-or-a-lake-141161.md>)

Original publisher: [Read original article](<https://medium.com/capital-one-tech/a-modern-dilemma-consume-data-from-a-stream-or-a-lake-296bbb354094?source=rss----3db3a67cb648---4>)

Author: Capital One Tech

Published: 2026-11-18T17:35:14Z

Content type: article

Language: en

Sources: [Capital One Tech](<https://devfeed.tech/sources/capital-one-tech.md>)

Topics: [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [stream-processing](<https://devfeed.tech/topics/stream-processing.md>), [Streaming](<https://devfeed.tech/topics/streaming.md>), [etl](<https://devfeed.tech/topics/etl.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Apache Flink](<https://devfeed.tech/topics/apache-flink.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [apis](<https://devfeed.tech/tags/apis.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [batch](<https://devfeed.tech/tags/batch.md>), [big-data](<https://devfeed.tech/tags/big-data.md>), [business-processes](<https://devfeed.tech/tags/business-processes.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [cloud-computing](<https://devfeed.tech/tags/cloud-computing.md>), [data](<https://devfeed.tech/tags/data.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [data-lakes](<https://devfeed.tech/tags/data-lakes.md>), [delta-lake](<https://devfeed.tech/tags/delta-lake.md>), [enrichment](<https://devfeed.tech/tags/enrichment.md>), [etl](<https://devfeed.tech/tags/etl.md>), [event](<https://devfeed.tech/tags/event.md>), [flink](<https://devfeed.tech/tags/flink.md>), [kafka](<https://devfeed.tech/tags/kafka.md>), [latency](<https://devfeed.tech/tags/latency.md>), [legacy](<https://devfeed.tech/tags/legacy.md>), [log](<https://devfeed.tech/tags/log.md>), [mapping](<https://devfeed.tech/tags/mapping.md>), [model-context-protocol](<https://devfeed.tech/tags/model-context-protocol.md>), [software-architecture](<https://devfeed.tech/tags/software-architecture.md>), [software-engineering](<https://devfeed.tech/tags/software-engineering.md>), [stream](<https://devfeed.tech/tags/stream.md>)

### AI overview

Choosing a data consumption pattern early can avoid costly architectural changes later. APIs support synchronous, record-by-record requests and paginated multirecord results, making them suitable for low-latency needs; Model Context Protocol can provide similar access for agents and is often an API wrapper. Event streams, commonly built with Kafka, Flink or Spark Streaming, suit sub-second latency and enable per-event calculations, transformations and enrichment. The excerpt also identifies Delta Change Data Feed (CDF) as a record-by-record pattern and traditional batch ETL as a multirecord pattern, but ends before explaining CDF's mechanics or comparing these approaches further.

### Source excerpt

Data is a critical component of software architecture, providing the foundation for business processes, including those powered by artificial intelligence (AI). Quality, volume, latency, consistency, ordering and duplicates are essential considerations in software design. Modern cloud architectures consume data in various ways, such as through application programming interfaces (APIs), streams and data lakes. You can consume data at the individual event or record level as it arrives or in larger batches. Legacy architectures often process data in scheduled batches, forcing surrounding architecture and business processes to depend on that approach. Getting the data consumption approach right up front is vital, because rearchitecting later is costly. General patterns to consume data There are several general data consumption patterns. These include APIs (record-by-record or multirecord results), event stream consumption (record-by-record), Delta Change Data Feed (CDF) consumption (record-by-record) or traditional batch ETL-extract, transform, load (multirecord results). APIs are ideal for low-latency, record-by-record requirements. They also support multirecord results, typically through pagination. APIs usually follow a synchronous approach, where the client makes a call and waits for a response before moving to the next step. Model Context Protocol is an industry specification for agents to consume data and can support record-by-record or batch results via pagination, similar to APIs. They are often a wrapper on top of APIs. The event stream pattern works well for sub-second latency requirements and typically runs on a tech stack like Kafka, Flink or Spark Streaming. These technologies excel at record-level calculations (like on-the-fly calculation), transformations (like column mapping) or enrichment (like adding data to an existing event). Delta Lake is often used in data lakes and serves as a transaction log to standard Apache Parquet data files (source). CDF is

## De-identifying text at scale: How Airbnb protects personal data in AI training

DevFeed: [De-identifying text at scale: How Airbnb protects personal data in AI training](<https://devfeed.tech/articles/de-identifying-text-at-scale-how-airbnb-protects-personal-data-in-ai-training-141090.md>)

Original publisher: [Read original article](<https://airbnb.tech/infrastructure/de-identifying-text-at-scale-how-airbnb-protects-personal-data-in-ai-training/>)

Author: natalijafijacko

Published: 2026-11-18T16:33:01Z

Content type: article

Language: en

Sources: [Airbnb Engineering & Data Science](<https://devfeed.tech/sources/airbnb-engineering-data-science.md>)

Topics: [managing large-scale text data in AI](<https://devfeed.tech/topics/managing-large-scale-text-data-in-ai.md>), [data loss prevention](<https://devfeed.tech/topics/data-loss-prevention.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [ner](<https://devfeed.tech/topics/ner.md>), [ML model versioning](<https://devfeed.tech/topics/ml-model-versioning.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [airbnb](<https://devfeed.tech/tags/airbnb.md>), [data](<https://devfeed.tech/tags/data.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [personal](<https://devfeed.tech/tags/personal.md>), [personal-data](<https://devfeed.tech/tags/personal-data.md>), [scale](<https://devfeed.tech/tags/scale.md>), [technology](<https://devfeed.tech/tags/technology.md>), [text](<https://devfeed.tech/tags/text.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

Airbnb describes an in-process text de-identification library built on Presidio to remove personal data before ML training. Teams provide data schemas; Airbnb supplies recognizers, operators, language handling and runtime configuration, while dataset tags and recorded versions/configurations support production gating and traceability. Detection and replacement are separate stages: Airbnb adds phrase-aware context for identifiers such as listing IDs and gift cards, and uses GLiNER for person and street-address detection where spaCy's broad location tags were insufficient. Replacement usually uses realistic Faker values; run-specific secrets make outputs consistent within a run but different across runs, without storing a real-to-fake mapping. Other data receives tailored handling, including salted hashes, coordinate truncation and format-preserving encryption for internal IDs. Detection thresholds and replacement methods vary by use case. Quality is measured by entity and language for recall, precision and throughput, with recall favored for privacy; benchmark comparisons gate model and library changes against regressions. The account covers text deployment and says work on other-媒体

### Source excerpt

Here's how Airbnb detects and replaces personal data in messages, reviews, and support chats before it reaches a model.

## Data Contracts

DevFeed: [Data Contracts](<https://devfeed.tech/articles/data-contracts-142435.md>)

Original publisher: [Read original article](<https://martinfowler.com/articles/data-contracts.html>)

Author: Martin Fowler (martin@martinfowler.com)

Published: 2026-11-18T14:02:00Z

Content type: article

Language: en

Sources: [Martin Fowler](<https://devfeed.tech/sources/martin-fowler.md>)

Topics: [data](<https://devfeed.tech/topics/data.md>), [schema design](<https://devfeed.tech/topics/schema-design.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [schema-evolution](<https://devfeed.tech/topics/schema-evolution.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Test automation](<https://devfeed.tech/topics/test-automation.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [contracts](<https://devfeed.tech/tags/contracts.md>), [data](<https://devfeed.tech/tags/data.md>), [data-contracts](<https://devfeed.tech/tags/data-contracts.md>), [data-products](<https://devfeed.tech/tags/data-products.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [enterprises](<https://devfeed.tech/tags/enterprises.md>), [guarantees](<https://devfeed.tech/tags/guarantees.md>), [interfaces](<https://devfeed.tech/tags/interfaces.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [practices](<https://devfeed.tech/tags/practices.md>), [robustness](<https://devfeed.tech/tags/robustness.md>), [services](<https://devfeed.tech/tags/services.md>)

### AI overview

Data contracts make a provider's dataset promises explicit and machine-readable, covering schema and meaning, quality checks, service levels, usage terms, ownership, and access details. The article presents ODCS as a YAML standard for these contracts and recommends validating promises automatically in CI/CD and against production data. Versioning helps detect breaking changes and phase in replacements; contracts can also connect to data products, ontologies, and marketplaces, giving consumers and AI agents context for finding, joining, and using data. They require ongoing effort and accountable ownership, so the article recommends starting with cross-team data interfaces where quality problems, broken pipelines, or miscommunication are costly.

### Source excerpt

Data contracts are a way to describe the contents and guarantees of datasets. Simon Harrer and Arif Wider describe in detail what they are and how to use them. They apply practices from API design to data by treating them as data-providing services - such as data products - whose interfaces we want to define as clearly as possible. This approach significantly increases the robustness of large-scale data landscapes, and gives both people and AI agents the explicit, trustworthy metadata they need to work with data autonomously, which is why more and more enterprises are adopting them. more...

## How to Develop a Data-Driven Marketing Culture | Blog | Fivetran

DevFeed: [How to Develop a Data-Driven Marketing Culture | Blog | Fivetran](<https://devfeed.tech/articles/how-to-develop-a-data-driven-marketing-culture-blog-fivetran-141326.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/how-to-develop-a-data-driven-marketing-culture>)

Author: Cat Origitano

Published: 2026-11-18T06:13:15Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [business-intelligence](<https://devfeed.tech/topics/business-intelligence.md>), [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [2022](<https://devfeed.tech/tags/2022.md>), [actions](<https://devfeed.tech/tags/actions.md>), [ads](<https://devfeed.tech/tags/ads.md>), [advertising](<https://devfeed.tech/tags/advertising.md>), [agile](<https://devfeed.tech/tags/agile.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [analysts](<https://devfeed.tech/tags/analysts.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analyze](<https://devfeed.tech/tags/analyze.md>), [blog](<https://devfeed.tech/tags/blog.md>), [culture](<https://devfeed.tech/tags/culture.md>), [data](<https://devfeed.tech/tags/data.md>), [data-driven](<https://devfeed.tech/tags/data-driven.md>), [develop](<https://devfeed.tech/tags/develop.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [help](<https://devfeed.tech/tags/help.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [marketing](<https://devfeed.tech/tags/marketing.md>), [skills](<https://devfeed.tech/tags/skills.md>), [team](<https://devfeed.tech/tags/team.md>)

### AI overview

The article argues that data-driven marketing requires organizational change alongside analytics tools. As third-party cookies disappear and first-party data remains scattered across teams, it recommends setting measurable goals for data culture, securing leadership support, holding teams accountable for evidence-based decisions, and sharing lessons from wins and failures. Practical steps include reducing silos through embedded or rotating analysts, assessing marketers' skills and planning training, and ensuring analytics cover six source categories: email, CRM, paid digital advertising, organic social and digital, conversions, and website or engagement analytics. For cross-platform analysis, it recommends a modern data stack: source platforms, an automated pipeline such as Fivetran, a cloud warehouse such as Snowflake, and a BI tool such as Looker or Tableau. This can replace error-prone, stale manual spreadsheet merging, though the article presents centralization as a foundation rather than a guarantee of effective decisions.

### Source excerpt

Help your team develop the appropriate skills to win in the age of data-driven marketing.

## How Many Training Labels Are Wrong? Auditing a Fitted Model through Gradient Allocation

DevFeed: [How Many Training Labels Are Wrong? Auditing a Fitted Model through Gradient Allocation](<https://devfeed.tech/articles/how-many-training-labels-are-wrong-auditing-a-fitted-model-through-gradient-allocation-141777.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22449>)

Author: Yuchen Li, Zongqi Fan, Xintong Li, Nguyen H. Tran, Ken-Tye Yong

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [machine learning overfitting](<https://devfeed.tech/topics/machine-learning-overfitting.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [cifar-10](<https://devfeed.tech/topics/cifar-10.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>)

Tags: [auditing](<https://devfeed.tech/tags/auditing.md>), [cifar-10](<https://devfeed.tech/tags/cifar-10.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [gradient](<https://devfeed.tech/tags/gradient.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [model](<https://devfeed.tech/tags/model.md>), [noise](<https://devfeed.tech/tags/noise.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

The paper estimates training-label noise from one trained model by normalizing each example's per-example gradient magnitudes into a gradient allocation and checking whether relabeling it as its nearest other class better matches that class's mean allocation. The threshold-free audit needs no clean data, held-out set, or additional training. Even after fitting 99-100% of wrong labels, it reports AUC 0.94-0.96 on the noisiest CIFAR-10N human labels; on fitted CIFAR-10 ViT-S models, it reads 54-96% of the true noise rate, with at least 93% precision among flagged examples. Before wrong labels are fitted, its rate estimate is within 1.7 percentage points across 0-58% noise. Compared with confident learning, which trains four additional models, label separation is similar, while confident learning usually estimates the rate more closely but with lower precision. Auditing 5,000 examples takes 14-27 seconds on one GPU.

### Source excerpt

arXiv:2611.22449v1 Announce Type: new Abstract: How many labels in a training set are wrong, and which ones? The usual answers read a held-out set or the model's outputs. A held-out reading depends on how the held-out set was drawn, and an output-based reading fails once the model has fitted its wrong labels, because the loss of a fitted wrong label is small and the prediction agrees with it. We read the answer from the per-example gradients of a single trained model. Each example, together with its label, asks the network to change in a particular way. We normalise the magnitudes of its gradient into a gradient allocation and compare it with the mean allocation of every class. An example is flagged when relabelling it as its nearest other class makes its allocation fit better than under its own label, and the share of flagged examples is the reading of the noise rate. The rule has no threshold and needs no clean data, no held-out set and no further training. After the model has fitted 99-100% of its wrong labels, the allocation still separates wrong from right labels with an AUC of 0.94-0.96 on the noisiest human labels of CIFAR-10N, where a feature-space margin falls to 0.79-0.84 and the loss, the gradient norm and the self-influence of an example to 0.73-0.76. On such a fitted model, readings of the noise rate from predictions or feature margins fall to 0-6% at true rates of 8-58% on CIFAR-10 with ViT-S, while the audit reads 54-96% of the true rate, and at least 93% of the examples it counts carry wrong labels. On a briefly trained model, before the wrong labels are fitted, the reading lies within 1.7 percentage points of the true noise rate on CIFAR-10 from 0% to 58% noise. Confident learning, which trains four further models, separates wrong labels about as well (AUC 0.925-0.998 against 0.900-0.995) and mostly reads the noise rate more closely, at a lower precision. An audit of 5,000 examples takes 14 to 27 seconds on one GPU.

## A Critical Appraisal and Motivated Intruder Test of A Search Dataset Anonymised for the Purposes of the EU Digital Markets Act

DevFeed: [A Critical Appraisal and Motivated Intruder Test of A Search Dataset Anonymised for the Purposes of the EU Digital Markets Act](<https://devfeed.tech/articles/a-critical-appraisal-and-motivated-intruder-test-of-a-search-dataset-anonymised-for-the-purposes-of-the-eu-digital-markets-act-141465.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21689>)

Author: Ghislain d'Entremont, Lisa Pilgram, Sophie Stalla-Bourdillon, Renee Gil, Lucy Mosquera, Olga Vovk, Khaled El Emam

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [enterprise data protection](<https://devfeed.tech/topics/enterprise-data-protection.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Cryptography](<https://devfeed.tech/topics/cryptography.md>)

Tags: [alphabet](<https://devfeed.tech/tags/alphabet.md>), [article](<https://devfeed.tech/tags/article.md>), [attack](<https://devfeed.tech/tags/attack.md>), [controls](<https://devfeed.tech/tags/controls.md>), [cost](<https://devfeed.tech/tags/cost.md>), [country](<https://devfeed.tech/tags/country.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [data](<https://devfeed.tech/tags/data.md>), [data-protection](<https://devfeed.tech/tags/data-protection.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [detection](<https://devfeed.tech/tags/detection.md>), [digital-markets-act](<https://devfeed.tech/tags/digital-markets-act.md>), [disclosure](<https://devfeed.tech/tags/disclosure.md>), [ethics](<https://devfeed.tech/tags/ethics.md>), [eu](<https://devfeed.tech/tags/eu.md>), [euro](<https://devfeed.tech/tags/euro.md>), [focus](<https://devfeed.tech/tags/focus.md>), [intruder](<https://devfeed.tech/tags/intruder.md>), [search](<https://devfeed.tech/tags/search.md>), [test](<https://devfeed.tech/tags/test.md>)

### AI overview

The study finds that identity-disclosure risk in the assessed search dataset was insignificant under its testing framework, while identifying unresolved privacy gaps. Its review says the anonymisation measures focus on search end-users, leaving other people mentioned in queries insufficiently protected, and do not explicitly address inference; accompanying safeguards reflect good practice. In a motivated intruder test targeting 98,501 people across six countries, Google-verified matches produced a 0.094% re-identification rate, below the study's 0.47% per-team threshold. All country-level rates were below that threshold, though one region exceeded it. Each verified match took about three hours (EUR 105), excluding Google verification and Gemini costs. Some sensitivity scenarios exceeded the threshold but relied on strong assumptions. The findings may not generalise beyond the targeted population, and ethics requirements constrained testing. Detection recall was assumed, not tested; the study gives 0.88 as the minimum defensible recall and recommends 0.976, while noting missed identifiers outside the allow-list would remain. Safeguards remain necessary.

### Source excerpt

arXiv:2611.21689v1 Announce Type: new Abstract: This study evaluated the European Commission's anonymisation measures for Alphabet's search-data sharing under Article 6(11) of the Digital Markets Act against European Data Protection Board guidance and contemporary practice, and assessed re-identification through motivated intruder testing. The measures focus on search end-users, leaving other individuals mentioned in queries insufficiently protected, and do not explicitly address inference. The accompanying controls and safeguards reflect good practice for managing residual risk. Motivated intruder testing targeted 98,501 individuals across six countries using publicly available profiles. Google-verified matches yielded a re-identification rate of 0.094%, below the study's 0.47% per-team threshold. Each verified match required about three hours (Euro 105), excluding Google verification and Gemini costs, suggesting limited cost deterrence. All country-level rates were below the threshold, but one region exceeded it. The threshold drew on conservative precedents, adjusted for data quality, verification, controls and safeguards, assuming five independent attack teams. Some sensitivity scenarios exceeded the threshold, but relied on strong assumptions, such as treating all uncertain matches as correct. Results may not generalise beyond the targeted population, and ethics requirements constrained the attacks. Personal data detection recall was assumed rather than tested: the minimum defensible recall was 0.88, with 0.976 recommended. However, missed identifiers outside the allow-list would remain in the dataset. Under the study's contextual framework, assumptions and testing limitations, identity-disclosure risk was considered insignificant. This finding does not resolve the gaps concerning inference and other individuals' information; safeguards remain necessary.

## How To Build a Data Pipeline: A Step-by-Step Guide

DevFeed: [How To Build a Data Pipeline: A Step-by-Step Guide](<https://devfeed.tech/articles/how-to-build-a-data-pipeline-a-step-by-step-guide-140200.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/build-a-data-pipeline>)

Author: Fivetran

Published: 2026-11-18T04:57:01Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Analytics Pipeline](<https://devfeed.tech/topics/analytics-pipeline.md>), [elt](<https://devfeed.tech/topics/elt.md>), [etl](<https://devfeed.tech/topics/etl.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [data](<https://devfeed.tech/topics/data.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [automation](<https://devfeed.tech/tags/automation.md>), [batch](<https://devfeed.tech/tags/batch.md>), [cdc](<https://devfeed.tech/tags/cdc.md>), [cloud-based](<https://devfeed.tech/tags/cloud-based.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [data-pipeline](<https://devfeed.tech/tags/data-pipeline.md>), [how-to](<https://devfeed.tech/tags/how-to.md>)

### AI overview

A data pipeline moves data from sources through ingestion, processing, storage and workflows, with monitoring to catch system and data quality problems. The guide recommends inventorying sources, choosing batch or streaming ingestion based on needs, validating and transforming data, selecting destinations such as a warehouse, lake or lakehouse, and monitoring health, anomalies, alerts and logs. It contrasts ETL, which transforms before storage and can support masking before loading but becomes harder to scale as sources grow, with ELT, which loads first for faster availability and easier cloud scaling but can analyze large volumes more slowly. It also highlights automation, performance, reliability, scalability and security; ELT can still protect sensitive data through isolation, encryption and blocking or hashing before storage. The excerpt concludes that many organizations buy managed pipelines because building and maintaining connectors and components is labor-intensive.

### Source excerpt

Learn what a data pipeline is and how to build one.

## How to enable smart manufacturing with AI-powered insights | Blog | Fivetran

DevFeed: [How to enable smart manufacturing with AI-powered insights | Blog | Fivetran](<https://devfeed.tech/articles/how-to-enable-smart-manufacturing-with-ai-powered-insights-blog-fivetran-140238.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/how-to-enable-smart-manufacturing-with-ai-powered-insights>)

Author: Fivetran

Published: 2026-11-18T04:00:45Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [decision-making](<https://devfeed.tech/topics/decision-making.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Internet of things](<https://devfeed.tech/topics/iot.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [manufacturing](<https://devfeed.tech/tags/manufacturing.md>), [smart-manufacturing](<https://devfeed.tech/tags/smart-manufacturing.md>)

### AI overview

Manufacturers can use AI for forecasting and generative tasks, but fragmented data and manual processes hinder adoption. The article describes supply chain command centers as hubs that combine equipment, analytics, automation and business processes to support end-to-end monitoring, disruption alerts, scenario modeling and routine decision automation. Tredence provides data architecture, modernization and AI capabilities; Fivetran supplies automated ingestion from more than 700 sources into analytics platforms. In an aluminum plant example, the partners streamed historian data and ingested batch quality data from edge to cloud, developed predictive models with Databricks and Microsoft Azure, then deployed them at the plant edge. The company reported 23% fewer production stoppages, 17% less work-in-process scrap and about 7% improved product quality.

### Source excerpt

Connect data from across all sources to see, understand, and predict every aspect of manufacturing operations and optimize decision making.

## Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows

DevFeed: [Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows](<https://devfeed.tech/articles/announcing-ai-data-preparation-capabilities-in-amazon-sagemaker-build-high-quality-datasets-for-model-development-workflows-138418.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/announcing-ai-data-preparation-capabilities-in-amazon-sagemaker-build-high-quality-datasets-for-model-development-workflows/>)

Author: Varun Rajan

Published: 2026-11-17T19:40:01Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [human feedback](<https://devfeed.tech/topics/human-feedback.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [Agent Skills](<https://devfeed.tech/topics/agent-skills.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-skill](<https://devfeed.tech/tags/agent-skill.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-data](<https://devfeed.tech/tags/ai-data.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apis](<https://devfeed.tech/tags/apis.md>), [auto-label](<https://devfeed.tech/tags/auto-label.md>), [build](<https://devfeed.tech/tags/build.md>), [data](<https://devfeed.tech/tags/data.md>), [data-preparation](<https://devfeed.tech/tags/data-preparation.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [development](<https://devfeed.tech/tags/development.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [examples](<https://devfeed.tech/tags/examples.md>), [foundational-100](<https://devfeed.tech/tags/foundational-100.md>), [model](<https://devfeed.tech/tags/model.md>), [model-development](<https://devfeed.tech/tags/model-development.md>), [quality](<https://devfeed.tech/tags/quality.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

Amazon SageMaker AI adds modular data preparation capabilities that let teams generate synthetic examples, label datasets, review uncertain labels, assess quality, and transform data before training or evaluation. Auto-labeling supports built-in and custom tasks; for tasks with fixed answers, multiple models label each row and their agreement supplies a confidence score, with low-confidence rows routed to human review in SageMaker Studio. Synthetic data can be grounded in seed data and documents, and generated pipelines can be inspected and modified. Teams can chain these steps, for example generating task-specific data, reshaping it for SFT, DPO, or RL, and checking for duplicates, leakage, and rule violations. Work is driven through Python SDK APIs or an AI-ML agent skill, with artifacts open to inspection and editing. Data stays in the team's S3 buckets in its chosen Region under an IAM execution role it controls. The capabilities are generally available in US East (N. Virginia) and US West (Oregon).

### Source excerpt

Amazon SageMaker AI now offers AI data preparation capabilities for building high-quality training and evaluation data. Generate synthetic examples, assess and improve datasets, auto-label at scale, and bring in expert review through Python SDK APIs and an agent skill, all from your own notebook or IDE.

## De-identifying text at scale: How Airbnb protects personal data in AI training

DevFeed: [De-identifying text at scale: How Airbnb protects personal data in AI training](<https://devfeed.tech/articles/de-identifying-text-at-scale-how-airbnb-protects-personal-data-in-ai-training-138584.md>)

Original publisher: [Read original article](<https://medium.com/airbnb-engineering/de-identifying-text-at-scale-how-airbnb-protects-personal-data-in-ai-training-32f3ff8ff7d0?source=rss----53c7c27702d5---4>)

Author: Alexandr Climov

Published: 2026-11-17T18:01:03Z

Content type: article

Language: en

Sources: [Airbnb](<https://devfeed.tech/sources/the-airbnb-tech-blog-medium.md>)

Topics: [pii](<https://devfeed.tech/topics/pii.md>), [privacy-filter](<https://devfeed.tech/topics/privacy-filter.md>), [managing large-scale text data in AI](<https://devfeed.tech/topics/managing-large-scale-text-data-in-ai.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-training](<https://devfeed.tech/tags/ai-training.md>), [airbnb](<https://devfeed.tech/tags/airbnb.md>), [data](<https://devfeed.tech/tags/data.md>), [de-identification](<https://devfeed.tech/tags/de-identification.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [extensibility](<https://devfeed.tech/tags/extensibility.md>), [hosting](<https://devfeed.tech/tags/hosting.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [messages](<https://devfeed.tech/tags/messages.md>), [modularity](<https://devfeed.tech/tags/modularity.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [personal-data](<https://devfeed.tech/tags/personal-data.md>), [pii](<https://devfeed.tech/tags/pii.md>), [presidio](<https://devfeed.tech/tags/presidio.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [reviews](<https://devfeed.tech/tags/reviews.md>), [support](<https://devfeed.tech/tags/support.md>), [technology](<https://devfeed.tech/tags/technology.md>), [text](<https://devfeed.tech/tags/text.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

Airbnb de-identifies text used for model training with an on-premises Presidio library integrated into its shared ML workflow. The Analyzer detects and labels PII; the Anonymizer resolves overlapping spans and replaces them. Airbnb added phrase-based context matching for company-specific identifiers and uses GLiNER for PERSON and LOCATION because spaCy's broad location tags did not reliably capture full street addresses in its benchmark. Detection thresholds and entity scope vary by consumer. Most text PII receives plausible Faker-generated replacements; per-run secret seeding keeps repeated values consistent within a run while changing fakes across runs, without storing a real-to-fake map. Structured data uses salted hashes for identifiers, truncated coordinates, and format-preserving encryption for internal IDs. Benchmarks report recall, precision, and throughput by entity type and language; releases must avoid regressions. The library's protection depends on pipelines using a current version and compliant configuration, and new languages require labeled data for evaluation.

### Source excerpt

Here's how Airbnb detects and replaces personal data in messages, reviews, and support chats before it reaches a model. By: Emelin Flores, Alex Klimov, Lee Formyduval, Bahador Nooraei Introduction Airbnb is built on trust. Every night that a guest books a stay, or a host welcomes someone into their home, that trust is backed by information they've shared with us, which includes personally identifiable information (PII) such as names, home location, current location, and payment details. We now use transaction information to train machine learning models. Before we do so, we remove PII to minimize the number of copies of this information and prevent leakage into and through our models. As we've written before, Airbnb maintains a shared taxonomy as to what constitutes PII, from commonly used fields such as names and card numbers to less frequently used fields such as precise location coordinates. We use de-identification to remove PII and replace it with simulated data that's as realistic as possible to maximize its usefulness for ML model training. Decisions relating to user privacy start as policy. These policies are set and maintained by Airbnb's Privacy Architecture team, with engagement from Legal, Policy, and Engineering. Engineering then implements policy decisions as code. This post focuses on text de-identification. We'll describe the OSS library we chose to start with, the changes we made to create a functional system for Airbnb, and how we confirm that the system is working. 1. Choosing Presidio as the foundation Many organizations are concerned with protecting PII, so there's a lot of existing best practice and tested code out there that we can use. We chose Presidio, an open-source library originally developed by Microsoft and recently transitioned to community governance. We needed to meet demanding requirements: On-premises hosting, to keep data on our infrastructure General-purpose functionality and high degree of modularity, for maximum extensibility

## Why Agentic Business Intelligence Still Struggles With Accuracy, Semantics, and Trust

DevFeed: [Why Agentic Business Intelligence Still Struggles With Accuracy, Semantics, and Trust](<https://devfeed.tech/articles/why-agentic-business-intelligence-still-struggles-with-accuracy-semantics-and-trust-138038.md>)

Original publisher: [Read original article](<https://hackernoon.com/why-agentic-business-intelligence-still-struggles-with-accuracy-semantics-and-trust?source=rss>)

Author: Vinuraj Devaraj

Published: 2026-11-17T12:54:38Z

Content type: opinion

Language: en

Sources: [HackerNoon](<https://devfeed.tech/sources/hackernoon.md>)

Topics: [business-intelligence](<https://devfeed.tech/topics/business-intelligence.md>), [Agentic AI](<https://devfeed.tech/topics/what-is-agentic-ai.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [Trustworthy AI](<https://devfeed.tech/topics/trustworthy-ai.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [trust](<https://devfeed.tech/topics/trust.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>)

Tags: [2025](<https://devfeed.tech/tags/2025.md>), [2026](<https://devfeed.tech/tags/2026.md>), [about](<https://devfeed.tech/tags/about.md>), [access-controls](<https://devfeed.tech/tags/access-controls.md>), [acting](<https://devfeed.tech/tags/acting.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-business-intelligence](<https://devfeed.tech/tags/agentic-business-intelligence.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent-evaluation](<https://devfeed.tech/tags/ai-agent-evaluation.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-reliability](<https://devfeed.tech/tags/ai-reliability.md>), [business](<https://devfeed.tech/tags/business.md>), [business-intelligence](<https://devfeed.tech/tags/business-intelligence.md>), [dabstep](<https://devfeed.tech/tags/dabstep.md>), [data-governance](<https://devfeed.tech/tags/data-governance.md>), [enterprise-data-security](<https://devfeed.tech/tags/enterprise-data-security.md>), [intelligence](<https://devfeed.tech/tags/intelligence.md>), [mast-study](<https://devfeed.tech/tags/mast-study.md>), [metrics](<https://devfeed.tech/tags/metrics.md>), [multi-agent-systems](<https://devfeed.tech/tags/multi-agent-systems.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [review](<https://devfeed.tech/tags/review.md>), [semantics](<https://devfeed.tech/tags/semantics.md>), [trust](<https://devfeed.tech/tags/trust.md>), [with](<https://devfeed.tech/tags/with.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

Across the cited studies, analytics agents perform poorly on realistic multi-step workflows: the strongest systems reported solve about 21% of Spider 2.0 tasks and 14.55% of DABStep's hard tasks. The article argues that production readiness also depends on grounding agents in certified semantic definitions and showing lineage, since agents using raw tables or invented KPI meanings can produce authoritative-looking errors. Privacy knowledge alone is insufficient: PrivacyLens agents leaked sensitive data in 25-40% of actions despite answering privacy questions accurately. The author recommends evaluating workflow completion, requiring governed semantics, enforcing access controls at runtime, and applying security frameworks. No validated measure of useful insight exists; the proposed approach combines deterministic checks with bias-controlled human judgment.

### Source excerpt

A review of 68 studies examines why AI agents in business intelligence still struggle with workflow accuracy, governed metrics, privacy, and trust.

[Next page](<https://devfeed.tech/topics/data-quality.md?cursor=WyIyMDI2LTExLTE3VDEyOjU0OjM4KzAwOjAwIiwgImM3NzQ1OTc4LTI5NjMtNDE4OS1hNmQyLTI0YjlmZmQ0MDg3YyJd>)