# Dataset development

The development of datasets for machine learning, including requirements, design, implementation, evaluation, distribution, and maintenance.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## C-LiTE: A Lightweight Foundation Model for Cellular feature learning in Histopathology

DevFeed: [C-LiTE: A Lightweight Foundation Model for Cellular feature learning in Histopathology](<https://devfeed.tech/articles/c-lite-a-lightweight-foundation-model-for-cellular-feature-learning-in-histopathology-145653.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26316>)

Author: Esha Sadia Nasir, Jiaqi Lv, Gozde N. Gunesli, Shan E Ahmed Raza

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [image recognition](<https://devfeed.tech/topics/image-recognition.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>)

Tags: [cellular](<https://devfeed.tech/tags/cellular.md>), [classification](<https://devfeed.tech/tags/classification.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [f1](<https://devfeed.tech/tags/f1.md>), [features](<https://devfeed.tech/tags/features.md>), [fewer](<https://devfeed.tech/tags/fewer.md>), [figure](<https://devfeed.tech/tags/figure.md>), [foundation-model](<https://devfeed.tech/tags/foundation-model.md>), [lightweight](<https://devfeed.tech/tags/lightweight.md>), [native](<https://devfeed.tech/tags/native.md>), [public](<https://devfeed.tech/tags/public.md>), [representation-learning](<https://devfeed.tech/tags/representation-learning.md>), [token](<https://devfeed.tech/tags/token.md>), [training-dataset](<https://devfeed.tech/tags/training-dataset.md>), [transformation](<https://devfeed.tech/tags/transformation.md>), [type](<https://devfeed.tech/tags/type.md>), [vit](<https://devfeed.tech/tags/vit.md>)

### AI overview

C-LiTE is a 22-million-parameter model for learning cellular features from H&E histopathology images. It processes 64x64-pixel cell-centred crops at native resolution, using 4x4-pixel patches to form a 16x16 token grid without upsampling; its patch embedding is initialized by adapting weights from a pre-trained ViT-5-S with a pseudoinverse-based transformation. The model is pre-trained on 60 million TCGA cell crops balanced across 19 cancer types and 16 tissue types. Across seven public datasets for mitotic figure recognition, nucleus and cell-type classification, and immune-cell phenotyping, frozen-feature evaluation yields mean macro-F1 0.670, close to CytoFormer's 0.682 with about 30 times fewer parameters. These findings are limited to the reported evaluation setting.

### Source excerpt

arXiv:2611.26316v1 Announce Type: cross Abstract: Characterising individual cells is fundamental to computational pathology, as cellular morphology informs tasks such as tumour grading, mitotic assessment and immune profiling. However, most pathology foundation models are trained on tissue patches and capture cellular features only implicitly, while existing cell-level models are either restricted to specific cell populations or rely on computationally expensive architectures with hundreds of millions of parameters. Applying ViTs directly to small cellular crops also presents an architectural challenge: upsampling increases computational cost without adding morphological information and may introduce interpolation artefacts. To address these limitations, we introduce C-LiTE, a lightweight foundation model for cellular representation learning in H&E-stained histopathology, with only 22 million parameters. C-LiTE employs a native-resolution tokenisation strategy tailored to cellular inputs, processing 64 x 64 px cell-centred crops using a 4 x 4 patch embedding to produce a 16 x 16 token grid without image upsampling. To transfer visual knowledge from large-scale pre-training, we adapt the patch embedding weights of a pre-trained ViT-5-S using a pseudoinverse-based transformation, enabling weight initialisation at the finer patch resolution. We further assemble a pre-training dataset of 60 million cell-centred crops from TCGA, balanced across 19 cancer types and 16 tissue types. To our knowledge, this represents the largest public dataset for self-supervised pre-training on H&E images at the cellular level. We evaluate C-LiTE on seven public datasets spanning mitotic figure recognition, nucleus and cell-type classification, and immune cell phenotyping. Under frozen-feature evaluation, C-LiTE achieves a mean macro-F1 of 0.670, approaching CytoFormer (0.682) with approximately 30x fewer parameters.

## Automating the Expert Eye: A System-Agnostic Deep Learning Framework for Rare Event Discovery in Imbalanced Force Spectroscopy

DevFeed: [Automating the Expert Eye: A System-Agnostic Deep Learning Framework for Rare Event Discovery in Imbalanced Force Spectroscopy](<https://devfeed.tech/articles/automating-the-expert-eye-a-system-agnostic-deep-learning-framework-for-rare-event-discovery-in-imbalanced-force-spectroscopy-144903.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2606.09541>)

Author: Jorge Rodriguez-Ramos

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Image](<https://devfeed.tech/topics/image.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [2d](<https://devfeed.tech/tags/2d.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [framework](<https://devfeed.tech/tags/framework.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [grad](<https://devfeed.tech/tags/grad.md>), [manual-review](<https://devfeed.tech/tags/manual-review.md>), [notebook](<https://devfeed.tech/tags/notebook.md>), [open-source-software](<https://devfeed.tech/tags/open-source-software.md>), [physics-app-ph](<https://devfeed.tech/tags/physics-app-ph.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [python](<https://devfeed.tech/tags/python.md>), [spectroscopy](<https://devfeed.tech/tags/spectroscopy.md>), [visual-inspection](<https://devfeed.tech/tags/visual-inspection.md>)

### AI overview

The workflow uses 2D images of force-extension curves and a modified ResNet18 trained with focal loss to screen severely imbalanced SMFS datasets without system-specific physical priors. In a held-out set of 970 curves with 13 target P₂ events (1.34% prevalence), it detected 12 events (92.31% recall) and correctly rejected 880 of 957 negative traces (91.95% specificity), reducing manual review to 89 flagged curves. Grad-CAM provides a qualitative visual reference for regions informing predictions. The open-source Python pipeline includes an executable Google Colab notebook and does not require dedicated local GPU hardware. Results are reported for the Ruminococcus champanellensis XMod-Doc/Coh complex.

### Source excerpt

arXiv:2606.09541v2 Announce Type: replace-cross Abstract: Single-molecule force spectroscopy (SMFS) probes biomolecular mechanics at the single-molecule level, but high-throughput acquisition of force-extension curves creates a data processing bottleneck. Identifying rare specific unbinding events among thousands of noise-dominated traces still relies largely on manual visual inspection. Here, we present a deep learning workflow for the preliminary screening of severely imbalanced SMFS datasets. Using 2D image representations of force-extension curves without system-specific physical priors, we fine-tuned a modified ResNet18 architecture trained with focal loss and evaluated it on the mechanical unfolding pathways of the Ruminococcus champanellensis XMod-Doc/Coh complex. On a held-out test set with a 1.34% target prevalence (13 positive P_2 events among 970 curves), the model achieved 92.31% recall (12 of 13 events) and 91.95% specificity (880 of 957 negative traces), automatically discarding 90.82% of the dataset and reducing manual review from 970 to 89 flagged curves. We also integrated Gradient-weighted Class Activation Mapping (Grad-CAM) to provide a qualitative visual reference of the curve regions driving each prediction. The complete Python pipeline is released as open-source software with an executable Google Colab notebook, enabling reproducible SMFS screening without dedicated local GPU hardware.

## WorldComposer: Generative High-Fidelity Simulation with Digital Cousins for Generalizable Robot Learning and Evaluation

DevFeed: [WorldComposer: Generative High-Fidelity Simulation with Digital Cousins for Generalizable Robot Learning and Evaluation](<https://devfeed.tech/articles/worldcomposer-generative-high-fidelity-simulation-with-digital-cousins-for-generalizable-robot-learning-and-evaluation-142517.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2604.15805>)

Author: Jasper Lu, Zhenhao Shen, Yuanfei Wang, Shugao Liu, Shengqiang Xu, Shawn Xie, Jingkai Xu, Feng Jiang, Jade Yang, Chen Xie, Ruihai Wu

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Robotics Simulation](<https://devfeed.tech/topics/robotics-simulation.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [automated](<https://devfeed.tech/tags/automated.md>), [correlation](<https://devfeed.tech/tags/correlation.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [data-augmentation](<https://devfeed.tech/tags/data-augmentation.md>), [engines](<https://devfeed.tech/tags/engines.md>), [environments](<https://devfeed.tech/tags/environments.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generation](<https://devfeed.tech/tags/generation.md>), [generative](<https://devfeed.tech/tags/generative.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [learning](<https://devfeed.tech/tags/learning.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [maps](<https://devfeed.tech/tags/maps.md>), [object](<https://devfeed.tech/tags/object.md>), [physics](<https://devfeed.tech/tags/physics.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [robot](<https://devfeed.tech/tags/robot.md>), [sim-to-real](<https://devfeed.tech/tags/sim-to-real.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [tasks](<https://devfeed.tech/tags/tasks.md>)

### AI overview

WorldComposer maps real-world panoramas into task-ready simulations and generates "Digital Cousins" by varying scenes and objects, aiming to expand robot-learning data without repeatedly acquiring physical assets or reconfiguring environments. The framework combines realistic assets and physics engines for manipulation of rigid, articulated, and deformable objects, and stitches rooms into larger environments for long-horizon tasks. The abstract reports strong sim-to-real correlation and improved generalization to unseen scene and object variations as generated data scales up.

### Source excerpt

arXiv:2604.15805v2 Announce Type: replace-cross Abstract: Learning robust robot policies in real-world environments requires diverse data augmentation, yet scaling real-world data collection is costly due to the need for acquiring physical assets and reconfiguring environments. Therefore, augmenting real-world scenes into simulation has become a practical augmentation for efficient learning and evaluation. We present WorldComposer, an automated generative Real2Sim2Real framework that maps real-world panoramas into high-fidelity, task-ready simulation environments and further synthesizes diverse Digital Cousins through scene and object variations. Combined with high-quality physics engines and realistic assets, WorldComposer supports interactive manipulation across rigid, articulated, and deformable objects. Additionally, we incorporate multi-room stitching to construct consistent large-scale environments for long-horizon tasks. Experiments demonstrate a strong sim-to-real correlation validating our platform's fidelity, and show that extensively scaling up data generation leads to significantly better generalization to unseen scene and object variations, demonstrating the effectiveness of Digital Cousins for generalizable robot learning and evaluation.

## GridForge: An Open Physics-Informed Digital Twin and Benchmark Suite for UK 11 kV Underground Distribution Cables

DevFeed: [GridForge: An Open Physics-Informed Digital Twin and Benchmark Suite for UK 11 kV Underground Distribution Cables](<https://devfeed.tech/articles/gridforge-an-open-physics-informed-digital-twin-and-benchmark-suite-for-uk-11-kv-underground-distribution-cables-143366.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23241>)

Author: Lilliane Linnet Musoke

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [catboost](<https://devfeed.tech/topics/catboost.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Digital Public Good](<https://devfeed.tech/topics/digital-public-goods.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmark-dataset](<https://devfeed.tech/tags/benchmark-dataset.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [cables](<https://devfeed.tech/tags/cables.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [diagnosis](<https://devfeed.tech/tags/diagnosis.md>), [digital-twin](<https://devfeed.tech/tags/digital-twin.md>), [distribution](<https://devfeed.tech/tags/distribution.md>), [gradient-boosted-trees](<https://devfeed.tech/tags/gradient-boosted-trees.md>), [maintenance](<https://devfeed.tech/tags/maintenance.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [neural-network](<https://devfeed.tech/tags/neural-network.md>), [open](<https://devfeed.tech/tags/open.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [operational](<https://devfeed.tech/tags/operational.md>), [physics-informed](<https://devfeed.tech/tags/physics-informed.md>), [public](<https://devfeed.tech/tags/public.md>), [standards](<https://devfeed.tech/tags/standards.md>), [uk](<https://devfeed.tech/tags/uk.md>)

### AI overview

GridForge provides an open-source benchmark for fault diagnosis and prediction in UK 11 kV underground cables. It combines IEC 60287/60853 thermal models, a calibrated synthetic dataset covering 64 cables and 320 cable-years, and a PINN surrogate that enforces IEC 60287 algebraic balance. The PINN reports 0.148 °C RMSE against the analytical reference on a held-out set and trained in two minutes on the stated platform. Five benchmark tasks include pure-physics, gradient-boosted-tree, and PINN baselines, but only the virtual-sensor task distinguishes them on the reported test split; other tasks tie or are undefined. The dataset, test sets, models, and MIT-licensed code are made available for validation.

### Source excerpt

arXiv:2611.23241v1 Announce Type: new Abstract: The UK distribution-cable monitoring sector is data-rich but framework-poor: each Distribution Network Operator (DNO) collects megabytes of telemetry per asset per day, but there is no public benchmark dataset, no shared reference model, and no commonly agreed evaluation protocol for benchmarking sectoral, data-intensive models for operational decision support; notably for maintenance planning and prioritisation. We address this gap with GridForge, an open-source physics-informed digital twin and benchmark suite for fault diagnosis and prediction, integrating four building blocks: (i) a verified steady state and transient thermal model based on IEC 60287 and IEC 60853; (ii) a calibrated synthetic dataset of 64 cables (covering 320 cable-years) representing four canonical UK 11 kV thermal archetypes and four condition modes; (iii) a Physics-Informed Neural Network (PINN) surrogate that satisfies the algebraic balance defined by IEC 60287 during training and reaches an RMSE of 0.148 {\deg}C on an independent held out set against the reference analytical oracle; and (iv) a five-task benchmark suite that includes three reference baseline models (pure physics, gradient-boosted trees, and the PINN). All numerical parameters are sourced from public standards, the code is licensed under the MIT licence, and the trained PINN converges in only two minutes (as run on the computing platform in Section 10.1), enabling independent verification by DNO engineering and research practitioners. At present only the virtual-sensor task (T4) discriminates between the reference baselines; the other tasks tie or are undefined on this test split, so extending the baselines with task-specific logic is a priority future enhancement. For open validation, the dataset, test sets and models are made available at https://github.com/mlily2024/Gridforge

## Learning Martial Arts Motion Skills for Animating Opponents in VR Sparring Games

DevFeed: [Learning Martial Arts Motion Skills for Animating Opponents in VR Sparring Games](<https://devfeed.tech/articles/learning-martial-arts-motion-skills-for-animating-opponents-in-vr-sparring-games-142706.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23825>)

Author: Jiqing Wen, Qixuan Shi, Robert LiKamWa, Pavan Turaga

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [animations](<https://devfeed.tech/topics/animations.md>), [Game Development](<https://devfeed.tech/topics/game-development.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [animation](<https://devfeed.tech/tags/animation.md>), [can](<https://devfeed.tech/tags/can.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-hc](<https://devfeed.tech/tags/cs-hc.md>), [cs-mm](<https://devfeed.tech/tags/cs-mm.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evasion](<https://devfeed.tech/tags/evasion.md>), [form](<https://devfeed.tech/tags/form.md>), [game](<https://devfeed.tech/tags/game.md>), [game-development](<https://devfeed.tech/tags/game-development.md>), [gameplay](<https://devfeed.tech/tags/gameplay.md>), [games](<https://devfeed.tech/tags/games.md>), [headsets](<https://devfeed.tech/tags/headsets.md>), [interactive](<https://devfeed.tech/tags/interactive.md>), [learning](<https://devfeed.tech/tags/learning.md>), [motion](<https://devfeed.tech/tags/motion.md>), [motion-capture](<https://devfeed.tech/tags/motion-capture.md>), [prototype](<https://devfeed.tech/tags/prototype.md>), [quest](<https://devfeed.tech/tags/quest.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [rl](<https://devfeed.tech/tags/rl.md>), [skills](<https://devfeed.tech/tags/skills.md>), [vr](<https://devfeed.tech/tags/vr.md>)

### AI overview

The paper presents a learned motion-skill repertoire for animating opponents in VR martial arts sparring. Using Tang Soo Do motion capture of individual attacks and defenses, combinations, transitions, and sparring variations, the authors pretrained reusable skills with reinforcement learning and adversarial style rewards, then adapted them for target-directed strikes and threat-aware evasion. A user study assessed generated motions for physical plausibility, smoothness, and martial arts form. A Meta Quest prototype paired policy-generated motion clips with lightweight state-based control to support interactive opponents. The abstract reports this as evidence of feasibility; it provides no quantitative results or comparison with other systems.

### Source excerpt

arXiv:2611.23825v1 Announce Type: cross Abstract: Animating virtual opponents is an important yet challenging task in game development. In martial arts games, opponent motions must not only be physically plausible but also exhibit appropriate technique, timing, transitions, and target-directed intent. Traditional game animations often rely on handcrafted clips, state machine transitions, and procedural adjustments, which can be labor-intensive and may limit the behavioral diversity of non-player characters. This paper presents a martial arts motion skills learning framework for character animation in virtual sparring games. Inspired by Tang Soo Do, we collected a martial arts motion capture dataset containing isolated attacking and defending techniques, technique combinations and transitions, and contextual sparring variations. We first pretrained a reusable repertoire of martial arts motion skills from the captured data using reinforcement learning (RL) with adversarial style rewards, and then adapted these skills with task-specific rewards for target-directed striking and threat-aware evasion. We evaluated the motions generated by the learned policy through a user study, in which participants assessed their physical plausibility, smoothness, and martial arts form. To demonstrate their applicability to interactive gameplay, we developed a VR sparring prototype for Meta Quest headsets. The prototype combines policy-generated motion clips with lightweight state-based control to support interactive opponent behavior. Together, these findings support the feasibility of using a learned martial arts skill repertoire as a motion foundation for animating opponents in VR sparring games.

## TabBioMed: A Large-Scale Benchmark for Biomedical Tabular Learning

DevFeed: [TabBioMed: A Large-Scale Benchmark for Biomedical Tabular Learning](<https://devfeed.tech/articles/tabbiomed-a-large-scale-benchmark-for-biomedical-tabular-learning-143446.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23779>)

Author: Pau Mateo-Bernad\\'o, Saivenkata Nagavyjayanthi Polapragada, David Bonet, Pol Arbiol Rakuljic, Laia Mogas Pladevall, Mar\\c{c}al Comajoan Cara, Jesus Gonzalez-Ferrer, Jordi Abante, Daniel Mas Montserrat

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Predictive AI](<https://devfeed.tech/topics/predictive-ai.md>)

Tags: [architectures](<https://devfeed.tech/tags/architectures.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [biology](<https://devfeed.tech/tags/biology.md>), [biomedical](<https://devfeed.tech/tags/biomedical.md>), [budget](<https://devfeed.tech/tags/budget.md>), [choice](<https://devfeed.tech/tags/choice.md>), [classification](<https://devfeed.tech/tags/classification.md>), [code](<https://devfeed.tech/tags/code.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [context](<https://devfeed.tech/tags/context.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [drug-discovery](<https://devfeed.tech/tags/drug-discovery.md>), [electronic-health-records](<https://devfeed.tech/tags/electronic-health-records.md>), [large](<https://devfeed.tech/tags/large.md>), [learning](<https://devfeed.tech/tags/learning.md>), [scale](<https://devfeed.tech/tags/scale.md>)

### AI overview

TabBioMed benchmarks 23 models on 94 curated public biomedical tabular datasets across classification, regression, and multi-target tasks. Its standardized, dataset-aware preprocessing and evaluation framework covers data from areas including electronic health records, drug discovery, and multiple omics fields. Tabular foundation models lead in family-level predictive performance, but their advantage depends on the data and task regime: tree-based models and tuned multilayer perceptrons remain competitive and can perform better under inference-time or training-cost constraints. The benchmark includes curated datasets and splits, preprocessing code, baselines, and results to support reproducible comparisons and practical model selection.

### Source excerpt

arXiv:2611.23779v1 Announce Type: new Abstract: Recent advances in machine learning have accelerated biomedical prediction, but evaluation on structured biomedical data remains fragmented, especially for datasets with high dimensionality, large sample size, missingness, and class imbalance. We introduce TabBioMed, a large-scale benchmark of 94 curated public biomedical tabular datasets spanning electronic health records, drug discovery, genomics, transcriptomics, proteomics, metabolomics, single-cell omics, and systems biology. TabBioMed unifies these datasets through a standardized, dataset-aware preprocessing and evaluation framework, enabling reproducible comparison across classification, regression, and multi-target tasks. We benchmark 23 models across classical baselines, gradient-boosted trees, neural tabular architectures, and tabular foundation models. Foundation models deliver the strongest family-level predictive performance. However, their gains are regime-dependent: tree-based models and tuned multilayer perceptrons remain highly competitive, often dominating under inference-time or training-cost constraints. Overall, TabBioMed shows that biomedical tabular learning is strongly context-dependent, with optimal model choice depending on data regime, task type, and computational budget. We release TabBioMed with curated datasets and splits, preprocessing code, baselines, and results, providing a reproducible benchmark for practical model selection and future methods development in biomedical machine learning, available at https://github.com/AI-sandbox/TabBioMed.

## Are You Learning Biological Signal or Shortcuts? Auditing and Mitigating Bias in Protein-Protein Interaction Datasets

DevFeed: [Are You Learning Biological Signal or Shortcuts? Auditing and Mitigating Bias in Protein-Protein Interaction Datasets](<https://devfeed.tech/articles/are-you-learning-biological-signal-or-shortcuts-auditing-and-mitigating-bias-in-protein-protein-interaction-datasets-143307.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2609.10193>)

Author: Judith Bernett, Anton Spannagl, Joel {\\AA}s, Markus List, David B. Blumenthal

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Bioinformatics](<https://devfeed.tech/topics/bioinformatics.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [abstract](<https://devfeed.tech/tags/abstract.md>), [also](<https://devfeed.tech/tags/also.md>), [amplify](<https://devfeed.tech/tags/amplify.md>), [analyze](<https://devfeed.tech/tags/analyze.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [auditing](<https://devfeed.tech/tags/auditing.md>), [bank](<https://devfeed.tech/tags/bank.md>), [based](<https://devfeed.tech/tags/based.md>), [bias](<https://devfeed.tech/tags/bias.md>), [can](<https://devfeed.tech/tags/can.md>), [choice](<https://devfeed.tech/tags/choice.md>), [combines](<https://devfeed.tech/tags/combines.md>), [construction](<https://devfeed.tech/tags/construction.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [learning](<https://devfeed.tech/tags/learning.md>), [protein](<https://devfeed.tech/tags/protein.md>), [q-bio-mn](<https://devfeed.tech/tags/q-bio-mn.md>), [shortcuts](<https://devfeed.tech/tags/shortcuts.md>), [signal](<https://devfeed.tech/tags/signal.md>)

### AI overview

The study finds that PPI prediction datasets can encode shortcuts that models exploit instead of biological signal. Random splitting creates strong topological shortcuts; even after removing train-test protein overlap, shortcuts related to self-interactions, taxonomic identity, and functional relatedness remain, with prevalence varying by data source. Sampling negatives from highly replicated non-interactions can amplify functional-relatedness shortcuts. The authors provide an open Nextflow pipeline that uses integer linear programs for similarity-aware, data-loss-minimizing splits and bias-minimizing negative sampling. They suggest the negative-sampling approach may extend to other machine-learning tasks with many more negative candidates than positives.

### Source excerpt

arXiv:2609.10193v2 Announce Type: replace-cross Abstract: Protein-protein interaction (PPI) databases do not faithfully reflect biological realities. Instead, they are influenced by study and technical biases that distort certain protein and interaction attributes. Machine learning models can exploit these as learning shortcuts if the negative dataset is not constructed with care. So far, the shortcuts introduced during PPI dataset construction have only been examined in isolation. Here, we systematically characterize both reported and, to our knowledge, previously unreported biases in PPI datasets that lead machine learning models to learn shortcuts instead of biological signal. We analyze HIPPIE, IntAct, and STRING, dedicated PPI databases, as well as two datasets derived from 3D-structural information in the Protein Data Bank (PDB). We show that random data splitting introduces strong topological shortcuts. When train-test protein overlap is removed, the resulting datasets still retain usable shortcuts stemming from self-interactions, taxonomic identity, and functional relatedness, whose prevalence interestingly depends on the data source. We further show that sampling negatives from a set of highly replicated non-interactions, an intuitively appealing choice, can amplify the shortcut stemming from functional relatedness. To detect and mitigate these biases, we provide an open Nextflow pipeline that combines similarity-aware, data-loss-minimizing dataset splitting with bias-minimizing negative sampling, both formulated as integer linear programs. Its key concept of quantifying biases to minimize them through optimization-based negative sampling can, in principle, be extended to any machine learning problem where the pool of negative candidates is much larger than the positives and is thus of interest also beyond PPI prediction.

## Continuous evaluation of production AI agents on Microsoft Foundry

DevFeed: [Continuous evaluation of production AI agents on Microsoft Foundry](<https://devfeed.tech/articles/continuous-evaluation-of-production-ai-agents-on-microsoft-foundry-141053.md>)

Original publisher: [Read original article](<https://www.lyzr.ai/blog/continuous-evaluation-on-microsoft-foundry/>)

Author: Lyzr Team

Published: 2026-11-18T08:48:33Z

Content type: article

Language: en

Sources: [Lyzr.ai](<https://devfeed.tech/sources/lyzr-ai.md>)

Topics: [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [Trustworthy AI](<https://devfeed.tech/topics/trustworthy-ai.md>), [CI/CD](<https://devfeed.tech/topics/cicd.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>), [blue green and canary deployments](<https://devfeed.tech/topics/blue-green-and-canary-deployments.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [2025](<https://devfeed.tech/tags/2025.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [backend](<https://devfeed.tech/tags/backend.md>), [continuous](<https://devfeed.tech/tags/continuous.md>), [desk](<https://devfeed.tech/tags/desk.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [foundry](<https://devfeed.tech/tags/foundry.md>), [it](<https://devfeed.tech/tags/it.md>), [launch](<https://devfeed.tech/tags/launch.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [microsoft-foundry](<https://devfeed.tech/tags/microsoft-foundry.md>), [production](<https://devfeed.tech/tags/production.md>), [production-ai](<https://devfeed.tech/tags/production-ai.md>), [service-desk](<https://devfeed.tech/tags/service-desk.md>), [ticketing](<https://devfeed.tech/tags/ticketing.md>)

### AI overview

Microsoft Foundry continuously evaluates sampled production agent responses after they complete, using traces sent to the project's Application Insights. Setup requires connecting Application Insights, configuring evaluators and a RESPONSE_COMPLETED rule, and assigning the project's managed identity the Foundry User role. Results appear in Monitor and Application Insights, where alerts can be configured. Each rule scores up to 100 responses per hour by default; excess runs are skipped, and the documentation cited does not specify how responses are selected. Live traffic lacks reference answers, so the text recommends reference-free evaluators; ground-truth checks belong in scheduled evaluations on fixed datasets. Scores arrive after an action and report or alert rather than block it. The article describes Lyzr Opencontroller as adding request-path controls and release promotion gates, including support for externally hosted agents instrumented with OpenTelemetry.

### Source excerpt

TL;DR An IT service-desk agent passed every pre-launch evaluation (a composite scenario). Five weeks into production, the backend team renamed a field in the ticketing...

## Benchmarking Deep Learning Models for Wheelchair Configuration Classification in Accessible Automated Vehicle Applications

DevFeed: [Benchmarking Deep Learning Models for Wheelchair Configuration Classification in Accessible Automated Vehicle Applications](<https://devfeed.tech/articles/benchmarking-deep-learning-models-for-wheelchair-configuration-classification-in-accessible-automated-vehicle-applications-139932.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21945>)

Author: Samir Ahmed, Shaaz Saleem, Devin Dhami, Wesley Maia, Angel Martinez-Sanchez, Parthib Roy, Jannatul Ferdous Srabonee, Ahmed Sabbir Arif, Ross Greer

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [image recognition](<https://devfeed.tech/topics/image-recognition.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [accessible](<https://devfeed.tech/tags/accessible.md>), [automated](<https://devfeed.tech/tags/automated.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [classification](<https://devfeed.tech/tags/classification.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [deep-learning-models](<https://devfeed.tech/tags/deep-learning-models.md>), [models](<https://devfeed.tech/tags/models.md>), [vehicle](<https://devfeed.tech/tags/vehicle.md>), [wheelchair](<https://devfeed.tech/tags/wheelchair.md>)

### AI overview

The Wheelchair Configuration Image Dataset (WCID) provides 467 face-blurred images for evaluating wheelchair configuration classification, addressing datasets that label wheelchair presence without describing chair type. It includes manual or powered labels, chair subtype, and annotations for occupancy, viewpoint, setting, lighting, occlusion, propulsion, and control; its 273-image validation and 194-image test splits are used solely for evaluation. Three convolutional backbones and a frozen vision-language probe, trained on an external image dataset, are assessed for cross-dataset generalization and Gaussian-blur robustness. Convolutional models perform well on clean images, but strong blur reduces performance, leaving a gap before deployment. The abstract says code, labels, split assignments, trained weights, and face-blurred images are available.

### Source excerpt

arXiv:2611.21945v1 Announce Type: cross Abstract: Making automated vehicles accessible requires consideration of vulnerable road users, including wheelchair users. To offer a more tailored experience that supports independence for this group, vehicle design needs to accommodate the wide range of wheelchair configurations. However, wheelchairs are individualized, varying in frame geometry, propulsion, and visual appearance. Moreover, occupants or accessories may obscure visual cues. Existing mobility-aid datasets only label the presence of a wheelchair, rather than describing its specific configuration. To fill this gap, this paper introduces the Wheelchair Configuration Image Dataset (WCID), comprising 467 face-blurred images across 192 capture groups solely for evaluation. Each image is annotated with (i) a two-class label of manual or powered, (ii) a chair subtype, (iii) occupancy, viewpoint, setting, lighting, occlusion, propulsion, and control, with a 273-image validation split and 194-image test split. Three convolutional neural network backbones and a frozen vision-language probe are trained on an external image dataset and evaluated on WCID to measure cross-dataset generalization, while also testing robustness using Gaussian blur. Convolutional models do well on clean images, but performance drops under strong blur, leaving a gap before deployment. Code, split assignments, labels, trained weights, and the face-blurred images is available at: https://github.com/Mi3-Lab/MAID

## Social Signal Bench: Evidence-Weighted Evaluation of Co-occurring Social Signals in Video and Audio

DevFeed: [Social Signal Bench: Evidence-Weighted Evaluation of Co-occurring Social Signals in Video and Audio](<https://devfeed.tech/articles/social-signal-bench-evidence-weighted-evaluation-of-co-occurring-social-signals-in-video-and-audio-141801.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22704>)

Author: Siddharth Ravi, Anders R. Bargum, Hugo Anselme, Patrizio Cugia di Sant'Orsola, Alberto Cardaci, Flora Kincso Parragi, Vincent Borowiec, Line H. Clemmensen

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [multimodal-ai](<https://devfeed.tech/topics/multimodal-ai.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Video Analytics](<https://devfeed.tech/topics/video-analytics.md>)

Tags: [audio](<https://devfeed.tech/tags/audio.md>), [bench](<https://devfeed.tech/tags/bench.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [computer-vision](<https://devfeed.tech/tags/computer-vision.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [engagement](<https://devfeed.tech/tags/engagement.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [frontier-models](<https://devfeed.tech/tags/frontier-models.md>), [recognition](<https://devfeed.tech/tags/recognition.md>), [signal](<https://devfeed.tech/tags/signal.md>), [social](<https://devfeed.tech/tags/social.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

Social Signal Bench evaluates co-occurring conversational signals in 47 hours of video and audio, addressing limits of conventional multi-label F1. Its video dataset covers ten signals in 25 audiovisual hours; its audio dataset covers six signals in 22 hours. Each has a public online-conversation training set, including 10 expert-annotated hours with the remainder pseudo-labeled, and a private expert-labeled test set spanning four domains. The proposed Evidence-Weighted F1 weights reference labels by annotator evidence and gives graded credit to semantically related predictions via optimal per-clip matching; controlled perturbations show it distinguishes related from unrelated errors, unlike conventional F1. Under a shared protocol, post-trained 7B open models outperform general-purpose frontier models on video and match them on audio.

### Source excerpt

arXiv:2611.22704v1 Announce Type: cross Abstract: Recognizing social signals such as interest and hesitation requires interpreting context-dependent behaviors that may co-occur in conversation. Existing affective computing benchmarks rarely evaluate such co-occurring signals, and conventional multi-label F1 overlooks semantic relationships and annotator disagreement. We introduce Social Signal Bench, a 47-hour densely annotated benchmark for the evaluation of social signal recognition and engagement, comprising two datasets: Social Signal Bench Video (25 hours), covering ten social signals in audiovisual recordings, and Social Signal Bench Audio (22 hours), covering six signals in audio-only recordings. Each dataset pairs a public training set of online conversational video, of which 10 hours are expert-annotated and the remainder pseudo-labeled, with a private expert-labeled test set spanning four conversational domains. We also propose Evidence-Weighted F1 (EW-F1), which weights reference labels by annotator evidence and assigns graded credit to semantically related predictions through optimal per-clip matching. Controlled perturbations demonstrate that EW-F1 distinguishes semantically related errors from unrelated ones, unlike conventional F1. Under a shared evaluation protocol, 7B open models post-trained on Social Signal Bench outperform general-purpose frontier models on video and match them on audio.

## HubEgo-100K: In-the-Wild Egocentric Video of Skilled Work for Robot Learning

DevFeed: [HubEgo-100K: In-the-Wild Egocentric Video of Skilled Work for Robot Learning](<https://devfeed.tech/articles/hubego-100k-in-the-wild-egocentric-video-of-skilled-work-for-robot-learning-141703.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21938>)

Author: Javad Amirian, Armin Kiani, Lo\\"ic Schaeffer, Tim Sprecher, Mohamed Taha, Karthik Yadati

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [multimodal-ai](<https://devfeed.tech/topics/multimodal-ai.md>), [lerobot](<https://devfeed.tech/topics/lerobot.md>)

Tags: [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [camera](<https://devfeed.tech/tags/camera.md>), [cc](<https://devfeed.tech/tags/cc.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [diversity](<https://devfeed.tech/tags/diversity.md>), [environment](<https://devfeed.tech/tags/environment.md>), [environments](<https://devfeed.tech/tags/environments.md>), [imu](<https://devfeed.tech/tags/imu.md>), [kitchen](<https://devfeed.tech/tags/kitchen.md>), [learning](<https://devfeed.tech/tags/learning.md>), [lerobot](<https://devfeed.tech/tags/lerobot.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [robot](<https://devfeed.tech/tags/robot.md>), [video](<https://devfeed.tech/tags/video.md>), [work](<https://devfeed.tech/tags/work.md>), [workplace](<https://devfeed.tech/tags/workplace.md>)

### AI overview

HubEgo-100K v1.0 releases 10,124 hours of 1080p egocentric skilled-work video, recorded by 12,227 contributors across 15,548 environments, with synchronized 100 Hz IMU data from a head-mounted phone camera. Its 72,754 episodes span 11 setting types, 30 work categories, 56 task types and 35 action families; 83% of hours are workplace recordings. Episodes include machine-generated action and language annotations and are available in LeRobot and MCAP formats under CC BY 4.0. The authors measure diversity across these dimensions and report that new contributors and words continue to appear as randomly ordered episodes are added. They relate dataset properties, including hand visibility and inertial sensing, to published evidence on six properties tied to robot policy performance. This version documents collection, curation and privacy measures, but does not yet include the benchmarks or later releases planned for the project.

### Source excerpt

arXiv:2611.21938v1 Announce Type: cross Abstract: Robot policies trained by imitation generalize poorly outside the environments and objects seen in training. Published data-scaling studies find that generalization grows with the diversity of training environments and objects rather than with more demonstrations per environment. Robot data is costly to collect across many environments, whereas egocentric human video can be recorded in the wild at scale; existing egocentric video, however, mostly shows daily-life activity and contains little skilled work in real workplaces. We present HubEgo-100K, a dataset built for diversity. This version of the paper covers the first release, v1.0: 10,124 hours of 1080p egocentric video with synchronized 100 Hz inertial (IMU) data from one head-mounted phone camera. In v1.0, 12,227 contributors record their own unscripted work in 15,548 environments (each one contributor's own setting of one type, such as their kitchen or workshop) across 11 setting types, 30 work categories, 56 task types and 35 action families, with 83% of hours in workplace settings. The release comprises 72,754 episodes with machine-generated action and language annotations, in LeRobot and MCAP formats under CC BY 4.0. We measure diversity along each axis, show that inside v1.0, with episodes in random order, new contributors and words keep appearing, and relate the measurements to published evidence on six data properties tied to policy performance, including hand visibility and inertial sensing. We also document collection, curation, privacy measures and data format, and provide a datasheet. Later versions of this paper will add benchmarks and cover further releases toward 100,000 hours.

## PRUE: A Practical Recipe for Field Boundary Segmentation at Scale

DevFeed: [PRUE: A Practical Recipe for Field Boundary Segmentation at Scale](<https://devfeed.tech/articles/prue-a-practical-recipe-for-field-boundary-segmentation-at-scale-141546.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2603.27101>)

Author: Gedeon Muhawenayo, Caleb Robinson, Subash Khanal, Zhanpei Fang, Isaac Corley, Alexander Wollam, Tianyi Gao, Leonard Strnad, Ryan Avery, Lyndon Estes, Ana M. T\\'arano, Nathan Jacobs, Hannah Kerner

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Image processing](<https://devfeed.tech/topics/image-processing.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [geospatial](<https://devfeed.tech/topics/geospatial.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [all](<https://devfeed.tech/tags/all.md>), [alternatives](<https://devfeed.tech/tags/alternatives.md>), [approach](<https://devfeed.tech/tags/approach.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [based](<https://devfeed.tech/tags/based.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [boundary](<https://devfeed.tech/tags/boundary.md>), [changes](<https://devfeed.tech/tags/changes.md>), [combines](<https://devfeed.tech/tags/combines.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [deep](<https://devfeed.tech/tags/deep.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [design](<https://devfeed.tech/tags/design.md>), [field](<https://devfeed.tech/tags/field.md>), [practical](<https://devfeed.tech/tags/practical.md>), [recipe](<https://devfeed.tech/tags/recipe.md>), [scale](<https://devfeed.tech/tags/scale.md>)

### AI overview

On the Fields of The World benchmark, a U-Net semantic segmentation model outperformed the evaluated instance-based and geospatial foundation models across performance and deployment metrics. The authors' approach combines a U-Net backbone with composite loss functions and targeted data augmentations to improve robustness to real-world variation. It reports 76% IoU and 47% object-F1, gains of 6 and 9 percentage points over the previous baseline, respectively. The abstract says the work releases all models and model-derived field-boundary datasets for five countries.

### Source excerpt

arXiv:2603.27101v3 Announce Type: replace-cross Abstract: Large-scale maps of field boundaries are essential for agricultural monitoring tasks. Existing deep learning approaches for satellite-based field mapping are sensitive to illumination, spatial scale, and changes in geographic location. We conduct the first systematic evaluation of segmentation and geospatial foundation models (GFMs) for global field boundary delineation using the Fields of The World (FTW) benchmark. We evaluate 18 models under unified experimental settings, showing that a U-Net semantic segmentation model outperforms instance-based and GFM alternatives on a suite of performance and deployment metrics. We propose a new segmentation approach that combines a U-Net backbone, composite loss functions, and targeted data augmentations to enhance performance and robustness under real-world conditions. Our model achieves a 76% IoU and 47% object-F1 on FTW, an increase of 6% and 9% over the previous baseline. Our approach provides a practical framework for reliable, scalable, and reproducible field boundary delineation across model design, training, and inference. We release all models and model-derived field boundary datasets for five countries.

## AgentLens: Revealing The Lucky Pass Problem in SWE-Agent Evaluation

DevFeed: [AgentLens: Revealing The Lucky Pass Problem in SWE-Agent Evaluation](<https://devfeed.tech/articles/agentlens-revealing-the-lucky-pass-problem-in-swe-agent-evaluation-139564.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2605.12925>)

Author: Priyam Sahoo, Gaurav Mittal, Xiaomin Li, Shengjie Ma, Benjamin Steenhoek, Pingping Lin, Yu Hu

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [agent observability](<https://devfeed.tech/topics/agent-observability.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Test automation](<https://devfeed.tech/topics/test-automation.md>), [Multi-step AI processes](<https://devfeed.tech/topics/multi-step-ai-processes.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-evaluation](<https://devfeed.tech/tags/agent-evaluation.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [cycles](<https://devfeed.tech/tags/cycles.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [exploration](<https://devfeed.tech/tags/exploration.md>), [framework](<https://devfeed.tech/tags/framework.md>), [implementation](<https://devfeed.tech/tags/implementation.md>), [quality](<https://devfeed.tech/tags/quality.md>), [retries](<https://devfeed.tech/tags/retries.md>), [verification](<https://devfeed.tech/tags/verification.md>)

### AI overview

AgentLens evaluates how software engineering agents reach passing patches, addressing the fact that pass/fail scores treat principled work and chaotic trial and error alike. In 1,815 OpenHands trajectories across 47 SWE-bench Verified tasks, 10.7% of passing runs were Lucky Passes involving behaviors such as regression cycles, blind retries, or missing verification. The framework merges multiple passing solutions into task-level Prefix Tree Acceptor references and labels actions by context as Exploration, Implementation, Verification, or Orchestration. Its quality score groups passing trajectories as Lucky, Solid, or Ideal. Across eight model backends, Lucky rates ranged from 0.5% to 23.2%, and quality-based rankings shifted some models by up to five positions compared with pass-rate rankings. The work releases AgentLens-Bench and an SDK.

### Source excerpt

arXiv:2605.12925v5 Announce Type: replace Abstract: Evaluation of software engineering (SWE) agents is dominated by a binary signal: whether the final patch passes the tests. This outcome-only view treats a principled solution and a chaotic trial-and-error process as equivalent. We show that this equivalence is empirically false. We evaluate 2,614 OpenHands trajectories from eight model backends on 60 SWE-bench Verified tasks. Of these, 47 have enough passing trajectories to construct task-level process references, yielding a 1,815-trajectory evaluation subset. Among passing trajectories in this subset, 10.7% exhibit behavior we call a Lucky Pass: regression cycles, blind retries, missing verification, or temporally disordered exploration, implementation, and verification. We introduce AgentLens, a framework for process-level assessment of SWE-agent trajectories, and release AgentLens-Bench, a dataset of 1,815 trajectories annotated with quality scores, waste signals, divergence points, and 47 task-level Prefix Tree Acceptor (PTA) references. AgentLens builds PTA references by merging multiple passing solutions for the same task, and uses a context-sensitive intent labeler to assign actions to Exploration, Implementation, Verification, or Orchestration based on trajectory history rather than tool identity alone. On AgentLens-Bench, the quality score separates passing trajectories into Lucky, Solid, and Ideal tiers and further decomposes Lucky Passes into five recurring mechanisms. Across the eight model backends, Lucky rates range from 0.5% to 23.2%, and some models move by as many as five rank positions when ranked by quality score instead of pass rate. We publicly release AgentLens-Bench and the AgentLens SDK at https://github.com/agentlens-framework/agentlens, with a project page at https://agentlens-framework.github.io/agentlens/.

## Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentials

DevFeed: [Stein Kernelized Molecular Dynamics for Active Learning of Interatomic Potentials](<https://devfeed.tech/articles/stein-kernelized-molecular-dynamics-for-active-learning-of-interatomic-potentials-141575.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2606.04100>)

Author: Joanna Zou, Fraser Birks, Dallas Foster, Youssef Marzouk

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Molecular Dynamics](<https://devfeed.tech/topics/molecular-dynamics.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>)

Tags: [acquisition](<https://devfeed.tech/tags/acquisition.md>), [adaptive](<https://devfeed.tech/tags/adaptive.md>), [asynchronous](<https://devfeed.tech/tags/asynchronous.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dft](<https://devfeed.tech/tags/dft.md>), [diversity](<https://devfeed.tech/tags/diversity.md>), [energy](<https://devfeed.tech/tags/energy.md>), [exploration](<https://devfeed.tech/tags/exploration.md>), [fewer](<https://devfeed.tech/tags/fewer.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [foundation](<https://devfeed.tech/tags/foundation.md>), [foundation-model](<https://devfeed.tech/tags/foundation-model.md>), [gradient](<https://devfeed.tech/tags/gradient.md>), [gradient-descent](<https://devfeed.tech/tags/gradient-descent.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [molecular-dynamics](<https://devfeed.tech/tags/molecular-dynamics.md>), [online](<https://devfeed.tech/tags/online.md>), [oracle](<https://devfeed.tech/tags/oracle.md>), [physics-comp-ph](<https://devfeed.tech/tags/physics-comp-ph.md>), [training](<https://devfeed.tech/tags/training.md>), [training-data](<https://devfeed.tech/tags/training-data.md>)

### AI overview

Stein kernelized molecular dynamics (SKMD) uses interacting-particle dynamics to select informative configurations for fine-tuning machine-learning interatomic potentials. It adapts stochastic Stein variational gradient descent to molecular dynamics with asynchronous updates and a kernel of global atomic descriptors for symmetry-aware configurational similarity. In the appropriate asymptotic limit, its dynamics retain the Boltzmann distribution as a stationary distribution, balancing exploration with attraction to high-probability regions. An adaptive stopping criterion selects non-redundant data online. The abstract reports demonstrations on the Müller-Brown potential, alanine dipeptide with MACE, and the Pandey reconstruction of Si(111) using a MACE foundation model and DFT oracle; compared with active-learning baselines, SKMD achieved higher model accuracy in fewer training iterations.

### Source excerpt

arXiv:2606.04100v2 Announce Type: replace Abstract: Machine learning interatomic potentials (MLIPs) enable efficient and accurate atomistic simulations but depend critically on the quality and diversity of the training data. We introduce Stein kernelized molecular dynamics (SKMD), an enhanced sampling method that uses interacting particle dynamics to acquire informative training configurations for the fine-tuning of MLIPs. SKMD corresponds to a stochastic variant of Stein variational gradient descent that is adapted for molecular dynamics by incorporating asynchronous particle updates and a kernel of global atomic descriptors, which provides a symmetry-aware measure of configurational similarity. Unlike other enhanced samplers used in molecular dynamics, SKMD maintains the Boltzmann distribution as a stationary distribution of its dynamics in the appropriate asymptotic limit. This property enforces a balance between the exploration of diverse configurations and attraction toward high-probability regions of the energy landscape. We further propose an approach to efficient online data acquisition using an adaptive stopping criterion that selects non-redundant training data over the course of simulation. We demonstrate SKMD for the active learning of a neural network model of the M\"uller--Brown potential, a MACE interatomic potential for alanine dipeptide, and a MACE foundation model with a DFT oracle for predicting the Pandey reconstruction of the Si(111) surface. Compared to active learning baselines, our method achieves higher model accuracy in fewer training iterations.

## Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows

DevFeed: [Announcing AI data preparation capabilities in Amazon SageMaker: Build high-quality datasets for model development workflows](<https://devfeed.tech/articles/announcing-ai-data-preparation-capabilities-in-amazon-sagemaker-build-high-quality-datasets-for-model-development-workflows-138418.md>)

Original publisher: [Read original article](<https://aws.amazon.com/blogs/machine-learning/announcing-ai-data-preparation-capabilities-in-amazon-sagemaker-build-high-quality-datasets-for-model-development-workflows/>)

Author: Varun Rajan

Published: 2026-11-17T19:40:01Z

Content type: release

Language: en

Sources: [Artificial Intelligence](<https://devfeed.tech/sources/artificial-intelligence.md>)

Topics: [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [AI-Ready Data](<https://devfeed.tech/topics/ai-ready-data.md>), [human feedback](<https://devfeed.tech/topics/human-feedback.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [Agent Skills](<https://devfeed.tech/topics/agent-skills.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Amazon S3](<https://devfeed.tech/topics/amazon-s3.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-skill](<https://devfeed.tech/tags/agent-skill.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-data](<https://devfeed.tech/tags/ai-data.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [amazon-sagemaker-ai](<https://devfeed.tech/tags/amazon-sagemaker-ai.md>), [announcements](<https://devfeed.tech/tags/announcements.md>), [apis](<https://devfeed.tech/tags/apis.md>), [auto-label](<https://devfeed.tech/tags/auto-label.md>), [build](<https://devfeed.tech/tags/build.md>), [data](<https://devfeed.tech/tags/data.md>), [data-preparation](<https://devfeed.tech/tags/data-preparation.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [development](<https://devfeed.tech/tags/development.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [examples](<https://devfeed.tech/tags/examples.md>), [foundational-100](<https://devfeed.tech/tags/foundational-100.md>), [model](<https://devfeed.tech/tags/model.md>), [model-development](<https://devfeed.tech/tags/model-development.md>), [quality](<https://devfeed.tech/tags/quality.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

Amazon SageMaker AI adds modular data preparation capabilities that let teams generate synthetic examples, label datasets, review uncertain labels, assess quality, and transform data before training or evaluation. Auto-labeling supports built-in and custom tasks; for tasks with fixed answers, multiple models label each row and their agreement supplies a confidence score, with low-confidence rows routed to human review in SageMaker Studio. Synthetic data can be grounded in seed data and documents, and generated pipelines can be inspected and modified. Teams can chain these steps, for example generating task-specific data, reshaping it for SFT, DPO, or RL, and checking for duplicates, leakage, and rule violations. Work is driven through Python SDK APIs or an AI-ML agent skill, with artifacts open to inspection and editing. Data stays in the team's S3 buckets in its chosen Region under an IAM execution role it controls. The capabilities are generally available in US East (N. Virginia) and US West (Oregon).

### Source excerpt

Amazon SageMaker AI now offers AI data preparation capabilities for building high-quality training and evaluation data. Generate synthetic examples, assess and improve datasets, auto-label at scale, and bring in expert review through Python SDK APIs and an agent skill, all from your own notebook or IDE.

## Mining Architectural Models in the Wild: A Curated Dataset of AADL Models

DevFeed: [Mining Architectural Models in the Wild: A Curated Dataset of AADL Models](<https://devfeed.tech/articles/mining-architectural-models-in-the-wild-a-curated-dataset-of-aadl-models-137952.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.18566>)

Author: Thi Dinh Tran, Maria Teresa Rossi, Ludovico Iovino, Leonardo Mariani

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [software-architecture](<https://devfeed.tech/topics/software-architecture.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Reverse Engineering](<https://devfeed.tech/topics/reverse-engineering.md>)

Tags: [aggregation](<https://devfeed.tech/tags/aggregation.md>), [ai](<https://devfeed.tech/tags/ai.md>), [alignment](<https://devfeed.tech/tags/alignment.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [annotation](<https://devfeed.tech/tags/annotation.md>), [annotations](<https://devfeed.tech/tags/annotations.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [component](<https://devfeed.tech/tags/component.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [design](<https://devfeed.tech/tags/design.md>), [domain](<https://devfeed.tech/tags/domain.md>), [domains](<https://devfeed.tech/tags/domains.md>), [evolution](<https://devfeed.tech/tags/evolution.md>), [formats](<https://devfeed.tech/tags/formats.md>), [mining](<https://devfeed.tech/tags/mining.md>), [models](<https://devfeed.tech/tags/models.md>)

### AI overview

A3D provides a curated dataset of 1,115 AADL models mined from public GitHub repositories and validated with OSATE, addressing the stated shortage of large, annotated architecture-model benchmarks. It covers 7 generic domains and 52 specific-problem clusters, with domain- and problem-level labels plus component mappings to three reference architectures validated through a user study. The models are available in AADL and JSON formats, alongside provenance, a reproducible mining pipeline, and a validation protocol.

### Source excerpt

arXiv:2611.18566v1 Announce Type: new Abstract: Empirical research on software architecture maintenance and evolution is hindered by the scarcity of large-scale, validated, and richly annotated model datasets. Existing benchmarks are limited in scale, provide only model-level annotations, or lack alignment with reference architectures, thereby restricting reproducible studies of architectural reuse, conformance, and AI-driven analysis. To address this gap, we present A3D, a curated dataset of 1,115 Architecture Analysis and Design Language (AADL) models mined from public GitHub repositories and validated with the OSATE tool. The dataset spans 7 generic domains and 52 specific-problem clusters, and provides two annotation layers: (i) domain- and problem-level labels, which capture different model aggregation criteria, and (ii) component-level mappings to three reference architectures, which have been externally validated through a user study. Models are released in AADL and JSON formats with full provenance, a reproducible mining pipeline, and the validation protocol.

## A Comparative Evaluation of BERT-Based and LLM-Based Models for Indic Sentence Similarity

DevFeed: [A Comparative Evaluation of BERT-Based and LLM-Based Models for Indic Sentence Similarity](<https://devfeed.tech/articles/a-comparative-evaluation-of-bert-based-and-llm-based-models-for-indic-sentence-similarity-138863.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.19356>)

Author: Aishwarya Gunjal, Kanchan Khemnar, Pawan Poojary, Pranav Kulkarni, Raviraj Joshi

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [bert](<https://devfeed.tech/topics/bert.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [all](<https://devfeed.tech/tags/all.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [based](<https://devfeed.tech/tags/based.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [bert](<https://devfeed.tech/tags/bert.md>), [compare](<https://devfeed.tech/tags/compare.md>), [construction](<https://devfeed.tech/tags/construction.md>), [correlation](<https://devfeed.tech/tags/correlation.md>), [coverage](<https://devfeed.tech/tags/coverage.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [development](<https://devfeed.tech/tags/development.md>), [difference](<https://devfeed.tech/tags/difference.md>), [effectiveness](<https://devfeed.tech/tags/effectiveness.md>), [embeddinggemma](<https://devfeed.tech/tags/embeddinggemma.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [indic](<https://devfeed.tech/tags/indic.md>), [llm](<https://devfeed.tech/tags/llm.md>), [models](<https://devfeed.tech/tags/models.md>), [similarity](<https://devfeed.tech/tags/similarity.md>)

### AI overview

Across the evaluated Indic sentence similarity benchmarks, the top BERT-based encoder outperformed the top LLM-based embedding model, though the gap differed by benchmark. On translated STS Benchmark development sets in ten Indic languages, IndicSBERT led in every language (macro-average Pearson correlation 0.843); BGE-M3 scored 0.792, while Harrier-270M was the strongest LLM-based model at 0.751. On the native Marathi MahaSTS test set, IndicSBERT scored 0.901 and Bhasha-Embed-v0 0.900; EmbeddingGemma led LLM-based models at 0.871. The results do not show uniform gains from LLM-derived embeddings and point to language coverage, task supervision, and benchmark construction as relevant evaluation factors.

### Source excerpt

arXiv:2611.19356v1 Announce Type: cross Abstract: The relative effectiveness of BERT-based encoders and large language model (LLM)-based embeddings for Indic semantic textual similarity remains insufficiently characterized. We compare eight BERT-based and five LLM-based models on the 1,500-pair STS Benchmark development set translated into ten Indic languages and on the native Marathi MahaSTS test set. IndicSBERT achieves the highest Pearson correlation in all ten translated language sets, with a macro-average of 0.843, followed by BGE-M3 at 0.792. Harrier-270M is the strongest LLM-based model on translated STS-B, with a macro-average of 0.751. On MahaSTS, IndicSBERT and Bhasha-Embed-v0 achieve Pearson correlations of 0.901 and 0.900, respectively, while EmbeddingGemma leads the LLM-based models at 0.871. The highest-scoring BERT-based model thus exceeds the highest-scoring LLM-based model in both settings, although the magnitude of the difference varies across benchmarks. These findings indicate that LLM-derived embeddings do not uniformly improve Indic sentence similarity over established encoders and motivate evaluation that accounts for language coverage, task supervision, and benchmark construction.

## Ambiguous Examples Help, But Full Data Wins: Revisiting Dataset Cartography for Extractive Adversarial QA

DevFeed: [Ambiguous Examples Help, But Full Data Wins: Revisiting Dataset Cartography for Extractive Adversarial QA](<https://devfeed.tech/articles/ambiguous-examples-help-but-full-data-wins-revisiting-dataset-cartography-for-extractive-adversarial-qa-138926.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.19763>)

Author: Paul K. Mandal

Published: 2026-11-17T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Adversarial attacks](<https://devfeed.tech/topics/adversarial-attacks.md>)

Tags: [adversarial](<https://devfeed.tech/tags/adversarial.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [qa](<https://devfeed.tech/tags/qa.md>), [robustness](<https://devfeed.tech/tags/robustness.md>), [train](<https://devfeed.tech/tags/train.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

In extractive adversarial question answering, selecting the 33% most ambiguous SQuAD examples using clean-source training dynamics generally outperforms a random 33% subset, but does not replace training on the full dataset. Ambiguous-ranked subsets beat random subsets on exact match in all 14 model-evaluation cells and on F1 in 12 of 14; full-data training beat ambiguous-ranked training on both metrics in 12 of 14 cells, with mean gains of 3.40 exact-match points and 4.10 F1 points. The study evaluates adversarial-only AddSent and AddOneSent rows. ELECTRA-small is the main exception to the ambiguous-over-random F1 gains. These findings support cartography for reduced-data selection while limiting claims that its out-of-distribution advantage generalizes as a full-data replacement.

### Source excerpt

arXiv:2611.19763v1 Announce Type: cross Abstract: Dataset cartography argues that training dynamics can reveal regions of a dataset that matter differently for learning: easy-to-learn examples aid optimization, hard-to-learn examples often expose annotation problems, and ambiguous examples contribute strongly to out-of-distribution generalization. A striking implication of the original work is that a model trained on only 33% ambiguous examples can outperform full-data training on several OOD evaluations, including a QNLI reformulation of SQuAD evaluated on Adversarial SQuAD. We revisit this claim in a stricter setting: open-ended extractive question answering, where models must predict answer spans rather than classify question-sentence pairs. For each encoder family, we compute clean-source SQuAD training dynamics, train on full, random, easy-ranked, ambiguous-ranked, and hard-ranked subsets, and evaluate robustness on adversarial-only AddSent and AddOneSent rows. Ambiguous-ranked 33% subsets beat random 33% subsets on exact-match accuracy in all 14 model-evaluation cells and on F1 in 12/14 cells. However, full-data training beats ambiguous-ranked training in 12/14 exact-match cells and 12/14 F1 cells, with mean full-minus-ambiguous gains of 3.40 EM and 4.10 F1. The most thoroughly replicated ELECTRA-small panel is also the main exception to the ambiguous-over-random F1 gains. These results show that clean-source cartography remains useful for reduced-data selection, but its OOD advantage does not carry over as a general replacement for full-data training in extractive adversarial QA.

## Self-supervised learning for zebrafish embryo phenotype evaluation: Systematic comparison of algorithms, label-efficient classification, and transfer learning

DevFeed: [Self-supervised learning for zebrafish embryo phenotype evaluation: Systematic comparison of algorithms, label-efficient classification, and transfer learning](<https://devfeed.tech/articles/self-supervised-learning-for-zebrafish-embryo-phenotype-evaluation-systematic-comparison-of-algorithms-label-efficient-classification-and-transfer-learning-137556.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.20269>)

Author: Thomas Lautenschlager, Ga\\"elle Hayot, Quentin Brassart, Angelo Jovin Yamachui Sitcheu, Linus Schilpp, Tijana Geroski, Tetyana Goldanova, Stephan Allgeier, Thibaut Soubri\\'e, Milica Nikolic, Thomas Di

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Self-supervised learning](<https://devfeed.tech/topics/self-supervised-learning.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [classification](<https://devfeed.tech/tags/classification.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [imaging](<https://devfeed.tech/tags/imaging.md>), [self-supervised-learning](<https://devfeed.tech/tags/self-supervised-learning.md>), [supervised-learning](<https://devfeed.tech/tags/supervised-learning.md>), [transfer-learning](<https://devfeed.tech/tags/transfer-learning.md>), [zebrafish](<https://devfeed.tech/tags/zebrafish.md>)

### AI overview

On the public EmbryoNet dataset, a ResNet50 trained with SwAV learned representations that let linear and nonlinear classifiers reach 86.4% and 87.1% accuracy, respectively; the latter matched the fully supervised EmbryoNet result. With only 5% of labels, SwAV reached 70.2% accuracy versus 45.7% for supervised training from scratch. On a small, previously unseen toxicity dataset captured in a different setting, the SwAV model achieved 81.3% accuracy without retraining, compared with 75.9% for EmbryoNet, across normal, dead and falsely cropped classes. The abstract concludes that SSL appears most useful for label efficiency and transfer to new settings, rather than improving fully supervised results.

### Source excerpt

arXiv:2611.20269v1 Announce Type: cross Abstract: Zebrafish embryos are a prominent model organism for image-based phenotyping and especially suited for large-scale imaging studies, for which machine learning (ML) models can automate evaluation. However, training ML models usually requires large labeled datasets, and differences in imaging conditions often impede reuse across laboratories. Self-supervised learning (SSL) addresses both constraints by learning transferable representations from unlabeled images. Yet central aspects like the choice of algorithm remain underexplored for domain-specific applications. To close this gap, we benchmark popular SSL algorithms on the public EmbryoNet dataset, explore label-efficient learning, and test transfer to an unseen setting. Using representations from our strongest model, a ResNet50 network trained with SwAV, a simple linear classifier reaches 86.4% accuracy and a non-linear classifier 87.1%, rivaling the fully supervised EmbryoNet model (87.1%). The SwAV model decisively outperforms supervised training from scratch when labels are scarce (70.2% vs. 45.7% accuracy with 5% of labels). On a three-class problem (normal, dead, falsely cropped) with a small, previously unseen zebrafish toxicity dataset, recorded in a different setting, our model reaches 81.3% accuracy without retraining, while EmbryoNet achieves 75.9%. Overall, self-supervised models for zebrafish embryos seem to mostly facilitate label-efficiency and transfer to new settings rather than improving supervised results.

## Minari: Infrastructure for Collaborative Reinforcement Learning Datasets

DevFeed: [Minari: Infrastructure for Collaborative Reinforcement Learning Datasets](<https://devfeed.tech/articles/minari-infrastructure-for-collaborative-reinforcement-learning-datasets-137317.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.18644>)

Author: Omar G. Younis, Rodrigo Perez-Vicente, John U. Balis, Alex Davey, Will Dudley, Jordan K. Terry

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [huggingface\_hub](<https://devfeed.tech/topics/huggingface-hub.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>)

Tags: [algorithms](<https://devfeed.tech/tags/algorithms.md>), [api](<https://devfeed.tech/tags/api.md>), [atari](<https://devfeed.tech/tags/atari.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [huggingface](<https://devfeed.tech/tags/huggingface.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [language](<https://devfeed.tech/tags/language.md>), [library](<https://devfeed.tech/tags/library.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [navigation](<https://devfeed.tech/tags/navigation.md>), [python](<https://devfeed.tech/tags/python.md>), [rebuild](<https://devfeed.tech/tags/rebuild.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [requirements](<https://devfeed.tech/tags/requirements.md>), [robotic](<https://devfeed.tech/tags/robotic.md>), [scripts](<https://devfeed.tech/tags/scripts.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

Minari is an open-source Python library intended to make offline reinforcement learning datasets easier to create, share, load, and reproduce. Its Gymnasium-style workflow records data by wrapping and stepping through an environment; users can add metadata, filter, combine, and shuffle datasets, then publish or download them through the HuggingFace Hub. Each dataset records its environment specification, seeds, wrappers, and pinned package requirements to support rebuilding the environment and regenerating data. TorchRL, AgileRL, and d3rlpy load Minari datasets natively, with dataset switching described as a one-line change. The abstract reports 338 reproducible datasets spanning several domains, including a regeneration of D4RL with public scripts, and baseline scores for six offline RL algorithms on regenerated D4RL and MuJoCo datasets.

### Source excerpt

arXiv:2611.18644v1 Announce Type: cross Abstract: Offline reinforcement learning (RL) depends on shared datasets, but sharing them is still hard. Each benchmark ships its own format, documentation is thin, and most datasets cannot be regenerated once the environment code moves on. We introduce Minari, an open-source Python library for creating, sharing, and loading RL datasets. Its API follows Gymnasium, so recording a dataset means wrapping an environment and stepping through it as usual. From there, users can attach metadata, filter, combine, and shuffle datasets, and publish or download them with one command through the HuggingFace Hub. Every dataset stores the environment specification, seeds, applied wrappers, and pinned package requirements needed to rebuild the environment and regenerate the data. TorchRL, AgileRL, and d3rlpy already load Minari datasets natively, so switching datasets in those libraries takes one line of code. Minari also hosts 338 reproducible datasets (350K trajectories, 55M steps) covering robotic locomotion and manipulation, maze and grid navigation, language-conditioned instruction following, Atari, and web navigation, including a full regeneration of D4RL with public generation scripts. We report baseline scores for six offline RL algorithms on the regenerated D4RL and MuJoCo datasets.

## DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detection

DevFeed: [DeepfakeBench-MM: A Comprehensive Benchmark for Multimodal Deepfake Detection](<https://devfeed.tech/articles/deepfakebench-mm-a-comprehensive-benchmark-for-multimodal-deepfake-detection-139224.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2510.22622>)

Author: Kangran Zhao, Xiaoyu Zhang, Yupeng Chen, Yize Chen, Weinan Guan, Bo Zheng, Yufan Liao, Chengzhe Sun, Soumyya Kanti Datta, Qingshan Liu, Siwei Lyu, Baoyuan Wu

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Video Analytics](<https://devfeed.tech/topics/video-analytics.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [benchmark overfitting machine learning](<https://devfeed.tech/topics/benchmark-overfitting-machine-learning.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-mm](<https://devfeed.tech/tags/cs-mm.md>), [deepfake](<https://devfeed.tech/tags/deepfake.md>), [deepfake-detection](<https://devfeed.tech/tags/deepfake-detection.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>)

### AI overview

The study introduces Mega-MMDF, a dataset of 100,000 real and 1.2 million forged audio-visual clips spanning 22 manipulation pipelines, and DeepfakeBench-MM, a standardized framework for evaluating 10 detectors across 8 datasets. Training-based detectors achieved their highest mean AUC with Mega-MMDF, gaining up to 0.0784 over each detector's best alternative training dataset. Cross-pipeline results show asymmetric generalization: training on composite forgeries did not always support detection of their component manipulations in isolation. Modality masking increased false alarms and missed detections, while temporal misalignment raised mean predicted forgery probabilities. Code and dataset access are subject to application and usage terms.

### Source excerpt

arXiv:2510.22622v2 Announce Type: replace Abstract: Audio-visual deepfakes can spread misinformation and enable impersonation, undermining trust in digital media. However, existing datasets provide limited coverage of forgery operations and their combinations, constraining detector development and systematic evaluation. We introduce Mega-MMDF, containing 100,000 real and 1.2 million forged clips across 22 pipelines spanning modality-specific manipulations, stacked forgeries, and joint audio-video generation. To assess its training value and enable fair comparisons, we develop DeepfakeBench-MM, which standardizes training and evaluation across 8 datasets and 10 detectors. Training-based detectors achieve their highest mean AUC when trained on Mega-MMDF, with gains of up to 0.0784 over the best alternative training dataset for each detector. Experiments on data scale and pipeline coverage further support the value of large, diverse training data. Cross-pipeline evaluations reveal bidirectional and asymmetric generalization. Training on composite forgeries does not necessarily enable detection of their constituent operations in isolation. Our analysis of altered inputs shows that modality masking can increase false alarms and missed detections, and temporal misalignment can raise mean predicted forgery probabilities. Together, these resources provide a foundation for understanding and improving multimodal deepfake detection, with publicly available code and dataset access subject to application and usage terms.

## Continuous Cuffless Blood Pressure Estimation Using PPG From Methods to Clinical Translation

DevFeed: [Continuous Cuffless Blood Pressure Estimation Using PPG From Methods to Clinical Translation](<https://devfeed.tech/articles/continuous-cuffless-blood-pressure-estimation-using-ppg-from-methods-to-clinical-translation-135788.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.17499>)

Author: Karthika Shalini Potail, Harshitha Manjunatha, Hetvi Kotadia, Tooraj Nikoubin

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [arxiv](<https://devfeed.tech/tags/arxiv.md>), [bias](<https://devfeed.tech/tags/bias.md>), [blood-pressure](<https://devfeed.tech/tags/blood-pressure.md>), [continuous](<https://devfeed.tech/tags/continuous.md>), [cs-et](<https://devfeed.tech/tags/cs-et.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [devices](<https://devfeed.tech/tags/devices.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hypertension](<https://devfeed.tech/tags/hypertension.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [motion](<https://devfeed.tech/tags/motion.md>), [optical](<https://devfeed.tech/tags/optical.md>), [pat](<https://devfeed.tech/tags/pat.md>), [practical](<https://devfeed.tech/tags/practical.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [review](<https://devfeed.tech/tags/review.md>), [survey](<https://devfeed.tech/tags/survey.md>), [transit](<https://devfeed.tech/tags/transit.md>), [wearable](<https://devfeed.tech/tags/wearable.md>)

### AI overview

PPG-based cuffless blood pressure estimation remains difficult to translate reliably into clinical use because PPG does not measure arterial pressure directly. Estimates from waveform features or pulse timing are also affected by vascular tone, arterial stiffness, sensor contact, motion, and individual physiology. The survey examines methods and the measurement chain, including PAT/PTT, machine learning, calibration, datasets, validation, and deployment. It argues that reported error alone is insufficient evidence: leakage between subjects or time periods, dataset imbalance, calibration dependence and drift, and motion artifacts can undermine real-world reliability. It calls for physiologically informed models, diverse longitudinal datasets, transparent reporting of calibration needs and failure rates, stronger evaluation, and studies showing practical clinical value.

### Source excerpt

arXiv:2611.17499v1 Announce Type: cross Abstract: Continuous blood pressure (BP) monitoring could improve hypertension management by capturing changes that intermittent cuff measurements miss. Photoplethysmography (PPG) is widely explored for cuffless BP estimation because optical sensors are inexpensive, wearable, and already present in many consumer and clinical devices. PPG, however, does not measure arterial pressure: BP is inferred from waveform characteristics or pulse timing, which also depend on vascular tone, arterial stiffness, sensor contact, motion, and individual physiology. This survey reviews PPG-based cuffless BP estimation along the full measurement chain, covering physiological mechanisms, waveform features, pulse arrival time (PAT), pulse transit time (PTT), machine-learning methods, datasets, calibration, validation, deployment, bias, and clinical translation. Studies are assessed by the strength of evidence they provide rather than by reported error alone, with particular attention to subject and temporal leakage, dataset imbalance, calibration dependence and drift, motion artifacts, and the gap between benchmark accuracy and reliable real-world measurement. The review finds that progress depends on more than better prediction algorithms. Future work should prioritize physiologically informed models, diverse longitudinal datasets, transparent reporting of calibration requirements and failure rates, stronger evaluation protocols, and studies that demonstrate practical value in clinical care.

## Generated Evaluation Suites as Diversity-Driven Search for Real Agent Regressions

DevFeed: [Generated Evaluation Suites as Diversity-Driven Search for Real Agent Regressions](<https://devfeed.tech/articles/generated-evaluation-suites-as-diversity-driven-search-for-real-agent-regressions-135090.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.17632>)

Author: Pulkit Yadav

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [gaia](<https://devfeed.tech/topics/gaia.md>), [Interactive AI Systems](<https://devfeed.tech/topics/interactive-ai-systems.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [archive](<https://devfeed.tech/tags/archive.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [coverage](<https://devfeed.tech/tags/coverage.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [defect](<https://devfeed.tech/tags/defect.md>), [defects](<https://devfeed.tech/tags/defects.md>), [detection](<https://devfeed.tech/tags/detection.md>), [diversity](<https://devfeed.tech/tags/diversity.md>), [domains](<https://devfeed.tech/tags/domains.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [generator](<https://devfeed.tech/tags/generator.md>), [improvement](<https://devfeed.tech/tags/improvement.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [regressions](<https://devfeed.tech/tags/regressions.md>), [requirements](<https://devfeed.tech/tags/requirements.md>), [retail](<https://devfeed.tech/tags/retail.md>), [search](<https://devfeed.tech/tags/search.md>), [specification](<https://devfeed.tech/tags/specification.md>), [tool](<https://devfeed.tech/tags/tool.md>), [trace](<https://devfeed.tech/tags/trace.md>)

### AI overview

The study finds that average pass rates can conceal real agent regressions because a defect can affect only the scenarios within its coverage footprint. In tests of seven controlled defects across two domains, four of five traceable defects had a maximum possible suite-level effect at or below the 0.10 detection threshold. Tool removal destroyed all covered scenarios in both domains, yet the aggregate pass rate moved in the opposite direction. Per-cell scoring recovered that defect and revealed another as a significant improvement; it also detected forced escalation in retail despite zero traced coverage, indicating a behavior-based footprint. Diversity helped when it aligned with the defect: at fixed suite size, a happy-path-only suite detected nothing, while a kind-diverse suite detected an orchestration defect in 5 of 20 draws. The authors recommend scoring evaluation archives per cell and publishing coverage.

### Source excerpt

arXiv:2611.17632v1 Announce Type: new Abstract: Generating an evaluation suite from an agent's specification is diversity-driven search: a generator fills a descriptor space (requirements $\times$ personas $\times$ scenario kinds), and the suite it emits is an archive, then scored like a benchmark by its mean pass rate, which throws away the search's product. We inject 7 controlled defects into a $\tau^2$-bench agent across two domains. Coverage yields a ceiling: if a defect's traced footprint holds $b$ scenarios that pass at baseline, it can itself contribute at most $b/N$ to a suite of $N$. For 4 of 5 traceable defects that ceiling lies at or below the detection threshold $\theta = 0.10$, so no within-footprint effect can move the suite past it; in both domains the tool-removal defect destroys every covered scenario it can (exactly its ceiling) while the suite-level pass rate moves the other way. Defects split into two regimes: trace-aligned ones, where per-cell scoring recovers the tool-removal defect in full and reveals a second as a significant improvement, and trace-orthogonal ones, whose footprint is behavioural: forced escalation is detected in retail at a traced coverage of exactly zero. Diversity along the generator's own axes helps only where it aligns: at fixed suite size a happy-path-only suite detects nothing, while a kind-diverse one detects the orchestration defect in 5 of 20 draws. Evaluation archives should be scored per cell and should publish coverage as a first-class property.

## The Complete Guide to LLM Evaluation

DevFeed: [The Complete Guide to LLM Evaluation](<https://devfeed.tech/articles/the-complete-guide-to-llm-evaluation-132662.md>)

Original publisher: [Read original article](<https://machinelearningmastery.com/the-complete-guide-to-llm-evaluation/>)

Author: Bala Priya C

Published: 2026-11-13T11:00:00Z

Content type: article

Language: en

Sources: [MachineLearningMastery.com](<https://devfeed.tech/sources/machinelearningmastery-com.md>)

Topics: [Reliable AI outputs](<https://devfeed.tech/topics/reliable-ai-outputs.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [LLM observability](<https://devfeed.tech/topics/llm-observability.md>), [Dataset development](<https://devfeed.tech/topics/dataset-development.md>), [Multi-step AI processes](<https://devfeed.tech/topics/multi-step-ai-processes.md>), [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>), [Temperature settings in AI](<https://devfeed.tech/topics/temperature-settings-in-ai.md>)

Tags: [adversarial](<https://devfeed.tech/tags/adversarial.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [api](<https://devfeed.tech/tags/api.md>), [article](<https://devfeed.tech/tags/article.md>), [bias](<https://devfeed.tech/tags/bias.md>), [bleu](<https://devfeed.tech/tags/bleu.md>), [chain-of-thought](<https://devfeed.tech/tags/chain-of-thought.md>), [classification](<https://devfeed.tech/tags/classification.md>), [code](<https://devfeed.tech/tags/code.md>), [cohen](<https://devfeed.tech/tags/cohen.md>), [coherence](<https://devfeed.tech/tags/coherence.md>), [comparison](<https://devfeed.tech/tags/comparison.md>), [comparisons](<https://devfeed.tech/tags/comparisons.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-applications](<https://devfeed.tech/tags/llm-applications.md>), [llm-evaluation](<https://devfeed.tech/tags/llm-evaluation.md>), [rag](<https://devfeed.tech/tags/rag.md>), [rag-systems](<https://devfeed.tech/tags/rag-systems.md>)

### AI overview

LLM evaluation is presented as a regression loop: keep a dataset of cases, score outputs against written criteria, and compare results across changes. Use deterministic code checks where rules suffice, then add reference-based or LLM-judge scorers for fuzzy criteria. The excerpt describes pointwise, pairwise, and reference-guided judging; QAG turns checkable claims into yes/no judgments, while G-Eval scores subjective qualities and may require token probabilities. Judges can be biased by answer order, length, or model family, so swap pairwise order, test length effects, use a different model family, and calibrate against 30-50 human-labeled outputs with Cohen's kappa. For RAG, score retrieval precision and recall separately from answer faithfulness and relevance; the pattern of scores can help locate failures. Agent evaluation adds task completion, tool choice, arguments, and trajectory. Before release, run versioned offline cases with preset criteria; after release, sample live traffic with reference-free checks alongside latency and cost. The excerpt notes risks including test-set overfitting, leakage, and metric gaming.

### Source excerpt

In this article, you will learn how to evaluate LLM applications systematically, from choosing scorers and designing reliable LLM judges to evaluating RAG systems and...

[Next page](<https://devfeed.tech/topics/dataset-development.md?cursor=WyIyMDI2LTExLTEzVDExOjAwOjAwKzAwOjAwIiwgIjc3MDE1MGU3LTIxZWUtNGQzMy04NTcwLTRiZjI5Y2IxNjJjOSJd>)