# Open Data

Open data is data that anyone can access, use, modify, and share, subject at most to requirements that preserve provenance and openness.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Open-fMIND: A Large-Scale Open-Access fMRI Corpus for Pretraining Brain Foundation Models

DevFeed: [Open-fMIND: A Large-Scale Open-Access fMRI Corpus for Pretraining Brain Foundation Models](<https://devfeed.tech/articles/open-fmind-a-large-scale-open-access-fmri-corpus-for-pretraining-brain-foundation-models-139141.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21215>)

Author: Carlo Alberto Barbano, Giovanni Marraffini, Demian Wassermann

Published: 2026-11-17T05:00:00Z

Content type: release

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>)

Tags: [accessible](<https://devfeed.tech/tags/accessible.md>), [acquisition](<https://devfeed.tech/tags/acquisition.md>), [brain](<https://devfeed.tech/tags/brain.md>), [connectivity](<https://devfeed.tech/tags/connectivity.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [files](<https://devfeed.tech/tags/files.md>), [foundation](<https://devfeed.tech/tags/foundation.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [functional](<https://devfeed.tech/tags/functional.md>), [language](<https://devfeed.tech/tags/language.md>), [large](<https://devfeed.tech/tags/large.md>), [learning](<https://devfeed.tech/tags/learning.md>), [matrices](<https://devfeed.tech/tags/matrices.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [models](<https://devfeed.tech/tags/models.md>), [open](<https://devfeed.tech/tags/open.md>), [open-access](<https://devfeed.tech/tags/open-access.md>), [pretraining](<https://devfeed.tech/tags/pretraining.md>), [q-bio-nc](<https://devfeed.tech/tags/q-bio-nc.md>), [scale](<https://devfeed.tech/tags/scale.md>)

### AI overview

Open-fMIND releases uniformly preprocessed, openly accessible fMRI timeseries from 322 OpenNeuro studies: 11,379 subjects and 45,731 functional runs. Runs are processed with fMRIPrep and parcellated using 52 atlases across 14 families, producing 2.4 million timeseries. The corpus includes denoised data from the default pipeline ("preproc") or fMRIPrep outputs with confound files ("quasiraw"), plus functional connectivity matrices and per-run provenance and motion metadata. It is intended for self-supervised brain representation pretraining; the abstract reports downstream performance comparable to pretraining with UK Biobank.

### Source excerpt

arXiv:2611.21215v1 Announce Type: new Abstract: Self-supervised pretraining has transformed language and vision, but its application to functional MRI (fMRI) is constrained by data access. The largest standardized fMRI resources are governed by data use agreements and dominated by a small number of acquisition protocols, while the thousands of openly licensed datasets on OpenNeuro are individually small, heterogeneously organized, and unprocessed. We present the first release of Open-fMIND, a uniformly preprocessed, openly accessible corpus of parcellated fMRI timeseries from 322 OpenNeuro studies, comprising 11,379 subjects and 45,731 functional runs. Each run is preprocessed with fMRIPrep and parcellated under 52 atlases spanning 14 families, yielding a massive 2.4 million timeseries. Timeseries are released either denoised with our default pipeline (preproc) or as the fMRIPrep output with its confound files (quasiraw), with functional connectivity matrices, per-run provenance and motion metadata. Open-fMIND is intended as a pretraining resource for self-supervised brain representation learning. Pretraining on it yields downstream performance comparable to that obtained with UK Biobank.

## Announcing SotM 2027 in Bogota

DevFeed: [Announcing SotM 2027 in Bogota](<https://devfeed.tech/articles/announcing-sotm-2027-in-bogota-134496.md>)

Original publisher: [Read original article](<https://blog.openstreetmap.org/2026/11/15/announcing-sotm-2027-in-bogota/>)

Author: Enock Seth Nyamador

Published: 2026-11-15T12:00:00Z

Content type: release

Language: en

Sources: [OpenStreetMap](<https://devfeed.tech/sources/openstreetmap-blog.md>)

Topics: [Developer Events](<https://devfeed.tech/topics/developer-events.md>), [coding-community](<https://devfeed.tech/topics/coding-community.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [celebration](<https://devfeed.tech/tags/celebration.md>), [city](<https://devfeed.tech/tags/city.md>), [coffee](<https://devfeed.tech/tags/coffee.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [communities](<https://devfeed.tech/tags/communities.md>), [community](<https://devfeed.tech/tags/community.md>), [conference](<https://devfeed.tech/tags/conference.md>), [conferences](<https://devfeed.tech/tags/conferences.md>), [contribute](<https://devfeed.tech/tags/contribute.md>), [creative](<https://devfeed.tech/tags/creative.md>), [data](<https://devfeed.tech/tags/data.md>), [developers](<https://devfeed.tech/tags/developers.md>), [gathering](<https://devfeed.tech/tags/gathering.md>), [international](<https://devfeed.tech/tags/international.md>), [map](<https://devfeed.tech/tags/map.md>), [open](<https://devfeed.tech/tags/open.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [openstreetmap](<https://devfeed.tech/tags/openstreetmap.md>), [sotm](<https://devfeed.tech/tags/sotm.md>), [state-of-the-map](<https://devfeed.tech/tags/state-of-the-map.md>)

### AI overview

State of the Map 2027, the OpenStreetMap community's international conference, is scheduled for 2-4 July 2027 in Bogotá, Colombia, at Universidad Nacional de Colombia. The local team, led by AC3, includes mappers from several Colombian cities and describes its aim as creating a welcoming, inclusive gathering for the global community. Details about speakers, the program, tickets, and ways to participate are forthcoming.

### Source excerpt

It's time to reconnect with familiar faces and meet new friends from the OpenStreetMap family around the world! We are excited to share that State of the Map (SotM), the international gathering of the OpenStreetMap community, will take place in Bogotá, Colombia in 2-4 July 2027! This edition will gather mappers, open data advocates, developers, [...]

## A Foundation Model for Electrodermal Activity Data

DevFeed: [A Foundation Model for Electrodermal Activity Data](<https://devfeed.tech/articles/a-foundation-model-for-electrodermal-activity-data-131893.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2603.16878>)

Author: Leonardo Alchieri, Matteo Garzon, Lidia Alecci, Francesco Bombassei De Bona, Martin Gjoreski, Giovanni De Felice, Silvia Santini

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [code](<https://devfeed.tech/tags/code.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [devices](<https://devfeed.tech/tags/devices.md>), [eda](<https://devfeed.tech/tags/eda.md>), [eess-sp](<https://devfeed.tech/tags/eess-sp.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [foundation-model](<https://devfeed.tech/tags/foundation-model.md>), [performance](<https://devfeed.tech/tags/performance.md>), [pretraining](<https://devfeed.tech/tags/pretraining.md>), [time-series-foundation-models](<https://devfeed.tech/tags/time-series-foundation-models.md>)

### AI overview

The authors compile EDAMAME, approximately 23,000 hours of electrodermal activity traces from 29 public datasets and 731 users, and use it to train UME, which they describe as the first EDA foundation model. As a frozen feature extractor, UME outperforms generic handcrafted features and matches generalist time-series foundation models while using 20 times fewer computational resources; fine-tuning improves performance on most tested downstream tasks. The model also generalizes to EDA from two devices not seen during training, and performance improves with more pretraining data. EDAMAME is shared under tiered access, with model weights and code released. The abstract notes intrinsic challenges in EDA signals but does not specify them.

### Source excerpt

arXiv:2603.16878v2 Announce Type: replace-cross Abstract: Foundation models have recently extended beyond natural language and vision to time-series domains, including physiological signals. Yet developing foundation models for electrodermal activity (EDA) remains hindered by the absence of large-scale, curated, openly accessible datasets. EDA reflects sympathetic activity and is widely used to infer cognitive load, stress, and engagement. However, few wearable devices feature EDA sensing, and the only large-scale EDA archive to date is proprietary. To address this gap, we compile EDAMAME, a collection of EDA traces from 29 public datasets comprising approximately 23,000 hours of data from 731 users. Using this collection, we train UME, the first foundation model for EDA. As a frozen feature extractor, UME outperforms generic handcrafted features and matches generalist time-series foundation models while requiring 20x fewer computational resources; fine-tuning on the downstream tasks further yields additional performance gains in most experiments. UME also generalizes to EDA from two devices unseen during training. We further show that UME's performance improves as the amount of pretraining data grows, underscoring the importance of large-scale data for effective foundation models. Our findings highlight intrinsic challenges of EDA signals, revealing future research opportunities. We share EDAMAME under tiered access and also release model weights and code.

## Exploring public-private data sharing practices through the lens of Open Data Ecosystems: A multiple case study on municipal and regional freight logistics

DevFeed: [Exploring public-private data sharing practices through the lens of Open Data Ecosystems: A multiple case study on municipal and regional freight logistics](<https://devfeed.tech/articles/exploring-public-private-data-sharing-practices-through-the-lens-of-open-data-ecosystems-a-multiple-case-study-on-municipal-and-regional-freight-logistics-127268.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.12440>)

Author: John Larsson, Johan Lin{\\aa}ker, Per Runeson

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [Data Space](<https://devfeed.tech/topics/data-space.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>), [meetings](<https://devfeed.tech/topics/meetings.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [actor](<https://devfeed.tech/tags/actor.md>), [actor-model](<https://devfeed.tech/tags/actor-model.md>), [air](<https://devfeed.tech/tags/air.md>), [air-pollution](<https://devfeed.tech/tags/air-pollution.md>), [case](<https://devfeed.tech/tags/case.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [data](<https://devfeed.tech/tags/data.md>), [ecosystems](<https://devfeed.tech/tags/ecosystems.md>), [exploring](<https://devfeed.tech/tags/exploring.md>), [lens](<https://devfeed.tech/tags/lens.md>), [logistics](<https://devfeed.tech/tags/logistics.md>), [multiple](<https://devfeed.tech/tags/multiple.md>), [open](<https://devfeed.tech/tags/open.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [practices](<https://devfeed.tech/tags/practices.md>), [private](<https://devfeed.tech/tags/private.md>), [public](<https://devfeed.tech/tags/public.md>), [sharing](<https://devfeed.tech/tags/sharing.md>), [study](<https://devfeed.tech/tags/study.md>)

### AI overview

A three-case study of municipal and regional last-mile freight logistics in Sweden finds that public-private data sharing can support integration and value creation, but depends on linked technical and organizational factors. The study identifies platform design, actor roles, sensitive-data handling, data quality, and procurement as shaping the ecosystem. It proposes that public actors can serve as neutral keystone actors by orchestrating collaboration and facilitating sharing through governance, including procurement. The findings draw on initial meetings, semi-structured interviews, thematic analysis, and a validation workshop; the authors present actor and conceptual models and seven proposition sketches for future research.

### Source excerpt

arXiv:2611.12440v1 Announce Type: new Abstract: Background: Freight transport is expected to increase, contributing to air pollution. There is, therefore, a critical need for increased efficiency that can reduce emissions. Data sharing is one approach, where actors within Open Data Ecosystems (ODE) collaborate and share data among stakeholders to plan and operate more efficient and sustainable freight transport. Aim: In this study, we explore how public-private data sharing practices in municipal and regional last-mile freight logistics in Sweden may improve efficiency. Method: Following a prolonged participation process, we conducted a multiple-case study involving three different cases, built upon initial meetings, semi-structured interviews, supported by a thematic analysis, and validated through a follow-up workshop. Results: The findings show that data sharing in public-private freight logistics (ODE-PPF) is shaped by interrelated socio-technical aspects, including platform design, roles of actors, handling of sensitive data, data quality, and procurement processes. We synthesize our findings in an actor model and a conceptual model, highlighting how these aspects contribute to the functioning of ODE-PPF, and derive seven proposition sketches as a foundation for future research. Conclusion: Data sharing is a central mechanism enabling integration and value creation in last-mile logistics. It depends on the interaction between technical and organizational aspects. Public actors can undertake a key role as a neutral keystone actor by orchestrating the ecosystem and facilitating data sharing through governance practices such as procurement.

## BrainPFN: Amortized Brain-Behaviour Prediction via Prior-Data Fitted Networks

DevFeed: [BrainPFN: Amortized Brain-Behaviour Prediction via Prior-Data Fitted Networks](<https://devfeed.tech/articles/brainpfn-amortized-brain-behaviour-prediction-via-prior-data-fitted-networks-120138.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.06934>)

Author: Carlo Alberto Barbano (MIND), Demian Wassermann (MIND)

Published: 2026-11-06T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [approach](<https://devfeed.tech/tags/approach.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [beats](<https://devfeed.tech/tags/beats.md>), [behaviour](<https://devfeed.tech/tags/behaviour.md>), [brain](<https://devfeed.tech/tags/brain.md>), [can](<https://devfeed.tech/tags/can.md>), [code](<https://devfeed.tech/tags/code.md>), [connectivity](<https://devfeed.tech/tags/connectivity.md>), [context](<https://devfeed.tech/tags/context.md>), [continuous](<https://devfeed.tech/tags/continuous.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [developing](<https://devfeed.tech/tags/developing.md>), [diagnosis](<https://devfeed.tech/tags/diagnosis.md>), [domain](<https://devfeed.tech/tags/domain.md>), [easier](<https://devfeed.tech/tags/easier.md>), [foundation](<https://devfeed.tech/tags/foundation.md>), [networks](<https://devfeed.tech/tags/networks.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [q-bio-nc](<https://devfeed.tech/tags/q-bio-nc.md>)

### AI overview

BrainPFN predicts behavioral scores from functional MRI using a single forward pass over a labeled context, avoiding separate per-score or per-cohort fitting. It is meta-trained using a domain-specific prior built from about 7,000 real functional connectivity matrices and one billion synthetic training samples. The abstract reports that across four independent cohorts it outperformed Kernel Ridge Regression (KRR) in small-sample prediction and led recent brain foundation models trained at four to nine times larger scale. Its training pool is smaller and publicly released with code and checkpoints; these results are limited to the reported cohorts and comparisons.

### Source excerpt

arXiv:2611.06934v1 Announce Type: cross Abstract: The standard approach to predicting behavioral phenotypes from functional MRI is represented by Kernel Ridge Regression (KRR) applied on functional connectivity (FC) matrices. However, this approach is limited: separate models must be fit and tuned for every score and cohort, they do not transfer across datasets, and accuracy degrades sharply when only a handful of subjects are available, as is typical of clinical or cognitive studies. Despite an increasing interest in developing brain foundation models, none has consistently outperformed KRR on behaviour prediction; most reported gains come from easier targets such as age, sex, or diagnosis rather than continuous behavioural scores. We introduce BrainPFN, a Prior Data Fitted Network for brain behaviour regression. BrainPFN is meta-trained on a domain-specific prior built from ~7k real FC matrices, from which we sample one billion synthetic training samples. At inference, a labelled context is simply passed through the network in a single forward pass, with no per-score or per-cohort refitting required. Across four independent cohorts, BrainPFN beats KRR on small sample prediction, and leads recent foundation models pre-trained at four to nine times larger scale. Our meta-training pool, aggregated from open repositories, is a fraction of the size of the corpora behind competing models, most of which sit behind restrictive data use agreements such as UK Biobank. We release this pool publicly alongside code and checkpoints, showing that a modest, openly available pool can match or beat models trained at Biobank scale.

## Autonomous Driving Research Requires a Community-Driven Data Paradigm

DevFeed: [Autonomous Driving Research Requires a Community-Driven Data Paradigm](<https://devfeed.tech/articles/autonomous-driving-research-requires-a-community-driven-data-paradigm-120102.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.08825>)

Author: Jinsu Yoo, Zanming Huang, Katie Z Luo, Zheda Mai, Qiyuan Wu, Bharath Hariharan, Mark Campbell, Wei-Lun Chao

Published: 2026-11-06T05:00:00Z

Content type: opinion

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [autonomous vehicles](<https://devfeed.tech/topics/autonomous-vehicles.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [autonomous-driving](<https://devfeed.tech/tags/autonomous-driving.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [community](<https://devfeed.tech/tags/community.md>), [contributors](<https://devfeed.tech/tags/contributors.md>), [coverage](<https://devfeed.tech/tags/coverage.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fragmentation](<https://devfeed.tech/tags/fragmentation.md>), [impact](<https://devfeed.tech/tags/impact.md>), [incentives](<https://devfeed.tech/tags/incentives.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [integration](<https://devfeed.tech/tags/integration.md>), [modeling](<https://devfeed.tech/tags/modeling.md>), [protocols](<https://devfeed.tech/tags/protocols.md>), [research](<https://devfeed.tech/tags/research.md>), [reuse](<https://devfeed.tech/tags/reuse.md>)

### AI overview

Autonomous driving research remains limited by its data paradigm as well as by modeling: it relies on a few benchmarks with narrow spatial and scenario coverage, while more than 600 datasets from nearly 50 countries remain underused. The abstract attributes this gap to fragmentation, low visibility, incompatible protocols, and incentives that concentrate attention on dominant datasets. It proposes community infrastructure to improve discovery, reuse, integration, and evaluation of diverse data, reward study of underexplored datasets, and lower barriers for contributors, with collaboration across academia and industry.

### Source excerpt

arXiv:2610.08825v2 Announce Type: replace-cross Abstract: Autonomous driving has made remarkable progress, with recent AI advances enabling commercial deployments that are reshaping urban mobility. Yet the field remains far from its universal social promise: autonomous systems that can operate robustly anywhere, anytime, for anyone. We posit that this gap is not merely a modeling problem, but a problem of the prevailing data paradigm. Current research relies heavily on a few benchmark datasets with limited spatial and scenario coverage, even though the community has collectively produced over 600 autonomous driving datasets across nearly 50 countries. However, this abundance has not translated into broad research impact: most datasets remain significantly underused due to fragmentation, limited visibility, incompatible protocols, and benchmark incentives that concentrate attention on a few dominant datasets. We therefore argue that autonomous driving research requires a collaborative, community-driven data paradigm. Such a paradigm would improve the discovery, reuse, integration, and evaluation of diverse datasets; make underexplored data easier and more rewarding to study; and lower the barrier for new contributors. We outline its key principles, illustrate an early realization, and call for collaboration across academia and industry to transform fragmented datasets into shared community infrastructure for anytime-anywhere autonomy.

## Why Keep a Data Warehouse If You Are Adopting a Data Lakehouse?

DevFeed: [Why Keep a Data Warehouse If You Are Adopting a Data Lakehouse?](<https://devfeed.tech/articles/why-keep-a-data-warehouse-if-you-are-adopting-a-data-lakehouse-121498.md>)

Original publisher: [Read original article](<https://www.starburst.io/blog/why-keep-a-data-warehouse-if-you-are-adopting-a-data-lakehouse>)

Published: 2026-11-05T22:52:02Z

Content type: article

Language: en

Sources: [Starburst Data](<https://devfeed.tech/sources/starburst-data.md>)

Topics: [data lake](<https://devfeed.tech/topics/data-lake.md>), [Amazon Redshift](<https://devfeed.tech/topics/amazon-redshift.md>), [data migrations](<https://devfeed.tech/topics/data-migrations.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [etl](<https://devfeed.tech/topics/etl.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-iceberg-tables](<https://devfeed.tech/tags/apache-iceberg-tables.md>), [batch](<https://devfeed.tech/tags/batch.md>), [bi](<https://devfeed.tech/tags/bi.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [business-intelligence](<https://devfeed.tech/tags/business-intelligence.md>), [cloud-data-warehouse](<https://devfeed.tech/tags/cloud-data-warehouse.md>), [concurrency](<https://devfeed.tech/tags/concurrency.md>), [concurrent](<https://devfeed.tech/tags/concurrent.md>), [cost](<https://devfeed.tech/tags/cost.md>), [costs](<https://devfeed.tech/tags/costs.md>), [data](<https://devfeed.tech/tags/data.md>), [data-lakehouse](<https://devfeed.tech/tags/data-lakehouse.md>), [data-warehouse](<https://devfeed.tech/tags/data-warehouse.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [warehouse](<https://devfeed.tech/tags/warehouse.md>)

### AI overview

The article recommends keeping a cloud data warehouse and an Iceberg-based lakehouse side by side, matching each workload to its needs and moving workloads gradually. Warehouses such as Snowflake, Redshift, and BigQuery remain suited to small, stable, governed data and high-concurrency BI, where managed performance may justify proprietary storage and indexing. Their costs can grow faster than useful query work due to idle or oversized clusters, egress, and duplicated data and pipelines. Open Iceberg tables add schema enforcement, ACID transactions, and time travel on object storage; they may better fit large or semi-structured data and shared access across teams or platforms. Iceberg's optimistic concurrency suits batch and merge-style writes, so frequent small-row writes need evaluation. The suggested low-risk approach is to query both platforms in place through a federated SQL layer, compare cost and performance on candidate workloads, then migrate incrementally based on evidence.

### Source excerpt

Adopting a data lakehouse doesn't mean retiring the cloud data warehouse on day one. Most ...

## AIRoA-0: Long-Horizon, Precise, Cross-Embodiment Manipulation from Handheld Data

DevFeed: [AIRoA-0: Long-Horizon, Precise, Cross-Embodiment Manipulation from Handheld Data](<https://devfeed.tech/articles/airoa-0-long-horizon-precise-cross-embodiment-manipulation-from-handheld-data-116850.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.03815>)

Author: Yueh-Hua Wu, Kei Ota, Hanlong Li, Hayata Yuasa, Jason Wang, Kengo Ikeuchi, Kensuke Chiyoma, Makoto Sugiura, Masafumi Takahashi, Masatoshi Tateno, Naoaki Kanazawa, Nicola Scianca, Petr Khrapchenkov, Sa

Published: 2026-11-04T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [camera](<https://devfeed.tech/tags/camera.md>), [continuous](<https://devfeed.tech/tags/continuous.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [handheld](<https://devfeed.tech/tags/handheld.md>), [manipulation](<https://devfeed.tech/tags/manipulation.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openarm](<https://devfeed.tech/tags/openarm.md>), [reinforcement-learning](<https://devfeed.tech/tags/reinforcement-learning.md>), [robot](<https://devfeed.tech/tags/robot.md>), [vision-language-action](<https://devfeed.tech/tags/vision-language-action.md>)

### AI overview

AIRoA-0 reports 78% average success across ten tasks, compared with 27% for the strongest of four vision-language-action models post-trained on the same task demonstrations. It learns from 16,151 hours of YUBI handheld-gripper demonstrations, with no robot data, teleoperation, reinforcement learning, or on-robot corrections; the robot is used only at test time. At evaluation, it uses wrist cameras alone, including at a site absent from its training data. Its method identifies relevant regions in wrist views, predicts task stage, and streams continuous actions. The authors describe it as usable across robots mounting YUBI and say they are releasing the dataset, pretrained weights, and post-training recipe. They report task-specific post-training can take under four hours on one node with eight H200 GPUs.

### Source excerpt

arXiv:2611.03815v1 Announce Type: cross Abstract: AIRoA-0 (A-0) is a bimanual manipulation system learned from 16,151 hours of handheld demonstrations, with no robot data collected at any stage. The demonstrations are recorded with YUBI, our open-source handheld gripper, which lets people record manipulation data anywhere with no robot present. From a single instruction, A-0 sorts more than a dozen small parts into their numbered cells and changes the mop pads and brush of a robot vacuum; among other tasks, it unzips a pencil case and folds a towel. It performs these tasks using only a camera on each wrist, with no head or scene camera, at a site where none of its training data was recorded. Across the ten tasks of our evaluation, it averages a success rate of 78%, against 27% for the strongest of four other vision-language-action models post-trained on the same task demonstrations. We collect no teleoperation data and use no reinforcement learning or on-robot corrections, and the robot appears only at test time. The system learns which regions of each wrist view matter for the task, predicts the stage the task has reached, and decodes actions as a continuous stream. A-0 is embodiment-agnostic: it runs on robots that mount the YUBI gripper, such as a bimanual Franka, TX-G2, OpenArm and UR. We are releasing the dataset, to our knowledge the largest open dataset of handheld-gripper demonstrations with task and subtask instructions, together with the pre-trained weights and the post-training recipe. Videos of A-0 on every task are on the project page, https://a-0.airoa.io. Anyone can build the gripper, record a task of their own and post-train the model on it in under four hours on a single node of eight H200 GPUs.

## Investigating Data Flows from Android Games

DevFeed: [Investigating Data Flows from Android Games](<https://devfeed.tech/articles/investigating-data-flows-from-android-games-109080.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.39730>)

Author: Judit Borcsiczky, Lukas Moog, Boel Nelson

Published: 2026-10-30T04:00:00Z

Content type: news

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Android Security](<https://devfeed.tech/topics/android-security.md>), [Internet Traffic](<https://devfeed.tech/topics/internet-traffic.md>), [Security](<https://devfeed.tech/topics/security.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [android](<https://devfeed.tech/tags/android.md>), [consent](<https://devfeed.tech/tags/consent.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [data-collection](<https://devfeed.tech/tags/data-collection.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [dns](<https://devfeed.tech/tags/dns.md>), [games](<https://devfeed.tech/tags/games.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [network-traffic](<https://devfeed.tech/tags/network-traffic.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [study](<https://devfeed.tech/tags/study.md>)

### AI overview

The study analyzes over 16 GB of network traffic from 50 free-to-play Android puzzle games to examine what data they collect and where it goes. Testing selected user-side countermeasures, it finds that most, including ad-blocking DNS services, reduce data flows, while withholding consent or opting out can behave inconsistently and sometimes increase outgoing traffic. The researchers release their measurements as an open dataset.

### Source excerpt

arXiv:2610.39730v1 Announce Type: new Abstract: Online applications can share data with arbitrary parties, without users noticing. In practice, these data flows could constitute privacy violations to individual users, with the lack of transparency leaving users unaware of the unwanted data flows. To understand the spread and scale of this privacy threat, we investigate what data is collected and where it is sent in popular free-to-play Android games. As part of our investigation, we conduct a measurement study where we collect and analyze over 16 GB of network traffic from 50 puzzle games. Additionally, we explore the effectiveness of user-side countermeasures for a selection of the apps. We find that while most countermeasures, such as ad-blocking DNS services, decrease data flows, withholding consent and opting out of data collection can produce inconsistent behavior including increased outgoing traffic. To encourage further analysis, we release our measurements as an open dataset.

## A curated global dataset of open science initiatives and policies

DevFeed: [A curated global dataset of open science initiatives and policies](<https://devfeed.tech/articles/a-curated-global-dataset-of-open-science-initiatives-and-policies-101513.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.35155>)

Author: Abdelghani Maddi (GEMASS), Marc-Andr{\\'e} Simard (UdeM, CIRST), Isabelle Dorsch (GEMASS)

Published: 2026-10-27T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [arxiv](<https://devfeed.tech/tags/arxiv.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [global](<https://devfeed.tech/tags/global.md>), [open](<https://devfeed.tech/tags/open.md>), [policies](<https://devfeed.tech/tags/policies.md>), [science](<https://devfeed.tech/tags/science.md>)

### AI overview

COSMI Hub brings together a curated dataset of 1,186 open science initiatives and policies, with 71 variables on identity, provenance, geography, operational status, activities, governance, funding and identifiers. Candidates came from directories, policy documents, official websites and community suggestions; records were checked, duplicates reconciled, and supporting evidence assessed. The dataset distinguishes initiative types, permits multiple thematic classifications and retains uncertainty where evidence is incomplete. The Zenodo release is fixed while the companion dashboard is updated separately. Because the collection was assembled purposively, it cannot estimate the worldwide number of open science initiatives.

### Source excerpt

arXiv:2610.35155v1 Announce Type: new Abstract: Inventories of open science initiatives differ in scope, geographic coverage and classification, making it difficult to compare infrastructures, services, networks and policies. We developed COSMI Hub within the OPENIT project to bring these sources together in a curated dataset. The release archived on 8 October 2026 contains 1,186 records and 71 variables covering initiative identity, source provenance, geography, record level, operational status, thematic activities, governance, funding and external identifiers. We identified candidates through structured directories, policy documents, official websites and suggestions from the open science community, then checked identities, reconciled duplicates and assessed supporting evidence. The dataset distinguishes standalone initiatives, services, deployments, umbrella organisations and policy instruments. Records can be assigned several thematic dimensions, with uncertainty retained where evidence is incomplete. We describe the collection and coding methods, the data structure and file-level checks, together with considerations for reuse. The Zenodo release is fixed, whereas the companion dashboard is updated separately. Because we assembled the collection purposively, it cannot be used to estimate the worldwide number of open science initiatives.

## Why Engineers Should Brave Capitol Hill

DevFeed: [Why Engineers Should Brave Capitol Hill](<https://devfeed.tech/articles/why-engineers-should-brave-capitol-hill-95748.md>)

Original publisher: [Read original article](<https://spectrum.ieee.org/engineers-lobbying-congress>)

Author: Lucas Laursen

Published: 2026-10-22T13:00:02Z

Content type: article

Language: en

Sources: [IEEE Spectrum](<https://devfeed.tech/sources/ieee-spectrum.md>)

Topics: [developer-relations](<https://devfeed.tech/topics/developer-relations.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [2014](<https://devfeed.tech/tags/2014.md>), [2025](<https://devfeed.tech/tags/2025.md>), [ai](<https://devfeed.tech/tags/ai.md>), [brave](<https://devfeed.tech/tags/brave.md>), [business](<https://devfeed.tech/tags/business.md>), [business-software](<https://devfeed.tech/tags/business-software.md>), [congress](<https://devfeed.tech/tags/congress.md>), [cto](<https://devfeed.tech/tags/cto.md>), [d-c](<https://devfeed.tech/tags/d-c.md>), [education](<https://devfeed.tech/tags/education.md>), [engineer](<https://devfeed.tech/tags/engineer.md>), [funding](<https://devfeed.tech/tags/funding.md>), [ieee](<https://devfeed.tech/tags/ieee.md>), [india](<https://devfeed.tech/tags/india.md>), [lobbying](<https://devfeed.tech/tags/lobbying.md>), [oversight](<https://devfeed.tech/tags/oversight.md>), [question](<https://devfeed.tech/tags/question.md>), [research-funding](<https://devfeed.tech/tags/research-funding.md>), [san-antonio](<https://devfeed.tech/tags/san-antonio.md>), [software-engineer](<https://devfeed.tech/tags/software-engineer.md>), [spring](<https://devfeed.tech/tags/spring.md>), [technology-policy](<https://devfeed.tech/tags/technology-policy.md>), [typedepartments](<https://devfeed.tech/tags/typedepartments.md>), [us-congress](<https://devfeed.tech/tags/us-congress.md>), [washington-dc](<https://devfeed.tech/tags/washington-dc.md>)

### AI overview

Engineers can contribute technical expertise to congressional policy discussions, but effective visits require preparation and a clear ask. Possible requests include supporting or opposing a bill, changing legislative text, seeking agency oversight, or requesting a hearing or briefing. Professional-society visits can offer access to multiple offices and broader constituent representation, while requiring participants to stick to the organization's talking points, which may not align closely with their own work. Jathar found short, jargon-free talking points useful in meetings that may last only 15 minutes to an hour; he also learned to check which legislators have jurisdiction over an issue. On a later visit, connecting IEEE-USA's AI proposal to his software experience helped make the discussion relevant to both his expertise and a staffer's interests. Staffers value informed, well-considered proposals and advocates' personal commitment, though the excerpt reports no resulting legislative impact.

### Source excerpt

When San Antonio-based software engineer Nikhil Jathar first went to Washington, D.C., to advocate for federal support for technology education and research funding, he was in awe of the opportunity. It was spring of 2025, not long after Jathar settled in the United States from India, when he got an invitation to join the annual Congressional Visits Day organized by IEEE-USA. "My first reaction was, 'Wow, I get to visit Congress,' " says Jathar, CTO of AvanSaber, a business software company he cofounded in 2014. At the time, he did not have a specific lobbying position on behalf of the company. But he was intrigued by the invitation--which goes out to all U.S. IEEE members--and as he read more about congressional visits, his motivation deepened. He realized: "I need to try this. I want to see where it goes." What's Your Ask? Congressional staffers expect clarity from advocates. Be clear on what you plan to ask for when you arrive. Here are some common options: Cosponsor (or oppose) an existing bill or amendment. Preserve, remove, or modify legislative text in a bill under consideration. Add language to an appropriations bill or committee report. Ask a federal agency a specific oversight question. Request a briefing, hearing, Government Accountability Office review, or stakeholder roundtable. Encourage an agency to clarify a technical rule. Congressional staffers say they welcome the knowledge and perspective that engineers like Jathar and other visitors from beyond Washington, D.C., provide. It's also important for those visitors to be clear on what they are advocating for. One staffer for the House Committee on Science, Space, and Technology, who agreed to speak anonymously due to the office's media policy, says, "Ideas for new policies come from multiple places. It could begin at the [legislator] or staff level, an ask from a constituent, or needs from industry. It's up to us to figure out what would do the most good," the staffer said. "For instance, if you leave i

## LibreOffice will omit AI features from its standard installation for now

DevFeed: [LibreOffice will omit AI features from its standard installation for now](<https://devfeed.tech/articles/libreoffice-touts-no-ai-as-a-feature-67036.md>)

Original publisher: [Read original article](<https://www.computerworld.com/article/4232129/libreoffice-no-ai-is-also-a-feature.html>)

Author: Viktor Eriksson

Published: 2026-10-07T13:41:00Z

Content type: news

Language: en

Sources: [Computerworld](<https://devfeed.tech/sources/computerworld.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [artificial-intelligence-office-suites-productivity-software](<https://devfeed.tech/tags/artificial-intelligence-office-suites-productivity-software.md>), [libreoffice](<https://devfeed.tech/tags/libreoffice.md>), [office-suites](<https://devfeed.tech/tags/office-suites.md>), [open-document-format](<https://devfeed.tech/tags/open-document-format.md>), [productivity](<https://devfeed.tech/tags/productivity.md>), [productivity-software](<https://devfeed.tech/tags/productivity-software.md>), [the-document-foundation](<https://devfeed.tech/tags/the-document-foundation.md>), [user-control](<https://devfeed.tech/tags/user-control.md>)

### AI overview

The Document Foundation says LibreOffice will not include AI in its standard installation for now because current options do not meet its requirements for privacy, user control, and open standards. Any future AI features must let users choose where models run, avoid telemetry and vendor lock-in, use ODF for generated content, and remain optional. The foundation may reconsider if an AI solution meets those requirements.

### Source excerpt

The lack of artificial intelligence features in LibreOffice should be considered a feature in and of itself, according to the free office suite's creators. The Document Foundation, the organization behind the free office suite. The Document Foundation, the organization behind the free office suite project, writes in a blog post that, for the time being, the software will not include any AI in the standard installation. The decision is not motivated by any principled opposition to AI, the post states, but rather by the fact that the technology doesn't currently meet the project's requirements for privacy, user control, and open standards. For example, users must be able to decide for themselves where the AI model runs. The Document Foundation also requires that any future AI solution not collect telemetry or lock users into a single vendor. AI-generated content must also use the open document format ODF, and AI features must be entirely optional. However, if an AI solution emerges in the future that can meet all these requirements, The Document Foundation will consider it. This article originally appeared on Computer Sweden. More on LibreOffice: Austrian Armed Forces switch from Microsoft Office to LibreOffice LibreOffice downloads on the rise as users look to avoid subscription costs

## New public datasets available in Google Cloud Lakehouse

DevFeed: [New public datasets available in Google Cloud Lakehouse](<https://devfeed.tech/articles/new-public-datasets-available-in-google-cloud-lakehouse-62963.md>)

Original publisher: [Read original article](<http://opensource.googleblog.com/2026/09/new-public-datasets-available-in-google-cloud-lakehouse.html>)

Author: Google Open Source (noreply@blogger.com)

Published: 2026-09-30T18:30:00Z

Content type: release

Language: en

Sources: [Google Open Source Blog](<https://devfeed.tech/sources/google-open-source-blog.md>)

Topics: [Apache Iceberg](<https://devfeed.tech/topics/apache-iceberg.md>), [BigQuery](<https://devfeed.tech/topics/bigquery.md>), [Apache Spark](<https://devfeed.tech/topics/spark.md>), [Google Cloud Platform (GCP)](<https://devfeed.tech/topics/google-cloud.md>), [parquet](<https://devfeed.tech/topics/parquet.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [apache](<https://devfeed.tech/tags/apache.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [apache-spark](<https://devfeed.tech/tags/apache-spark.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [biglake](<https://devfeed.tech/tags/biglake.md>), [bigquery](<https://devfeed.tech/tags/bigquery.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [commits](<https://devfeed.tech/tags/commits.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [github](<https://devfeed.tech/tags/github.md>), [google](<https://devfeed.tech/tags/google.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [high-performance](<https://devfeed.tech/tags/high-performance.md>), [iceberg](<https://devfeed.tech/tags/iceberg.md>), [lakehouse](<https://devfeed.tech/tags/lakehouse.md>), [metadata](<https://devfeed.tech/tags/metadata.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [public](<https://devfeed.tech/tags/public.md>), [pyiceberg](<https://devfeed.tech/tags/pyiceberg.md>), [python](<https://devfeed.tech/tags/python.md>)

### AI overview

Google Cloud Lakehouse offers public Wikipedia pageview and GitHub commit datasets as Apache Iceberg tables stored in Parquet, for exploring data or benchmarking query engines such as BigQuery, Spark, and Trino. The excerpt shows how to inspect a table's schema with PyIceberg and query the datasets with serverless Managed Service for Apache Spark. Access requires a Google Cloud project ID for quota authentication and Application Default Credentials; the examples use the BigLake REST catalog and vended credentials. The excerpt provides setup and sample queries, but does not specify dataset-wide coverage or performance benchmarks.

### Source excerpt

by Daniel Rodrigues & Alex Stephen, Google Cloud Did you know the Google Chrome Wikipedia page received over 36 million page views in 2025, or that Chromium logged over 3,700 commits in April 2010? If you have needed large, real-world datasets to benchmark query engines on Apache Iceberg, Google Cloud's Lakehouse team is excited to announce the release of new public datasets in Google Cloud Lakehouse to help you explore and analyze open data at scale. Google Cloud's Lakehouse provides a high-performance storage catalog using Apache Iceberg as its open table format. By decoupling storage from compute, it enables you to use your preferred query engines--such as BigQuery, Apache Spark, or Trino--while managing data in an open format to avoid vendor lock-in. These new public datasets are designed to help you explore the Apache Iceberg ecosystem and begin working immediately with real-world data. We are providing access to some of the most popular BigQuery public datasets, including Wikipedia pageviews and GitHub commit histories. Let's dive into how you can start querying them. Prerequisites A Google Cloud project (for authentication). Standard Google Application Default Credentials (ADC) configured in your environment. Explore metadata with PyIceberg To explore table metadata using PyIceberg, install the required Python packages in a virtual environment: sudo apt-get install python3-venv python3 -m venv public_data_lakehouse source public_data_lakehouse/bin/activate pip install google-auth pip install pyiceberg pip install pyarrow After installing the required packages, you can inspect a table's schema using the Python script below. Here is how to inspect the table containing Wikipedia page view data from 2016: from pyiceberg import catalog as pyiceberg_catalog PROJECT = "<YOUR_PROJECT_ID>" NAMESPACE = "wikipedia" TABLE = "pageviews_2016" def load_catalog() -> pyiceberg_catalog.Catalog: properties = { "type": "rest", "uri": "https://biglake.googleapis.com/iceberg/v1/rest

## Open Knowledge Format (OKF) bundle

DevFeed: [Open Knowledge Format (OKF) bundle](<https://devfeed.tech/articles/open-knowledge-format-okf-bundle-89086.md>)

Original publisher: [Read original article](<https://specification.website/spec/agent-readiness/okf-bundle/>)

Author: Joost de Valk

Published: 2026-09-10T00:00:00Z

Content type: tutorial

Language: en

Sources: [The Website Specification](<https://devfeed.tech/sources/the-website-specification.md>)

Topics: [knowledge-management](<https://devfeed.tech/topics/knowledge-management.md>), [Agent Skills](<https://devfeed.tech/topics/agent-skills.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>)

Tags: [agent-readiness](<https://devfeed.tech/tags/agent-readiness.md>), [optional](<https://devfeed.tech/tags/optional.md>)

### AI overview

The Open Knowledge Format (OKF) packages a knowledge base as Markdown concept files with typed front matter, indexes, change history, and referenced standards. The document describes OKF 0.2 changes, guidance for generating and validating bundles, and using discovery surfaces such as an AI Catalog entry and llms.txt so agents can find them.

### Source excerpt

Publish your whole knowledge base as an Open Knowledge Format bundle -- a tree of Markdown concept files with typed front matter -- so an agent can ingest the entire corpus in one fetch instead of scraping page by page. Now at v0.2, which moves provenance and citations into front matter.

## Data access: the hidden cost of security vendor lock-in

DevFeed: [Data access: the hidden cost of security vendor lock-in](<https://devfeed.tech/articles/data-access-the-hidden-cost-of-security-vendor-lock-in-48933.md>)

Original publisher: [Read original article](<https://www.elastic.co/security-labs/blog/siem-data-export-comparison>)

Author: Mike Nichols,Jamie Hynds

Published: 2026-09-04T00:00:00Z

Content type: opinion

Language: en

Sources: [Elastic Security Labs](<https://devfeed.tech/sources/elastic-security-labs.md>)

Topics: [Security](<https://devfeed.tech/topics/security.md>), [vendor lock-in](<https://devfeed.tech/topics/vendor-lock-in.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [telemetry](<https://devfeed.tech/topics/telemetry.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Security Information and Event Management (SIEM)](<https://devfeed.tech/topics/siem-security.md>)

Tags: [doing](<https://devfeed.tech/tags/doing.md>), [latency](<https://devfeed.tech/tags/latency.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [security](<https://devfeed.tech/tags/security.md>), [security-operations](<https://devfeed.tech/tags/security-operations.md>), [soc](<https://devfeed.tech/tags/soc.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>), [vendor-lock-in](<https://devfeed.tech/tags/vendor-lock-in.md>)

### AI overview

This commentary argues that security vendors often make data ingestion easy while imposing costs, delays, or degraded access on data export. It defines open data access as ownership without extra charges, full-fidelity records, and real-time availability, and presents export restrictions as a form of security vendor lock-in.

### Source excerpt

Getting data into a security platform is always easy; getting it back out is where vendors add cost, extra tooling, and latency, and it is the part of the evaluation most teams overlook.

## 6 ways Open Data Infrastructure accelerates your workflows | Blog | Fivetran

DevFeed: [6 ways Open Data Infrastructure accelerates your workflows | Blog | Fivetran](<https://devfeed.tech/articles/6-ways-open-data-infrastructure-accelerates-your-workflows-blog-fivetran-136750.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/6-ways-open-data-infrastructure-accelerates-your-workflows>)

Author: Ciara Rafferty

Published: 2026-09-02T17:26:16Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [digital sovereignty](<https://devfeed.tech/topics/digital-sovereignty.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [3](<https://devfeed.tech/tags/3.md>), [about](<https://devfeed.tech/tags/about.md>), [accelerate](<https://devfeed.tech/tags/accelerate.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-framework](<https://devfeed.tech/tags/ai-framework.md>), [ai-projects](<https://devfeed.tech/tags/ai-projects.md>), [ai-systems](<https://devfeed.tech/tags/ai-systems.md>), [ai-use](<https://devfeed.tech/tags/ai-use.md>), [blog](<https://devfeed.tech/tags/blog.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [open](<https://devfeed.tech/tags/open.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

Open Data Infrastructure (ODI) is presented as an open, standards-based architecture that can reduce data workflow friction by decoupling storage, compute, and metadata. The excerpt describes six benefits: improving access to data despite vendor restrictions; storing data once in object storage with open table formats such as Apache Iceberg or Delta Lake while choosing compute per workload; making tools easier to swap; reducing duplicate pipelines and inconsistent copies; sharing definitions, lineage, and documentation through governed metadata (including Fivetran's Agents Schema); and carrying access policies and classifications across systems to support visibility, audits, and approvals. These are benefits claimed by the article; the excerpt provides no independent evaluation or quantified results.

### Source excerpt

Six ways Open Data Infrastructure removes friction from your workflows.

## 6 ways Open Data Infrastructure accelerates your workflows | Blog | Fivetran

DevFeed: [6 ways Open Data Infrastructure accelerates your workflows | Blog | Fivetran](<https://devfeed.tech/articles/6-ways-open-data-infrastructure-accelerates-your-workflows-blog-fivetran-78381.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/6-ways-open-data-infrastructure-accelerates-your-workflows>)

Author: Ciara Rafferty

Published: 2026-09-02T17:26:16Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Open Data](<https://devfeed.tech/topics/open-data.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [clean energy data centers](<https://devfeed.tech/topics/clean-energy-data-centers.md>)

Tags: [ai-ready-data](<https://devfeed.tech/tags/ai-ready-data.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [core](<https://devfeed.tech/tags/core.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [delta-lake](<https://devfeed.tech/tags/delta-lake.md>), [open-data](<https://devfeed.tech/tags/open-data.md>)

### AI overview

The article describes six ways Open Data Infrastructure can reduce friction for data engineering and analytics: preserve access to data across vendors, scale storage and compute independently, make tools easier to change, reduce duplicate pipelines, provide shared metadata and lineage, and apply consistent security controls. It argues that open formats and shared standards can support AI workloads without repeated data copies or rebuilt foundations.

### Source excerpt

Six ways Open Data Infrastructure removes friction from your workflows.

## Open Data Infrastructure needs context engineering to unify data use cases | Blog | Fivetran

DevFeed: [Open Data Infrastructure needs context engineering to unify data use cases | Blog | Fivetran](<https://devfeed.tech/articles/open-data-infrastructure-needs-context-engineering-to-unify-data-use-cases-blog-fivetran-78444.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/open-data-infrastructure-needs-context-engineering-to-unify-data-use-cases>)

Author: Charles Wang

Published: 2026-08-07T15:06:58Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>), [context-architecture](<https://devfeed.tech/topics/context-architecture.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [api](<https://devfeed.tech/tags/api.md>), [context-engineering](<https://devfeed.tech/tags/context-engineering.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [dbt](<https://devfeed.tech/tags/dbt.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [single-source-of-truth](<https://devfeed.tech/tags/single-source-of-truth.md>)

### AI overview

The article argues that an open data infrastructure needs explicit context engineering to give people and AI systems a consistent, usable view of data. It describes four needs: semantics and provenance, data quality and state, governance and lifecycle management, and discovery and delivery. It discusses how dbt tools and standards support these needs.

### Source excerpt

A single source of truth doesn't just come from centralizing data. You have to engineer context from it, too.

## The Journey of {nycOpenData}: From Classroom to Community

DevFeed: [The Journey of {nycOpenData}: From Classroom to Community](<https://devfeed.tech/articles/the-journey-of-nycopendata-from-classroom-to-community-53002.md>)

Original publisher: [Read original article](<https://ropensci.org/blog/2026/08/06/the-journey-of-nycopendata-from-classroom-to-community/>)

Author: rOpenSci

Published: 2026-08-06T00:00:00Z

Content type: article

Language: en

Sources: [rOpenSci](<https://devfeed.tech/sources/ropensci-open-tools-for-open-science.md>)

Topics: [Data analysis](<https://devfeed.tech/topics/data-analysis.md>), [R](<https://devfeed.tech/topics/r.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [CSV](<https://devfeed.tech/topics/csv.md>), [dataset](<https://devfeed.tech/topics/dataset.md>)

Tags: [csv](<https://devfeed.tech/tags/csv.md>), [data-analysis](<https://devfeed.tech/tags/data-analysis.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [learning](<https://devfeed.tech/tags/learning.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [r](<https://devfeed.tech/tags/r.md>)

### AI overview

An instructor describes replacing an unengaging introduction to R with NYC Open Data to connect coursework to students' interests. The article discusses the benefits and challenges of using static Excel or CSV files and APIs for teaching reproducible workflows, data analysis, and related skills.

### Source excerpt

FADE IN Nine students in the M.S. in Psychology Research program at Brooklyn College, New York City (NYC), USA are taking the course Reproducible Psychological Research, where they are learning how to code for the first time. All of them have their cameras off. They are all learning R for the first time, and as an introduction to R, are being taught using the mtcars dataset. Nine NYC graduate students who don't own a car, don't drive a car, and have no interest in cars. Even with their screens off, with every additional mtcars column we talked about, they fell deeper and deeper asleep during the lectures. If I wanted my students to learn anything in my class--not just R--I needed to make an immediate pivot. Change needed to happen, and happen fast. Relevance drives rigor I didn't take my students' interests into consideration at the start of the course, and I was paying the price. How do I make sure that no matter what each individual student is interested in, they can be accommodated? Probably a big ask, but part of me felt like I was starting the semester in debt and needed to really pay up. What do all my students have in common? They all live in NYC. Even if they're not from NYC, they currently call it home. Then came the idea: 💡 What if I incorporate NYC Open Data into the course? For anyone who doesn't know, NYC does an incredible job of making public data available through the NYC Open Data Portal. Thousands of datasets, ranging from 311 calls to transportation data to slashings and stabbings (a favorite of one of my students), are available for free, for anyone, anywhere. Immediately, there was a switch in my (virtual) classroom. Before, engagement was about as close to zero as you can get. Now, it skyrocketed. Students were asking more questions, which was great. There were really only two options when it came to using NYC Open Data. The first, which I began using, was downloading static datasets as Excel or CSV files. While this helped with engagement, it al

## 7 things data leaders need to know about Open Data Infrastructure | Blog | Fivetran

DevFeed: [7 things data leaders need to know about Open Data Infrastructure | Blog | Fivetran](<https://devfeed.tech/articles/7-things-data-leaders-need-to-know-about-open-data-infrastructure-blog-fivetran-78382.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/7-things-data-leaders-need-to-know-about-open-data-infrastructure>)

Author: Jamie Cole

Published: 2026-07-31T23:53:45Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [Big data infrastructure](<https://devfeed.tech/topics/big-data-infrastructure.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>)

Tags: [all](<https://devfeed.tech/tags/all.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [databases](<https://devfeed.tech/tags/databases.md>), [delta-lake](<https://devfeed.tech/tags/delta-lake.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [open-data](<https://devfeed.tech/tags/open-data.md>)

### AI overview

The article argues that Open Data Infrastructure can help data leaders handle growing AI workloads by storing data in open formats in a managed data lake, separating storage from compute, and allowing multiple engines to use the same data. It presents this approach as a way to reduce vendor lock-in, control access costs, and make it easier to adopt new tools.

### Source excerpt

As AI scales and workloads become continuous, traditional architectures fall short -- making Open Data Infrastructure a critical priority for data leaders.

## An Open Data Infrastructure can be secure, too | Fivetran | Blog

DevFeed: [An Open Data Infrastructure can be secure, too | Fivetran | Blog](<https://devfeed.tech/articles/an-open-data-infrastructure-can-be-secure-too-fivetran-blog-78388.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/an-open-data-infrastructure-can-be-secure-too>)

Author: Natalie Waller

Published: 2026-07-31T23:53:45Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [digital sovereignty](<https://devfeed.tech/topics/digital-sovereignty.md>)

Tags: [access-controls](<https://devfeed.tech/tags/access-controls.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [open](<https://devfeed.tech/tags/open.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

The article argues that Open Data Infrastructure, built on open standards, can strengthen security by reducing duplicate data, separating storage from compute, reusing metadata and business definitions, and applying access controls and lineage consistently. It describes how these practices can help organizations govern analytics and AI agent workloads while preserving auditability and flexibility.

### Source excerpt

How open standards give security teams more control, not less.

## What is Open Data Infrastructure? | Blog | Fivetran

DevFeed: [What is Open Data Infrastructure? | Blog | Fivetran](<https://devfeed.tech/articles/what-is-open-data-infrastructure-blog-fivetran-78460.md>)

Original publisher: [Read original article](<https://www.fivetran.com/blog/what-is-open-data-infrastructure>)

Author: Natalie Waller

Published: 2026-07-31T23:53:45Z

Content type: tutorial

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [Apache Kafka](<https://devfeed.tech/topics/apache-kafka.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [databricks](<https://devfeed.tech/topics/databricks.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [open-standards](<https://devfeed.tech/tags/open-standards.md>)

### AI overview

Open Data Infrastructure separates storage, compute, and tools so organizations can store data once in open formats and use it across analytics and AI workloads. The article outlines its benefits, architectural principles, use cases, and implementation practices, including open table formats and centralized governance.

### Source excerpt

Learn what open data infrastructure is and how it improves the modern data stack. Explore key benefits, architecture, and the shift toward open standards.

## 7 things data leaders need to know about Open Data Infrastructure | Blog | Fivetran

DevFeed: [7 things data leaders need to know about Open Data Infrastructure | Blog | Fivetran](<https://devfeed.tech/articles/7-things-data-leaders-need-to-know-about-open-data-infrastructure-blog-fivetran-136751.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/7-things-data-leaders-need-to-know-about-open-data-infrastructure>)

Author: Jamie Cole

Published: 2026-07-31T23:53:45Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [Big data infrastructure](<https://devfeed.tech/topics/big-data-infrastructure.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amazon](<https://devfeed.tech/tags/amazon.md>), [amazon-s3](<https://devfeed.tech/tags/amazon-s3.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [apache-iceberg](<https://devfeed.tech/tags/apache-iceberg.md>), [api](<https://devfeed.tech/tags/api.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [automated](<https://devfeed.tech/tags/automated.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [benefits](<https://devfeed.tech/tags/benefits.md>), [cloud-data-warehouse](<https://devfeed.tech/tags/cloud-data-warehouse.md>), [cloud-storage](<https://devfeed.tech/tags/cloud-storage.md>), [continuous](<https://devfeed.tech/tags/continuous.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [open](<https://devfeed.tech/tags/open.md>), [open-data](<https://devfeed.tech/tags/open-data.md>)

### AI overview

Open Data Infrastructure (ODI) separates storage from compute: data is kept in a managed lake using open formats such as Apache Iceberg or Delta Lake on cloud object storage, while teams choose compute engines for each workload. The article argues this can preserve access across tools and AI agents, reduce dependence on a warehouse vendor's metered access, and avoid data migration when adding or changing compute engines. Existing cloud data warehouses can continue running their queries over the lake, so adopting ODI is presented as an evolution rather than a full stack rebuild. The tradeoffs described are that teams must establish and maintain a managed lake and shared foundation; the article says DIY ingestion and lake management do not scale well. It presents Fivetran's managed connectors, lake service, and catalog as handling ingestion and maintenance, including compaction and snapshot management.

### Source excerpt

As AI scales and workloads become continuous, traditional architectures fall short -- making Open Data Infrastructure a critical priority for data leaders.

## Why an Open Data Infrastructure means reliability and low cost | Blog | Fivetran

DevFeed: [Why an Open Data Infrastructure means reliability and low cost | Blog | Fivetran](<https://devfeed.tech/articles/why-an-open-data-infrastructure-means-reliability-and-low-cost-blog-fivetran-136826.md>)

Original publisher: [Read original article](<https://wf.fivetran.com/blog/why-an-open-data-infrastructure-means-reliability-and-low-cost>)

Author: Natalie Waller

Published: 2026-07-31T23:53:45Z

Content type: article

Language: en

Sources: [Fivetran Blog](<https://devfeed.tech/sources/fivetran-blog.md>)

Topics: [Data Infrastructure](<https://devfeed.tech/topics/data-infrastructure.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [deltalake](<https://devfeed.tech/topics/deltalake.md>), [cloud cost management](<https://devfeed.tech/topics/cloud-cost-management.md>), [Open Data](<https://devfeed.tech/topics/open-data.md>), [AI Infrastructure](<https://devfeed.tech/topics/ai-infrastructure.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>), [Big data infrastructure](<https://devfeed.tech/topics/big-data-infrastructure.md>)

Tags: [cost](<https://devfeed.tech/tags/cost.md>), [data](<https://devfeed.tech/tags/data.md>), [data-infrastructure](<https://devfeed.tech/tags/data-infrastructure.md>), [fivetran](<https://devfeed.tech/tags/fivetran.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [open](<https://devfeed.tech/tags/open.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [reliability](<https://devfeed.tech/tags/reliability.md>)

### AI overview

Open Data Infrastructure aims to combine the low-cost scale of data lakes with warehouse-like structure and reliability. The article argues that separate warehouse and lake systems create duplicate data and pipelines, fragmented governance, and rising infrastructure and engineering costs; bundled warehouse storage and compute can also make scaling expensive, while vendor lock-in can limit data access and portability. Open table formats such as Apache Iceberg and Delta Lake add schema enforcement and ACID-style transactions to lake storage. Keeping data in commodity object storage while selecting separate compute engines for BI, data science, or operational workloads can reduce storage costs and let teams match compute to each job. A shared architecture and open standards can also reduce duplicated pipelines and dependency on a single vendor. The approach depends on consistent governance and interoperability, including vendors allowing relatively unimpeded access to data.

### Source excerpt

An open, unified data foundation is critical for reliably and cost-effectively supporting future data use cases, especially AI.

[Next page](<https://devfeed.tech/topics/open-data.md?cursor=WyIyMDI2LTA3LTMxVDIzOjUzOjQ1KzAwOjAwIiwgImE2NjM0ZjQxLTI4OWItNDZmMS1iNDg0LWIxOGUxMTkzNmVkYSJd>)