# arXiv: Databases

Research papers on database systems, query processing, data storage, indexing, transactions, and data management.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## GenSPARQL: A Generative Extension of SPARQL for Incomplete Knowledge Graphs

DevFeed: [GenSPARQL: A Generative Extension of SPARQL for Incomplete Knowledge Graphs](<https://devfeed.tech/articles/gensparql-a-generative-extension-of-sparql-for-incomplete-knowledge-graphs-145628.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26062>)

Author: Jingcheng Wu, Yi Wang, Hongkuan Zhou, Steffen Staab, Bo Xiong

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [база знаний](<https://devfeed.tech/topics/tag-c51cc4bf76e5.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Wikidata](<https://devfeed.tech/topics/wikidata.md>)

Tags: [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [generative](<https://devfeed.tech/tags/generative.md>), [join](<https://devfeed.tech/tags/join.md>), [knowledge-graphs](<https://devfeed.tech/tags/knowledge-graphs.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>)

### AI overview

GenSPARQL extends SPARQL 1.1 with GENOP, which binds LLM-generated values to query variables while evaluating a query over incomplete knowledge graphs. Because LLMs return names rather than graph IRIs, a similarity join maps those names to graph entities. The query planner limits LLM calls to bindings selected by other graph patterns and filters, addressing the need for a separate call per variable binding. A web workbench lets users query two Wikidata-based graphs and inspect generated values, mapped entities, and calls. In evaluation with three open-weight LLMs, embedding similarity mapped 83% of named entities and produced one incorrect match.

### Source excerpt

arXiv:2611.26062v1 Announce Type: cross Abstract: Knowledge graphs on the Web are incomplete, and SPARQL answers a query only from the stored triples. Large language models (LLMs) can predict missing facts, but an LLM returns names instead of IRIs and requires one call per binding of a query variable. We present GenSPARQL, a generative extension of SPARQL 1.1 with an operator GENOP that binds values generated by an LLM to query variables during query evaluation. A similarity join maps generated names to entities of the graph, and the query planner invokes the LLM only for the bindings selected by the other graph patterns and filters. In a web workbench, attendees query two graphs built from Wikidata and inspect generated values, mapped entities and LLM calls. In our evaluation with three open-weight LLMs, the embedding similarity maps 83% of the entities named by the LLMs and yields only one incorrect match.

## Similarity-based OSF Logic for Flexible SPARQL Query Answering

DevFeed: [Similarity-based OSF Logic for Flexible SPARQL Query Answering](<https://devfeed.tech/articles/similarity-based-osf-logic-for-flexible-sparql-query-answering-145646.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26261>)

Author: Gian Carlo Milanese, Gabriella Pasi

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [RDF (Resource Description Framework)](<https://devfeed.tech/topics/rdf.md>), [Wikidata](<https://devfeed.tech/topics/wikidata.md>)

Tags: [algorithm](<https://devfeed.tech/tags/algorithm.md>), [calculus](<https://devfeed.tech/tags/calculus.md>), [constraint](<https://devfeed.tech/tags/constraint.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-lo](<https://devfeed.tech/tags/cs-lo.md>), [domain](<https://devfeed.tech/tags/domain.md>), [engine](<https://devfeed.tech/tags/engine.md>), [feature](<https://devfeed.tech/tags/feature.md>), [flexible](<https://devfeed.tech/tags/flexible.md>), [functions](<https://devfeed.tech/tags/functions.md>), [graphs](<https://devfeed.tech/tags/graphs.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [knowledge-graphs](<https://devfeed.tech/tags/knowledge-graphs.md>), [language](<https://devfeed.tech/tags/language.md>), [logic](<https://devfeed.tech/tags/logic.md>), [ontology](<https://devfeed.tech/tags/ontology.md>), [query](<https://devfeed.tech/tags/query.md>), [rdf](<https://devfeed.tech/tags/rdf.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [results](<https://devfeed.tech/tags/results.md>), [returning](<https://devfeed.tech/tags/returning.md>), [similarity](<https://devfeed.tech/tags/similarity.md>)

### AI overview

The updated fosf reasoner adds similarity-based flexible SPARQL answering over RDF knowledge graphs. Queries are written as fuzzy OSF terms, then rewritten using sort definitions, feature domain and range declarations, and fuzzy subsumption and similarity relations before translation into standard SPARQL. Constraint normalization allows approximate answers when a query would otherwise conflict with the ontology. The source describes the approach and its components but provides no evaluation results or performance comparisons.

### Source excerpt

arXiv:2611.26261v1 Announce Type: new Abstract: We present an updated version of fosf, a reasoner for fuzzy order-sorted feature (OSF) logic, with support for flexible SPARQL query answering over RDF knowledge graphs. Fuzzy OSF logic is a knowledge representation and reasoning language where feature symbols denote functions and sort symbols denote fuzzy sets. Sorts are organized in a fuzzy subsumption relation that extends to OSF terms, record-like structures representing classes of entities. The unification algorithm for these structures provides a calculus of fuzzy type subsumption. The latest release of fosf introduces support for similarity-based reasoning by extending the OSF language with a similarity relation among sorts, alongside a translation engine for compiling OSF terms into standard SPARQL. Queries expressed as OSF terms undergo fuzzy ontology-aware rewriting prior to translation. This process incorporates an OSF theory of sort definitions, feature domain and range declarations, and fuzzy subsumption and similarity relations through fuzzy OSF constraint normalization. This rewriting enables flexible query answering by returning approximate solutions, allowing queries that would otherwise be inconsistent with the underlying ontology to yield relevant results.

## From Industrial Product Documentation to Automated Digital Product Passport Generation: An Experimental Study of Large Language Models

DevFeed: [From Industrial Product Documentation to Automated Digital Product Passport Generation: An Experimental Study of Large Language Models](<https://devfeed.tech/articles/from-industrial-product-documentation-to-automated-digital-product-passport-generation-an-experimental-study-of-large-language-models-145733.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24998>)

Author: Marco Buecheler, Grant Richards, Nathan Hartman

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>), [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Vectors & LLMs](<https://devfeed.tech/topics/vectors-llms.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>), [Factuality scoring in AI](<https://devfeed.tech/topics/factuality-scoring-in-ai.md>)

Tags: [automated](<https://devfeed.tech/tags/automated.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [digital](<https://devfeed.tech/tags/digital.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [experimental](<https://devfeed.tech/tags/experimental.md>), [generation](<https://devfeed.tech/tags/generation.md>), [industrial](<https://devfeed.tech/tags/industrial.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [passport](<https://devfeed.tech/tags/passport.md>), [product](<https://devfeed.tech/tags/product.md>), [study](<https://devfeed.tech/tags/study.md>)

### AI overview

The study tests a RAG pipeline for generating Digital Product Passports as Asset Administration Shell instances from scattered industrial documentation. It chunks documents, stores embeddings in ChromaDB, combines semantic and lexical retrieval against AAS submodel requirements, and supplies retrieved content to five LLMs. Across 4,560 executions covering 76 product-submodel combinations, 97.4% of outputs were valid JSON, but 44.9% passed full AAS validation. Deterministic scoring found mean completeness of 49.6%, conditional accuracy of 58.3%, and overall field correctness of 30.8%; an LLM judge rated the same outputs higher at 66.5%, 88.9%, and 60.4%. The abstract says four prompt-guidance levels were evaluated but does not report their comparative effects.

### Source excerpt

arXiv:2611.24998v1 Announce Type: cross Abstract: Manufacturing companies that are planning to sell certain products in the European Union (EU) will be required to provide mandatory digital product passports (DPPs). The use of DPPs is to provide standardized product information throughout multiple product life cycles in a circular economy. Required passport information, such as technical specifications, material composition, and environmental product footprint, is available in manufacturers' data sources but is scattered across different heterogeneous systems, documents, and data formats. The given paper investigates using large language models (LLMs) to automate the generation of DPPs based on the asset administration shell (AAS). A retrieval-augmented generation (RAG) approach is used to extract product information from industrial documentation and generate populated AAS instances. Product documentation is processed and divided into text chunks. The text chunks are then stored in a persistent ChromaDB vector database using vector embeddings. The retrieval process combines semantic and lexical search to identify relevant information based on standardized AAS submodel template requirements. The retrieved information is provided to five LLMs to generate structured AAS instances. The experiments cover different industrial products and AAS submodels. Four levels of prompt guidance are investigated to assess their influence on generation quality. The generated passports are evaluated against a ground truth. The experimental evaluation includes 4,560 executions across 76 product-submodel combinations. Of the generated passport outputs, 97.4% are valid JSON, while 44.9% pass the full AAS validation procedure. Under deterministic scoring, mean completeness, conditional accuracy, and overall field correctness are 49.6%, 58.3%, and 30.8%, respectively. An LLM-as-a-judge yields better scores of 66.5%, 88.9%, and 60.4% for the same outputs.

## ArrivalBench: Agent-Generated Data Pipelines Are Correct Once and Wrong Under Time

DevFeed: [ArrivalBench: Agent-Generated Data Pipelines Are Correct Once and Wrong Under Time](<https://devfeed.tech/articles/arrivalbench-agent-generated-data-pipelines-are-correct-once-and-wrong-under-time-144954.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.02363>)

Author: Pranay Kothari

Published: 2026-11-20T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [data observability](<https://devfeed.tech/topics/data-observability.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>)

Tags: [adversarial](<https://devfeed.tech/tags/adversarial.md>), [agent](<https://devfeed.tech/tags/agent.md>), [artifacts](<https://devfeed.tech/tags/artifacts.md>), [batch](<https://devfeed.tech/tags/batch.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [crash](<https://devfeed.tech/tags/crash.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [data-pipelines](<https://devfeed.tech/tags/data-pipelines.md>), [delivery](<https://devfeed.tech/tags/delivery.md>), [failure](<https://devfeed.tech/tags/failure.md>), [idempotency](<https://devfeed.tech/tags/idempotency.md>), [log](<https://devfeed.tech/tags/log.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [oracle](<https://devfeed.tech/tags/oracle.md>), [ordering](<https://devfeed.tech/tags/ordering.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [time](<https://devfeed.tech/tags/time.md>)

### AI overview

ArrivalBench tests agent-built data pipelines by replaying late, duplicated, out-of-order, and retried records, then comparing the final state with a batch recomputation of the full log. Unlike one-shot snapshot grading, this exposes silent wrong results separately from crashes. Across 40 tasks and eleven models, one-shot grading certified 86-100% of pipelines, while replay found 7.0-79.2% of those certified pipelines silently wrong. Idempotency hazards failed more often than ordering hazards in every model. In one model, a hazard warning reduced silent failures from 48.2% to 10.5%, but raised crashes from 9.0% to 37.0%; total failure fell only from 51.0% to 44.0%. Independently rerunning all eleven arms shifted rates by at most 5.9 percentage points.

### Source excerpt

arXiv:2610.02363v2 Announce Type: replace Abstract: Benchmarks for agent-generated data work grade a pipeline by running it once against a fixed snapshot. ArrivalBench instead re-executes the pipeline an agent leaves behind under adversarial but replayable delivery schedules (late, duplicated, out-of-order and retried records) and requires its final state to equal a batch recomputation of the complete log. Because the oracle recomputes rather than classifies, a wrong table and a crash are distinct verdicts: a crash is visible to monitoring a team already runs, and a wrong table is not. On 40 tasks we built, our reimplementation of single-execution grading certifies 86-100% of the pipelines eleven models produce; re-executing the same artifacts finds 7.0-79.2% of the certified ones silently wrong. The gap is not produced by the repair loop: within the same model and task, pipelines repaired against the snapshot test fail replay about as often as those that passed it first time. In every model, idempotency hazards fail more often than ordering hazards. Separating a wrong answer from a crash also changes how interventions read: a hazard warning cuts one model's silent failure from 48.2% to 10.5% while raising its crash rate from 9.0% to 37.0%, so all-in failure moves only from 51.0% to 44.0%. All eleven arms were independently re-run, and rates moved by at most 5.9 points.

## CRAFT: Constrained Route planning with Adaptive Framework and Template-based code generation

DevFeed: [CRAFT: Constrained Route planning with Adaptive Framework and Template-based code generation](<https://devfeed.tech/articles/craft-constrained-route-planning-with-adaptive-framework-and-template-based-code-generation-145471.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25128>)

Author: Shahd Elmahallawy, Ahmed Eldawy

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [Google Maps](<https://devfeed.tech/topics/google-maps.md>), [generative-ai-tools](<https://devfeed.tech/topics/generative-ai-tools.md>)

Tags: [code-generation](<https://devfeed.tech/tags/code-generation.md>), [constraint](<https://devfeed.tech/tags/constraint.md>), [craft](<https://devfeed.tech/tags/craft.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [llm](<https://devfeed.tech/tags/llm.md>), [natural-language](<https://devfeed.tech/tags/natural-language.md>), [network](<https://devfeed.tech/tags/network.md>), [planning](<https://devfeed.tech/tags/planning.md>), [routing](<https://devfeed.tech/tags/routing.md>), [scalability](<https://devfeed.tech/tags/scalability.md>), [search-engine](<https://devfeed.tech/tags/search-engine.md>)

### AI overview

CRAFT turns free-text constrained routing requests into routes on real road networks. An LLM parses each request and generates four search functions for a generic graph-search engine to execute. The paper formalizes this as State-Expanded RCSP, extending resource-constrained shortest paths to represent non-additive state, including node-dependent resets and discrete progress. The abstract reports evaluation on 2,600 natural-language queries over California road networks, examining correctness, constraint violations, long-distance scalability, and semantic POI filtering against two baselines; it does not provide the results.

### Source excerpt

arXiv:2611.25128v1 Announce Type: cross Abstract: Everyday routing requests are rarely a point-to-point shortest path. A driver may need to visit stops, sometimes in a fixed order, under time budgets or distance limits, and perhaps recharge their EV car along the way. Each combination is a distinct routing problem that classically requires its own algorithm, so no fixed solver covers the space of queries users may ask. This paper presents CRAFT, which takes a constrained routing query as free text and returns a route that satisfies the user's requirements on a real road network. An LLM parses the query and generates four search functions, which a generic graph-search engine executes on the road network. We formalize the underlying problem as State-Expanded RCSP (SE-RCSP), which extends resource-constrained shortest paths (RCSP) with non-additive state such as node-dependent resets and discrete progress tracking. We evaluate CRAFT on 2,600 natural-language queries over California road networks against two baselines, analyzing correctness, constraint violations, long-distance scalability, and semantic POI filtering.

## UniCom: A Unified Framework for Community Search and Detection via Transfer Learning

DevFeed: [UniCom: A Unified Framework for Community Search and Detection via Transfer Learning](<https://devfeed.tech/articles/unicom-a-unified-framework-for-community-search-and-detection-via-transfer-learning-145729.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2512.02460>)

Author: Yifan Zhu, Hanchen Wang, Wenjie Zhang, Alexander Zhou, Ying Zhang

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [Model Development](<https://devfeed.tech/topics/model-development.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>)

Tags: [community](<https://devfeed.tech/tags/community.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-si](<https://devfeed.tech/tags/cs-si.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [detection](<https://devfeed.tech/tags/detection.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [framework](<https://devfeed.tech/tags/framework.md>), [graph](<https://devfeed.tech/tags/graph.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [learning](<https://devfeed.tech/tags/learning.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [search](<https://devfeed.tech/tags/search.md>), [transfer-learning](<https://devfeed.tech/tags/transfer-learning.md>)

### AI overview

UniCom combines community search, which finds a community for a query, and community detection, which partitions a graph, in one transfer-learning framework. Its Universal Graph Learning stage distills local and global community knowledge from multiple source domains; Domain-aware Specialization then adapts to unseen graphs and tasks on the fly, avoiding costly retraining while keeping the model compact. The abstract reports experiments on 16 datasets against 22 baselines, claiming UniCom outperforms all state-of-the-art baselines across both tasks while maintaining runtime efficiency. The supplied evidence does not give performance details or explain the adaptation procedure.

### Source excerpt

arXiv:2512.02460v2 Announce Type: replace-cross Abstract: Searching and detecting communities in real-world graphs underpins a wide range of applications. Specifically, community search identifies a community for a given query, whereas community detection partitions the entire graph into multiple communities. Although they target different community analysis objectives, both tasks aim to uncover cohesive community structures and are complementary in real-world applications. Despite this connection, current learning-based solutions generally regard them as separate problems, necessitating task- and dataset-specific retraining. This separated learning paradigm limits the applicability and generalization ability of the existing models. To mitigate this limitation, we propose UniCom, a unified framework to solve both community search and detection tasks. UniCom centers on a Universal Graph Learning (UGL) stage that distills local and global community-aware knowledge from multiple source domains. Following UGL, the Domain-aware Specialization (DAS) stage supports on-the-fly adaptation to unseen graphs and tasks through transfer learning, avoiding costly retraining while keeping the model compact. Extensive experiments on both tasks across 16 datasets and 22 baselines have been conducted to ensure a comprehensive, rigorous, and fair evaluation. UniCom consistently outperforms all state-of-the-art baselines across all tasks while maintaining runtime efficiency.

## Standardized Tolerance for Adaptive Reuse and Repair: A Method for HNSW Migration Under Embedding Model Change Scenarios

DevFeed: [Standardized Tolerance for Adaptive Reuse and Repair: A Method for HNSW Migration Under Embedding Model Change Scenarios](<https://devfeed.tech/articles/standardized-tolerance-for-adaptive-reuse-and-repair-a-method-for-hnsw-migration-under-embedding-model-change-scenarios-145736.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25416>)

Author: Hengzhao Ma, Chenyang Zhu, Bin Wang, Xiaochun Yang

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [data migrations](<https://devfeed.tech/topics/data-migrations.md>), [Test-driven development](<https://devfeed.tech/topics/tdd.md>)

Tags: [adaptive](<https://devfeed.tech/tags/adaptive.md>), [change](<https://devfeed.tech/tags/change.md>), [construction](<https://devfeed.tech/tags/construction.md>), [correlation](<https://devfeed.tech/tags/correlation.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embedding-model](<https://devfeed.tech/tags/embedding-model.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [faster](<https://devfeed.tech/tags/faster.md>), [graph](<https://devfeed.tech/tags/graph.md>), [hnsw](<https://devfeed.tech/tags/hnsw.md>), [index](<https://devfeed.tech/tags/index.md>), [indexes](<https://devfeed.tech/tags/indexes.md>), [layer](<https://devfeed.tech/tags/layer.md>), [limits](<https://devfeed.tech/tags/limits.md>), [local](<https://devfeed.tech/tags/local.md>), [median](<https://devfeed.tech/tags/median.md>), [migration](<https://devfeed.tech/tags/migration.md>), [model](<https://devfeed.tech/tags/model.md>), [repair](<https://devfeed.tech/tags/repair.md>), [reuse](<https://devfeed.tech/tags/reuse.md>)

### AI overview

STARR migrates an HNSW index after an embedding model change by reusing suitable source-graph connections. It compares standardized edge lengths for the same neighbor lists in the old and new spaces, uses correlation between distance profiles to set a tolerance, and reconnects affected vertices through searches in the partially migrated graph. The authors bound edge rejection under local distortion and prove a final repair pass restores base-layer reachability from the entry point while respecting degree limits. In single-threaded tests on three million-object collections, STARR reported 5.25-44.54x construction speedups over Fresh and faster migration than both DGM variants on 15 selected transitions. Recall@10 was within one percentage point of Fresh in 10 cases; query throughput exceeded DGM-Local in 14. Across 240 MS MARCO transitions, median speedup was 16.71x with median recall loss of 1.0 percentage point.

### Source excerpt

arXiv:2611.25416v1 Announce Type: new Abstract: When an embedding model changes, the same collection is re-encoded, and its vector index must be adapted to the new embedding space. Because the source and target vectors represent the same objects, suitable connections in the source index can be reused. We propose STARR (Standardized Tolerance for Adaptive Reuse and Repair) to migrate HNSW indexes after an embedding model change. STARR compares standardized edge lengths over the same source neighbor lists in both embedding spaces and uses the correlation between their distance profiles to set the allowable increase in standardized edge length. It reconnects affected vertices by searching the partially migrated graph and shares the resulting candidates with their neighbors. We bound edge rejection under local distance distortion, characterize migration work, and prove that a final repair pass makes every vertex reachable from the entry point at the base layer while respecting degree limits. Single-threaded experiments on MS MARCO, Wikipedia, and CC3M, each with one million objects, show that STARR achieves 5.25--44.54$\times$ construction speedups over Fresh and migrates faster than both DGM variants on all 15 selected transitions. Recall@10 remains within one percentage point of Fresh in 10 cases, and query throughput exceeds DGM-Local in 14 cases. Parameter sweeps on three transitions further demonstrate favorable migration-time--recall tradeoffs beyond the default settings. Across all 240 directed transitions among 16 MS MARCO models, STARR achieves a median construction speedup of 16.71$\times$ with a median recall loss of 1.0 percentage point.

## Variants of Beam Search for DiskANN

DevFeed: [Variants of Beam Search for DiskANN](<https://devfeed.tech/articles/variants-of-beam-search-for-diskann-145739.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26609>)

Author: Viraj Agrawal, Kirankumar Shiragur

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [ann](<https://devfeed.tech/topics/ann.md>)

Tags: [ann](<https://devfeed.tech/tags/ann.md>), [approximate-nearest-neighbor](<https://devfeed.tech/tags/approximate-nearest-neighbor.md>), [beam-search](<https://devfeed.tech/tags/beam-search.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-ds](<https://devfeed.tech/tags/cs-ds.md>), [cs-ir](<https://devfeed.tech/tags/cs-ir.md>), [diskann](<https://devfeed.tech/tags/diskann.md>), [graph](<https://devfeed.tech/tags/graph.md>), [search](<https://devfeed.tech/tags/search.md>)

### AI overview

The paper generalizes guarantees for adaptive beam search (ABS): on α-reachable graphs it proves approximation factor (α+1)/(α(γ+1)−1) for any metric, with a tighter bound for sorted α-reachable graphs under ℓ2. It also introduces a beam predictor trained to minimize mean distance computations while meeting a target recall. Across three 100-million-point benchmarks, on SSD indices at matched recall, it reduces mean query latency by up to 29.6% versus classical beam search (CBS). Against ABS it is faster in 11 of 15 settings, by up to 6.5%, and no more than 1.4% slower in the other four; at 95% recall its advantage over ABS is larger for 500 neighbors than 100. In memory, it uses 1.3-23.7% fewer distance computations than CBS and 0.0-3.9% fewer than ABS.

### Source excerpt

arXiv:2611.26609v1 Announce Type: cross Abstract: Graph-based data structures such as DiskANN, HNSW, and NSG constitute the state of the art for large-scale approximate nearest-neighbor (ANN) search. Indyk and Xu introduced the notion of $\alpha$-reachable graphs, which include graphs built by DiskANN's slow-preprocessing construction, and proved that greedy search achieves an approximation factor of $\tfrac{\alpha+1}{\alpha-1}$. Independently, Al-Jazzazi et al. proposed adaptive beam search (ABS) with a relaxation parameter $\gamma > 0$, showing a $\tfrac{2}{\gamma}$ approximation on navigable graphs ($\alpha \approx 1$), where greedy search admits no guarantees. In this work, we unify and generalize these results by proving that ABS with parameter $\gamma$ on $\alpha$-reachable graphs achieves an approximation of $\tfrac{\alpha+1}{\alpha(\gamma+1)-1}$ for any metric. Moreover, on sorted $\alpha$-reachable graphs (introduced by Gollapudi et al.) under the $\ell_2$ metric, we obtain the tighter bound $\max\bigl(\tfrac{\alpha}{\alpha(\gamma+1)-1}, \tfrac{\alpha^{2}+1}{\alpha^{2}(\gamma+1)-1}\bigr)$. Beyond these theoretical results, we design a beam predictor using features inspired by fine-grained analysis of ABS, trained via a constrained objective that minimizes mean distance computations subject to a target recall. On three 100-million-point benchmarks, using graphs built by DiskANN's practical construction, beam predictor lowers mean query latency on SSD-resident indices at matched recall by up to $29.6\%$ relative to classical beam search (CBS). Relative to ABS, it is faster in $11$ of $15$ settings, by up to $6.5\%$, and at most $1.4\%$ slower in the other $4$; at $95\%$ recall, its advantage over ABS grows from $0.8$--$4.2\%$ for $100$ neighbors to $4.6$--$5.6\%$ for $500$ neighbors. In memory, it needs $1.3$--$23.7\%$ fewer distance computations than CBS and $0.0$--$3.9\%$ fewer than ABS.

## Bridging the Discovery Gap in Solid Dataspaces with a Semantic Data Catalog

DevFeed: [Bridging the Discovery Gap in Solid Dataspaces with a Semantic Data Catalog](<https://devfeed.tech/articles/bridging-the-discovery-gap-in-solid-dataspaces-with-a-semantic-data-catalog-145740.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26611>)

Author: Florian H\\"olken, Alexander Paulus, Tobias Meisen, Andr\\'e Pomp

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [Data Space](<https://devfeed.tech/topics/data-space.md>)

Tags: [accessibility](<https://devfeed.tech/tags/accessibility.md>), [catalog](<https://devfeed.tech/tags/catalog.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [data-catalog](<https://devfeed.tech/tags/data-catalog.md>), [decentralized](<https://devfeed.tech/tags/decentralized.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [interoperability](<https://devfeed.tech/tags/interoperability.md>), [open-data](<https://devfeed.tech/tags/open-data.md>), [pods](<https://devfeed.tech/tags/pods.md>), [reuse](<https://devfeed.tech/tags/reuse.md>), [semantic](<https://devfeed.tech/tags/semantic.md>), [smart-city](<https://devfeed.tech/tags/smart-city.md>), [solid](<https://devfeed.tech/tags/solid.md>)

### AI overview

Solid can offer a lighter path to building dataspaces than concept-heavy architectures such as IDSA- and Gaia-X-based systems, but decentralized Solid deployments lack built-in catalog mechanisms for finding data across servers and pods. The paper proposes a FAIR-compliant catalog that uses semantic models to describe available data sources and standardized metadata to support discovery, accessibility, interoperability, and reuse. The abstract presents this as a way to improve Solid dataspace usability, including in potential settings such as smart cities; it does not provide implementation details or evaluation results.

### Source excerpt

arXiv:2611.26611v1 Announce Type: new Abstract: Dataspaces are an emerging concept to enable secure and controlled data sharing between multiple stakeholders. However, most existing dataspace architectures, such as those based on the concepts of IDSA (International Data Spaces Association) and Gaia-X, are heavily concept-driven and require significant effort to implement, making it difficult to quickly build a functional dataspace. Solid (Social Linked Data) offers a compelling alternative by providing a lighter and more practical approach. However, for Solid to function as a true dataspace, like traditional dataspaces, it must be built in a decentralized manner, i.e., the dataspace must consist of more than a single Solid server. However, this decentralization introduces a key challenge: Data Discovery. Unlike traditional dataspace architectures, which often include predefined components such as data catalogs to facilitate data discovery and access, Solid does not inherently provide such mechanisms. As a result, managing and locating relevant data across multiple Solid servers and pods becomes a significant barrier to usability. To address this gap, we present a FAIR-compliant data catalog for Solid. Our catalog follows the FAIR principles (Findability, Accessibility, Interoperability, and Reusability) by integrating semantic models that describe all available data sources within the Solid ecosystem. This approach enables enhanced data discovery, improves accessibility through standardized metadata, enhances interoperability between different data sources, and promotes data reuse across applications. By bridging this critical gap, our catalog improves the usability of Solid-based dataspaces, making them a viable option for decentralized and open data ecosystems, such as smart city applications.

## ShapleyPipe: A Game-Theoretic Approach to Data Preparation Pipeline Construction

DevFeed: [ShapleyPipe: A Game-Theoretic Approach to Data Preparation Pipeline Construction](<https://devfeed.tech/articles/shapleypipe-a-game-theoretic-approach-to-data-preparation-pipeline-construction-145728.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2510.27168>)

Author: Jing Chang, Shuyuan Zheng, Jinbin Huang, Chang Liu, Jianbin Qin

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Advanced AI workflows](<https://devfeed.tech/topics/advanced-ai-workflows.md>), [Feature Engineering](<https://devfeed.tech/topics/feature-engineering.md>)

Tags: [automated](<https://devfeed.tech/tags/automated.md>), [classification](<https://devfeed.tech/tags/classification.md>), [coherence](<https://devfeed.tech/tags/coherence.md>), [construction](<https://devfeed.tech/tags/construction.md>), [contribution](<https://devfeed.tech/tags/contribution.md>), [contributions](<https://devfeed.tech/tags/contributions.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [data-preparation](<https://devfeed.tech/tags/data-preparation.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [framework](<https://devfeed.tech/tags/framework.md>), [frontier](<https://devfeed.tech/tags/frontier.md>), [game](<https://devfeed.tech/tags/game.md>), [machine](<https://devfeed.tech/tags/machine.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [practical](<https://devfeed.tech/tags/practical.md>), [rank](<https://devfeed.tech/tags/rank.md>), [records](<https://devfeed.tech/tags/records.md>), [reduce](<https://devfeed.tech/tags/reduce.md>), [scaling](<https://devfeed.tech/tags/scaling.md>), [transformation](<https://devfeed.tech/tags/transformation.md>)

### AI overview

ShapleyPipe builds data preparation pipelines by estimating each operator's position-dependent contribution to downstream model utility. Its Pipeline Shapley value distinguishes repeated uses of the same operator type, and the framework selects and orders operators using those contributions. Hierarchical ShapleyPipe (H-SP) makes the approach more practical through representative selection based on a Category Coherence Assumption and adaptive early termination. Across 27 classification datasets, H-SP reports the highest average accuracy (0.847) and best average rank among evaluated practical methods, on the empirical accuracy-runtime Pareto frontier. On three datasets with up to 581K records, searching 10K subsamples with 16 workers averaged 891 seconds and accuracy of 0.705.

### Source excerpt

arXiv:2510.27168v2 Announce Type: replace Abstract: Data preparation is a critical yet highly time-consuming component of machine learning (ML) workflows and has a substantial impact on downstream model performance. Automated data preparation pipeline construction requires selecting appropriate operators, such as missing-value imputation, feature scaling, and feature transformation, and placing them at suitable pipeline positions. However, existing methods lack a principled and interpretable mechanism for understanding the marginal contribution of each operator at a specific position. To address this limitation, we study data preparation pipeline construction from a cooperative game-theoretic perspective. We formulate the task as a pipeline construction game, in which operators act as players that cooperatively improve downstream model utility. Based on this formulation, we propose the Pipeline Shapley value (PipeShapley), a contribution-attribution method that explicitly captures position-dependent contributions and distinguishes repeated occurrences of the same operator type. Building on PipeShapley, we introduce ShapleyPipe, an interpretable pipeline construction framework that selects and orders operators according to their position-aware contributions. To make PipeShapley practical, we develop Hierarchical ShapleyPipe (H-SP) based on a Category Coherence Assumption to exploit coherent contribution patterns, combining MAB-based representative selection with adaptive early termination. Experiments on 27 classification datasets show that H-SP achieves the highest average accuracy of 0.847 and the best average rank among the evaluated practical methods, while lying on the empirical accuracy--runtime Pareto frontier. On three datasets with up to 581K records, 10K-subsample search and 16-worker parallel execution reduce the average wall-clock time to 891 seconds while retaining the highest average accuracy of 0.705.

## Continuous Prompts: LLM-Augmented Pipeline Processing over Unstructured Streams

DevFeed: [Continuous Prompts: LLM-Augmented Pipeline Processing over Unstructured Streams](<https://devfeed.tech/articles/continuous-prompts-llm-augmented-pipeline-processing-over-unstructured-streams-145730.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2512.03389>)

Author: Shu Chen, Deepti Raghavan, U\\u{g}ur \\c{C}etintemel

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [stream-processing](<https://devfeed.tech/topics/stream-processing.md>), [streaming data analytics](<https://devfeed.tech/topics/streaming-data-analytics.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [batching](<https://devfeed.tech/tags/batching.md>), [bayesian](<https://devfeed.tech/tags/bayesian.md>), [continuous](<https://devfeed.tech/tags/continuous.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-reasoning](<https://devfeed.tech/tags/llm-reasoning.md>), [long-running](<https://devfeed.tech/tags/long-running.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [operator](<https://devfeed.tech/tags/operator.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [pipelines](<https://devfeed.tech/tags/pipelines.md>), [probing](<https://devfeed.tech/tags/probing.md>), [queries](<https://devfeed.tech/tags/queries.md>), [rag](<https://devfeed.tech/tags/rag.md>), [stream](<https://devfeed.tech/tags/stream.md>), [stream-processing](<https://devfeed.tech/tags/stream-processing.md>), [streams](<https://devfeed.tech/tags/streams.md>)

### AI overview

Continuous Prompts (CPs) brings persistent LLM reasoning to stream processing by extending retrieval-augmented generation to streaming data and defining continuous semantic operators. Implemented in VectraFlow, it offers multiple implementations, mainly LLM-based plus an embedding-based variant. Tuple batching and operator fusion improve efficiency at the cost of accuracy. To manage that trade-off, CPs uses lightweight shadow executions and cost-aware multi-objective Bayesian optimization to learn throughput-accuracy frontiers and adapt plans within probing budgets. The abstract reports evaluations with operator microbenchmarks and real-dataset pipelines, finding that VectraFlow adapts to workload changes and sustains semantic queries over evolving unstructured streams.

### Source excerpt

arXiv:2512.03389v2 Announce Type: replace Abstract: Monitoring unstructured streams increasingly requires persistent, semantics-aware computation, yet today's LLM frameworks remain stateless and one-shot, limiting their usefulness for long-running analytics. We introduce Continuous Prompts (CPs), the first framework that brings LLM reasoning into continuous stream processing. CPs extend RAG to streaming settings, define continuous semantic operators, and provide multiple implementations, primarily focusing on LLM-based approaches but also reporting one embedding-based variants. Furthermore, we study two LLM-centric optimizations, tuple batching and operator fusion, to significantly improve efficiency while managing accuracy loss. Because these optimizations inherently trade accuracy for speed, we present a dynamic optimization framework that uses lightweight shadow executions and cost-aware multi-objective Bayesian optimization (MOBO) to learn throughput-accuracy frontiers and adapt plans under probing budgets. We implement CPs in the VectraFlow stream processing system. Using operator-level microbenchmarks and streaming pipelines on real datasets, we show that VectraFlow can adapt to workload dynamics, navigate accuracy-efficiency trade-offs, and sustain persistent semantic queries over evolving unstructured streams.

## ProvCards: Artifact-Oriented Provenance for Heterogeneous Scientific Workflows

DevFeed: [ProvCards: Artifact-Oriented Provenance for Heterogeneous Scientific Workflows](<https://devfeed.tech/articles/provcards-artifact-oriented-provenance-for-heterogeneous-scientific-workflows-142291.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24894>)

Author: Tanja Auge, Marinus Holitschke, Meike Klettke

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [reproducibility](<https://devfeed.tech/topics/reproducibility.md>), [Data pipelines](<https://devfeed.tech/topics/data-pipelines.md>), [RDF (Resource Description Framework)](<https://devfeed.tech/topics/rdf.md>)

Tags: [cs-db](<https://devfeed.tech/tags/cs-db.md>), [data-processing](<https://devfeed.tech/tags/data-processing.md>), [provenance](<https://devfeed.tech/tags/provenance.md>), [querying](<https://devfeed.tech/tags/querying.md>), [reproducibility](<https://devfeed.tech/tags/reproducibility.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

ProvCards captures workflow provenance as portable artifacts grounded in the W3C PROV Data Model. Components can independently create, exchange, reuse, and compose cards without relying on a particular workflow system or centralized execution context. ProvDecks group related cards while preserving their identities; derived ProvGraphs support reconstruction, querying, visualization, and analysis. A graph-based implementation evaluated in a scientific data-processing workflow demonstrated component-level capture, cross-component composition, and reconstruction. The evidence is limited to the abstract and does not specify comparative performance or broader evaluation results.

### Source excerpt

arXiv:2611.24894v1 Announce Type: new Abstract: Reproducibility in scientific workflows is hindered by heterogeneous components and execution environments, as well as fragmented provenance capture. Although existing approaches offer established semantics and workflow-specific solutions, provenance remains difficult to capture, exchange, and compose across workflow boundaries. We present ProvCards, an artifact-oriented approach that treats provenance as a first-class artifact grounded in the W3C PROV Data Model. Individual workflow components can generate cards that are stored, exchanged, reused, and composed independently of any workflow system or centralized execution context. ProvDecks group related cards into portable scopes while preserving their identities. ProvGraphs provide derived views for provenance reconstruction, querying, visualization, and analysis. Together, these representations support coherent, task-specific provenance views across heterogeneous components, facilitating traceability, reuse, and reproducibility. We implement ProvCards using a graph-based infrastructure and evaluate them in a scientific data-processing workflow. The results demonstrate independent provenance capture at the component level, composition across component boundaries, and reconstruction for querying and analysis. ProvCards provide a portable, composable, and incrementally extensible foundation for provenance management in heterogeneous scientific workflows.

## VOS: Variate Ordering Strategies for Skyline Query Optimization

DevFeed: [VOS: Variate Ordering Strategies for Skyline Query Optimization](<https://devfeed.tech/articles/vos-variate-ordering-strategies-for-skyline-query-optimization-142284.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2608.26464>)

Author: Abhinav Gorantla, Pratanu Mandal, K. Sel\\c{c}uk Candan, Maria Luisa Sapino

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [database-optimization](<https://devfeed.tech/topics/database-optimization.md>), [ordering](<https://devfeed.tech/topics/ordering.md>), [Query (disambiguation)](<https://devfeed.tech/topics/query.md>)

Tags: [algorithms](<https://devfeed.tech/tags/algorithms.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [ordering](<https://devfeed.tech/tags/ordering.md>), [overhead](<https://devfeed.tech/tags/overhead.md>), [query](<https://devfeed.tech/tags/query.md>), [query-optimization](<https://devfeed.tech/tags/query-optimization.md>), [scalar](<https://devfeed.tech/tags/scalar.md>), [simd](<https://devfeed.tech/tags/simd.md>)

### AI overview

VOS targets a gap in skyline query optimization: reducing tuple-pair dominance checks may not reduce execution work when each check evaluates only some preference attributes. The paper argues that both tuple-level checks and total per-attribute comparisons matter, and proposes strategies for ordering attributes (variates) to reduce redundant comparisons. Experiments on synthetic and real-world datasets, using scalar and SIMD architectures, reportedly reduce computational overhead and improve skyline query performance.

### Source excerpt

arXiv:2608.26464v2 Announce Type: replace Abstract: Efficiency of skyline algorithms is highly influenced by the underlying data characteristics. Traditionally, optimization efforts have focused on minimizing the total number of tuple-pair dominance checks to improve query performance. However, in practice, a dominance check between two tuples does not necessarily require evaluating dominance relationships for each and every preference attribute of the data and this creates a disconnect between dominance checks optimization and query execution performance. In this paper, we argue that skyline algorithms need to optimize total per-attribute dominance checks, along with per-tuple dominance checks and that, for both of these goals, the ordering of the attributes (or variates) can have a substantial impact on the efficiency of skyline computation. Based on this premise, we present several strategies for identifying an effective variate order to minimize redundant attribute comparisons. Extensive experiments on both synthetic and real-world datasets, and on both scalar and SIMD architectures, confirm the effectiveness of the proposed approach in reducing computational overhead and improving skyline query performance.

## Exploring Agentic Visual Analytics: A Co-Evolutionary Framework of Roles and Workflows

DevFeed: [Exploring Agentic Visual Analytics: A Co-Evolutionary Framework of Roles and Workflows](<https://devfeed.tech/articles/exploring-agentic-visual-analytics-a-co-evolutionary-framework-of-roles-and-workflows-142282.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2604.15813>)

Author: Tianqi Luo, Leixian Shen, Yuyu Luo

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [Agentic AI](<https://devfeed.tech/topics/what-is-agentic-ai.md>), [agentic workflows](<https://devfeed.tech/topics/agentic-workflows.md>), [Data visualization](<https://devfeed.tech/topics/data-visualization.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [human computer interaction](<https://devfeed.tech/topics/human-computer-interaction.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agents](<https://devfeed.tech/tags/agents.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analytics-pipeline](<https://devfeed.tech/tags/analytics-pipeline.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-agents](<https://devfeed.tech/tags/autonomous-agents.md>), [autonomy](<https://devfeed.tech/tags/autonomy.md>), [based](<https://devfeed.tech/tags/based.md>), [browser](<https://devfeed.tech/tags/browser.md>), [class](<https://devfeed.tech/tags/class.md>), [context](<https://devfeed.tech/tags/context.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [data](<https://devfeed.tech/tags/data.md>), [exploring](<https://devfeed.tech/tags/exploring.md>), [framework](<https://devfeed.tech/tags/framework.md>), [roles](<https://devfeed.tech/tags/roles.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

The paper surveys 55 agentic visual analytics systems and proposes a framework that tracks agent autonomy alongside changing human roles, from manual operators to strategic supervisors. Its taxonomy maps four agent roles--PLANNER, CREATOR, REVIEWER, and CONTEXT MANAGER--to stages of the visual analytics workflow. The authors identify recurring trade-offs across autonomy, roles, and workflow, then offer design guidelines and future research directions. The overview is based on the supplied abstract.

### Source excerpt

arXiv:2604.15813v2 Announce Type: replace Abstract: Agentic visual analytics (VA) represents an emerging class of systems in which large language model (LLM)-driven agents autonomously plan, execute, evaluate, and iterate across the full visual analytics pipeline. By shifting users from low-level tool operations to high-level analytical goals expressed through natural language, these systems are fundamentally transforming how humans interact with data. However, the rapid proliferation of such systems in recent years has outpaced our understanding of their design landscape. Two intertwined problems remain open: how do autonomous agents reshape the traditional VA pipeline, and how must human involvement adapt as agent autonomy increases? To address these questions, this paper presents a comprehensive survey of 55 primary agentic VA systems and introduces a co-evolutionary framework. This framework is essential because it jointly analyzes the progression of agent autonomy alongside the necessary shift in human roles from manual operators to strategic supervisors. Within this framework, we define a role-workflow taxonomy that aligns four key agentic roles (PLANNER, CREATOR, REVIEWER, and CONTEXT MANAGER) and maps them onto established VA pipeline stages. Our analysis uncovers recurring trade-offs along three foundational axes: autonomy levels, agentic roles, and the VA workflow. We consolidate these findings into actionable design guidelines and outline future research directions for agentic visual analytics. A web-based interactive browser of our co-evolutionary framework, including the corpus and design guidelines, is available at agenticva.github.io/AgenticVA/.

## Towards Online Adaptive LLM-based Semantic Filtering

DevFeed: [Towards Online Adaptive LLM-based Semantic Filtering](<https://devfeed.tech/articles/towards-online-adaptive-llm-based-semantic-filtering-142289.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24518>)

Author: Ziqi Zou, Zhenyan Nie, Kangfei Zhao, Zhiwei Zhang, Aoqian Zhang, Peng Wu, Xuefeng Zhao

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>)

Tags: [adaptive](<https://devfeed.tech/tags/adaptive.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [llm](<https://devfeed.tech/tags/llm.md>), [online](<https://devfeed.tech/tags/online.md>), [semantic](<https://devfeed.tech/tags/semantic.md>)

### AI overview

OASIS reduces the cost and latency of LLM-based semantic filtering by combining a document similarity graph with query-specific proxy learning and adaptive sampling. For each query, a graph attention network scores documents; density-aware active learning selects informative labels and stops when more labels are unlikely to help. Calibration sets also grow adaptively to the query's score distribution. In reported experiments, at 0.9 accuracy, OASIS cut online latency by 1.75x-5.42x and reduced the number of documents processed by an LLM by 35%-75% versus state-of-the-art methods.

### Source excerpt

arXiv:2611.24518v1 Announce Type: new Abstract: Large language models (LLMs) enable semantic filtering over unstructured documents using natural language predicates, but invoking an oracle LLM on every document incurs prohibitive monetary cost and online latency. Existing model-cascade approaches reduce this cost by using a lightweight proxy model to score each document and forwarding only uncertain documents to the oracle. However, their proxy models have limited generalization capability, and they typically adopt fixed sampling budgets for proxy training and threshold calibration, which insufficiently adapts to diverse online queries. To address this, we present OASIS, an online adaptive framework for LLM-based semantic filtering. OASIS combines a query-agnostic document similarity prior with query-adaptive online learning and sampling. In the offline phase, OASIS utilizes query-agnostic document similarity as a prior and constructs a document navigating spread-out graph (NSG) over document embeddings. For each online query, OASIS trains a query-conditioned graph attention network over the document NSG to obtain proxy scores through semi-supervised node classification. To allocate labels effectively, OASIS adopts density-aware active learning to explore uncertain score regions, selectively annotate informative documents, retrain the proxy, and stop early when additional labels are unlikely to improve the cascade. During threshold calibration, OASIS progressively samples an adaptively sized calibration set, adapting calibration cost to the query's score distribution. Extensive experiments demonstrate that OASIS achieves a 1.75x-5.42x reduction in online latency and reduces the number of LLM-processed documents by 35%-75% relative to the state-of-the-art methods at an achieved accuracy of 0.9.

## Cascadeability and the Realization Gap: An Empirical Study of LLM-Powered Semantic Filtering

DevFeed: [Cascadeability and the Realization Gap: An Empirical Study of LLM-Powered Semantic Filtering](<https://devfeed.tech/articles/cascadeability-and-the-realization-gap-an-empirical-study-of-llm-powered-semantic-filtering-142288.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23898>)

Author: Nan Hou, Kangfei Zhao, Jiadong Xie, Jeffrey Xu Yu

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [bottlenecks](<https://devfeed.tech/tags/bottlenecks.md>), [cascade](<https://devfeed.tech/tags/cascade.md>), [class](<https://devfeed.tech/tags/class.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [proxy](<https://devfeed.tech/tags/proxy.md>), [query-processing](<https://devfeed.tech/tags/query-processing.md>), [questions](<https://devfeed.tech/tags/questions.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [reduction](<https://devfeed.tech/tags/reduction.md>), [release](<https://devfeed.tech/tags/release.md>), [semantic](<https://devfeed.tech/tags/semantic.md>), [stage](<https://devfeed.tech/tags/stage.md>), [study](<https://devfeed.tech/tags/study.md>), [systems](<https://devfeed.tech/tags/systems.md>), [target](<https://devfeed.tech/tags/target.md>)

### AI overview

The abstract presents a benchmark of four LLM semantic-filtering systems and argues that oracle-call reduction alone does not show whether poor results stem from weak proxies or threshold calibration. It defines cascadeability as the maximum empirical oracle reduction possible from fixed proxy scores at a target accuracy, measured retrospectively with complete oracle labels. Comparing this ceiling with achieved reduction yields a realization gap that, alongside accuracy, helps distinguish proxy and calibration bottlenecks. The benchmark covers 10 real-world workloads with annotations from two LLM families; the abstract says it examines proxy quality, end-to-end performance, workload sensitivities, and component ablations, but does not report specific comparative results.

### Source excerpt

arXiv:2611.23898v1 Announce Type: new Abstract: Semantic filters enable natural language predicates over unstructured documents, but evaluating every document with a large language model (LLM) oracle is expensive. Proxy cascades reduce oracle invocations using cheaper surrogates, but oracle reduction alone cannot distinguish proxy limitations from calibration bottlenecks and establish practical efficiency. We present a unified benchmark of four representative systems, which formulate query processing as a three-stage workflow comprising proxy construction, threshold calibration, and cascade inference, using a two-threshold acceptance rule. We introduce cascadeability: the maximum empirical oracle reduction attainable from fixed proxy scores at a specified accuracy target, computed retrospectively using complete oracle labels. We investigate 8 research questions, spanning proxy quality, end-to-end performance, workload sensitivities, and component ablations, and reveal our key findings accordingly. Comparing cascadeability with achieved oracle reduction yields a realization gap that, interpreted alongside accuracy, exposes distinct proxy and calibration bottlenecks. The benchmark and diagnostics support evaluation beyond oracle reduction and motivate joint proxy-calibration design, class-sensitive quality assessment, and end-to-end cost optimization. We release a dataset-query benchmark, containing 10 real-world workloads across various domains and difficulties, with annotations of two LLM families.

## The Value Semantics Layer: Enabling Machine-Understandable Databases for Agentic AI

DevFeed: [The Value Semantics Layer: Enabling Machine-Understandable Databases for Agentic AI](<https://devfeed.tech/articles/the-value-semantics-layer-enabling-machine-understandable-databases-for-agentic-ai-142286.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23629>)

Author: Jalal Mahmud, Eser Kandogan

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [semantic-layer](<https://devfeed.tech/topics/semantic-layer.md>), [Agentic AI](<https://devfeed.tech/topics/what-is-agentic-ai.md>), [Data Management](<https://devfeed.tech/topics/data-management.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [abstraction](<https://devfeed.tech/tags/abstraction.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-native](<https://devfeed.tech/tags/ai-native.md>), [analysts](<https://devfeed.tech/tags/analysts.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [assertions](<https://devfeed.tech/tags/assertions.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [bridging](<https://devfeed.tech/tags/bridging.md>), [but](<https://devfeed.tech/tags/but.md>), [concepts](<https://devfeed.tech/tags/concepts.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [databases](<https://devfeed.tech/tags/databases.md>), [layer](<https://devfeed.tech/tags/layer.md>), [machine](<https://devfeed.tech/tags/machine.md>), [semantics](<https://devfeed.tech/tags/semantics.md>), [value](<https://devfeed.tech/tags/value.md>)

### AI overview

The Value Semantics Layer (VSL) is proposed as persistent, planner-visible infrastructure for representing operational semantics in databases used by LLM-powered agents and human analysts. It adds reusable Value Semantic Types (VSTs)--assertions about distributional, relational, process, quantitative, and policy-grounded semantics--to existing schemas, catalogs, lineage, and governance metadata. The proposal says planners can use VSTs to validate analytical operations, select appropriate operators, and guide workflows. The abstract reports motivation, formalization, architecture, and prototype realizations, and outlines further research; it does not specify implementation details or evaluation results.

### Source excerpt

arXiv:2611.23629v1 Announce Type: new Abstract: As data systems increasingly support autonomous LLM-powered agents alongside human analysts, they require richer semantic infrastructure bridging analytical concepts and analytical operations. Existing metadata systems expose schemas, catalogs, lineage, and governance information, but provide limited support for representing operational semantics. We propose the Value Semantics Layer (VSL), an architectural abstraction that externalizes value semantics as persistent, planner-visible infrastructure. VSL introduces Value Semantic Types (VSTs), reusable operational semantic assertions capturing distributional, relational, process, quantitative, and policy-grounded semantics. Unlike descriptive metadata, VSTs enable planners to validate analytical operations, select appropriate operators, and guide analytical workflows. We present the motivation, formalization, architecture, and prototype realizations of VSL, and outline a research agenda toward AI-native semantic infrastructure for analytical systems.

## MetaSieve: Faster Relational Deep Learning through SQL-Based Metapath Selection

DevFeed: [MetaSieve: Faster Relational Deep Learning through SQL-Based Metapath Selection](<https://devfeed.tech/articles/metasieve-faster-relational-deep-learning-through-sql-based-metapath-selection-142283.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2608.25903>)

Author: Fahim Shahriar Khan, Ashraf Aboulnaga

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [rdbms](<https://devfeed.tech/topics/rdbms.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [JOIN](<https://devfeed.tech/topics/join.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>), [Deep neural networks](<https://devfeed.tech/topics/deep-neural-networks.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [deep-learning](<https://devfeed.tech/tags/deep-learning.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [faster](<https://devfeed.tech/tags/faster.md>), [gnn](<https://devfeed.tech/tags/gnn.md>), [relational-databases](<https://devfeed.tech/tags/relational-databases.md>), [selection](<https://devfeed.tech/tags/selection.md>), [sql](<https://devfeed.tech/tags/sql.md>), [time](<https://devfeed.tech/tags/time.md>)

### AI overview

MetaSieve reduces the subgraphs used to train relational graph neural networks by pruning metapaths that appear uninformative, aiming to cut training time while maintaining accuracy. For each candidate metapath extension, it uses SQL joins and aggregations to calculate statistics, then scores the candidate for low cost and informativeness; extensions below a threshold are pruned. The selection layer relies on database statistics and task labels, not GNN parameters, and is designed to work with different GNN architectures for classification and regression. On RelBench with multiple GNN backbones, the authors report large per-epoch training-time reductions while maintaining and often improving accuracy.

### Source excerpt

arXiv:2608.25903v2 Announce Type: replace Abstract: Relational Deep Learning (RDL) is an effective approach to machine learning over multi-table relational databases. In RDL, a database is modeled as a graph in which each row is a node and each foreign-key relation is an edge, and a graph neural network (GNN) is trained on this graph. Training a GNN requires sampling a subgraph around every seed node in the training set, and the cost of training is largely determined by the size of these subgraphs. This paper aims to reduce subgraph size by leveraging the join and aggregation capabilities of relational database systems. We observe that sampled subgraphs are obtained by following metapaths composed of foreign-key links, and that many of these metapaths can be pruned without loss of accuracy. We present MetaSieve, a metapath selection layer that determines which metapaths to retain and which to prune. For each candidate metapath extension, MetaSieve computes statistics via SQL join and aggregation queries and evaluates the extension based on a novel scoring function that prefers lightweight but informative candidates. Metapaths whose scores fall below a threshold are deemed uninformative and pruned. Metapath selection in MetaSieve is lightweight since it relies only on database statistics and task labels, and it is independent of GNN parameters, so it integrates with diverse GNN architectures for classification and regression. Our evaluation on the RelBench benchmark with multiple GNN backbones shows that MetaSieve consistently reduces per-epoch training time by large margins while maintaining and often improving accuracy.

## Logical Design Tuning via Workload-aware E/R-to-Relational Mapping

DevFeed: [Logical Design Tuning via Workload-aware E/R-to-Relational Mapping](<https://devfeed.tech/articles/logical-design-tuning-via-workload-aware-e-r-to-relational-mapping-142287.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23632>)

Author: Hasara Kalumin, Amol Deshpande

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [data-modeling](<https://devfeed.tech/topics/data-modeling.md>), [schema design](<https://devfeed.tech/topics/schema-design.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [rdbms](<https://devfeed.tech/topics/rdbms.md>)

Tags: [applications](<https://devfeed.tech/tags/applications.md>), [approach](<https://devfeed.tech/tags/approach.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [automatically](<https://devfeed.tech/tags/automatically.md>), [based](<https://devfeed.tech/tags/based.md>), [challenge](<https://devfeed.tech/tags/challenge.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [data](<https://devfeed.tech/tags/data.md>), [design](<https://devfeed.tech/tags/design.md>), [designer](<https://devfeed.tech/tags/designer.md>), [execution](<https://devfeed.tech/tags/execution.md>), [execution-plan](<https://devfeed.tech/tags/execution-plan.md>), [existing](<https://devfeed.tech/tags/existing.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [fixed](<https://devfeed.tech/tags/fixed.md>), [flexibility](<https://devfeed.tech/tags/flexibility.md>), [framework](<https://devfeed.tech/tags/framework.md>), [inheritance](<https://devfeed.tech/tags/inheritance.md>), [logical](<https://devfeed.tech/tags/logical.md>), [mapping](<https://devfeed.tech/tags/mapping.md>)

### AI overview

The paper presents a cost-based framework that chooses a relational schema for an E/R model using a representative workload. It optimizes choices for inheritance and entity and relationship representations, then compiles user E/R queries to SQL so existing relational optimizers can choose physical plans. Experiments on real-world-inspired schemas report that fixed and heuristic mappings vary widely in performance across workloads, while the proposed method achieves competitive performance and avoids pathological cases. The supplied text does not provide quantitative results or implementation details.

### Source excerpt

arXiv:2611.23632v1 Announce Type: new Abstract: Conceptual data models, like the E/R model, can provide a more stable and intuitive user-facing interface and better logical independence for applications, compared to the relational model which is forced to closely mirror the physical representation. However, this flexibility introduces a challenge as well as an opportunity: a single conceptual schema admits many semantically equivalent relational schemas, whose performance can differ substantially across workloads. Traditional mapping methods use a set of predefined transformation rules or designer-selected mapping strategies, rather than optimizing the relational realization with respect to the expected workload. In this paper, we present a cost-based framework for workload-aware conceptual-to-relational mapping. Given an E/R schema and a representative workload, our framework automatically selects an efficient relational schema by optimizing mapping decisions, including inheritance, entity and relationship representations. User-specified E/R queries are compiled into SQL over the selected relational realization, allowing existing relational query optimizers to determine the physical execution plan. Experiments on real-world-inspired schemas show that mapping choices strongly affect performance; fixed or heuristic strategies exhibit large variability across workloads, whereas our approach consistently achieves competitive performance avoiding pathological cases.

## DispersedBFT: Bottleneck-Free Primary-Backup Consensus using Dispersed Replication

DevFeed: [DispersedBFT: Bottleneck-Free Primary-Backup Consensus using Dispersed Replication](<https://devfeed.tech/articles/dispersedbft-bottleneck-free-primary-backup-consensus-using-dispersed-replication-142290.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24833>)

Author: Nancy Kansal, Celine Sana, Jelle Hellings

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>), [arXiv: Distributed Computing](<https://devfeed.tech/sources/arxiv-distributed-computing.md>)

Topics: [Distributed Systems & Parallel Computing](<https://devfeed.tech/topics/distributed-systems-parallel-computing.md>), [consensus algorithm](<https://devfeed.tech/topics/consensus-algorithm.md>), [performance-engineering](<https://devfeed.tech/topics/performance-engineering.md>), [Blockchain](<https://devfeed.tech/topics/blockchain.md>)

Tags: [bottleneck](<https://devfeed.tech/tags/bottleneck.md>), [consensus](<https://devfeed.tech/tags/consensus.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-dc](<https://devfeed.tech/tags/cs-dc.md>), [replication](<https://devfeed.tech/tags/replication.md>)

### AI overview

DispersedBFT aims to remove the primary bottleneck in PBFT-like consensus by using information dispersal to distribute request replication from the primary to backup replicas. Its variants trade CPU cost against communication cost: one uses Message Authentication Codes and Merkle proofs for lower CPU cost, while another uses digital signatures for lower communication cost. The abstract reports throughput of 3.4 million transactions per second with 43 replicas, up to 6.2 times faster than PBFT and 2.6 times faster than HotStuff. These are reported experimental results; the supplied text does not provide evaluation details.

### Source excerpt

arXiv:2611.24833v1 Announce Type: new Abstract: The advent of blockchains is fueling the development of novel resilient data management systems (RDSs). Typically, these RDSs are managed using a primary-backup design using a consensus protocol such as PBFT. In these primary-backup designs, a single participant, the primary, is responsible for coordinating the replication and execution of requests. Unfortunately, the central role of the primary makes it a bottleneck that drastically limits performance. In this paper, we propose DispersedBFT, a high performance PBFT-like consensus protocol that utilizes dispersed replication to eliminate the primary bottleneck of PBFT-like consensus. In specific, DispersedBFT uses information dispersal to distribute the task of replicating request from the primary to the backups. We propose several variants of DispersedBFT with either low CPU cost (by using Message Authentication Codes and Merkle proofs) or communication cost (by using digital signatures). We practically analyze the performance of DispersedBFT and show it greatly outperforms PBFT and HotStuff: DispersedBFT supports a throughput of 3.4Mtxn/sec with 43 replicas and is up-to 6.2x faster than PBFT and 2.6x faster than HotStuff.

## MoL-SQL: A Controlled Benchmark for Mixture-of-Language Text-to-SQL

DevFeed: [MoL-SQL: A Controlled Benchmark for Mixture-of-Language Text-to-SQL](<https://devfeed.tech/articles/mol-sql-a-controlled-benchmark-for-mixture-of-language-text-to-sql-140630.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22333>)

Author: Tianqi Luo, Boyan Li, Yuyu Luo

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [text2sql](<https://devfeed.tech/topics/text2sql.md>), [SQL](<https://devfeed.tech/topics/sql.md>), [AI for SQL query generation](<https://devfeed.tech/topics/ai-for-sql-query-generation.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [context](<https://devfeed.tech/tags/context.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [database](<https://devfeed.tech/tags/database.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [execution](<https://devfeed.tech/tags/execution.md>), [language](<https://devfeed.tech/tags/language.md>), [llms](<https://devfeed.tech/tags/llms.md>), [mapping](<https://devfeed.tech/tags/mapping.md>), [question](<https://devfeed.tech/tags/question.md>), [schema](<https://devfeed.tech/tags/schema.md>), [sql](<https://devfeed.tech/tags/sql.md>), [translation](<https://devfeed.tech/tags/translation.md>), [values](<https://devfeed.tech/tags/values.md>)

### AI overview

MoL-SQL tests how question, schema, and stored-value languages independently affect Text-to-SQL while keeping each task aligned. Its pipeline maps cross-lingual entities, migrates databases with constraints, checks rewritten SQL for execution equivalence, and regenerates questions from verified queries. The benchmark includes MoL-Full (16,892 samples) for overall evaluation and MoL-Cube (3,840) for comparing every language combination. Experiments across eight LLMs and four method families found distinct schema and value effects; stored-value language reduced accuracy by up to 23 points, mainly through cross-lingual entity mapping. Question translation and extra reasoning did not close that value gap, while access to target-database values substantially reduced it.

### Source excerpt

arXiv:2611.22333v1 Announce Type: new Abstract: Text-to-SQL systems are usually built and evaluated under a monolingual assumption, yet in international applications users often query databases stored in a different language. Existing multilingual benchmarks mostly translate only the question without aligning schema and value entities, so they can neither locate the source of an accuracy drop nor rule out translation errors. Hence, we introduce MoL-SQL, a benchmark for mixture-of-language Text-to-SQL that switches the languages of the question, schema, and stored values independently while keeping each task fixed, and grades every cross-lingual entity mapping into four difficulty levels. We migrate five Text-to-SQL benchmarks of different domains and source languages through a unified alignment pipeline that builds a shared cross-lingual entity map, migrates each database with its constraints, rewrites the gold SQL under execution-equivalence checks, and regenerates the question from the verified SQL, keeping all language versions of a task aligned in entities, intent, and execution result. MoL-SQL provides two splits: MoL-Full (16,892 samples) for overall evaluation and MoL-Cube (3,840 samples) covering every language combination to isolate question, schema, and value effects. Experiments with eight LLMs and four families of Text-to-SQL methods show that schema and value languages have distinct effects, with stored values costing up to 23 points, and that these effects mainly stem from cross-lingual entity mapping. Neither question translation nor additional reasoning narrows the value gap, whereas access to target-database values substantially reduces it, indicating that mixture-of-language Text-to-SQL benefits most from language-aware context grounding.

## SIMQ: A Single Graph-based Index for Multi-Vector Query

DevFeed: [SIMQ: A Single Graph-based Index for Multi-Vector Query](<https://devfeed.tech/articles/simq-a-single-graph-based-index-for-multi-vector-query-140627.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22079>)

Author: Yifan Lu, Jiabao Jin, Xiaoyao Zhong, Peng Cheng, Xiangyu Wang, Haotian Li, Hua Chen, Junqing Chen, Wei Xi, Heng Tao Shen

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [ann](<https://devfeed.tech/topics/ann.md>), [clustering](<https://devfeed.tech/topics/clustering.md>), [Vectors & LLMs](<https://devfeed.tech/topics/vectors-llms.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [accelerated](<https://devfeed.tech/tags/accelerated.md>), [analysis](<https://devfeed.tech/tags/analysis.md>), [approximation](<https://devfeed.tech/tags/approximation.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [bottlenecks](<https://devfeed.tech/tags/bottlenecks.md>), [candidate](<https://devfeed.tech/tags/candidate.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [clustering](<https://devfeed.tech/tags/clustering.md>), [clusters](<https://devfeed.tech/tags/clusters.md>), [compression](<https://devfeed.tech/tags/compression.md>), [construction](<https://devfeed.tech/tags/construction.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [cs-ir](<https://devfeed.tech/tags/cs-ir.md>), [data](<https://devfeed.tech/tags/data.md>), [graph](<https://devfeed.tech/tags/graph.md>), [index](<https://devfeed.tech/tags/index.md>), [query](<https://devfeed.tech/tags/query.md>), [vector](<https://devfeed.tech/tags/vector.md>)

### AI overview

SIMQ approximates ColBERT-style MaxSim retrieval by grouping token vectors into fine-grained, data-aware clusters, indexing their centroids in one graph, and navigating that graph per query token. The approach avoids building a full centroid interaction matrix and does not require GPU acceleration for this search process; the index is independent of PLAID's residual representation. The paper's theoretical result is conditional on a manifold assumption and successful cell retrieval, under which data-aware partitioning has lower expected approximation error than data-oblivious partitioning. SIMQ+ adds count-based scoring and a dynamic candidate set to improve robustness across query conditions. Evaluation on five benchmarks compares recall, throughput, and construction time against several baselines, primarily on CPU; large-scale PLAID k-means centroids were built on a separate GPU machine. SIMQ is integrated into VSAG.

### Source excerpt

arXiv:2611.22079v1 Announce Type: cross Abstract: Multi-vector retrieval models such as ColBERT achieve state-of-the-art effectiveness by representing documents as sets of token-level vectors and scoring via MaxSim, but their high computational cost limits scalability to large corpora. Existing approximate methods face fundamental bottlenecks: centroid interaction matrix approaches require computing a full matrix at every query and rely on GPU-accelerated clustering, while data-oblivious compression methods yield unstable recall that requires repeated compensation. We propose SIMQ (Single graph Index for Multi-vector Query), a framework that bridges single-vector graph indices and multi-vector retrieval through data-aware sampling-based clustering and per-token graph navigation, simultaneously bypassing all aforementioned bottlenecks. SIMQ organizes all token vectors into fine-grained clusters via data-aware sampling, builds a single graph index over cluster centroids independently of PLAID's residual representation, and approximates the MaxSim score through per-token graph search without materializing any interaction matrix or relying on GPU acceleration. We provide theoretical analysis showing that, under a manifold assumption and successful cell retrieval, data-aware partitioning has a smaller expected approximation error than a data-oblivious partition. Building on this foundation, SIMQ+ further introduces count-based scoring and a dynamic candidate set to improve robustness across varying query conditions. Experiments on five benchmarks compare recall, throughput, and construction time against several baselines, primarily on CPU; large-scale PLAID k-means centroids are built on a separate GPU machine. SIMQ has been integrated into VSAG, an Ant Group's open-source vector search library.

## Errpedia: Is Your Exact $k$-NN Vector Search Really Exact?

DevFeed: [Errpedia: Is Your Exact $k$-NN Vector Search Really Exact?](<https://devfeed.tech/articles/errpedia-is-your-exact-k-nn-vector-search-really-exact-140631.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22474>)

Author: Yinuo Deng, Ying Zhang, Hanchen Wang, Wenjie Zhang

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [floating-point](<https://devfeed.tech/topics/floating-point.md>), [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>), [test data](<https://devfeed.tech/topics/test-data.md>), [ann](<https://devfeed.tech/topics/ann.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [database](<https://devfeed.tech/tags/database.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [error](<https://devfeed.tech/tags/error.md>), [floating-point](<https://devfeed.tech/tags/floating-point.md>), [vector-search](<https://devfeed.tech/tags/vector-search.md>)

### AI overview

Errpedia tests numerical correctness in exact k-nearest-neighbor vector search, where floating-point rounding and overflow can produce mathematically wrong results. It contains 1,616 queries across 21 error categories, with ground truth verified using exact rational arithmetic. In tests of 20 library and database configurations, every configuration returned an incorrect top-10 result set on at least one applicable query. Reported failures include misranking nearly equidistant vectors, one library omitting all 10 exact matches for a query, and several systems returning fewer than k neighbors. The authors present Errpedia as a reproducible benchmark for checking implementations.

### Source excerpt

arXiv:2611.22474v1 Announce Type: new Abstract: Exact $k$-nearest-neighbor ($k$-NN) vector search is a common feature of vector libraries and database systems. It serves applications that require exact results and provides the ground truth for evaluating approximate search. However, floating-point rounding and overflow can cause an exact search to return mathematically incorrect top-$k$ result sets. These errors can go unnoticed and affect downstream tasks that rely on exact results. We present Errpedia, a purpose-built dataset for testing the numerical correctness of exact vector search. Errpedia contains 1,616 queries across 21 error categories, with ground truth independently verified using exact rational arithmetic. We evaluate 20 widely used library and database configurations and find that every tested configuration returns mathematically incorrect top-10 result sets on at least 1 applicable query. Failures include misranking nearly equidistant vectors and returning incomplete results: 1 library omits all 10 exact matches to a query, and several systems return fewer than $k$ neighbors. We release Errpedia as a reproducible benchmark for developers and researchers to test their implementations. The dataset is publicly available at https://github.com/dynos01/errpedia.

## Pelorus: Warped-Product Graph Indexing for Hyperbolic Vector Search

DevFeed: [Pelorus: Warped-Product Graph Indexing for Hyperbolic Vector Search](<https://devfeed.tech/articles/pelorus-warped-product-graph-indexing-for-hyperbolic-vector-search-140628.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22159>)

Author: Wenxuan Xiao, Xu Cao

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [ann](<https://devfeed.tech/topics/ann.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Graphs](<https://devfeed.tech/topics/graphs.md>), [quantization](<https://devfeed.tech/topics/quantization.md>)

Tags: [amd-epyc](<https://devfeed.tech/tags/amd-epyc.md>), [approximate-nearest-neighbor-search](<https://devfeed.tech/tags/approximate-nearest-neighbor-search.md>), [avx2](<https://devfeed.tech/tags/avx2.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [graph](<https://devfeed.tech/tags/graph.md>), [indexing](<https://devfeed.tech/tags/indexing.md>), [memory](<https://devfeed.tech/tags/memory.md>), [recall](<https://devfeed.tech/tags/recall.md>), [reranking](<https://devfeed.tech/tags/reranking.md>), [search](<https://devfeed.tech/tags/search.md>), [throughput](<https://devfeed.tech/tags/throughput.md>), [traversal](<https://devfeed.tech/tags/traversal.md>), [vector](<https://devfeed.tech/tags/vector.md>), [vector-search](<https://devfeed.tech/tags/vector-search.md>)

### AI overview

Pelorus is a hyperbolic vector search graph index designed to reduce navigation memory and traversal cost while retaining geodesic ordering. It stores FP32 radial and conformal scalars separately from 2-bit spherical direction codes, then uses FP64 full-vector evaluation only in a compact reranking tail. Its distortion corrections include orthogonal-projection debiasing, purity-gated tangent-cone residuals, and Conformal Jacobian gating; QuadriPrune distributes edges across geodesic fibers, same-shell rings, and radial elevators. Across eight benchmarks on AMD EPYC 9654, it builds Cohere-1M indices 5.44x faster than full-precision polar graphs using 32 threads, with 517 MB of hot navigation memory. At 99% Recall@10, Cohere-1M throughput is reported as 4.30x higher on one thread and 6.31x higher on 24 threads; MERU-1M reaches 53,483 QPS. Tangent-cone residuals lift recall from 34.22% to 99.385% on clustered narrow shells, but isotropic narrow-shell tests still reveal recall limits.

### Source excerpt

arXiv:2611.22159v1 Announce Type: new Abstract: Hyperbolic embeddings capture hierarchical relations, but million-scale approximate nearest neighbor search must reconcile geodesic fidelity with memory efficiency. Flat inner-product indices distort order across radial shells, while native hyperbolic graphs repeatedly access full-precision vectors or quantize coordinates with singular conformal scales. We present Pelorus, a warped-product proximity-graph index for hyperbolic vector search. Pelorus separates unquantized FP32 radial and conformal scalars from scale-invariant 2-bit spherical directional codes and defers full-vector FP64 evaluation to a compact reranking tail. A conformal distortion analysis motivates orthogonal-projection debiasing, purity-gated tangent-cone residuals, and Conformal Jacobian gating. QuadriPrune allocates edges across geodesic fibers, same-shell rings, and radial elevators, with spanning-tree chord swaps restoring entry reachability. A single-page record layout and carry-save AVX2 kernel accelerate traversal. Across eight real and synthetic benchmarks on AMD EPYC 9654, Pelorus builds Cohere-1M indices 5.44x faster than full-precision polar graphs on 32 threads, reducing hot navigation memory to 517.0 MB. At 99% Recall@10, it improves Cohere-1M throughput by 4.30x on one thread and 6.31x on 24 threads, and delivers 53,483 QPS on MERU-1M. On clustered narrow shells, tangent-cone residuals raise recall from 34.22% to 99.385%, while isotropic narrow-shell stress tests expose remaining recall limits.

[Next page](<https://devfeed.tech/sources/arxiv-databases.md?cursor=WyIyMDI2LTExLTE4VDA1OjAwOjAwKzAwOjAwIiwgImEzYTNlY2NlLTI1YjUtNDE0Yy05NDc4LTE2NzU4N2JkNTc2NiJd>)