# AI-driven information retrieval

An approach to information retrieval that uses artificial-intelligence methods to extract relevant insights and improve search results.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Decoupled Knowledge Retrieval and Compact Memory Enable Reliable Lifelong Model Editing

DevFeed: [Decoupled Knowledge Retrieval and Compact Memory Enable Reliable Lifelong Model Editing](<https://devfeed.tech/articles/decoupled-knowledge-retrieval-and-compact-memory-enable-reliable-lifelong-model-editing-145596.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25861>)

Author: Yue Che, Jingze Wang, Chen Guoyi, Yujie Wu, Xuming Ran, Mingkun Xu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [memory](<https://devfeed.tech/tags/memory.md>), [model](<https://devfeed.tech/tags/model.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>)

### AI overview

BiSpace addresses growing storage needs and declining retrieval performance in memory-based lifelong model editing while leaving the base LLM parameters untouched. It separates retrieval and injection across representation spaces: queries locate edits in an external semantic space, and sparse, storage-efficient updates inject the relevant knowledge into the model's internal representation space. The abstract reports that BiSpace reduces storage per entry to about 10.2% of the original, remains resilient through edit sequences of up to 16K edits, and improves Overall Performance by more than 23% over existing methods on a more challenging benchmark.

### Source excerpt

arXiv:2611.25861v1 Announce Type: new Abstract: Lifelong model editing requires continuously incorporating new facts into deployed large language models (LLMs) without expensive retraining or compromising existing capabilities. Memory-based editors offer an appealing solution by keeping the base parameters untouched, yet their practical use is hindered by linearly growing storage requirements and deteriorating retrieval performance as edits accumulate. To tackle these problems, we introduce BiSpace, a lifelong model editing framework that decouples memory retrieval from knowledge injection across two distinct representation spaces. BiSpace routes queries and identifies relevant edits in an external semantic space, while injecting the corresponding knowledge into the internal representation space of the LLM through sparse and storage-efficient updates. Extensive experiments show that BiSpace shrinks each entry's storage to only about 10.2% of the original and shows strong resilience to long edit sequences of up to 16K edits. On a more challenging benchmark, BiSpace further improves Overall Performance by more than 23% over existing methods. These results advance memory-based editing toward reliable long-term model maintenance at scale.

## Web search in Latin America: language models use less local and diverse news than search engines

DevFeed: [Web search in Latin America: language models use less local and diverse news than search engines](<https://devfeed.tech/articles/web-search-in-latin-america-language-models-use-less-local-and-diverse-news-than-search-engines-145613.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25955>)

Author: Francisco W. Kerche, Franziska Sofia Hafner, Felix M. Simon, Luc Rocher

Published: 2026-11-20T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [search-engines](<https://devfeed.tech/topics/search-engines.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amplify](<https://devfeed.tech/tags/amplify.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-cy](<https://devfeed.tech/tags/cs-cy.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [information-systems](<https://devfeed.tech/tags/information-systems.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [latin-america](<https://devfeed.tech/tags/latin-america.md>), [news](<https://devfeed.tech/tags/news.md>), [search](<https://devfeed.tech/tags/search.md>), [search-engines](<https://devfeed.tech/tags/search-engines.md>)

### AI overview

The study finds that language models return less diverse news sources than search engines when answering queries about Latin America. Researchers tested three search engines and four language models on 1,901 current events across nine countries, varying query language and user location. For local users, search engines returned 41.3% domestic news, while language models returned 3.6 to 11.6 percentage points less; domestic-news shares varied across user types. The findings suggest LLM-based search may reproduce or sometimes amplify geographical imbalances in news visibility. The researchers released an open dataset for multilingual and geographically diverse evaluation.

### Source excerpt

arXiv:2611.25955v1 Announce Type: cross Abstract: AI platforms are becoming a major gateway to news and current events. This shift risks amplifying existing geographical biases that favour narratives from wealthier countries over those from the Global South. This is particularly relevant in Latin America, which accounts for the largest share of AI usage in the Global South. We examine how information about Latin America changes when users shift from conventional search engines to LLM-based search. We construct a dataset of 1,901 current events across nine Latin American countries, craft realistic queries, and submit them to three search engines and four language models. We vary query language and user location to represent local, diaspora, tourist, and foreign user scenarios. Across 49,207 requests and 8,834 unique domains, language models return a less diverse set of news sources than search engines. Across user types, the share of domestic news returned by language models is inconsistent. For local users, while search engines already return only 41.3\% local news, language models return a further 3.6 to 11.6 percentage points less. Taken together, our findings suggest that LLM-based search can reproduce and, in some settings, amplify geographical hierarchies in the reach and visibility of news sources. We release an open dataset to support multilingual and geographically diverse evaluation of LLM-based search, and highlight implications for more equitable information systems design.

## Microsoft adds knowledge graphs, retrieval model to Foundry IQ for better AI grounding

DevFeed: [Microsoft adds knowledge graphs, retrieval model to Foundry IQ for better AI grounding](<https://devfeed.tech/articles/microsoft-adds-knowledge-graphs-retrieval-model-to-foundry-iq-for-better-ai-grounding-143172.md>)

Original publisher: [Read original article](<https://www.infoworld.com/article/4250726/microsoft-adds-knowledge-graphs-retrieval-model-to-foundry-iq-for-better-ai-grounding.html>)

Author: Anirban Ghoshal

Published: 2026-11-19T12:56:43Z

Content type: news

Language: en

Sources: [InfoWorld](<https://devfeed.tech/sources/infoworld.md>)

Topics: [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [knowledge-engineering](<https://devfeed.tech/topics/knowledge-engineering.md>), [Serverless](<https://devfeed.tech/topics/serverless.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-grounding](<https://devfeed.tech/tags/ai-grounding.md>), [analytics](<https://devfeed.tech/tags/analytics.md>), [analytics-artificial-intelligence-data-management](<https://devfeed.tech/tags/analytics-artificial-intelligence-data-management.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [automate](<https://devfeed.tech/tags/automate.md>), [build](<https://devfeed.tech/tags/build.md>), [build-ai-agents](<https://devfeed.tech/tags/build-ai-agents.md>), [business](<https://devfeed.tech/tags/business.md>), [capability](<https://devfeed.tech/tags/capability.md>), [conference](<https://devfeed.tech/tags/conference.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [connect](<https://devfeed.tech/tags/connect.md>), [data-management](<https://devfeed.tech/tags/data-management.md>), [foundry](<https://devfeed.tech/tags/foundry.md>), [graphs](<https://devfeed.tech/tags/graphs.md>), [grounding](<https://devfeed.tech/tags/grounding.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [knowledge-graphs](<https://devfeed.tech/tags/knowledge-graphs.md>), [language-en](<https://devfeed.tech/tags/language-en.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [model](<https://devfeed.tech/tags/model.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [storytype-news](<https://devfeed.tech/tags/storytype-news.md>)

### AI overview

Foundry IQ adds knowledge graphs, Microsoft-Retriever-1, and automatic retrieval-resource provisioning to help ground agents in enterprise data. Developers can supply an ontology or bring an existing graph; the service maps relationships across documents and records each connection's source, supporting questions that span multiple sources. Graphs are in public preview. Microsoft-Retriever-1 reformulates queries using enterprise terminology and decides whether to search again; it can be enabled on existing indexes and knowledge bases without extra provisioning or reindexing. It aims to reduce search rounds and reliance on large models for retrieval planning, though iterative searches may add latency and cost, and Microsoft has published no detailed performance comparisons. New Foundry projects will automatically receive a managed resource, removing the need to provision a separate Azure AI Search resource. That service is planned for public preview in December 2026, with usage-based serverless pricing. The text cautions that graph extraction can misread jargon or naming, graphs need validation and upkeep, and graph answers may cost more and take longer than routine search. Usage and

### Source excerpt

Microsoft is enhancing its Foundry IQ knowledge retrieval service with knowledge graphs, a specialized retrieval model and automatic infrastructure provisioning, seeking to make it easier for developers to build AI agents that can access, understand and reason over enterprise data. Grounding AI agents in organizational data is critical for enterprises to ensure they can deliver responses based on accurate, relevant, and up-to-date business information as they look to increasingly automate business workflows. The new knowledge graphs in Foundry IQ, announced at the Microsoft Ignite conference, will help agents connect related entities and facts across documents and organize enterprise content into topics, allowing them to answer questions that require information from multiple sources, the hyperscaler wrote in a blog post. In order to map relationships across documents, developers can add a graph configuration containing their ontology to an existing Foundry IQ knowledge source or bring an existing graph into the service. Foundry IQ then uses the ontology to map how documents, contacts, and information relate, while recording the source of each connection, it added. Alongside knowledge graphs, which are currently in public preview, the hyperscaler is adding a new retrieval model named Microsoft-Retriever-1 to reduce the number of searches and the reliance on large language models (LLMs) for retrieval planning in an effort to help developers lower latency and token consumption. The new model, according to the hyperscaler, interprets user queries, reformulates them using terminology found in enterprise documents, and determines whether additional searches are needed to retrieve relevant information. Developers can enable it on existing Foundry IQ indexes and knowledge bases without requiring additional provisioning or document reindexing, the hyperscaler wrote. Additionally, to simplify deployment of Foundry IQ, Microsoft is adding a capability that will automatically

## Searching the Pareto Front: Multi-Objective Retrieval for Heterogeneous Scientific Modalities

DevFeed: [Searching the Pareto Front: Multi-Objective Retrieval for Heterogeneous Scientific Modalities](<https://devfeed.tech/articles/searching-the-pareto-front-multi-objective-retrieval-for-heterogeneous-scientific-modalities-142684.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23639>)

Author: Song Young Oh, Nesar Ramachandra, Bin Xia, Ian Foster, Kyle Chard

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [multimodal-ai](<https://devfeed.tech/topics/multimodal-ai.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>)

Tags: [adaptive](<https://devfeed.tech/tags/adaptive.md>), [approach](<https://devfeed.tech/tags/approach.md>), [astro-ph-im](<https://devfeed.tech/tags/astro-ph-im.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [fm](<https://devfeed.tech/tags/fm.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [fusion](<https://devfeed.tech/tags/fusion.md>), [galaxy](<https://devfeed.tech/tags/galaxy.md>), [history](<https://devfeed.tech/tags/history.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nearest-neighbor](<https://devfeed.tech/tags/nearest-neighbor.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [pareto-optimality](<https://devfeed.tech/tags/pareto-optimality.md>), [properties](<https://devfeed.tech/tags/properties.md>), [proximity](<https://devfeed.tech/tags/proximity.md>), [query](<https://devfeed.tech/tags/query.md>), [raw](<https://devfeed.tech/tags/raw.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [searching](<https://devfeed.tech/tags/searching.md>), [similarity](<https://devfeed.tech/tags/similarity.md>)

### AI overview

The study compares a multimodal foundation model (FM) with separately trained modality embeddings combined through Pareto-based multi-objective optimization for galaxy retrieval across star-formation histories, spectra, and observations from two telescopes. The FM provides strong embedding-space proximity, while late fusion retains modality-specific distances so scientists can inspect which physical signals contribute to similarity. Across six measured properties, the method's nearest neighbor is reported to be 8% closer to the query in raw-data space on average than kNN in the FM embedding space (spread 0.128 versus 0.139). The abstract suggests this may surface astrophysically coherent candidates overlooked by single-objective search.

### Source excerpt

arXiv:2611.23639v1 Announce Type: new Abstract: In cosmology, surveys span different sky regions and wavelength ranges, resulting in uneven modality coverage across observational datasets. Such heterogeneity can be addressed through either multimodal foundation models (FMs), which learn shared embedding spaces, or independently learned modality embeddings combined via late fusion. We investigate whether the latter provides an adaptive alternative to FM-based scientific retrieval. We evaluate this approach on a galaxy retrieval task spanning diverse modalities--history of star formation, spectra of light emitted, and multi-wavelength observations from two telescopes--comparing an FM baseline with separately trained embeddings fused through multi-objective optimization based on Pareto optimality. We find that the FM baseline achieves strong embedding-space proximity, but our method preserves modality-specific distance structure that allows scientists to inspect which physical signals drive similarity. Our method also achieves improved fidelity in raw-data space: across six measured properties, its nearest neighbor is 8% closer to the query on average than that retrieved by kNN in the FM embedding space (spread 0.128 vs. 0.139). These results suggest that multi-objective retrieval can surface astrophysically coherent candidates that single-objective search alone may overlook.

## SurgCBVR: A Multi-Domain Benchmark for Content-Based Surgical Video-to-Video Retrieval

DevFeed: [SurgCBVR: A Multi-Domain Benchmark for Content-Based Surgical Video-to-Video Retrieval](<https://devfeed.tech/articles/surgcbvr-a-multi-domain-benchmark-for-content-based-surgical-video-to-video-retrieval-142641.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23347>)

Author: Mohammad Eslami, Mousa Moradi, Negin Ghamsarian, Nazlee Zebardast, Jennifer L Lindsey, Sophia Y. Wang, Lucia Sobrin, Rishi P Singh, Tobias Elze

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [Video Analytics](<https://devfeed.tech/topics/video-analytics.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [based](<https://devfeed.tech/tags/based.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cases](<https://devfeed.tech/tags/cases.md>), [classes](<https://devfeed.tech/tags/classes.md>), [classifier](<https://devfeed.tech/tags/classifier.md>), [clip](<https://devfeed.tech/tags/clip.md>), [computer](<https://devfeed.tech/tags/computer.md>), [computer-vision](<https://devfeed.tech/tags/computer-vision.md>), [content](<https://devfeed.tech/tags/content.md>), [counts](<https://devfeed.tech/tags/counts.md>), [covering](<https://devfeed.tech/tags/covering.md>), [cross](<https://devfeed.tech/tags/cross.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [domain](<https://devfeed.tech/tags/domain.md>), [domains](<https://devfeed.tech/tags/domains.md>), [eess-iv](<https://devfeed.tech/tags/eess-iv.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

SurgCBVR benchmarks surgical video-to-video retrieval across eight public datasets: 679 cases and 76,489 clips from six procedure types in ophthalmic, laparoscopic, robotic-assisted, and colonoscopy domains. Its Scene tier retrieves matching operative states across cases and sites; Workflow retrieves and localizes phase transitions and deviations. Fixed clip lengths and frame counts, plus phase-classifier oracle and duration-only baselines, are used to check for label and timing shortcuts. Evaluation covers six generic and surgical foundation models, two retrieval methods, and contrastive heads, with within-dataset, cross-dataset, and pooled-gallery settings restricted to the same procedure type. Frozen representations barely beat a timing-only baseline, transition retrieval is near chance, and trained heads lose up to half their accuracy across datasets, indicating weak generalization in current representations.

### Source excerpt

arXiv:2611.23347v1 Announce Type: cross Abstract: Hospitals record thousands of hours of surgical video annually, yet these archives remain difficult to search by content. Surgeons cannot readily retrieve similar operations, complications, or workflow events. Existing surgical computer vision primarily produces labels rather than retrieving relevant videos. We introduce SurgCBVR, the first benchmark for content-based video-to-video retrieval in surgery. It integrates eight public datasets across four domains-ophthalmic, laparoscopic, robotic-assisted, and colonoscopy-covering six procedure types, 679 cases, and 76,489 clips (106 hours). SurgCBVR comprises two tiers: Scene, retrieving the same operative state across cases and sites, and Workflow, retrieving and localizing phase transitions and deviations. Scene includes 74,765 clips spanning 40 classes, three temporal granularities, and three playback speeds; Workflow contains 1,724 transition clips. Fixed clip lengths and frame counts, together with phase-classifier oracle and duration-only baselines, help assess label and timing shortcuts. We evaluate six generic and surgical foundation models, two video retrieval methods, and contrastive heads trained on SurgCBVR, using within-dataset, cross-dataset, and pooled-gallery retrieval restricted to the same procedure type. Frozen representations barely outperform a timing-only baseline, transition retrieval approaches chance, and trained heads lose up to half their accuracy across datasets. These findings expose substantial limitations in current video representations and establish SurgCBVR as a benchmark for advancing surgery-aware retrieval.

## LusoClin: A Synthetic Clinical Note Dataset for Medical Information Retrieval in European Portuguese

DevFeed: [LusoClin: A Synthetic Clinical Note Dataset for Medical Information Retrieval in European Portuguese](<https://devfeed.tech/articles/lusoclin-a-synthetic-clinical-note-dataset-for-medical-information-retrieval-in-european-portuguese-142657.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23454>)

Author: Carla Teixeira Lopes, Daniel F\\'elix

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [lora](<https://devfeed.tech/topics/lora.md>), [llama](<https://devfeed.tech/topics/llama.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [managing large-scale text data in AI](<https://devfeed.tech/topics/managing-large-scale-text-data-in-ai.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [Internationalization (i18n)](<https://devfeed.tech/topics/i18n.md>)

Tags: [bert](<https://devfeed.tech/tags/bert.md>), [clinical-search](<https://devfeed.tech/tags/clinical-search.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ir](<https://devfeed.tech/tags/cs-ir.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [document-retrieval](<https://devfeed.tech/tags/document-retrieval.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [information-retrieval](<https://devfeed.tech/tags/information-retrieval.md>), [languages](<https://devfeed.tech/tags/languages.md>), [llama](<https://devfeed.tech/tags/llama.md>), [low-resource-languages](<https://devfeed.tech/tags/low-resource-languages.md>), [medical](<https://devfeed.tech/tags/medical.md>), [note](<https://devfeed.tech/tags/note.md>), [resource](<https://devfeed.tech/tags/resource.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>)

### AI overview

LusoClin is a publicly released dataset of synthetic clinical notes in European Portuguese, intended to support privacy-preserving research on clinical information retrieval in a language with limited access to real clinical text. It was created by preprocessing real clinical data, fine-tuning Llama 3.2 (3B) with Quantized Low-Rank Adaptation, and generating notes from prompts; a BERT-based model automatically annotates clinical entities for search and indexing. Evaluations using automatic metrics and human review indicate that the dataset captures relevant clinical language and may support document retrieval and domain-specific model adaptation. However, annotators can often distinguish its notes from real ones, and some medical inconsistencies remain.

### Source excerpt

arXiv:2611.23454v1 Announce Type: new Abstract: Access to large-scale clinical text collections is crucial for advancing medical information retrieval research, including clinical note search, patient cohort identification, and domain-adapted retrieval models. However, real clinical notes are rarely available due to privacy regulations, which particularly limits progress for low-resource languages such as European Portuguese. We present LusoClin, a publicly released dataset of synthetic clinical notes in European Portuguese, created to support privacy-preserving research on clinical text retrieval. LusoClin was generated by pre-processing real clinical data, fine-tuning the open-source Llama 3.2 (3B) instruction-tuned model using Quantized Low-Rank Adaptation, and applying prompt-based clinical note generation. To facilitate semantic indexing and clinical search, the notes are automatically annotated with clinical entities using a BERT-based model. We evaluate LusoClin in terms of utility, fidelity, diversity, and privacy using automatic metrics and human evaluation. Results indicate that the dataset captures clinically relevant language patterns and can support downstream IR applications such as clinical document retrieval and domain-specific model adaptation, although annotators can often distinguish synthetic from real notes and some medical inconsistencies persist.

## KnowMe Paper Radar: Lightweight Discovery of Promising Papers in the Age of Autoresearch

DevFeed: [KnowMe Paper Radar: Lightweight Discovery of Promising Papers in the Age of Autoresearch](<https://devfeed.tech/articles/knowme-paper-radar-lightweight-discovery-of-promising-papers-in-the-age-of-autoresearch-142693.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.23702>)

Author: Zhuo Chen, Jian Wang, Jinjie Gu, Lijun Wu

Published: 2026-11-19T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [recommendation systems](<https://devfeed.tech/topics/recommendation-systems.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Cache](<https://devfeed.tech/topics/cache.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [acquisition](<https://devfeed.tech/tags/acquisition.md>), [agents](<https://devfeed.tech/tags/agents.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [authors](<https://devfeed.tech/tags/authors.md>), [automatic](<https://devfeed.tech/tags/automatic.md>), [autoresearch](<https://devfeed.tech/tags/autoresearch.md>), [browser](<https://devfeed.tech/tags/browser.md>), [cache](<https://devfeed.tech/tags/cache.md>), [capabilities](<https://devfeed.tech/tags/capabilities.md>), [cli](<https://devfeed.tech/tags/cli.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [command-line](<https://devfeed.tech/tags/command-line.md>), [command-line-interface](<https://devfeed.tech/tags/command-line-interface.md>), [component](<https://devfeed.tech/tags/component.md>), [context](<https://devfeed.tech/tags/context.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ir](<https://devfeed.tech/tags/cs-ir.md>), [discovery](<https://devfeed.tech/tags/discovery.md>), [lightweight](<https://devfeed.tech/tags/lightweight.md>), [paper](<https://devfeed.tech/tags/paper.md>), [papers](<https://devfeed.tech/tags/papers.md>)

### AI overview

KnowMe Paper Radar ranks papers for a reader's current research questions by combining topical relevance and recency with author research histories, collaboration paths, and direction-specific institutional context. Users set topics, priorities, exclusions, and dates; exposed score components and sources help explain priorities and surface work beyond familiar authors. Automatic acquisition, version merging, and graph-cache reuse support routine use without LLM inference. On 174,640 acquired records, repeated context preparation was more than three times faster; cached abstracts raised NDCG@10 from 0.412 to 0.598 on expert-judged retrieval tasks. The abstract also reports analyses of semantic retrieval, research-history modeling, and literature-grounded planning, with browser and structured CLI interfaces for researchers and research agents.

### Source excerpt

arXiv:2611.23702v1 Announce Type: new Abstract: The growing volume of topically similar papers makes it difficult to identify new work that can offer useful research insights or methodological guidance. We present KnowMe Paper Radar, a lightweight discovery tool that combines multiple sources of evidence into personalized reading priorities. Users specify topics, priorities, exclusions and dates; the system brings together topical relevance, recency, author research histories, collaboration paths and direction-specific institutional context. By exposing each score component and its supporting sources, KnowMe helps readers select promising papers for their current questions and discover relevant work beyond familiar authors. Automatic acquisition, version merging and graph-cache reuse keep this workflow convenient without large language model (LLM) inference during ordinary use. Experiments on 174,640 acquired records show more than threefold faster repeated context preparation, while cached abstracts improve normalized discounted cumulative gain at rank 10 (NDCG@10) from 0.412 to 0.598 on expert-judged retrieval tasks. Complementary analyses examine how the same accumulated records support semantic retrieval, research-history modeling and literature-grounded planning. A browser interface and a structured command-line interface (CLI) make these capabilities available to both researchers and research agents, positioning KnowMe as a practical upstream tool for literature-informed recursive self-improvement (RSI) workflows.

## Meet the Writer: Alena Belova on Reputation, AI Search and the Numbers Nobody Publishes

DevFeed: [Meet the Writer: Alena Belova on Reputation, AI Search and the Numbers Nobody Publishes](<https://devfeed.tech/articles/meet-the-writer-alena-belova-on-reputation-ai-search-and-the-numbers-nobody-publishes-141289.md>)

Original publisher: [Read original article](<https://hackernoon.com/meet-the-writer-alena-belova-on-reputation-ai-search-and-the-numbers-nobody-publishes?source=rss>)

Author: HackerNoon Writers Spotlight

Published: 2026-11-18T19:42:59Z

Content type: article

Language: en

Sources: [HackerNoon](<https://devfeed.tech/sources/hackernoon.md>)

Topics: [Search engine optimization (SEO)](<https://devfeed.tech/topics/seo.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [search-engines](<https://devfeed.tech/topics/search-engines.md>), [Finance](<https://devfeed.tech/topics/finance.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-search](<https://devfeed.tech/tags/ai-search.md>), [ai-search-optimization](<https://devfeed.tech/tags/ai-search-optimization.md>), [data-journalism](<https://devfeed.tech/tags/data-journalism.md>), [economics](<https://devfeed.tech/tags/economics.md>), [generative-engine-optimization](<https://devfeed.tech/tags/generative-engine-optimization.md>), [geo](<https://devfeed.tech/tags/geo.md>), [hidden](<https://devfeed.tech/tags/hidden.md>), [llms](<https://devfeed.tech/tags/llms.md>), [meet-the-writer](<https://devfeed.tech/tags/meet-the-writer.md>), [numbers](<https://devfeed.tech/tags/numbers.md>), [online](<https://devfeed.tech/tags/online.md>), [online-reputation](<https://devfeed.tech/tags/online-reputation.md>), [search](<https://devfeed.tech/tags/search.md>), [testing](<https://devfeed.tech/tags/testing.md>), [writer](<https://devfeed.tech/tags/writer.md>)

### AI overview

Alena Belova's work connects AI search, reputation and hidden economics through a recurring question: how do people and organizations become visible, and what supports the picture people trust? At BARS Agency, she works on how companies appear in AI search; Geometrika began as a tool to track how assistants describe brands and which sources they use. Her research starts with a table of unanswered questions, then checks primary documents and reconciles datasets against their stated totals. She treats a number's absence from public records as a finding, while emphasizing restraint in what makes it into a story. She says AI answers can vary between rounds and across countries, and plans to ask major assistants who she is and trace any errors to their sources. She also wants smaller cultural institutions to be easier to find online.

### Source excerpt

Alena Belova on AI search, online reputation and hidden economics: how she researches the numbers nobody publishes and what she is testing next.

## Wayfinder: Frontier-level Code Search at a Fraction of the Cost

DevFeed: [Wayfinder: Frontier-level Code Search at a Fraction of the Cost](<https://devfeed.tech/articles/wayfinder-frontier-level-code-search-at-a-fraction-of-the-cost-141039.md>)

Original publisher: [Read original article](<https://blog.voyageai.com/2026/11/18/wayfinder-code-search/>)

Author: Voyage AI

Published: 2026-11-18T15:30:00Z

Content type: article

Language: en

Sources: [Voyage AI](<https://devfeed.tech/sources/voyage-ai.md>)

Topics: [code search](<https://devfeed.tech/topics/code-search.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [hierarchical agent systems](<https://devfeed.tech/topics/hierarchical-agent-systems.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [code](<https://devfeed.tech/tags/code.md>), [code-search](<https://devfeed.tech/tags/code-search.md>), [cost](<https://devfeed.tech/tags/cost.md>), [frontier](<https://devfeed.tech/tags/frontier.md>), [grep](<https://devfeed.tech/tags/grep.md>), [news](<https://devfeed.tech/tags/news.md>), [search](<https://devfeed.tech/tags/search.md>), [wayfinder](<https://devfeed.tech/tags/wayfinder.md>)

### AI overview

Wayfinder pairs a small fine-tuned code-search model with a local hybrid index to make agent search cheaper while finding more relevant files. The index combines semantic search (80%) with BM25 (20%); its results are merged and reranked with grep results, then the model runs follow-up greps. On 200 held-out tasks, open models with this approach found about 74% of the right files for roughly $0.01 per search, compared with 76% for Sonnet 5.5 high effort at $0.12 and 78% for GPT-6.1 Sol medium effort at $0.07. Two pooled Wayfinder runs reached 78% for about $0.02. In a 42-task coding evaluation, competitive search methods had similar pass rates; Wayfinder reached 55%, while pooled runs reached 61%, but the sample was too small to establish a clear lead. Indexing also has ongoing costs: the authors estimate a typical repository pays back after about two searches monthly. Wayfinder is an open-source research project, not a MongoDB product; the authors recommend evaluating it on individual codebases.

### Source excerpt

Author: Henry Weller Before a coding agent can fix a bug, it has to find the code that matters. The coding agent industry has generally embraced grep as the way agents search code, but repeated searches with grep can become slow and expensive as codebases grow. For customers building coding agents, we wanted to explore [...]

## Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL

DevFeed: [Efficient Generative Retrieval for E-commerce Search with Semantic Cluster IDs and Expert-Guided RL](<https://devfeed.tech/articles/efficient-generative-retrieval-for-e-commerce-search-with-semantic-cluster-ids-and-expert-guided-rl-139770.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2605.14434>)

Author: Jianbo Zhu, Xing Fang, Jing Wang, Mingmin Jin, Bokang Wang, Guangxin Song, Zhenyu Xie, Junjie Bai

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [grpo](<https://devfeed.tech/topics/grpo.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Reinforcement learning](<https://devfeed.tech/topics/reinforcement-learning.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [VAE](<https://devfeed.tech/topics/vae.md>)

Tags: [beam](<https://devfeed.tech/tags/beam.md>), [cluster](<https://devfeed.tech/tags/cluster.md>), [contrastive-learning](<https://devfeed.tech/tags/contrastive-learning.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-ir](<https://devfeed.tech/tags/cs-ir.md>), [e-commerce](<https://devfeed.tech/tags/e-commerce.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generative](<https://devfeed.tech/tags/generative.md>), [group-relative-policy-optimization](<https://devfeed.tech/tags/group-relative-policy-optimization.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [ids](<https://devfeed.tech/tags/ids.md>), [learning](<https://devfeed.tech/tags/learning.md>), [offline](<https://devfeed.tech/tags/offline.md>), [online](<https://devfeed.tech/tags/online.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [performance](<https://devfeed.tech/tags/performance.md>), [policy](<https://devfeed.tech/tags/policy.md>), [production](<https://devfeed.tech/tags/production.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [rl](<https://devfeed.tech/tags/rl.md>), [search](<https://devfeed.tech/tags/search.md>), [semantic](<https://devfeed.tech/tags/semantic.md>)

### AI overview

The framework positions generative retrieval as a recall-stage supplement to existing e-commerce search, addressing catalog scale, latency, and downstream ranking alignment. CQ-SID combines category-aware and query-item contrastive learning with Residual Quantized VAEs to create hierarchical semantic IDs and reduce beam-search complexity. On TmallAPP search logs, it improves semantic and personalized click hitrate by up to 26.76% and 11.11% over RQ-VAE baselines while halving beam-search size. EG-GRPO uses ground-truth samples to stabilize reinforcement learning under sparse rewards and further improves multi-objective performance. Online A/B tests report GMV gains of 1.15% and UCTCVR gains of 0.40%; in production, the generative recall channel accounts for 50.25% of exposures, 58.96% of clicks, and 72.63% of purchases.

### Source excerpt

arXiv:2605.14434v2 Announce Type: replace-cross Abstract: Generative retrieval offers a promising alternative by unifying the fragmented multi-stage retrieval process into a single end-to-end model. However, its practical adoption in industrial e-commerce search remains challenging, given the massive and dynamic product catalogs, strict latency requirements, and the need to align retrieval with downstream ranking goals. In this work, we propose a retrieval framework tailored for real-world recall scenarios, positioning generative retrieval as a recall-stage supplement rather than an end-to-end replacement. Our method, CQ-SID (Category-and-Query constrained Semantic ID), employs category-aware and query-item contrastive learning along with Residual Quantized VAEs to encode items into hierarchical semantic cluster identifiers, significantly reducing beam search complexity. Additionally, we develop EG-GRPO (Expert-Guided Group Relative Policy Optimization), a reinforcement learning approach that aligns generative recall with downstream ranking under sparse rewards by injecting ground-truth samples to stabilize training. Offline experiments on TmallAPP search logs show that CQ-SID achieves up to 26.76% and 11.11% relative gains in semantic and personalized click hitrate over RQ-VAE baselines, while halving beam search size. EG-GRPO further improves multi-objective performance. Online A/B tests confirm gains in GMV (+1.15%) and UCTCVR (+0.40%). The generative recall channel now contributes substantially in production, accounting for over 50.25% of exposures, 58.96% of clicks, and 72.63% of purchases, demonstrating a viable path for deploying generative retrieval in real-world e-commerce systems.

## Parallel web search is free on AI Gateway and eve through January 31

DevFeed: [Parallel web search is free on AI Gateway and eve through January 31](<https://devfeed.tech/articles/parallel-web-search-is-free-on-ai-gateway-and-eve-through-january-31-141198.md>)

Original publisher: [Read original article](<https://vercel.com/changelog/parallel-web-search-is-free-on-ai-gateway-and-eve-through-january-31>)

Author: Mark Pariente

Published: 2026-11-18T05:00:00Z

Content type: release

Language: en

Sources: [Vercel News](<https://devfeed.tech/sources/vercel-news.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [search-engines](<https://devfeed.tech/topics/search-engines.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-gateway](<https://devfeed.tech/tags/ai-gateway.md>), [ai-sdk](<https://devfeed.tech/tags/ai-sdk.md>), [api](<https://devfeed.tech/tags/api.md>), [api-key](<https://devfeed.tech/tags/api-key.md>), [automatically](<https://devfeed.tech/tags/automatically.md>), [built-in](<https://devfeed.tech/tags/built-in.md>), [data-retention](<https://devfeed.tech/tags/data-retention.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [eve](<https://devfeed.tech/tags/eve.md>), [fast](<https://devfeed.tech/tags/fast.md>), [filter](<https://devfeed.tech/tags/filter.md>), [free](<https://devfeed.tech/tags/free.md>), [links](<https://devfeed.tech/tags/links.md>), [model](<https://devfeed.tech/tags/model.md>), [parallel](<https://devfeed.tech/tags/parallel.md>), [search](<https://devfeed.tech/tags/search.md>), [web](<https://devfeed.tech/tags/web.md>), [web-search](<https://devfeed.tech/tags/web-search.md>)

### AI overview

Parallel fast mode is free on AI Gateway through January 31, 2027, and is the default web search for eve agents when their model is served through AI Gateway. It works with any AI Gateway model without a separate Parallel API key, returning links with short excerpts and allowing filters by website or publication date. With the AI SDK, enable it using `gateway.tools.parallelSearch({ mode: 'fast' })` in the tools configuration. The offer applies to fast mode only, with Zero Data Retention enabled by default; other modes use standard pricing.

### Source excerpt

Parallel web search in fast mode is now free on AI Gateway through January 31, 2027, and Parallel is now the default web search for eve agents. The tool works with any AI Gateway model, with no separate Parallel API key. Parallel finds relevant web pages and returns links with short excerpts. You can filter results by website or publication date. In eve, the built-in web_search tool uses Parallel fast mode automatically when the model is served through AI Gateway. See the eve documentation for other search configurations. To use Parallel fast mode with the AI SDK, add gateway.tools.parallelSearch({ mode: 'fast' }) to your tools: The offer covers fast mode only, with Zero Data Retention enabled by default. Other modes are billed at standard pricing. Learn more in the web search documentation. Read more

## Teaching Language Models to Narrow Boolean Patent Searches from Search Feedback

DevFeed: [Teaching Language Models to Narrow Boolean Patent Searches from Search Feedback](<https://devfeed.tech/articles/teaching-language-models-to-narrow-boolean-patent-searches-from-search-feedback-139996.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22270>)

Author: Seiya Kawano, Koji Marusaki, Hirofumi Nonaka, Koichiro Yoshino

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [boolean](<https://devfeed.tech/tags/boolean.md>), [computer-science](<https://devfeed.tech/tags/computer-science.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-ir](<https://devfeed.tech/tags/cs-ir.md>), [feedback](<https://devfeed.tech/tags/feedback.md>), [information-retrieval](<https://devfeed.tech/tags/information-retrieval.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [patent](<https://devfeed.tech/tags/patent.md>), [search](<https://devfeed.tech/tags/search.md>), [strategy](<https://devfeed.tech/tags/strategy.md>)

### AI overview

Using 38,397 Japan Patent Office search reports, the study trains language models to generate executable Boolean patent-search strategies. Prompted models achieve high citation recall but leave citations in sets too large to screen. The authors compare offline strategy-level learning, which scores whole strategies, with line-level learning that rewards query lines preserving citations while narrowing result sets. On shared rollouts, line-level credit improves screening measures; after iteration, the median citation-containing set falls from 768 documents to under 50, and more citations appear in sets under 100 documents than with expert strategies, at lower recall. Strategy-level preference learning reaches near-complete recall, so the two approaches offer complementary tradeoffs.

### Source excerpt

arXiv:2611.22270v1 Announce Type: cross Abstract: Patent prior-art searchers issue Boolean queries line by line, broadening to find relevant documents and narrowing until candidates can be screened. We distill 38,397 Japan Patent Office search reports into executable expert strategies, re-execute them, and evaluate generated strategies by citation recall and the smallest set containing each citation. Prompted models write valid, high-recall strategies but leave citations in sets too large to screen. We adapt a generator offline from scored rollouts in two forms: strategy-level learning from a screening-aware strategy score, and line-level learning from citation-preserving narrowing credit, which upweights the query lines keeping a found citation in a smaller set. On shared rollouts, line-level credit outperforms strategy-level scores on screening measures; iterated, it cuts the median citation-containing set from 768 to under 50 and places more citations in sets under 100 documents than experts, at lower recall. Strategy-level preference learning reaches near-complete recall; the two forms are complementary.

## LoCaR: Localized Canvas Retrieval With Frozen Vision-Language Model

DevFeed: [LoCaR: Localized Canvas Retrieval With Frozen Vision-Language Model](<https://devfeed.tech/articles/locar-localized-canvas-retrieval-with-frozen-vision-language-model-139967.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22131>)

Author: Rahim Hossain, Dipanwita Saha, Ashirbad Mishra, Xinxin Shu, Svetlana Strunjas, Binbin Li

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cv](<https://devfeed.tech/tags/cs-cv.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [region](<https://devfeed.tech/tags/region.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [vision-language-models](<https://devfeed.tech/tags/vision-language-models.md>)

### AI overview

LoCaR targets localized text-to-image retrieval queries that whole-image embeddings may miss when they concern small objects or local attributes. It uses SAM2 to propose object-focused regions and encodes each region independently with a frozen visual encoder, without training. An optional paired-support residual uses matched text-region exemplars without changing the encoders. The authors introduce LOCFG, a Visual Genome-derived benchmark for smaller, more challenging referents, and report across several vision-language backbones that better region representations are the main source of gains.

### Source excerpt

arXiv:2611.22131v1 Announce Type: new Abstract: Whole image embeddings can under represent small objects and local attributes that distinguish relevant images for localized queries. We present LoCaR, a training free framework for localized text to image retrieval with frozen vision language models. LoCaR constructs and utilizes independent proposals (SAM2) focusing on the object so as to get a more localized representation that independently encodes each region using the frozen visual encoder. We further study paired-support adaptation as an optional residual that uses matched text region exemplars without updating the underlying encoders. We also introduce LOCFG, a Visual Genome derived benchmark designed to evaluate localized retrieval for smaller and more challenging referents. Across several vision language backbones, our results show that improving the region representation itself is the main source of gain.

## Synergizing Evidence Retrieval and Utilization for Self-Improving Multimodal Scientific Document Reasoning

DevFeed: [Synergizing Evidence Retrieval and Utilization for Self-Improving Multimodal Scientific Document Reasoning](<https://devfeed.tech/articles/synergizing-evidence-retrieval-and-utilization-for-self-improving-multimodal-scientific-document-reasoning-140084.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.22837>)

Author: Frank Nie, Ethan B. Liu, Yuan Zhu, Jindong Han

Published: 2026-11-18T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [Enhancing AI model performance](<https://devfeed.tech/topics/enhancing-ai-model-performance.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [acquisition](<https://devfeed.tech/tags/acquisition.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [budget](<https://devfeed.tech/tags/budget.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [framework](<https://devfeed.tech/tags/framework.md>), [grounded](<https://devfeed.tech/tags/grounded.md>), [guidance](<https://devfeed.tech/tags/guidance.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [ontology](<https://devfeed.tech/tags/ontology.md>), [optimize](<https://devfeed.tech/tags/optimize.md>), [organization](<https://devfeed.tech/tags/organization.md>), [question](<https://devfeed.tech/tags/question.md>), [questions](<https://devfeed.tech/tags/questions.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [reward](<https://devfeed.tech/tags/reward.md>), [settings](<https://devfeed.tech/tags/settings.md>), [sources](<https://devfeed.tech/tags/sources.md>), [space](<https://devfeed.tech/tags/space.md>), [tables](<https://devfeed.tech/tags/tables.md>)

### AI overview

The framework separates evidence retrieval from evidence use for multimodal scientific document reasoning. A Retriever selects source-aligned text, figure, and table evidence under a context budget; a Perceiver organizes selected evidence and the question into a question-conditioned latent ontology; and a Reasoner uses that guidance alongside the original sources to generate grounded answers. During training, the three components are alternately optimized with a shared answering reward. Retrieval Potential Feedback and Latent Efficacy Feedback diagnose whether questions need better retrieval or latent guidance and direct targeted resampling. Across four benchmarks and seven evaluation settings, it reports average scores of 69.9 with a 7B Reasoner and 75.0 with an 8B Reasoner, exceeding the strongest baseline by 4.0 and 9.1 points, respectively.

### Source excerpt

arXiv:2611.22837v1 Announce Type: new Abstract: Scientific document reasoning requires an agent to acquire and integrate evidence distributed across text, figures, and tables. Retrieval can identify relevant sources while missing complementary support, and answer-level feedback alone does not reveal whether an error stems from evidence acquisition or evidence use. We present an agentic Retriever--Perceiver--Reasoner framework for multimodal scientific document reasoning. The Retriever sequentially selects source-aligned evidence under a context budget. Given the selected evidence and question, the Perceiver constructs a question-conditioned latent ontology, an implicit organization of multimodal evidence in a shared continuous space. The Reasoner combines this latent guidance with the original sources to produce grounded answers. We train the three components through diagnostic-guided co-evolution: alternating updates optimize them with a shared answering reward, while Retrieval Potential Feedback (RPF) and Latent Efficacy Feedback (LEF) identify questions that need better retrieval or latent guidance and direct targeted resampling. Across four benchmarks and seven evaluation settings, our framework obtains average scores of 69.9 and 75.0 with 7B and 8B Reasoner backbones, exceeding the strongest baseline by 4.0 and 9.1 points, respectively.

## Improve search relevance with semantic reranking and BM25 score projection in Azure Cosmos DB

DevFeed: [Improve search relevance with semantic reranking and BM25 score projection in Azure Cosmos DB](<https://devfeed.tech/articles/improve-search-relevance-with-semantic-reranking-and-bm25-score-projection-in-azure-cosmos-db-139450.md>)

Original publisher: [Read original article](<https://devblogs.microsoft.com/cosmosdb/improve-search-relevance-with-semantic-reranking-and-bm25-score-projection-in-azure-cosmos-db/>)

Author: Madeline Egan

Published: 2026-11-17T18:45:12Z

Content type: release

Language: en

Sources: [Azure Cosmos DB Blog](<https://devfeed.tech/sources/azure-cosmos-db-blog.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>), [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [Azure](<https://devfeed.tech/topics/azure.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-model](<https://devfeed.tech/tags/ai-model.md>), [azure](<https://devfeed.tech/tags/azure.md>), [azure-cosmos-db](<https://devfeed.tech/tags/azure-cosmos-db.md>), [azure-cosmos-db-for-nosql](<https://devfeed.tech/tags/azure-cosmos-db-for-nosql.md>), [bm25](<https://devfeed.tech/tags/bm25.md>), [full-text-search](<https://devfeed.tech/tags/full-text-search.md>), [projection](<https://devfeed.tech/tags/projection.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [relevance](<https://devfeed.tech/tags/relevance.md>), [reranker](<https://devfeed.tech/tags/reranker.md>), [reranking](<https://devfeed.tech/tags/reranking.md>), [score](<https://devfeed.tech/tags/score.md>), [search](<https://devfeed.tech/tags/search.md>), [semantic](<https://devfeed.tech/tags/semantic.md>), [text](<https://devfeed.tech/tags/text.md>)

### AI overview

Azure Cosmos DB adds two generally available search capabilities: a semantic reranker and full-text score projection. The reranker uses an AI model to reorder retrieved candidates by relevance to a query or task context, which the excerpt recommends considering for natural-language queries, RAG, and hybrid retrieval. Setup includes enabling the account feature, granting the calling identity the Semantic Reranker User role, using Microsoft Entra ID credentials, and sending retrieved candidates to the rerank call. Because reranking adds an inference call, evaluate relevance gains against increased latency and cost. Score projection exposes ranking scores in query output for inspection, thresholding, and debugging. The excerpt also lists additional full-text search features as planned for early 2027.

### Source excerpt

At Ignite 2026 on November 17, we are announcing two generally available capabilities in Azure Cosmos DB to help you build better search experiences: Semantic reranker in Azure Cosmos DB Score projection for full-text ranking These capabilities let you improve result quality and make ranking behavior easier to inspect and tune. Semantic reranker in Azure [...] The post Improve search relevance with semantic reranking and BM25 score projection in Azure Cosmos DB appeared first on Azure Cosmos DB Blog.

## Simplify AI retrieval with embedding generation using Microsoft-Embedding-1

DevFeed: [Simplify AI retrieval with embedding generation using Microsoft-Embedding-1](<https://devfeed.tech/articles/simplify-ai-retrieval-with-embedding-generation-using-microsoft-embedding-1-139451.md>)

Original publisher: [Read original article](<https://devblogs.microsoft.com/cosmosdb/microsoft-embedding-one/>)

Author: Khelan Modi

Published: 2026-11-17T18:45:11Z

Content type: release

Language: en

Sources: [Azure Cosmos DB Blog](<https://devfeed.tech/sources/azure-cosmos-db-blog.md>)

Topics: [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [Vectors & LLMs](<https://devfeed.tech/topics/vectors-llms.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Azure](<https://devfeed.tech/topics/azure.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [analyst](<https://devfeed.tech/tags/analyst.md>), [azure](<https://devfeed.tech/tags/azure.md>), [azure-cosmos-db](<https://devfeed.tech/tags/azure-cosmos-db.md>), [charts](<https://devfeed.tech/tags/charts.md>), [cosmos](<https://devfeed.tech/tags/cosmos.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [financial](<https://devfeed.tech/tags/financial.md>), [generation](<https://devfeed.tech/tags/generation.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [pages](<https://devfeed.tech/tags/pages.md>), [q3](<https://devfeed.tech/tags/q3.md>), [region](<https://devfeed.tech/tags/region.md>), [reports](<https://devfeed.tech/tags/reports.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [revenue](<https://devfeed.tech/tags/revenue.md>), [search](<https://devfeed.tech/tags/search.md>), [tables](<https://devfeed.tech/tags/tables.md>)

### AI overview

Microsoft Embedding 1 creates embeddings for text, images, and document pages in a shared vector space, allowing text queries to retrieve answers in charts, diagrams, and scanned files. The source reports a #1 ranking in its ViDoRe v3 size class (66.24 nDCG@10, as of November 16, 2026). It offers dense and late-interaction multi-vector output: multi-vector retrieval improves visual-document relevance, but can use substantial storage and requires MaxSim scoring. Users can limit vector count and dimensions; 32 vectors of 128 dimensions reportedly gives up about 3.4 nDCG@10 points while reducing storage roughly 300-fold versus unconstrained output. Dense vectors are positioned for text-heavy content, multi-vector for visual documents. The article describes enabling inference on a Cosmos DB account, generating embeddings with preview Python or .NET clients, then storing and searching vectors; input tokens are billed. It says text retrieval scores on par with text-embedding-3-large on BEIR, with smaller vectors, while benchmark results and claims are source-reported.

### Source excerpt

Most enterprise knowledge doesn't live in clean text. It lives in charts, tables, scanned pages, and diagrams, where text-only search often misses it: Financial reports: An analyst asks, "Which region's revenue fell in Q3?" The answer is a bar in a chart on page 14, and no sentence on the page says it. Technical manuals: A [...] The post Simplify AI retrieval with embedding generation using Microsoft-Embedding-1 appeared first on Azure Cosmos DB Blog.

## Classical structural priors improve neural molecular representations in molecule language models

DevFeed: [Classical structural priors improve neural molecular representations in molecule language models](<https://devfeed.tech/articles/classical-structural-priors-improve-neural-molecular-representations-in-molecule-language-models-139148.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.21276>)

Author: Donghyeok Lee, Sangkwon Park, Munyoung Chang, Sungroh Yoon

Published: 2026-11-17T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [AI Models](<https://devfeed.tech/topics/ai-models.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [fingerprint](<https://devfeed.tech/tags/fingerprint.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [neural](<https://devfeed.tech/tags/neural.md>), [property](<https://devfeed.tech/tags/property.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>)

### AI overview

Structure-Aware Guided Alignment (SAGA) is a training-only regularizer for molecule-language models that uses Centered Kernel Alignment to bring neural molecular representations into line with fingerprint-based Tanimoto similarity. It adds no parameters and requires no fingerprints at inference. In MolCA and Atomas, the abstract reports better molecule-text retrieval, closer structural analogues among non-exact retrievals, and higher average scaffold-split property-prediction performance. Molecular description and text-to-molecule generation were improved or preserved in single-run ablations; the abstract does not establish broader run-to-run reliability.

### Source excerpt

arXiv:2611.21276v1 Announce Type: new Abstract: Classical molecular similarity is central to chemical information systems, yet molecule-language models trained on paired structure-text data do not necessarily organize molecular embeddings according to graded structural relationships. Here we introduce Structure-Aware Guided Alignment (SAGA), a training-only regularizer that uses Centered Kernel Alignment to align neural molecular representations with fingerprint-based Tanimoto similarity, without adding parameters or requiring fingerprints at inference. In MolCA and Atomas, SAGA improves molecule-text retrieval, shifts non-exact retrieval toward closer structural analogues, and increases average scaffold-split property-prediction performance, while molecular description and text-to-molecule generation are improved or preserved in single-run ablations. These results show that established chemoinformatics priors can make molecule-language representations more chemically faithful while retaining their multimodal utility.

## How Instacart Uses LLMs to Make People Buy More

DevFeed: [How Instacart Uses LLMs to Make People Buy More](<https://devfeed.tech/articles/how-instacart-uses-llms-to-make-people-buy-more-136317.md>)

Original publisher: [Read original article](<https://blog.bytebytego.com/p/how-instacart-uses-llms-to-make-people>)

Author: ByteByteGo

Published: 2026-11-16T16:30:56Z

Content type: article

Language: en

Sources: [ByteByteGo](<https://devfeed.tech/sources/bytebytego.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>)

Tags: [a-b-testing](<https://devfeed.tech/tags/a-b-testing.md>), [a100](<https://devfeed.tech/tags/a100.md>), [adapter](<https://devfeed.tech/tags/adapter.md>), [advertising](<https://devfeed.tech/tags/advertising.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-software](<https://devfeed.tech/tags/agentic-software.md>), [agents](<https://devfeed.tech/tags/agents.md>), [api](<https://devfeed.tech/tags/api.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [autoscaling](<https://devfeed.tech/tags/autoscaling.md>), [behaviour](<https://devfeed.tech/tags/behaviour.md>), [brand](<https://devfeed.tech/tags/brand.md>), [business-context](<https://devfeed.tech/tags/business-context.md>), [cache](<https://devfeed.tech/tags/cache.md>), [instacart](<https://devfeed.tech/tags/instacart.md>), [llms](<https://devfeed.tech/tags/llms.md>), [product-search](<https://devfeed.tech/tags/product-search.md>), [search](<https://devfeed.tech/tags/search.md>), [shopping](<https://devfeed.tech/tags/shopping.md>)

### AI overview

Instacart combines purchase-history candidates, LLM interpretation, and embedding-based relevance checks to map shopping queries to catalog categories. For rewrites, it separates synonyms, broader terms, and substitutes; the article reports coverage above 95% and precision above 90%. For semantic tags, an offline LLM teacher creates validated examples and cached results, while a LoRA-fine-tuned Llama-3 8B handles uncached live queries. Merging the adapter and moving from A100 to H100 reduced reported serving latency from nearly 700 ms to a 300 ms target. FP8 offered another 10% latency reduction but slightly lowered recall, so Instacart deployed the unquantized model. Caching meant only 2% of queries needed live inference. The article reports A/B test results for tail queries: 6% lower average scroll depth, 50% fewer related complaints, and marginal latency increase.

### Source excerpt

In this article, we'll look at how Instacart used LLMs to build a product search that could accurately understand a user's shopping intention.

## SA-RAG: Structuring Noisy Conversations for Retrieval-Augmented Generation

DevFeed: [SA-RAG: Structuring Noisy Conversations for Retrieval-Augmented Generation](<https://devfeed.tech/articles/sa-rag-structuring-noisy-conversations-for-retrieval-augmented-generation-135692.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2605.24366>)

Author: Kaiqiao Han, LuAn Tang, Renliang Sun, Peng Yuan, Wei Cheng, Haoyu Wang, Wei Wang, Yizhou Sun, Haifeng Chen

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Enhancing AI model performance](<https://devfeed.tech/topics/enhancing-ai-model-performance.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Conversational AI](<https://devfeed.tech/topics/conversational-ai.md>)

Tags: [consistency](<https://devfeed.tech/tags/consistency.md>), [conversations](<https://devfeed.tech/tags/conversations.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [external](<https://devfeed.tech/tags/external.md>), [framework](<https://devfeed.tech/tags/framework.md>), [induction](<https://devfeed.tech/tags/induction.md>), [information-retrieval](<https://devfeed.tech/tags/information-retrieval.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [llms](<https://devfeed.tech/tags/llms.md>), [quality](<https://devfeed.tech/tags/quality.md>), [rag](<https://devfeed.tech/tags/rag.md>), [rag-applications](<https://devfeed.tech/tags/rag-applications.md>), [real-world](<https://devfeed.tech/tags/real-world.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>), [robust](<https://devfeed.tech/tags/robust.md>), [semantic](<https://devfeed.tech/tags/semantic.md>)

### AI overview

SA-RAG aims to make retrieval-augmented generation more robust to noisy conversational data by inducing intermediate table structures directly from it, rather than assuming clean, high-quality structures are already available. Its quality-aware induction jointly models semantic and structural consistency. The paper explores both training-free and training-based strategies to improve structure quality while preserving fidelity. Experiments on two noisy real-world datasets reportedly show significant gains over existing RAG baselines; further analysis emphasizes the importance of high-quality structures. The supplied text does not specify the datasets, metrics, or strategy details.

### Source excerpt

arXiv:2605.24366v2 Announce Type: replace-cross Abstract: Large Language Models (LLMs) have been widely adopted in conversational applications. However, their reliance on parametric knowledge limits reliability in real-world scenarios that require dynamic or domain-specific information. Retrieval-Augmented Generation (RAG) addresses this limitation by incorporating external knowledge during generation, but existing RAG methods often struggle with noisy or irrelevant contexts, as they typically assume that high-quality structures are already available. In this work, we propose Structure-aware Retrieval-Augmented Generation (SA-RAG), a principled structure induction and generation framework that constructs reliable intermediate structures directly from noisy conversational data. SA-RAG uses tables as compact and controllable structured representations. We introduce a quality-aware structure induction framework that jointly models semantic and structural consistency. Furthermore, we explore both training-free and training-based structure generation strategies to further improve structure quality while maintaining fidelity. Experiments on two noisy real-world datasets show that SA-RAG significantly outperforms existing RAG baselines. Further analysis highlights that high-quality structural representations are crucial for robust RAG applications.

## Evaluating Large Language Models for Scientific Paper Search: Retrieval Success and Inference Latency on Mac Studio and NVIDIA A100

DevFeed: [Evaluating Large Language Models for Scientific Paper Search: Retrieval Success and Inference Latency on Mac Studio and NVIDIA A100](<https://devfeed.tech/articles/evaluating-large-language-models-for-scientific-paper-search-retrieval-success-and-inference-latency-on-mac-studio-and-nvidia-a100-135147.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.17929>)

Author: Frederic Andriantseheno Rakoto (Mnemosyne), Yannis Bendi-Ouis (Mnemosyne), Xavier Hinaut (Mnemosyne)

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Self Hosted AI Tools](<https://devfeed.tech/topics/self-hosted-ai-tools.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>)

Tags: [a100](<https://devfeed.tech/tags/a100.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [context](<https://devfeed.tech/tags/context.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [gpus](<https://devfeed.tech/tags/gpus.md>), [inference](<https://devfeed.tech/tags/inference.md>), [infrastructure](<https://devfeed.tech/tags/infrastructure.md>), [input](<https://devfeed.tech/tags/input.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [latency](<https://devfeed.tech/tags/latency.md>), [literature](<https://devfeed.tech/tags/literature.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mac-studio](<https://devfeed.tech/tags/mac-studio.md>), [memory](<https://devfeed.tech/tags/memory.md>), [model](<https://devfeed.tech/tags/model.md>), [nvidia-a100](<https://devfeed.tech/tags/nvidia-a100.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>)

### AI overview

The study evaluates whether locally deployed open-weight language models can retrieve scientific papers with web assistance. It measures inference latency across input contexts from 512 to 128k tokens on a Mac Studio and a server with two NVIDIA A100 GPUs, then tests eight models on 70 papers from seven repositories using queries at three levels of domain knowledge. Retrieval success varies with both model choice and query specificity. The A100 setup is generally faster, while the Mac Studio's unified memory can accommodate larger models that would not load in the tested GPU configuration.

### Source excerpt

arXiv:2611.17929v1 Announce Type: new Abstract: Scientific literature search can benefit from locally deployed LLM assistants, which reduce reliance on hosted model providers while giving research teams greater control over their data and infrastructure. This work investigates whether open-weight models can support web-assisted paper retrieval under practical computing constraints. We first characterize inference latency as the input context grows from 512 to 128k tokens on a Mac Studio and a server equipped with two NVIDIA A100 GPUs. We then evaluate eight models on the retrieval of 70 papers from seven scientific repositories, using queries that represent three levels of domain knowledge. The results show that retrieval success depends strongly on the selected model and the specificity of the query. And that A100 GPUs are generally faster than the Mac Studio, but its unified memory allows larger models that could not be loaded in the tested GPU configuration.

## GenTUS: Table Union Search via Constrained Generation of Semantic Table Identifiers

DevFeed: [GenTUS: Table Union Search via Constrained Generation of Semantic Table Identifiers](<https://devfeed.tech/articles/gentus-table-union-search-via-constrained-generation-of-semantic-table-identifiers-135437.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2607.00833>)

Author: Shulun Zhang, Linting Wang, Yuwei Xu, Yingli Zhou, Jieming Shi, Chenhao Ma

Published: 2026-11-16T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Databases](<https://devfeed.tech/sources/arxiv-databases.md>)

Topics: [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [search-engines](<https://devfeed.tech/topics/search-engines.md>), [data lake](<https://devfeed.tech/topics/data-lake.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [analytics](<https://devfeed.tech/tags/analytics.md>), [beam](<https://devfeed.tech/tags/beam.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [cs-db](<https://devfeed.tech/tags/cs-db.md>), [data-discovery](<https://devfeed.tech/tags/data-discovery.md>), [data-lake](<https://devfeed.tech/tags/data-lake.md>), [enrichment](<https://devfeed.tech/tags/enrichment.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generative](<https://devfeed.tech/tags/generative.md>), [identifier](<https://devfeed.tech/tags/identifier.md>), [latency](<https://devfeed.tech/tags/latency.md>), [quality](<https://devfeed.tech/tags/quality.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>), [semantic](<https://devfeed.tech/tags/semantic.md>), [storage](<https://devfeed.tech/tags/storage.md>), [supervision](<https://devfeed.tech/tags/supervision.md>), [table](<https://devfeed.tech/tags/table.md>), [union](<https://devfeed.tech/tags/union.md>), [vector](<https://devfeed.tech/tags/vector.md>), [vector-index](<https://devfeed.tech/tags/vector-index.md>)

### AI overview

GenTUS retrieves unionable tables by generating their semantic identifiers directly from a query table. It learns compact identifiers with pairwise unionability supervision, encouraging compatible tables to share prefixes, then uses prefix-constrained beam search so every generated identifier maps to an existing table. The generated order provides the ranking without searching or reranking a candidate pool, which avoids the candidate-recall limitation described for encode-search-refine methods. Across seven public benchmarks, the abstract reports the best overall retrieval quality, with the largest gains on larger and more diverse benchmarks, plus substantially lower online retrieval time and retrieval-artifact storage than prior TUS methods.

### Source excerpt

arXiv:2607.00833v2 Announce Type: replace Abstract: Modern data lakes contain heterogeneous tables, and the information needed for a task is often scattered across many tables with different schemas, sources, and naming conventions. Table union search (TUS) retrieves tables whose rows are semantically compatible with a query table for union, supporting data discovery, enrichment, and downstream analytics. Existing TUS methods follow an encode-search-refine pipeline: they embed tables or columns, retrieve a candidate pool from a vector index, and refine it by query-candidate matching or reranking. As a result, a unionable table missed by candidate retrieval cannot be recovered later, and searching and refining a pool for every query adds latency and storage costs that grow with the data lake. We propose GenTUS, a generative retrieval framework that reformulates TUS as constrained generation over discrete semantic table identifiers. GenTUS assigns each data-lake table a compact identifier learned under pairwise unionability supervision, which encourages unionable tables to share identifier prefixes, and trains a generator to produce the identifiers of unionable tables directly from the query table. At query time, prefix-constrained beam search guarantees that every generated identifier maps to an existing table, and its output order serves directly as the ranking, with no candidate pool to search or rerank. Experiments on seven public TUS benchmarks show that GenTUS achieves the best overall retrieval quality, with the largest gains on the larger and more diverse benchmarks, while requiring substantially lower online retrieval time and retrieval-artifact storage than prior TUS methods.

## Web search for agents is here: Why ranking still decides the answer

DevFeed: [Web search for agents is here: Why ranking still decides the answer](<https://devfeed.tech/articles/web-search-for-agents-is-here-why-ranking-still-decides-the-answer-134078.md>)

Original publisher: [Read original article](<https://thenewstack.io/ai-agent-search-ranking/>)

Author: Bonnie Chase

Published: 2026-11-14T16:00:00Z

Content type: article

Language: en

Sources: [The New Stack](<https://devfeed.tech/sources/the-new-stack.md>)

Topics: [information retrieval](<https://devfeed.tech/topics/information-retrieval.md>), [search-engines](<https://devfeed.tech/topics/search-engines.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Web](<https://devfeed.tech/topics/web.md>)

Tags: [2](<https://devfeed.tech/tags/2.md>), [22](<https://devfeed.tech/tags/22.md>), [3](<https://devfeed.tech/tags/3.md>), [about](<https://devfeed.tech/tags/about.md>), [access-controls](<https://devfeed.tech/tags/access-controls.md>), [account](<https://devfeed.tech/tags/account.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-engineering](<https://devfeed.tech/tags/ai-engineering.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [but](<https://devfeed.tech/tags/but.md>), [first](<https://devfeed.tech/tags/first.md>), [here](<https://devfeed.tech/tags/here.md>), [information](<https://devfeed.tech/tags/information.md>), [needs](<https://devfeed.tech/tags/needs.md>), [post-contributed](<https://devfeed.tech/tags/post-contributed.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [search](<https://devfeed.tech/tags/search.md>), [sponsor-vespa-ai](<https://devfeed.tech/tags/sponsor-vespa-ai.md>), [sponsored-post-contributed](<https://devfeed.tech/tags/sponsored-post-contributed.md>), [url](<https://devfeed.tech/tags/url.md>), [vespa-ai](<https://devfeed.tech/tags/vespa-ai.md>), [web](<https://devfeed.tech/tags/web.md>), [web-search](<https://devfeed.tech/tags/web-search.md>)

### AI overview

Live web search helps agents find current pages, but a retrieval layer must decide which web and internal evidence to trust and show. The article warns that simply concatenating results can leave conflicts unresolved, favor stale but similar documents, expose restricted content if permissions are checked too late, and increase cost and latency across repeated agent calls. It recommends combining keyword, vector, and structured filtering; ranking with explicit freshness, source authority, and business rules; enforcing permissions at query time; and sending only relevant passages to the model. External results can be indexed with internal data when permitted or kept separate and fused or reranked later; these choices trade off latency, freshness, score comparability, and complexity. The article also advises measuring retrieval quality separately from answer generation and load-testing at realistic agent call volumes.

### Source excerpt

AI agents have had a URL problem for a while. When an agent needs current information but has no search The post Web search for agents is here: Why ranking still decides the answer appeared first on The New Stack.

## How to Evaluate Snowflake Cortex Embedding Models for Enterprise Search

DevFeed: [How to Evaluate Snowflake Cortex Embedding Models for Enterprise Search](<https://devfeed.tech/articles/how-to-evaluate-snowflake-cortex-embedding-models-for-enterprise-search-133909.md>)

Original publisher: [Read original article](<https://hackernoon.com/how-to-evaluate-snowflake-cortex-embedding-models-for-enterprise-search?source=rss>)

Author: Akshay Sharma

Published: 2026-11-14T03:45:02Z

Content type: article

Language: en

Sources: [HackerNoon](<https://devfeed.tech/sources/hackernoon.md>)

Topics: [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [hybrid-search](<https://devfeed.tech/topics/hybrid-search.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [search-engines](<https://devfeed.tech/topics/search-engines.md>), [Vectors & LLMs](<https://devfeed.tech/topics/vectors-llms.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [8k](<https://devfeed.tech/tags/8k.md>), [account](<https://devfeed.tech/tags/account.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-assistant](<https://devfeed.tech/tags/ai-assistant.md>), [arctic](<https://devfeed.tech/tags/arctic.md>), [cortex](<https://devfeed.tech/tags/cortex.md>), [cost](<https://devfeed.tech/tags/cost.md>), [data-engineering](<https://devfeed.tech/tags/data-engineering.md>), [dimensions](<https://devfeed.tech/tags/dimensions.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embedding-models](<https://devfeed.tech/tags/embedding-models.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [enterprise-search](<https://devfeed.tech/tags/enterprise-search.md>), [models](<https://devfeed.tech/tags/models.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rag](<https://devfeed.tech/tags/rag.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>), [semantic-search](<https://devfeed.tech/tags/semantic-search.md>), [snowflake](<https://devfeed.tech/tags/snowflake.md>), [snowflake-cortex](<https://devfeed.tech/tags/snowflake-cortex.md>), [text](<https://devfeed.tech/tags/text.md>), [vector](<https://devfeed.tech/tags/vector.md>), [vector-databases](<https://devfeed.tech/tags/vector-databases.md>)

### AI overview

Snowflake Cortex makes embedding generation through AI_EMBED straightforward, but choosing among its eight text models requires testing retrieval on the enterprise workload. The article recommends starting with a compact English model for short English documents, evaluating multilingual candidates on cross-language queries, and comparing long-context models with chunking for lengthy or mixed-topic documents. Larger vectors and longer context windows do not guarantee better retrieval; dimensions alone are not a quality measure. Semantic similarity can miss exact error codes and identifiers, so hybrid lexical and vector retrieval may help. Evaluate candidates on representative queries and relevant documents, weigh failure impact, check account and regional availability and current pricing, and record model and chunking versions because changing models may require re-embedding the corpus. No comparative benchmark winner is claimed.

### Source excerpt

Snowflake Cortex offers eight text embedding models, but which one should you choose? Explore vector dimensions, multilingual retrieval, performance, and cost.

## Bing now has an "-ai" operator for search results without the AI

DevFeed: [Bing now has an "-ai" operator for search results without the AI](<https://devfeed.tech/articles/bing-now-has-an-ai-operator-for-search-results-without-the-ai-133449.md>)

Original publisher: [Read original article](<https://www.techspot.com/news/114557-bing-now-has-ai-operator-search-results-without.html>)

Author: Alfonso Maruccia

Published: 2026-11-13T23:24:00Z

Content type: news

Language: en

Sources: [TechSpot](<https://devfeed.tech/sources/techspot.md>)

Topics: [search-engines](<https://devfeed.tech/topics/search-engines.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [Chrome extension](<https://devfeed.tech/topics/chrome-extension.md>), [Extension](<https://devfeed.tech/topics/extension.md>), [Google Search](<https://devfeed.tech/topics/google-search.md>), [Google Chrome](<https://devfeed.tech/topics/google-chrome.md>), [Edge](<https://devfeed.tech/topics/edge.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-answers](<https://devfeed.tech/tags/ai-answers.md>), [ai-features](<https://devfeed.tech/tags/ai-features.md>), [ai-industry](<https://devfeed.tech/tags/ai-industry.md>), [ai-mode](<https://devfeed.tech/tags/ai-mode.md>), [ai-search](<https://devfeed.tech/tags/ai-search.md>), [ai-summaries](<https://devfeed.tech/tags/ai-summaries.md>), [bing](<https://devfeed.tech/tags/bing.md>), [browser-extension](<https://devfeed.tech/tags/browser-extension.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [choice](<https://devfeed.tech/tags/choice.md>), [chrome](<https://devfeed.tech/tags/chrome.md>), [chromium](<https://devfeed.tech/tags/chromium.md>), [custom](<https://devfeed.tech/tags/custom.md>), [data-center](<https://devfeed.tech/tags/data-center.md>), [extensions](<https://devfeed.tech/tags/extensions.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [google](<https://devfeed.tech/tags/google.md>), [microsoft](<https://devfeed.tech/tags/microsoft.md>), [microsoft-edge](<https://devfeed.tech/tags/microsoft-edge.md>), [operator](<https://devfeed.tech/tags/operator.md>), [search](<https://devfeed.tech/tags/search.md>), [the-web](<https://devfeed.tech/tags/the-web.md>), [users](<https://devfeed.tech/tags/users.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

Microsoft's Bing offers two ways to suppress its AI summaries: install the Microsoft Bing AI Search Choice browser extension, which works with Chrome and Edge and lets users toggle AI summaries, or add the "-ai" operator to a query. Users can configure a custom search engine to append the operator automatically. The text says the operator is an option for users who do not want to install an add-on; it does not establish that either method removes AI features beyond Bing's service. It also cites a study estimating frequent errors in Google AI Overviews, which Google disputes, and reports disagreement over Google's AI-related policies in schools.

### Source excerpt

After being among the first to incorporate ChatGPT-style AI answers on Bing, Microsoft has acknowledged that some people don't want to deal with AI's answers in their web searches. The company has now unveiled a browser extension designed to give users a choice between "full" AI-powered search results and traditional... Read Entire Article

[Next page](<https://devfeed.tech/topics/ai-driven-information-retrieval.md?cursor=WyIyMDI2LTExLTEzVDIzOjI0OjAwKzAwOjAwIiwgImVhNmU5NDRhLTI3YjItNDgyYS1hYzkxLWY4YmUxOGYxNjRmZSJd>)