# AI Chat

AI chat software combines conversational interfaces with artificial intelligence models to generate responses, answer questions, and support interactive tasks. Projects in this topic include web and desktop chat applications, developer libraries for building chat interfaces, self-hosted assistants, and integrations that connect language models with tools, data, and multimodal input.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Google Is Putting AI Chats Right On the Homepage

DevFeed: [Google Is Putting AI Chats Right On the Homepage](<https://devfeed.tech/articles/google-is-putting-ai-chats-right-on-the-homepage-146415.md>)

Original publisher: [Read original article](<https://tech.slashdot.org/story/26/11/20/0138234/google-is-putting-ai-chats-right-on-the-homepage>)

Author: BeauHD

Published: 2026-11-20T17:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [Google Search](<https://devfeed.tech/topics/google-search.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Google](<https://devfeed.tech/topics/google.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-mode](<https://devfeed.tech/tags/ai-mode.md>), [autocomplete](<https://devfeed.tech/tags/autocomplete.md>), [chatbot](<https://devfeed.tech/tags/chatbot.md>), [desktop](<https://devfeed.tech/tags/desktop.md>), [google](<https://devfeed.tech/tags/google.md>), [web-search](<https://devfeed.tech/tags/web-search.md>)

### AI overview

Google is rolling out a redesigned desktop homepage with a collapsible sidebar that lets users return to and continue previous AI Mode searches. Product vice president Robby Stein says the feature responds to people asking Search questions that require more than one interaction; Google's testing found the sidebar helped users make progress and keep exploring the web. The excerpt places this change alongside earlier additions: an AI Mode button that opens a chatbot-like search experience and a search box updated for longer queries and AI-powered autocomplete.

### Source excerpt

Google is rolling out a redesigned desktop homepage that adds a collapsible sidebar for accessing and continuing previous AI Mode searches. Google's vice president of product, Robby Stein, says the company is rolling out the option because "people are coming to Search with more questions that aren't just one and done," adding that "in testing, this sidebar made a big difference for making progress & continuing to explore the web." The Verge reports: It's yet another big change for Google's homepage, which has long presented you with a single bar to kick off your web search. The company brought its AI Mode button to its search bar last year, which opens up a chatbot-like search experience within Google. In May, Google updated its search box to accommodate longer queries and added AI-powered autocomplete. Read more of this story at Slashdot.

## Chapter 3: Build Your First Workflow in n8n

DevFeed: [Chapter 3: Build Your First Workflow in n8n](<https://devfeed.tech/articles/chapter-3-build-your-first-workflow-in-n8n-146462.md>)

Original publisher: [Read original article](<https://linuxhandbook.com/courses/n8n/build-your-n8n-workflow/>)

Author: Yash Kiran Patil

Published: 2026-11-20T14:21:03Z

Content type: tutorial

Language: en

Sources: [Linux Handbook](<https://devfeed.tech/sources/linux-handbook.md>)

Topics: [n8n](<https://devfeed.tech/topics/n8n.md>), [workflow automation](<https://devfeed.tech/topics/workflow-automation.md>), [Tutorial](<https://devfeed.tech/topics/tutorial.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [airtable](<https://devfeed.tech/tags/airtable.md>), [api-key](<https://devfeed.tech/tags/api-key.md>), [credentials](<https://devfeed.tech/tags/credentials.md>), [customer-feedback](<https://devfeed.tech/tags/customer-feedback.md>), [n8n](<https://devfeed.tech/tags/n8n.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

A basic n8n workflow starts with a trigger, then passes data between connected nodes, each of which can process input and produce output. Triggers include manual runs for development, app events, schedules, form submissions, chat messages, and webhooks. The tutorial builds a feedback tracker: a form collects a name and review, an Information Extractor uses a connected language model to return a review and sentiment label, and an Airtable node creates a record. It gives setup guidance for OpenAI credentials and Airtable Personal Access Tokens, including limiting token access to the example base. The chapter recommends testing with fictional positive and negative feedback, checking model results because classifications can be wrong, and verifying field mappings. It frames this as a learning example; real use calls for validation, human review, and decisions about data collection, access, and retention. Google Sheets is mentioned as another storage option.

### Source excerpt

We have learned what n8n is and explored its interface. Now we can look at how workflows are put together and build a first example. Before opening the editor, let's clarify what a workflow is. To explain the workflow component let's make an example like this: This is

## 21 ways Gemini can genuinely be useful on Android

DevFeed: [21 ways Gemini can genuinely be useful on Android](<https://devfeed.tech/articles/21-ways-gemini-can-genuinely-be-useful-on-android-146554.md>)

Original publisher: [Read original article](<https://www.computerworld.com/article/4007736/21-ways-gemini-can-genuinely-be-useful-on-android.html>)

Author: JR Raphael

Published: 2026-11-20T10:45:00Z

Content type: tutorial

Language: en

Sources: [Computerworld](<https://devfeed.tech/sources/computerworld.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-chatbots](<https://devfeed.tech/tags/ai-chatbots.md>), [android](<https://devfeed.tech/tags/android.md>), [android-artificial-intelligence-google-machine-learning-productivity-software](<https://devfeed.tech/tags/android-artificial-intelligence-google-machine-learning-productivity-software.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [chatbot](<https://devfeed.tech/tags/chatbot.md>), [context](<https://devfeed.tech/tags/context.md>), [device](<https://devfeed.tech/tags/device.md>), [edition-us](<https://devfeed.tech/tags/edition-us.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [google](<https://devfeed.tech/tags/google.md>), [google-assistant](<https://devfeed.tech/tags/google-assistant.md>), [google-s](<https://devfeed.tech/tags/google-s.md>), [graveyard](<https://devfeed.tech/tags/graveyard.md>), [industry](<https://devfeed.tech/tags/industry.md>), [language-en](<https://devfeed.tech/tags/language-en.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [like](<https://devfeed.tech/tags/like.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [productivity](<https://devfeed.tech/tags/productivity.md>), [productivity-software](<https://devfeed.tech/tags/productivity-software.md>), [rap](<https://devfeed.tech/tags/rap.md>), [search](<https://devfeed.tech/tags/search.md>), [storytype-tips](<https://devfeed.tech/tags/storytype-tips.md>), [tasks](<https://devfeed.tech/tags/tasks.md>), [technology](<https://devfeed.tech/tags/technology.md>)

### AI overview

Gemini is presented as most useful on Android for practical tasks rather than as a reliable answer engine: the excerpt says large language models can misunderstand context and give wrong answers, while Gemini still lacks some Google Assistant device basics. Examples include setting reminders, remembering details, saving notes to Google Keep, finding and labeling locations, navigating, checking or creating calendar events, making contacts from cards or visible information, summarizing on-screen documents, YouTube videos, and--when Gmail/Workspace integration is active--recent emails. It can also identify visible items and handle phone tasks such as checking battery, taking or showing screenshots, texting, calling, adjusting volume and settings, and opening system settings. These capabilities depend on the described integrations and on-screen context; the excerpt does not establish that every command works in all configurations.

### Source excerpt

Google's Gemini chatbot gets a bit of a bad rap as an Android assistant -- and, let's be honest: It's easy to see why. Google rushed Gemini out of the gates long before it was ready. It crippled the perfectly fine Google Assistant experience, and even with all the progress over time, Gemini still can't do everything Assistant did in terms of day-to-day device basics -- despite having now fully replaced Assistant and sent that service to the Google Graveyard. Beyond that, Gemini can be complicated and confusing, with its many models and cryptically coded options. It's being shoved in our faces at every possible opportunity in a move reminiscent of a certain other much-maligned Google service. And, most troubling of all, it's being positioned as an all-purpose answer machine when it gets answers wildly wrong anywhere from 5 to 20% of the time. Just like all the other generative AI chatbots of the moment, in other words, it's a steaming hot mess -- even if it's all anyone in the tech industry wants to talk about these days. But the problem with Gemini (and other similar systems) is less the technology itself and more the way its maker insists on framing it. These large-language model mechanisms just aren't good at understanding context or offering consistently reliable answers. They shouldn't be set up to serve as replacements for search. They get stuff wrong shockingly often, for cryin' out loud. It's par for the course with the underlying technology, and it's just plain silly to see the results. (Seriously: The hits keep comin' -- and comin', and comin', and...well, you get the idea.) They are, however, useful in other ways -- namely when it comes to more subjective, mundane sorts of tasks where context, judgment, and a lack of flat-out fabricating aren't required. Here, specifically, are 21 simple ways Gemini can genuinely be useful and worth using on Android -- with minimal "AI" (in the current sense of the term), no "creative brainstorming" ballyhoo, and absolutely no err

## Best Tools for AI Support Agents

DevFeed: [Best Tools for AI Support Agents](<https://devfeed.tech/articles/best-tools-for-ai-support-agents-146956.md>)

Original publisher: [Read original article](<https://www.swytchcode.com/content/best-tools-ai-support-agents>)

Author: Swytchcode Team

Published: 2026-11-20T09:00:00Z

Content type: comparison

Language: en

Sources: [Swytchcode](<https://devfeed.tech/sources/swytchcode.md>)

Topics: [Support](<https://devfeed.tech/topics/support.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Tool](<https://devfeed.tech/topics/tool.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [access-control](<https://devfeed.tech/tags/access-control.md>), [actions](<https://devfeed.tech/tags/actions.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-frameworks](<https://devfeed.tech/tags/agent-frameworks.md>), [agent-tools](<https://devfeed.tech/tags/agent-tools.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-answers](<https://devfeed.tech/tags/ai-answers.md>), [ai-help](<https://devfeed.tech/tags/ai-help.md>), [best](<https://devfeed.tech/tags/best.md>), [fin](<https://devfeed.tech/tags/fin.md>), [intercom](<https://devfeed.tech/tags/intercom.md>), [scout](<https://devfeed.tech/tags/scout.md>), [send](<https://devfeed.tech/tags/send.md>), [stop](<https://devfeed.tech/tags/stop.md>), [support](<https://devfeed.tech/tags/support.md>), [tools](<https://devfeed.tech/tags/tools.md>), [use-cases](<https://devfeed.tech/tags/use-cases.md>)

### AI overview

The review finds that the five support platforms can draft replies, but the supplied November 2026 documentation does not establish a hard, client-independent boundary that reliably gates sending, refunds, or account closures. Controls vary: Intercom offers a human pause inside a configured procedure; Zendesk offers discrete actions and rollout guidance, while Auto Assist can act on its own; Freshdesk supports refund skills but the reviewed material does not document action confirmations or Copilot sign-off behavior; Help Scout separates self-serve answers from human-sent inbox drafts, though its send API lacks a built-in draft safeguard; and Decagon documents procedures and escalation rules without verified platform-level enforcement. Pricing models differ and do not determine permissions. The text presents Swytchcode as an execution layer that applies allowlists and approval policies at the API call, with held calls failing closed if approval times out. Its policy examples are illustrative and require discovering canonical method IDs.

### Source excerpt

We ranked Intercom Fin, Zendesk AI, Freddy AI, Help Scout AI and Decagon on one question: can they actually stop a send, refund or close before it happens?

## 4 ways to automate ChatGPT with Zapier MCP

DevFeed: [4 ways to automate ChatGPT with Zapier MCP](<https://devfeed.tech/articles/4-ways-to-automate-chatgpt-with-zapier-mcp-146776.md>)

Original publisher: [Read original article](<https://zapier.com/blog/automate-chatgpt-zapier-mcp>)

Author: Steph Spector

Published: 2026-11-20T05:00:00Z

Content type: tutorial

Language: en

Sources: [Zapier](<https://devfeed.tech/sources/zapier.md>)

Topics: [ChatGPT](<https://devfeed.tech/topics/chatgpt.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-tools](<https://devfeed.tech/tags/ai-tools.md>), [apps](<https://devfeed.tech/tags/apps.md>), [automate](<https://devfeed.tech/tags/automate.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [zapier](<https://devfeed.tech/tags/zapier.md>), [zapier-automation](<https://devfeed.tech/tags/zapier-automation.md>)

### AI overview

Zapier MCP connects ChatGPT to apps through Zapier-managed logins, letting it create or update records and send messages across 10,000+ apps. The text outlines setup in Zapier's MCP dashboard, then four examples: draft content into Google Docs, research a prospect and update HubSpot, turn meeting notes into Asana tasks, and summarize Google Sheets metrics in Notion. For repeated work, ChatGPT can draft a Zap that runs on a schedule or app events after the chat closes. Zapier logs failed runs and proposes fixes; it may also replace repeated AI steps with regular steps to reduce token use. The article contrasts this with built-in ChatGPT connectors, which cover fewer apps, and scheduled tasks, which redo every step each run. Connections can also be used by other MCP-supporting AI tools.

### Source excerpt

Lots of AI tools give you ways to take action in other apps, and I've tried a handful of them. The problem is they're almost always locked to one ecosystem, or they connect to just one app at a time, which defeats the purpose. I'd get something working, then hit a wall the moment I needed it to reach into a different corner of my stack. Zapier MCP is different. Install it once in ChatGPT (or any AI tool that supports MCP) and it can reach apps, with Zapier handling each app's login so ChatGPT n

## How Feedback-Free Self-Evolution Reshapes Agent Skills: A Systematic Study

DevFeed: [How Feedback-Free Self-Evolution Reshapes Agent Skills: A Systematic Study](<https://devfeed.tech/articles/how-feedback-free-self-evolution-reshapes-agent-skills-a-systematic-study-145532.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25534>)

Author: Litao Guo, Man Chen, Xinli Xu, Jinsong Zhou, Zixin Zhang, Ying-Cong Chen

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Agent Skills](<https://devfeed.tech/topics/agent-skills.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-skills](<https://devfeed.tech/tags/agent-skills.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [evolution](<https://devfeed.tech/tags/evolution.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [experts](<https://devfeed.tech/tags/experts.md>), [feedback](<https://devfeed.tech/tags/feedback.md>), [knowledge](<https://devfeed.tech/tags/knowledge.md>), [model](<https://devfeed.tech/tags/model.md>), [pass](<https://devfeed.tech/tags/pass.md>), [skills](<https://devfeed.tech/tags/skills.md>), [study](<https://devfeed.tech/tags/study.md>)

### AI overview

In experiments where models repeatedly rewrote expert skills without tasks, runs, or judgments, the skills became less useful: every tested model performed worse on every benchmark, with an average 15-point drop on SkillsBench after 30 rounds. The authors find that rewriting pulls skills toward what each model already tends to produce, discarding knowledge outside that prior first. Restoring this knowledge recovers much of the lost pass rate. Their SkillDiff method marks that knowledge and improves SkillsBench pass rate by an average 4.8 points, without feedback or changing the skill text. These findings are reported in the supplied abstract.

### Source excerpt

arXiv:2611.25534v1 Announce Type: new Abstract: Agent skills are documents in which experts write down procedural knowledge, and models increasingly maintain them by rewriting them without feedback. Such rewriting could adapt a skill to the model that uses it or erode the expert knowledge that makes it useful, yet how skills evolve under this feedback-free self-evolution has not been studied. We let models rewrite expert skills round after round without any task, run or judgment and run agents built on the same models with the rewritten skills. Our experiments show that the skills lose value rather than improve, as every model we test performs worse with them on every benchmark, by 15 points on average on SkillsBench after thirty rounds. Sampling each model's prior with skills it writes from the topic alone, we find that rewriting pulls skills toward this prior and gives up first the knowledge outside it. Putting this knowledge back recovers much of the lost pass rate, so an expert's skill is valuable largely for what the model does not write on its own. Building on this insight, SkillDiff marks this knowledge in place and raises the pass rate on SkillsBench by 4.8 points on average without feedback or any change to the skill's text. Project repository: https://github.com/LitaoGuo/How-Self-Evolution-Reshapes-Skills.

## From Reliance to Overreliance: Taxonomizing and Detecting Relational Risks in AI Companionship

DevFeed: [From Reliance to Overreliance: Taxonomizing and Detecting Relational Risks in AI Companionship](<https://devfeed.tech/articles/from-reliance-to-overreliance-taxonomizing-and-detecting-relational-risks-in-ai-companionship-145579.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25734>)

Author: Viet Cuong Nguyen, Fiona Li, Chang Wan, Sheyril Agarwal, Nhi Nguyen, Angel Hsing-Chi Hwang, Munmun De Choudhury

Published: 2026-11-20T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [trust and safety](<https://devfeed.tech/topics/trust-and-safety.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [companion](<https://devfeed.tech/tags/companion.md>), [confidence](<https://devfeed.tech/tags/confidence.md>), [conversations](<https://devfeed.tech/tags/conversations.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-hc](<https://devfeed.tech/tags/cs-hc.md>), [dependency](<https://devfeed.tech/tags/dependency.md>), [llms](<https://devfeed.tech/tags/llms.md>), [replika](<https://devfeed.tech/tags/replika.md>), [risks](<https://devfeed.tech/tags/risks.md>), [safety](<https://devfeed.tech/tags/safety.md>), [support](<https://devfeed.tech/tags/support.md>), [taxonomy](<https://devfeed.tech/tags/taxonomy.md>), [users](<https://devfeed.tech/tags/users.md>)

### AI overview

The Taxonomy of Relational Risks separates observable emotional overreliance (EO) behaviors from evidence of relational harm (RH), so reliance is not treated as harm by itself. In naturalistic Character.AI and Replika conversations from 110 adults, EO-related behaviors appeared in 63.2% of non-roleplay conversations, while observable harms appeared in 10.5%; recurring EO patterns often co-occurred with harm. Open-source LLMs satisfactorily detected 12 of 14 EO behaviors in at least one configuration. The authors propose graduated safety interventions tailored to EO behavior patterns and trajectories.

### Source excerpt

arXiv:2611.25734v1 Announce Type: cross Abstract: Companion AIs are increasingly used for emotional support, yet distinguishing meaningful engagement from harmful reliance remains difficult. We introduce the Taxonomy of Relational Risks (TRR), which operationalizes users' emotional overreliance (EO) as observable conversational behaviors and separately identifies evidence of relational harm (RH), enabling empirical examination of when reliance behaviors co-occur with adverse consequences. Using naturalistic Character.AI and Replika conversations from 110 adults, we found EO-related behaviors in 63.2% of non-roleplay conversations, while observable relational harms appeared in 10.5%. Although EO did not necessarily lead to harm, recurring patterns often co-occurred with harmful outcomes, suggesting value as risk indicators. Open-source LLMs satisfactorily detected 12 of 14 EO behaviors in at least one configuration. Qualitative analysis revealed expectations of care, repeated support seeking, dependency, distress, and reduced confidence in personal judgment. We argue for graduated safety interventions tailored to patterns and trajectories of EO-related behavior.

## Question, Then Affirm: Restoring Commitment Does Not Restore Refusal

DevFeed: [Question, Then Affirm: Restoring Commitment Does Not Restore Refusal](<https://devfeed.tech/articles/question-then-affirm-restoring-commitment-does-not-restore-refusal-146050.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25929>)

Author: Haoyang Xu, Qirui Wang, Liuwan Zhu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Image](<https://devfeed.tech/topics/image.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [behavior](<https://devfeed.tech/tags/behavior.md>), [challenge](<https://devfeed.tech/tags/challenge.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [deferred](<https://devfeed.tech/tags/deferred.md>), [element](<https://devfeed.tech/tags/element.md>), [elements](<https://devfeed.tech/tags/elements.md>), [generation](<https://devfeed.tech/tags/generation.md>), [gpt-image-2](<https://devfeed.tech/tags/gpt-image-2.md>), [image-generation](<https://devfeed.tech/tags/image-generation.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [meaning](<https://devfeed.tech/tags/meaning.md>), [question](<https://devfeed.tech/tags/question.md>), [restore](<https://devfeed.tech/tags/restore.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

On a 300-case challenge set, gpt-image-2 generated images for 43.3% of harmful requests phrased as questions followed by an affirmation, versus 16.3% of direct statements; the images endorsed the original proposition in 41.3% versus 15.3% of cases. The authors call this Deferred Semantic Commitment: questioning withdraws commitment, then a separate element restores it, but safety behavior appears to track the withdrawal. In an open-weight language model, re-endorsement only partly reversed the refusal-related change caused by questioning. The authors argue safeguards should assess the completed message. These findings are reported in the supplied abstract.

### Source excerpt

arXiv:2611.25929v1 Announce Type: new Abstract: We find that safeguards for image generation can be bypassed without changing what a message says. A sign stating a harmful proposition is blocked, but the same proposition phrased as a question and followed by a check mark is generated, even though the resulting image endorses the original claim. On a 300-case challenge set, gpt-image-2 returns images for 43.3% of question-affirmation requests versus 16.3% of direct statements, with 41.3% versus 15.3% of cases yielding images that endorse the original proposition. We define this as Deferred Semantic Commitment (DSC): commitment is withdrawn by the question and restored by a separate element, while safety behavior follows only the withdrawal. To investigate why, we study an open-weight language model and find that re-endorsement only partially reverses the refusal-related change introduced by questioning. These findings reveal a mismatch between recovered meaning and refusal behavior, motivating safeguards that assess the completed message rather than its individual elements.

## Why Do LLMs Help with Scientific Misconduct Requests and What to Do About It?: Increasing the Trustworthiness of AI for Science

DevFeed: [Why Do LLMs Help with Scientific Misconduct Requests and What to Do About It?: Increasing the Trustworthiness of AI for Science](<https://devfeed.tech/articles/why-do-llms-help-with-scientific-misconduct-requests-and-what-to-do-about-it-increasing-the-trustworthiness-of-ai-for-science-145523.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25492>)

Author: Almene De Meran Meguimtsop, Daniel E. Acuna

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI for science](<https://devfeed.tech/topics/ai-for-science.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [llms](<https://devfeed.tech/tags/llms.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [prompts](<https://devfeed.tech/tags/prompts.md>), [research-integrity](<https://devfeed.tech/tags/research-integrity.md>), [safety](<https://devfeed.tech/tags/safety.md>), [science](<https://devfeed.tech/tags/science.md>)

### AI overview

Across eight LLMs tested on 1,350 SciIntBench prompts, models often recognized scientific misconduct requests but rarely refused them: they identified misconduct in 91% of cases when asked directly, yet refused in 34%. Request framing was associated with refusal; changing instructions into questions about permissibility raised refusal from 52% to 88%. Two tested system-prompt changes--asking models to assess a request before answering and reminding them of responsible conduct of research principles--raised refusal on adversarial requests from 58% to 87% and 86%, respectively. The abstract reports these as study findings, not evidence that the changes prevent misconduct in practice.

### Source excerpt

arXiv:2611.25492v1 Announce Type: new Abstract: Large language models (LLMs) support scientific research, but some of that assistance can also undermine research integrity. Existing safety evaluations in science often measure whether models refuse misconduct requests, but rarely explain whether they even recognize the problem or why they comply. We investigate this gap across 8 LLMs using SciIntBench, an existing benchmark of 1,350 prompts about scientific research integrity. We examine the reasons behind compliance in four steps. First, when asked directly whether fulfilling a request would involve misconduct, models overwhelmingly identify such requests, even in the Most Covert cases (91%), while they refuse to carry out the request in only 34% of cases. Second, we examine which request characteristics are associated with refusal using features that capture how the request is framed, how much the assistant has been told about what it is helping to hide, and how the goal and the user's stake are stated, among others. Third, we estimate that the most significant effect was to rephrase requests as questions about permissibility rather than instructions, which increased refusal from 52% to 88%. Finally, we test two system-prompt fixes: asking models to assess the request before responding and reminding them of responsible conduct of research principles. These changes increase refusal rates on adversarial requests from 58% to 87% and 86%, respectively. Our findings show that models recognize wrongful requests but still help users violate integrity. Understanding why these failures occur and testing ways to reduce them offer promising paths toward more trustworthy AI for science.

## LLM4Rail: An LLM-Augmented Personalized Railway Services Platform

DevFeed: [LLM4Rail: An LLM-Augmented Personalized Railway Services Platform](<https://devfeed.tech/articles/llm4rail-an-llm-augmented-personalized-railway-services-platform-145306.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2507.23377>)

Author: Zhuo Li, Xianghuai Deng, Chiwei Feng, Hanmeng Li, Shenjie Wang, Junchao Fan, Jiaxing Shen, Zhiyuan Wen, Longxiang Gao, Linchun Wu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [recommendation systems](<https://devfeed.tech/topics/recommendation-systems.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [function calling](<https://devfeed.tech/topics/function-calling.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [arguments](<https://devfeed.tech/tags/arguments.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [food](<https://devfeed.tech/tags/food.md>), [framework](<https://devfeed.tech/tags/framework.md>), [generation](<https://devfeed.tech/tags/generation.md>), [generative](<https://devfeed.tech/tags/generative.md>), [language](<https://devfeed.tech/tags/language.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [mechanism](<https://devfeed.tech/tags/mechanism.md>), [modules](<https://devfeed.tech/tags/modules.md>), [novel](<https://devfeed.tech/tags/novel.md>), [platform](<https://devfeed.tech/tags/platform.md>), [railway](<https://devfeed.tech/tags/railway.md>), [service](<https://devfeed.tech/tags/service.md>), [services](<https://devfeed.tech/tags/services.md>), [similarity](<https://devfeed.tech/tags/similarity.md>), [system](<https://devfeed.tech/tags/system.md>)

### AI overview

LLM4Rail is a personalized railway-services platform with modules for ticket and weather inquiries, onboard food and drink recommendations, and casual conversation. Its iterative ER-QTAO framework uses Experience Storage and Retrieval and Diagnostic Observation Generation to help the LLM call external tools with complex arguments. For catering, the authors introduce the Chinese Railway Food & Drink dataset, organized by city, cuisine, age group, and spiciness, and a zero-shot conversational recommender. A feature-similarity alignment mechanism is intended to keep generated recommendations matched to dataset entries.

### Source excerpt

arXiv:2507.23377v2 Announce Type: replace Abstract: Large language models (LLMs) have significantly reshaped different walks of business. To meet the increasing demands for individualized railway service, we develop LLM4Rail - a novel LLM-augmented personalized railway services platform. Empowered by the LLM, LLM4Rail provides dedicated modules for ticket and weather inquiries, food & drink recommendations, and casual conversation. In LLM4Rail, we propose the iterative "Experience-Retrieval Question-Thought-Action-Observation (ER-QTAO)" reasoning framework. It introduces two key mechanisms, Experience Storage and Retrieval (ESR) and Diagnostic Observation Generation (DOG), to enhance the LLM's ability to invoke appropriate external tools with complex arguments. To provide personalized onboard dining services, we first construct the Chinese Railway Food & Drink (CRFD) dataset, which covers a wide range of signature dishes categorized by city, cuisine, age group, and spiciness level, and then develop an LLM-based zero-shot conversational recommender system for railway catering. In addition, to address the unconstrained nature of generative recommendations, we design a feature-similarity-based alignment mechanism to ensure that all recommended items are aligned with entries in the CRFD dataset.

## MemMend: A Selective Revision Framework for Memory Question Answering

DevFeed: [MemMend: A Selective Revision Framework for Memory Question Answering](<https://devfeed.tech/articles/memmend-a-selective-revision-framework-for-memory-question-answering-145576.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25721>)

Author: Sheng Shi, Geng Li

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [abstract](<https://devfeed.tech/tags/abstract.md>), [budget](<https://devfeed.tech/tags/budget.md>), [completeness](<https://devfeed.tech/tags/completeness.md>), [cost](<https://devfeed.tech/tags/cost.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [editor](<https://devfeed.tech/tags/editor.md>), [edits](<https://devfeed.tech/tags/edits.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [external](<https://devfeed.tech/tags/external.md>), [f1](<https://devfeed.tech/tags/f1.md>), [features](<https://devfeed.tech/tags/features.md>), [fewer](<https://devfeed.tech/tags/fewer.md>), [framework](<https://devfeed.tech/tags/framework.md>), [gap](<https://devfeed.tech/tags/gap.md>), [gate](<https://devfeed.tech/tags/gate.md>), [independent](<https://devfeed.tech/tags/independent.md>), [inference](<https://devfeed.tech/tags/inference.md>), [interface](<https://devfeed.tech/tags/interface.md>), [memory](<https://devfeed.tech/tags/memory.md>), [question](<https://devfeed.tech/tags/question.md>), [revision](<https://devfeed.tech/tags/revision.md>)

### AI overview

MemMend selectively routes potentially incomplete long-term-memory answers to an editor, which proposes bounded exact-text replacements tied to resolvable source coordinates. Invalid edits are rejected, and the current answer is preserved if no legal repair is proposed, without an extra semantic-verification call. On 1,986 LoCoMo development questions, it scored 67.17 conversation-macro F1 and 88.35 mean Judge, using 62.37% fewer revision calls than a verified revision chain. Compared with ungated local review, routing cut calls by 54.15%, with similar F1 but a 0.67-point lower Judge score. Editing native PropMem, Mem0, and SimpleMem answers improved F1 by 3.79, 6.44, and 0.42 points, respectively; ungated editing retained higher F1 in this adaptation. Transfer results favored revision efficiency on 451 LongMemEval-V2 Small questions, while an external PerLTQA dialogue subset showed a completeness gap.

### Source excerpt

arXiv:2611.25721v1 Announce Type: new Abstract: Revising every answer from a long-term memory can consume substantial inference budget and damage facts that were already correct. We introduce MemMend, a modular selective revision framework that routes potentially incomplete answers to an editor, represents corrections as bounded exact-text replacements, and accepts only edits with resolvable source coordinates and valid edit operations. The editor preserves the current answer when no legal repair is proposed; accepted edits require no additional semantic-verification call. On 1,986 LoCoMo development questions, MemMend achieves 67.17 conversation-macro F1 and 88.35 mean Judge score, improving over a verified revision chain by 0.82 and 1.24 points while using 62.37% fewer revision calls. Routing uses 54.15% fewer revision calls than ungated local review, with similar F1 but a 0.67-point lower Judge score. Applied directly to native PropMem, Mem0, and SimpleMem answers, the editing interface raises F1 by 3.79, 6.44, and 0.42 points. It outperforms same-gate rewriting and saves 49.85-83.72% of editing calls relative to ungated editing, which retains higher F1 in this adaptation. A source-by-editing factorial supports local editing for F1 but leaves an independent quality benefit from source obligations unresolved. Transfer to 451 LongMemEval-V2 Small questions also favors revision efficiency, while an external PerLTQA dialogue subset reveals a completeness gap. These results support selective editing as a reusable quality-cost operating point.

## Client Exits - A Way to Increase LLM Transparency on the Client Side

DevFeed: [Client Exits - A Way to Increase LLM Transparency on the Client Side](<https://devfeed.tech/articles/client-exits-a-way-to-increase-llm-transparency-on-the-client-side-145651.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26309>)

Author: Marc Jansen

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [qwen](<https://devfeed.tech/topics/qwen.md>)

Tags: [approach](<https://devfeed.tech/tags/approach.md>), [client](<https://devfeed.tech/tags/client.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [enrichment](<https://devfeed.tech/tags/enrichment.md>), [librechat](<https://devfeed.tech/tags/librechat.md>), [llm](<https://devfeed.tech/tags/llm.md>), [prototype](<https://devfeed.tech/tags/prototype.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [test](<https://devfeed.tech/tags/test.md>), [transparency](<https://devfeed.tech/tags/transparency.md>), [xml](<https://devfeed.tech/tags/xml.md>)

### AI overview

Client Exits add predefined, machine-interpretable markers to LLM responses while leaving the receiving client to decide whether and how to present the associated information. This separates the response's semantic intent from client-specific presentation and allows enrichments in modalities such as graphics, text, or speech without prescribing an interface. A prototype pairs a finetuned Qwen model with a modified LibreChat client and uses three XML-based exits in a Question-Option-Criteria approach. On 100 test questions, the model trained with exit annotations included all three markers in every response; an LLM judge preferred its answers in 66% of comparisons. The results support feasibility on this test set, but the excerpt does not establish broader performance.

### Source excerpt

arXiv:2611.26309v1 Announce Type: new Abstract: Textual recommendations generated by large language models (LLMs) can be difficult to inspect. This paper introduces \emph{Client Exits}, a lightweight mechanism for enriching LLM responses while separating semantic intent from client-specific presentation. The model inserts predefined, machine-interpretable markers into its output, and the receiving client decides whether and how to realize the corresponding enrichments. This allows supplementary information to be presented as graphics, text, speech, or other modalities without prescribing a concrete interface. We implement a prototype combining a finetuned Qwen model with a modified LibreChat client. Using the Question--Option--Criteria (QOC) approach including three XML-based client exits. We evaluate two QOC-oriented model variants trained on essentially the same examples, with client-exit annotations added for one variant. Across 100 test questions, the client-exit model includes all three markers in every response. An LLM judge, informed about the mechanism without being instructed to favor it, prefers this model's answers in 66\% of the comparisons. These results demonstrate successful marker generation on the evaluated test set and support the feasibility of client-controlled enrichment.

## FrontierReplay: Split-Free Exact Prefix Caching for Hybrid Language Models

DevFeed: [FrontierReplay: Split-Free Exact Prefix Caching for Hybrid Language Models](<https://devfeed.tech/articles/frontierreplay-split-free-exact-prefix-caching-for-hybrid-language-models-145128.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26020>)

Author: Zekun Wang, Yizhuo Wang

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Cache](<https://devfeed.tech/topics/cache.md>), [LLM optimization](<https://devfeed.tech/topics/llm-optimization.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [AI Context Management](<https://devfeed.tech/topics/ai-context-management.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [approximation](<https://devfeed.tech/tags/approximation.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [attention](<https://devfeed.tech/tags/attention.md>), [branch](<https://devfeed.tech/tags/branch.md>), [caching](<https://devfeed.tech/tags/caching.md>), [capacity](<https://devfeed.tech/tags/capacity.md>), [chat](<https://devfeed.tech/tags/chat.md>), [checkpoint](<https://devfeed.tech/tags/checkpoint.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [hybrid](<https://devfeed.tech/tags/hybrid.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [kv-cache](<https://devfeed.tech/tags/kv-cache.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [layer](<https://devfeed.tech/tags/layer.md>), [layers](<https://devfeed.tech/tags/layers.md>), [load](<https://devfeed.tech/tags/load.md>), [prefill](<https://devfeed.tech/tags/prefill.md>), [prefix-caching](<https://devfeed.tech/tags/prefix-caching.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [question](<https://devfeed.tech/tags/question.md>)

### AI overview

FrontierReplay targets exact prefix caching in hybrid language models, where recurrent state updates limit reuse to saved positions. It identifies predictable structural boundaries, such as turn ends and known branch points, and creates exact checkpoints there without interrupting prefill: it logs a short window of recurrent-layer inputs and uses a cross-layer state-only replay kernel, reported to cost 6-37x less per token than full recomputation without host synchronization. Its retention policy prioritizes active anchors and proven branches and lends unused checkpoint slots to the attention KV cache. Across the evaluated architectures, scales, and workloads, the abstract reports 16-89% lower median time to first token, up to 1.73x higher capacity at an 80% SLO, and up to 4.26x higher goodput (3.67x at larger scales) versus existing exact caches. Versus approximate replay, it reports up to 1.54x higher goodput while preserving exact task accuracy; approximation suffered up to a 17% accuracy drop on long contexts.

### Source excerpt

arXiv:2611.26020v1 Announce Type: new Abstract: Hybrid language models combine self-attention with recurrent layers whose in-place state updates restrict prefix reuse to exact saved positions. Saving states on a coarse grid wastes reusable prefixes, whereas existing fine-grained exact caches must cut the prefill forward pass at each mid-prompt checkpoint, adding scheduler steps that outweigh the reuse gains under load. We observe that across multi-turn chat, agent loops, document question answering, and tree search, prefix reuse almost always ends at structural boundaries predictable in advance, such as turn ends and known branch points. We present FrontierReplay, a prefix caching system that materializes exact checkpoints at these boundaries without cutting the prefill. While the forward pass runs uncut, FrontierReplay logs a short window of recurrent-layer inputs and invokes a cross-layer, state-only replay kernel to build the target state 6-37x cheaper per token than full recomputation without host synchronization. A frontier-aware retention policy prioritizes active anchors and proven branches while lending dead checkpoint slots to the attention KV cache. Across diverse hybrid architectures, model scales, and workloads, FrontierReplay delivers clear gains over existing exact caches, lowering median time to first token (TTFT) by 16-89% (up to 8.9x), raising 80% service-level objective (SLO) capacity by up to 1.73x, and improving goodput by up to 4.26x (3.67x at larger scales). Compared with approximate replay methods, FrontierReplay delivers up to 1.54x higher goodput while preserving exact task accuracy, avoiding the up to 17% accuracy drop suffered by approximation on long contexts.

## Web search in Latin America: language models use less local and diverse news than search engines

DevFeed: [Web search in Latin America: language models use less local and diverse news than search engines](<https://devfeed.tech/articles/web-search-in-latin-america-language-models-use-less-local-and-diverse-news-than-search-engines-145613.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25955>)

Author: Francisco W. Kerche, Franziska Sofia Hafner, Felix M. Simon, Luc Rocher

Published: 2026-11-20T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [search-engines](<https://devfeed.tech/topics/search-engines.md>), [AI-driven information retrieval](<https://devfeed.tech/topics/ai-driven-information-retrieval.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [amplify](<https://devfeed.tech/tags/amplify.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-cy](<https://devfeed.tech/tags/cs-cy.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [information-systems](<https://devfeed.tech/tags/information-systems.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [latin-america](<https://devfeed.tech/tags/latin-america.md>), [news](<https://devfeed.tech/tags/news.md>), [search](<https://devfeed.tech/tags/search.md>), [search-engines](<https://devfeed.tech/tags/search-engines.md>)

### AI overview

The study finds that language models return less diverse news sources than search engines when answering queries about Latin America. Researchers tested three search engines and four language models on 1,901 current events across nine countries, varying query language and user location. For local users, search engines returned 41.3% domestic news, while language models returned 3.6 to 11.6 percentage points less; domestic-news shares varied across user types. The findings suggest LLM-based search may reproduce or sometimes amplify geographical imbalances in news visibility. The researchers released an open dataset for multilingual and geographically diverse evaluation.

### Source excerpt

arXiv:2611.25955v1 Announce Type: cross Abstract: AI platforms are becoming a major gateway to news and current events. This shift risks amplifying existing geographical biases that favour narratives from wealthier countries over those from the Global South. This is particularly relevant in Latin America, which accounts for the largest share of AI usage in the Global South. We examine how information about Latin America changes when users shift from conventional search engines to LLM-based search. We construct a dataset of 1,901 current events across nine Latin American countries, craft realistic queries, and submit them to three search engines and four language models. We vary query language and user location to represent local, diaspora, tourist, and foreign user scenarios. Across 49,207 requests and 8,834 unique domains, language models return a less diverse set of news sources than search engines. Across user types, the share of domestic news returned by language models is inconsistent. For local users, while search engines already return only 41.3\% local news, language models return a further 3.6 to 11.6 percentage points less. Taken together, our findings suggest that LLM-based search can reproduce and, in some settings, amplify geographical hierarchies in the reach and visibility of news sources. We release an open dataset to support multilingual and geographically diverse evaluation of LLM-based search, and highlight implications for more equitable information systems design.

## LLM GerryMandering: Separating Interactions from Additive Effects in LLM Audits

DevFeed: [LLM GerryMandering: Separating Interactions from Additive Effects in LLM Audits](<https://devfeed.tech/articles/llm-gerrymandering-separating-interactions-from-additive-effects-in-llm-audits-145681.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26538>)

Author: George Rahul, Ronit Jahilal, Bhaskara Hanuma Vedula, Ponnurangam Kumaraguru, Pushkar Shukla

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [audit](<https://devfeed.tech/topics/audit.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [arxiv](<https://devfeed.tech/tags/arxiv.md>), [audit](<https://devfeed.tech/tags/audit.md>), [auditing](<https://devfeed.tech/tags/auditing.md>), [audits](<https://devfeed.tech/tags/audits.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [bias](<https://devfeed.tech/tags/bias.md>), [challenge](<https://devfeed.tech/tags/challenge.md>), [class](<https://devfeed.tech/tags/class.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [effects](<https://devfeed.tech/tags/effects.md>), [gender](<https://devfeed.tech/tags/gender.md>), [gerrymandering](<https://devfeed.tech/tags/gerrymandering.md>), [identity](<https://devfeed.tech/tags/identity.md>), [independent](<https://devfeed.tech/tags/independent.md>), [indian](<https://devfeed.tech/tags/indian.md>), [interaction](<https://devfeed.tech/tags/interaction.md>), [language](<https://devfeed.tech/tags/language.md>), [llm](<https://devfeed.tech/tags/llm.md>)

### AI overview

The standard subgroup criterion can label independent attribute effects as intersectional bias. Across 150 synthetic datasets with no interactions, it produced 66.1 false subgroup flags per dataset on average; a repaired version recovered 32% of planted interactions. ADDIS fits an additive model across attributes, measures each subgroup's Additive Residual Distance from its prediction, and tests it with a Freedman-Lane null. On the same benchmark it averaged 0.09 false flags per dataset and recovered 84% of planted interactions. In audits of 13 open language models using 10,000 synthetic Indian personas, the standard criterion flagged 7.1% of 738 tested subgroups on average, compared with 3.0% for ADDIS. Gender identity crossed with sexual orientation was the largest pairing in every model. Counterfactual personas also revealed a caste-class interaction in all but one model, which the observational test lacked data to detect.

### Source excerpt

arXiv:2611.26538v1 Announce Type: new Abstract: Intersectional bias arises when a model treats people who hold several marginalised identities at once differently from what their separate identities would predict. Auditing such intersectional subgroups remains a challenge: their number grows quadratically, and there is no agreed baseline for what independent attributes would predict. Without such a baseline, many existing audits flag a subgroup when it exceeds each attribute alone, a condition that attributes acting independently already satisfy. We test this standard criterion on 150 synthetic datasets built with no interaction. With the shuffle null, it flags 66.1 false subgroups per dataset on average, and at least one in every dataset. When we plant interactions of known size into these datasets, a repaired null lets the criterion recover only 32% of them. We introduce ADDIS (Additive Intersectional Screen), which fits an additive model over all attributes, scores each subgroup by its Additive Residual Distance (ARD) from that model's prediction, and tests it against a Freedman-Lane null. On our synthetic benchmark, ADDIS flags 0.09 false subgroups per dataset and recovers 84% of the same planted interactions. We then build IndiPersona, 10,000 synthetic Indian personas with six identity attributes, and audit 13 open language models. The standard criterion flags 7.1% of the 738 tested subgroups on average; ADDIS flags 3.0%. Gender identity crossed with sexual orientation is the largest pairing in every model, and counterfactual personas confirm it and additionally reveal a caste x class interaction in all but one model that the observational test lacked the data to detect. Much of what audits report as intersectional bias can thus arise from independent single-attribute effects alone, yet a small core of interactions survives.

## A Quasi-experimental Study of Conversational AI-supported Engagement in Large CS Courses

DevFeed: [A Quasi-experimental Study of Conversational AI-supported Engagement in Large CS Courses](<https://devfeed.tech/articles/a-quasi-experimental-study-of-conversational-ai-supported-engagement-in-large-cs-courses-145304.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2506.18941>)

Author: Neha Rani, Sharan Majumder, Ishan Bhardwaj, Pedro Guillermo Feijoo Garcia

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Conversational AI](<https://devfeed.tech/topics/conversational-ai.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [computer-science](<https://devfeed.tech/tags/computer-science.md>), [conversational-ai](<https://devfeed.tech/tags/conversational-ai.md>), [courses](<https://devfeed.tech/tags/courses.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cy](<https://devfeed.tech/tags/cs-cy.md>), [cs-et](<https://devfeed.tech/tags/cs-et.md>), [cs-hc](<https://devfeed.tech/tags/cs-hc.md>), [engagement](<https://devfeed.tech/tags/engagement.md>), [experimental](<https://devfeed.tech/tags/experimental.md>), [large](<https://devfeed.tech/tags/large.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [study](<https://devfeed.tech/tags/study.md>)

### AI overview

In a quasi-experimental within-subject study in a large Software Engineering course at a public U.S. university, students took part in both an in-class discussion using ChatGPT and a peer discussion without it. Researchers assessed CAI interactions and students' self-reported engagement. The CAI activity was associated with higher engagement with the learning material, higher self-reported learning, and significantly greater perceived usefulness for learning. The abstract presents CAI as having potential to support engagement in large classes; it does not establish effects beyond this course and study design.

### Source excerpt

arXiv:2506.18941v2 Announce Type: replace-cross Abstract: Lucrative career prospects and creative opportunities often attract students to enroll in computer science courses, resulting in large class sizes. A common challenge in large classrooms is the lack of engagement between students and both the instructor and the learning material. Recent advances in Large Language Models (LLMs) present an opportunity to leverage Conversational Artificial Intelligence (CAI) to address this challenge. To examine the potential of CAI to support engagement with learning material, we designed an in class activity in a large Software Engineering course in which students interacted with a CAI tool. Using a quasi-experimental, within-subject study design in a real classroom at a large public United States University. We compared student engagement during an activity that involved the use of CAI for discussion with an activity that did not (peer discussion). For our analysis, we collected data on students interactions with the CAI tool and their self-reported responses on multiple engagement scales. Results show higher student engagement with the learning material in the activity involving CAI discussion as opposed to without (peer discussion). Higher self-reported learning was also observed in the activity with CAI as compared to without. Students also reported significantly more usefulness for learning in the CAI condition. Overall, our results indicate that CAI (ChatGPT) has the potential to support engagement with learning content during in-class activities in large class sizes.

## TwinLab-Bench: Evaluating AI Scientists in Agentic Twins of Real Labs

DevFeed: [TwinLab-Bench: Evaluating AI Scientists in Agentic Twins of Real Labs](<https://devfeed.tech/articles/twinlab-bench-evaluating-ai-scientists-in-agentic-twins-of-real-labs-145156.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26248>)

Author: Yang Wan, Linchao Zhu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Claude](<https://devfeed.tech/topics/claude.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [bench](<https://devfeed.tech/tags/bench.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [environment](<https://devfeed.tech/tags/environment.md>), [experiment](<https://devfeed.tech/tags/experiment.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [frontier](<https://devfeed.tech/tags/frontier.md>), [frontier-models](<https://devfeed.tech/tags/frontier-models.md>), [grounded](<https://devfeed.tech/tags/grounded.md>), [laboratory](<https://devfeed.tech/tags/laboratory.md>), [labs](<https://devfeed.tech/tags/labs.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [life-sciences](<https://devfeed.tech/tags/life-sciences.md>), [measurements](<https://devfeed.tech/tags/measurements.md>), [memory](<https://devfeed.tech/tags/memory.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>)

### AI overview

TwinLab-Bench tests whether AI agents can design experiments and obtain readings grounded in real laboratory records, extending beyond benchmarks that assess fixed workflows or choices among predefined measurements. It covers 52 tasks across physical sciences, life sciences, and engineering, with more than 100 experimental action types. For each task, a TwinLab agent executes the tested agent's designed experiments using laboratory materials and record-based calculators; reports are scored against hidden answers from real lab records. The authors say this setup nearly eliminates readings that deviate from the records and inconsistent responses to repeated requests compared with a language model given only the task description; closed-book probes address answers recalled from memory. The tasks remain difficult for frontier models: Claude Fable 5.2, the strongest reported, averaged 45.0. The excerpt does not specify the score scale.

### Source excerpt

arXiv:2611.26248v1 Announce Type: cross Abstract: AI agents are increasingly expected to act as AI scientists, which requires three increasingly open abilities: carrying out a given computational workflow correctly, choosing the next measurements from a given design space, and designing their own experiments. Existing benchmarks mainly evaluate the first two abilities, in a terminal or in a closed loop that selects from predefined candidates. Evaluating the third ability requires reliably executing an experiment that an agent designs, with readings grounded in a real laboratory. We introduce TwinLab-Bench, which evaluates AI scientists on self-designed experiments in 52 tasks from laboratories in the physical sciences, the life sciences, and engineering. The benchmark supports more than 100 experimental action types, and the agent's report is scored by comparison with a hidden answer taken from real laboratory records. Each task has its own TwinLab agent, an agent that serves as the environment and executes the experiments that the tested agent designs, reading the raw materials of the laboratory and calling calculators that are built from its records. Compared with a language model that sees only the task description, the TwinLab agent almost eliminates readings that deviate from the real records and inconsistent answers to a repeated request, and closed-book probes control for answers recalled from memory. We find that these tasks remain hard for frontier models: the strongest, Claude Fable 5.2, averages a score of only 45.0, and we conduct an empirical study of where it fails.

## Understanding Help Seeking for Digital Privacy, Safety, and Security on Reddit

DevFeed: [Understanding Help Seeking for Digital Privacy, Safety, and Security on Reddit](<https://devfeed.tech/articles/understanding-help-seeking-for-digital-privacy-safety-and-security-on-reddit-145994.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2601.11398>)

Author: Kurt Thomas, Sai Teja Peddinti, Sarah Meiklejohn, Tara Matthews, Amelia Hassoun, Animesh Srivastava, Jessica McClearn, Patrick Gage Kelley, Sunny Consolvo, Nina Taft

Published: 2026-11-20T05:00:00Z

Content type: news

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Security, Privacy and Abuse Prevention](<https://devfeed.tech/topics/security-privacy-and-abuse-prevention.md>), [Security](<https://devfeed.tech/topics/security.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Reddit](<https://devfeed.tech/topics/reddit.md>)

Tags: [account](<https://devfeed.tech/tags/account.md>), [advice](<https://devfeed.tech/tags/advice.md>), [communities](<https://devfeed.tech/tags/communities.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [development](<https://devfeed.tech/tags/development.md>), [digital](<https://devfeed.tech/tags/digital.md>), [digital-privacy](<https://devfeed.tech/tags/digital-privacy.md>), [ecosystem](<https://devfeed.tech/tags/ecosystem.md>), [family](<https://devfeed.tech/tags/family.md>), [guides](<https://devfeed.tech/tags/guides.md>), [help](<https://devfeed.tech/tags/help.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [llms](<https://devfeed.tech/tags/llms.md>), [mitigations](<https://devfeed.tech/tags/mitigations.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [reddit](<https://devfeed.tech/tags/reddit.md>), [safety](<https://devfeed.tech/tags/safety.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

The study identifies four million Reddit posts seeking digital privacy, safety, or security help from more than two billion posts spanning five years. Its LLM-assisted pipeline reports 93% precision and recall and annotates topics such as privacy settings, data misuse, and account compromise. The authors use the dataset to examine the scale and locations of help seeking and the kinds of assistance users request. They point to the difficulty of helping across varied threats, platforms, mitigations, contexts, and emotions, and frame the findings as groundwork for improving resources such as guides and LLM help-giving agents.

### Source excerpt

arXiv:2601.11398v2 Announce Type: replace Abstract: The complexity of navigating digital privacy, safety, and security threats often falls directly on users. This leads to users seeking help from family and peers, platforms and advice guides, dedicated communities, and even large language models (LLMs). As a precursor to improving resources across this ecosystem, our community needs to understand what help seeking looks like in the wild. To that end, we build a scaled analysis pipeline leveraging LLMs to sift through over two billion Reddit posts from the last five years to identify where and for what users seek digital privacy, safety, or security help. We isolate four million relevant posts with 93% precision and recall and automatically annotate each with the topics discussed (e.g., privacy configurations, data misuse, account compromise, and more). We use this dataset to understand the scope and scale of help seeking on Reddit, the subcommunities that provide help, and to qualitatively analyze the types of help sought. Our work informs the development of better resources for users (e.g., user guides or LLM help-giving agents) while underscoring the inherent challenges of supporting users through complex combinations of threats, platforms, mitigations, context, and emotions.

## A Neurosymbolic Multimodal Framework for 30-Day Diabetic Readmission Prediction: Integrating Structured EHR Data, Dense Clinical Embeddings, and Knowledge-Grounded Symbolic Extraction

DevFeed: [A Neurosymbolic Multimodal Framework for 30-Day Diabetic Readmission Prediction: Integrating Structured EHR Data, Dense Clinical Embeddings, and Knowledge-Grounded Symbolic Extraction](<https://devfeed.tech/articles/a-neurosymbolic-multimodal-framework-for-30-day-diabetic-readmission-prediction-integrating-structured-ehr-data-dense-clinical-embeddings-and-knowledge-grounded-symbolic-145488.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25236>)

Author: Una Suman Kumar Patro, Sibangi Subhadarsani, Narendra Badam

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Vectors & LLMs](<https://devfeed.tech/topics/vectors-llms.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Representation learning](<https://devfeed.tech/topics/representation-learning.md>), [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [AI for data automation](<https://devfeed.tech/topics/ai-for-data-automation.md>), [data-engineering](<https://devfeed.tech/topics/data-engineering.md>)

Tags: [cross-encoder](<https://devfeed.tech/tags/cross-encoder.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [hallucinations](<https://devfeed.tech/tags/hallucinations.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>), [structured](<https://devfeed.tech/tags/structured.md>), [xgboost](<https://devfeed.tech/tags/xgboost.md>)

### AI overview

On a held-out cohort of 20,153 encounters, the multimodal model improved sensitivity over the structured EHR baseline (0.6667 vs. 0.5839), achieved the best F2-score (0.3824) and lower Brier score (0.0977 vs. 0.1080), but had slightly lower AUROC (0.6375 vs. 0.6477) and specificity (0.5161). It combines engineered structured features, 32 compressed Bio_ClinicalBERT embedding components, and symbolic entities extracted through hybrid retrieval and negation auditing, then predicts with cost-sensitive XGBoost. In a separate 500-note code-switched benchmark, grounded retrieval raised Hinglish symptom recall and precision and reduced entity hallucinations. Prior utilization was the dominant risk signal. The reported findings are from the abstract's dataset and evaluations.

### Source excerpt

arXiv:2611.25236v1 Announce Type: new Abstract: Unplanned 30-day readmissions among patients with diabetes mellitus impose a substantial clinical and economic burden, yet most predictive models use only structured electronic health record (EHR) data and ignore free-text clinical notes, which often contain code-mixed Hindi-English (Hinglish) phrasing and negation that general-purpose language models parse unreliably. We propose a neurosymbolic multimodal framework evaluated on the public Diabetes 130-US Hospitals dataset (101,766 encounters; 71,518 patients) with a patient-level grouped 80/20 split. Three streams are fused: engineered structured features; 32 components of Bio_ClinicalBERT note embeddings obtained by truncated singular value decomposition; and symbolic entities extracted by an open-weight clinical language model within a three-stage hybrid retrieval-augmented generation pipeline (dense retrieval, sparse lexical retrieval, and cross-encoder re-ranking) with reflective negation auditing. A cost-sensitive XGBoost classifier with a decision threshold calibrated by Youden's J statistic produces the prediction. On the held-out test cohort (n = 20,153), the structured baseline achieved an area under the receiver operating characteristic curve (AUROC) of 0.6477, sensitivity of 0.5839, and Brier score of 0.1080. The full multimodal model achieved the highest sensitivity (0.6667; +8.28 percentage points), the best F2-score (0.3824), and the lowest Brier score (0.0977), at a slightly lower AUROC (0.6375) and specificity (0.5161). Shapley additive explanations showed that prior utilization dominates risk, with compressed narrative components among the top predictors. On a 500-note code-switched benchmark, grounded retrieval raised Hinglish symptom recall from 4.8% to 40.2% and precision from 3.1% to 45.2%, while reducing entity hallucinations from 1.74 to 0.00 per note.

## No-Harm-Jury A Jury-Based Multi-Dimensional Harm Evaluation Framework for Medical AI Responses

DevFeed: [No-Harm-Jury A Jury-Based Multi-Dimensional Harm Evaluation Framework for Medical AI Responses](<https://devfeed.tech/articles/no-harm-jury-a-jury-based-multi-dimensional-harm-evaluation-framework-for-medical-ai-responses-145451.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24972>)

Author: Antonio Puertas Gallardo, Mario Ceresa

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [Parallel reasoning](<https://devfeed.tech/topics/parallel-reasoning.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-responses](<https://devfeed.tech/tags/ai-responses.md>), [automated](<https://devfeed.tech/tags/automated.md>), [autonomy](<https://devfeed.tech/tags/autonomy.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [dimensions](<https://devfeed.tech/tags/dimensions.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [framework](<https://devfeed.tech/tags/framework.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llm](<https://devfeed.tech/tags/llm.md>), [median](<https://devfeed.tech/tags/median.md>), [medical](<https://devfeed.tech/tags/medical.md>), [medical-ai](<https://devfeed.tech/tags/medical-ai.md>), [models](<https://devfeed.tech/tags/models.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [qa](<https://devfeed.tech/tags/qa.md>), [reliability](<https://devfeed.tech/tags/reliability.md>), [responses](<https://devfeed.tech/tags/responses.md>), [robust](<https://devfeed.tech/tags/robust.md>), [social](<https://devfeed.tech/tags/social.md>)

### AI overview

No-Harm-Jury evaluates medical AI responses across seven harm dimensions--informational, social, psychological, autonomy, economic, privacy, and epistemic--using five diverse language models as independent jurors. The study applies it to Ministral-14B responses for 3,000 questions from PubMedQA, MedQA, and MedMCQA; 151 empty responses are excluded, leaving 2,849 samples. Median aggregation is intended to reduce individual juror bias while retaining coverage through complementary specialisation, with a reliability-weighted extension also described. The supplied abstract does not report comparative performance results.

### Source excerpt

arXiv:2611.24972v1 Announce Type: cross Abstract: We present No-Harm-Jury, a jury-based automated evaluation framework that scores AI-generated medical responses across seven conceptually distinct harm dimensions using a panel of five diverse language models as independent jurors. Responses generated by Ministral-14B on 3,000 questions drawn from PubMedQA, MedQA, and MedMCQA are scored by five jurors across dimensions of informational, social, psychological, autonomy, economic, privacy, and epistemic harm; the 151 empty responses (98 MedQA, 53 MedM- CQA) are excluded, leaving 2,849 valid samples. The median aggregation robustly suppresses individual juror biases while maintaining coverage through complementary specialisation. No existing system combines all five prop- erties of No-Harm-Jury: automated scalable evaluation, five diverse LLM jurors, robust me- dian aggregation (with a reliability-weighted extension), seven conceptually distinct harm dimensions, and application to medical QA benchmarks.

## Serialization Tax in Shared-Latent Exchangeable Decisions

DevFeed: [Serialization Tax in Shared-Latent Exchangeable Decisions](<https://devfeed.tech/articles/serialization-tax-in-shared-latent-exchangeable-decisions-145625.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26029>)

Author: Siming Zhang, Zhehui Shen, Shijie Chen, Xinle Gu, Yansen Yu, Hang Yu

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [VAE](<https://devfeed.tech/topics/vae.md>)

Tags: [aggregate](<https://devfeed.tech/tags/aggregate.md>), [approximation](<https://devfeed.tech/tags/approximation.md>), [audits](<https://devfeed.tech/tags/audits.md>), [batch](<https://devfeed.tech/tags/batch.md>), [blocks](<https://devfeed.tech/tags/blocks.md>), [boundary](<https://devfeed.tech/tags/boundary.md>), [comparisons](<https://devfeed.tech/tags/comparisons.md>), [convex](<https://devfeed.tech/tags/convex.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [decision](<https://devfeed.tech/tags/decision.md>), [defer](<https://devfeed.tech/tags/defer.md>), [error](<https://devfeed.tech/tags/error.md>), [independent](<https://devfeed.tech/tags/independent.md>), [inspect](<https://devfeed.tech/tags/inspect.md>), [large](<https://devfeed.tech/tags/large.md>), [law](<https://devfeed.tech/tags/law.md>), [margin](<https://devfeed.tech/tags/margin.md>), [means](<https://devfeed.tech/tags/means.md>), [routing](<https://devfeed.tech/tags/routing.md>), [score](<https://devfeed.tech/tags/score.md>), [serialization](<https://devfeed.tech/tags/serialization.md>)

### AI overview

Independent item scoring can preserve each item's mean probability while losing shared latent-state dependence, leading to inaccurate group decisions such as slate display or batch inspection. The paper calls this error the "serialization tax." For binary items sharing a success rate, it reports that the exact count distribution is more dispersed than an independent completion with the same total mean, and connects approximation gaps to threshold separation and decision regret. TaxScore flags large hidden blocks with unresolved uncertainty near a decision boundary for routing to richer posterior heads. In pre-specified MovieLens 1M/10M audits, shared-latent heads improved high-score NLL/utility from 0.673/0.696 to 0.629/0.723 and 0.670/0.691 to 0.639/0.715; routing yielded 0.006-0.012 full-population utility gains. The abstract also says results cover non-binary outcomes, heterogeneous items, and sufficient posterior resolution.

### Source excerpt

arXiv:2611.26029v1 Announce Type: new Abstract: Accurate item probabilities can produce inaccurate group-level decisions. A system may score each item separately, yet act on whether enough hidden items succeed: show a slate, defer a panel decision, or inspect a batch. When items share an uncertain latent state, independent marginalization preserves means but removes dependence from the aggregate posterior. We call this error the serialization tax. For binary items sharing one success rate, classical convex-order comparisons give a more dispersed exact count law than any independent completion with the same total mean. We quantify variance and total-variation gaps, derive threshold separation under margin conditions, and connect posterior approximation to decision regret. Separate results cover non-binary outcomes, heterogeneous items, and sufficient posterior resolution. TaxScore identifies large hidden blocks with unresolved uncertainty near a decision boundary for routing to richer posterior heads. On pre-specified, hidden-target-free MovieLens 1M/10M audits, existing shared-latent heads improve high-score negative log-likelihood (NLL)/utility from 0.673/0.696 to 0.629/0.723 and from 0.670/0.691 to 0.639/0.715. Routing gives 0.006--0.012 full-population utility gains, with matched controls identifying their sources. Our code is available at https://github.com/SiminChang/Serialization-Tax-in-Shared-Latent-Exchangeable-Decisions.

## FinVeriQA: Financial Research Agents for Question Answering: Routing, Retrieval, MCP Tool Use, and Provenance-Aware Evidence Verification

DevFeed: [FinVeriQA: Financial Research Agents for Question Answering: Routing, Retrieval, MCP Tool Use, and Provenance-Aware Evidence Verification](<https://devfeed.tech/articles/finveriqa-financial-research-agents-for-question-answering-routing-retrieval-mcp-tool-use-and-provenance-aware-evidence-verification-145463.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.25071>)

Author: Meenakshi Rajpurohit, Anna Phan, Ravikumar Komandur Narayanan, Gunanidhi Ramakrishnan, Nathan Howland

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Multi Agent Systems](<https://devfeed.tech/topics/multi-agent-systems.md>), [Finance](<https://devfeed.tech/topics/finance.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [llamaindex](<https://devfeed.tech/topics/llamaindex.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [advice](<https://devfeed.tech/tags/advice.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [alphabet](<https://devfeed.tech/tags/alphabet.md>), [amd](<https://devfeed.tech/tags/amd.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [better](<https://devfeed.tech/tags/better.md>), [case-study](<https://devfeed.tech/tags/case-study.md>), [code](<https://devfeed.tech/tags/code.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-ir](<https://devfeed.tech/tags/cs-ir.md>), [cs-ma](<https://devfeed.tech/tags/cs-ma.md>), [financial](<https://devfeed.tech/tags/financial.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [provenance](<https://devfeed.tech/tags/provenance.md>), [question](<https://devfeed.tech/tags/question.md>), [research](<https://devfeed.tech/tags/research.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [routing](<https://devfeed.tech/tags/routing.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tool-use](<https://devfeed.tech/tags/tool-use.md>), [verification](<https://devfeed.tech/tags/verification.md>)

### AI overview

FinVeriQA assigns financial QA tasks to specialized components: Laya routes questions and screens out advice requests, Python performs calculations, retrieval and tools gather evidence, and Mistral-7B writes cited answers. Laya routed better than Mistral-7B in live experiments (0.85 vs. 0.52); DeepSeek-R1-8B also did better but took about 9.9 times longer. Python got all 100 tested calculations right versus 29% for Mistral-7B, and a live quote reduced price error from 210% to zero. Hybrid retrieval reached 76% Hit@5 on filing questions. However, both answers in a case study passed validation despite mislabeling AMD data as NVIDIA and Alphabet data. On FinRank, checks against shared evidence caught fewer errors than checks against original passages, supporting the authors' conclusion that verification should be independent of the evidence used to draft an answer.

### Source excerpt

arXiv:2611.25071v1 Announce Type: cross Abstract: Large language models (LLMs) write fluent financial analyses but miscompute ratios, recall stale prices, and route questions to the wrong tool with high confidence. We ask which component should do each job in a financial question-answering assistant, and study it with FinVeriQA, an open-source multi-agent research prototype over SEC filings and live market data: a compact typed-decision model (Laya) routes each question and screens out advice requests, Python computes every number, retrieval and tools fetch evidence, Mistral-7B writes a cited answer, a code validator checks that cited IDs exist and that numbers match computed notes, and a Model Context Protocol (MCP) server exposes the pipeline. In live experiments, Laya routed better than Mistral-7B (0.85 vs. 0.52; overall 0.86 vs. 0.68, McNemar p = 0.0003); a 12B Mistral decided no better, and DeepSeek-R1-8B decided better (0.79 vs. 0.68, p = 0.0192) but about 9.9 times more slowly. Mistral-7B computed 29% of 100 financial calculations correctly against 100% for Python, a live quote cut price error from 210% to 0.00%, and hybrid retrieval reached 76% Hit@5 on 50 filing questions. Yet in a live case study, both agent answers passed validation while describing AMD sample data under NVIDIA's and Alphabet's names. A controlled upper-bound study on the FinRank benchmark explains why: when one figure in the shared evidence is corrupted, self-consistency stays confident (agreement 0.55 to 0.59 while accuracy falls from 0.50 to 0.00), and a shared-evidence check (the kind our validator performs) catches 35% of the errors, whereas a check against the original passage catches 77% ($p = 5.96 \times 10^{-8}$); for DeepSeek-R1-8B, 68% vs. 90%. Verification must be independent of the evidence the writer saw.

## DailySafe: Benchmarking Dynamic Safety Awareness in Everyday Multi-Turn Multimodal Interactions

DevFeed: [DailySafe: Benchmarking Dynamic Safety Awareness in Everyday Multi-Turn Multimodal Interactions](<https://devfeed.tech/articles/dailysafe-benchmarking-dynamic-safety-awareness-in-everyday-multi-turn-multimodal-interactions-146058.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.26298>)

Author: Xuankun Rong, Xinhao Deng, Wenzhang Jiang, Ziheng Peng, Siyuan Liang, Wenke Huang, Pablo Arbelaez, Mang Ye

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>), [trust and safety](<https://devfeed.tech/topics/trust-and-safety.md>)

Tags: [awareness](<https://devfeed.tech/tags/awareness.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [everyday](<https://devfeed.tech/tags/everyday.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

DailySafe benchmarks whether multimodal language models can detect safety risks that emerge as everyday tasks unfold across conversation turns and images, while still helping with legitimate goals. It contains 195 naturalistic interactions spanning 10 domains and 42 task categories, with safety-critical evidence revealed progressively and case-specific annotations used to assess how models respond. The authors position it as a complement to benchmarks centered on isolated harmful requests or adversarial scenarios; the supplied abstract does not report evaluation results.

### Source excerpt

arXiv:2611.26298v1 Announce Type: new Abstract: As multimodal large language models (MLLMs) become increasingly integrated into everyday life, their ability to provide safe and reliable assistance in realistic daily activities remains insufficiently explored. Existing safety benchmarks primarily focus on isolated harmful requests or adversarial scenarios, overlooking the safety risks that may arise as ordinary tasks unfold. In practice, users pursue legitimate goals through multi-turn, multimodal interactions, where seemingly benign requests may become safety-critical when considered alongside earlier actions and visual observations. This calls for Dynamic Safety Awareness, the ability to track evolving task conditions, recognize implicit contextual risks, and provide safe and helpful assistance. To systematically evaluate this capability, we introduce DailySafe, a benchmark comprising 195 naturalistic multi-turn, multi-image interactions across 10 everyday domains and 42 task categories. Grounded in authentic user dialogue topics and documented safety knowledge, DailySafe captures realistic scenarios where safety-critical evidence is progressively revealed across conversational turns and visual observations. Using case-specific safety annotations, DailySafe assesses whether MLLMs can recognize and appropriately address evolving risks while supporting users' legitimate goals, bringing multimodal safety evaluation closer to real-world everyday AI assistance. DailySafe is publicly available at: https://github.com/XuankunRong/DailySafe.

## Show Your Work: Can Small Open Models Read SEC Filings with Evidence a Machine Can Check?

DevFeed: [Show Your Work: Can Small Open Models Read SEC Filings with Evidence a Machine Can Check?](<https://devfeed.tech/articles/show-your-work-can-small-open-models-read-sec-filings-with-evidence-a-machine-can-check-145768.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.24990>)

Author: Krishna Nandula

Published: 2026-11-20T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [automatic](<https://devfeed.tech/tags/automatic.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [code](<https://devfeed.tech/tags/code.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [models](<https://devfeed.tech/tags/models.md>), [open](<https://devfeed.tech/tags/open.md>), [protocol](<https://devfeed.tech/tags/protocol.md>), [questions](<https://devfeed.tech/tags/questions.md>), [qwen3-5](<https://devfeed.tech/tags/qwen3-5.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [retry](<https://devfeed.tech/tags/retry.md>), [rtx-4090](<https://devfeed.tech/tags/rtx-4090.md>), [sec](<https://devfeed.tech/tags/sec.md>), [sec-filings](<https://devfeed.tech/tags/sec-filings.md>), [small](<https://devfeed.tech/tags/small.md>)

### AI overview

Filing-Evidence tests whether small open models can extract SEC filing figures with a page reference and verbatim quote. Across 1,000 questions from 90 recent 10-K and 10-Q filings for 45 companies, ten 7-21B instruct models ran on one RTX 4090; inline XBRL tags supplied the answer keys. Plain-setup accuracy with checkable evidence ranged from 17.1% to 82.7%, with Qwen3.5-9B reaching 84.5% in the best result. The checker rejected many incorrect answers, but 16-167 per 1,000 answerable questions still had a wrong value that passed every check. Among these plain-setup errors, 57% involved scale or units and 30% used the wrong period or column. Reasoning reduced these errors for four of five models offering it; retrying after a failed check improved accuracy by up to 3.9 points but did not reduce them. Questions, outputs, code, and protocol are public.

### Source excerpt

arXiv:2611.24990v1 Announce Type: new Abstract: A fluent answer from a language model is not a verified one. We ask whether small open models that run on a single consumer GPU can extract numbers from SEC filings with evidence a machine can check: the page and a verbatim quote containing the number. We introduce Filing-Evidence, a benchmark of 1,000 questions over 90 recent 10-K and 10-Q filings of 45 US companies, with answer keys taken from the filers' inline XBRL tags. We evaluate ten instruct models from ten developers (7-21B parameters) on one RTX 4090 in three setups: plain, check-and-retry, and the model's own reasoning mode. Accuracy with checkable evidence ranges from 17.1% to 82.7% in the plain setup, and the best result is 84.5% (Qwen3.5-9B). An automatic checker rejects many wrong answers, but between 16 and 167 answers per 1,000 give a wrong value for an answerable question and still pass every check. In the plain setup, 57% of these are scale or unit errors and 30% take another period or column of the right line. Reasoning significantly reduces such errors for 4 of 5 models that offer it. Retrying after a failed check raises accuracy by up to 3.9 points but never reduces them. Questions, model outputs, code and protocol are public.

[Next page](<https://devfeed.tech/topics/ai-chat.md?cursor=WyIyMDI2LTExLTIwVDA1OjAwOjAwKzAwOjAwIiwgIjEwYzExZWJhLTVhNTUtNDE1Ni05ZGI2LTdiNzk1YmMyNzQ4NyJd>)