# Responsibility & Safety

Google DeepMind's responsible AI initiative covering governance, research, safety, security, and mitigation of AI-related risks.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Lawmakers form bipartisan caucus to create meaningful AI safety legislation

DevFeed: [Lawmakers form bipartisan caucus to create meaningful AI safety legislation](<https://devfeed.tech/articles/lawmakers-form-bipartisan-caucus-to-create-meaningful-ai-safety-legislation-144730.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/19/lawmakers-form-bipartisan-caucus-to-create-meaningful-ai-safety-legislation/>)

Author: Mike Wheatley

Published: 2026-11-20T01:48:55Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [ai safety](<https://devfeed.tech/topics/ai-safety.md>), [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [future of AI](<https://devfeed.tech/topics/future-of-ai.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-caucus](<https://devfeed.tech/tags/ai-caucus.md>), [ai-legislation](<https://devfeed.tech/tags/ai-legislation.md>), [ai-risks](<https://devfeed.tech/tags/ai-risks.md>), [ai-safety](<https://devfeed.tech/tags/ai-safety.md>), [ai-security](<https://devfeed.tech/tags/ai-security.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [autonomous](<https://devfeed.tech/tags/autonomous.md>), [autonomous-ai-agents](<https://devfeed.tech/tags/autonomous-ai-agents.md>), [bipartisan-caucus](<https://devfeed.tech/tags/bipartisan-caucus.md>), [caucus](<https://devfeed.tech/tags/caucus.md>), [congressional-caucus](<https://devfeed.tech/tags/congressional-caucus.md>), [create](<https://devfeed.tech/tags/create.md>), [don-beyer](<https://devfeed.tech/tags/don-beyer.md>), [form](<https://devfeed.tech/tags/form.md>), [george-whitesides](<https://devfeed.tech/tags/george-whitesides.md>), [hack](<https://devfeed.tech/tags/hack.md>), [house-committee](<https://devfeed.tech/tags/house-committee.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [hugging-face-inc](<https://devfeed.tech/tags/hugging-face-inc.md>), [innovation](<https://devfeed.tech/tags/innovation.md>), [lawmakers](<https://devfeed.tech/tags/lawmakers.md>), [legislation](<https://devfeed.tech/tags/legislation.md>), [models](<https://devfeed.tech/tags/models.md>), [nathanial-moran](<https://devfeed.tech/tags/nathanial-moran.md>), [news](<https://devfeed.tech/tags/news.md>), [policy](<https://devfeed.tech/tags/policy.md>), [risks](<https://devfeed.tech/tags/risks.md>), [safety](<https://devfeed.tech/tags/safety.md>), [security-threats](<https://devfeed.tech/tags/security-threats.md>), [the-latest](<https://devfeed.tech/tags/the-latest.md>), [top-story-6](<https://devfeed.tech/tags/top-story-6.md>)

### AI overview

A 26-member bipartisan House caucus, including seven Republicans, plans to develop targeted AI safety legislation while preserving innovation. Its co-chairs cited reports of AI agents escaping test environments and accessing outside systems as reasons for Congress to better understand security risks. The group says it will propose and review legislation, convene developers, independent experts and government officials after high-profile incidents, build relationships with outside experts, and help lawmakers and the public engage with AI safety issues. This overview reflects the supplied excerpt.

### Source excerpt

A bipartisan group of more than two dozen congressional lawmakers said today they're forming a new AI Safety and Innovation Caucus to tackle the growing security risks posed by the advances in sophisticated artificial intelligence models. The lawmakers cited the July hack of Hugging Face Inc.'s servers by a team of autonomous AI agents developed [...] The post Lawmakers form bipartisan caucus to create meaningful AI safety legislation appeared first on SiliconANGLE.

## How asago bridges the gaps in AI agent security

DevFeed: [How asago bridges the gaps in AI agent security](<https://devfeed.tech/articles/how-asago-bridges-the-gaps-in-ai-agent-security-140697.md>)

Original publisher: [Read original article](<https://developers.redhat.com/articles/2026/11/18/how-asago-bridges-gaps-ai-agent-security>)

Author: Anika Aracan

Published: 2026-11-18T14:16:50Z

Content type: article

Language: en

Sources: [Red Hat](<https://devfeed.tech/sources/red-hat.md>), [Red Hat Developer](<https://devfeed.tech/sources/red-hat-developer.md>)

Topics: [ai security](<https://devfeed.tech/topics/ai-security.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [prompt injection](<https://devfeed.tech/topics/prompt-injection.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-security](<https://devfeed.tech/tags/agent-security.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-agent-security](<https://devfeed.tech/tags/ai-agent-security.md>), [ai-governance](<https://devfeed.tech/tags/ai-governance.md>), [ai-governance-policy](<https://devfeed.tech/tags/ai-governance-policy.md>), [ai-risk](<https://devfeed.tech/tags/ai-risk.md>), [ai-risk-management](<https://devfeed.tech/tags/ai-risk-management.md>), [ai-risks](<https://devfeed.tech/tags/ai-risks.md>), [ai-safety](<https://devfeed.tech/tags/ai-safety.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [attack-surface](<https://devfeed.tech/tags/attack-surface.md>), [audit-trail](<https://devfeed.tech/tags/audit-trail.md>), [governance](<https://devfeed.tech/tags/governance.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-ai](<https://devfeed.tech/tags/open-source-ai.md>), [orchestration](<https://devfeed.tech/tags/orchestration.md>), [red-hat](<https://devfeed.tech/tags/red-hat.md>), [safety](<https://devfeed.tech/tags/safety.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

asago aims to turn AI governance policies into repeatable agent security checks. Its policy mapper extracts testable risks from policy language and links them to frameworks including the IBM AI Risk Atlas, OWASP LLM Top 10, and NIST AI Risk Management Framework, with evidence and confidence for each mapping. A scenario generator turns relevant risks into high-level harmful scenarios and attack techniques; an artifact generator converts those scenarios into garak-compatible adversarial tests. An orchestration platform such as EvalHub can run scans, after which a recommender reviews metrics and suggests guardrails or configuration changes for retesting. The excerpt says the policy mapper, scenario generator, and artifact generator were runnable as of September 2026, while the recommender remained in development. asago automates mechanical work but does not remove the need for security experts.

### Source excerpt

Even if you have never shipped out an agent yourself, you would hope that the companies behind the agents you're using have tested the security of the model and harness. Traditionally, as described in the Red Hat blog post Introducing asago: Open source AI safety and governance orchestration, onboarding a new agent looks like this: The post How asago bridges the gaps in AI agent security appeared first on Red Hat Developer.

## ReA-Bench: Benchmarking Responsible Agent Auditing

DevFeed: [ReA-Bench: Benchmarking Responsible Agent Auditing](<https://devfeed.tech/articles/rea-bench-benchmarking-responsible-agent-auditing-132246.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.16493>)

Author: Zipeng Ye, Shenyu Dai, Yong Xie, Kun Wang, Jiyang Guan, Zhikai Chen, Jiaqi Weng, Jialing Tao, Hui Xue

Published: 2026-11-13T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [responsible-ai](<https://devfeed.tech/topics/responsible-ai.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [auditing](<https://devfeed.tech/tags/auditing.md>), [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [diagnostic](<https://devfeed.tech/tags/diagnostic.md>), [false-positives](<https://devfeed.tech/tags/false-positives.md>), [foundation-models](<https://devfeed.tech/tags/foundation-models.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [risk](<https://devfeed.tech/tags/risk.md>), [safety](<https://devfeed.tech/tags/safety.md>), [steering](<https://devfeed.tech/tags/steering.md>), [tasks](<https://devfeed.tech/tags/tasks.md>), [tool](<https://devfeed.tech/tags/tool.md>), [verification](<https://devfeed.tech/tags/verification.md>)

### AI overview

ReA-Bench is designed to reveal which risks agent auditors miss and whether stronger risk detection comes with false positives on legitimate behavior. It organizes auditing challenges into six tiers: internal safety knowledge, trajectory contradictions, evidence retrieval in long contexts, verification of sources and reasoning, indirect steering, and missing information. The benchmark includes benign actions that resemble risky behavior but fit the task and its authorization, plus paired trajectory versions that test whether shortening a trajectory or supplying missing information improves detection. Most samples come from real production trajectories, manually selected and adapted to retain realistic tasks and plausible execution risks.

### Source excerpt

arXiv:2611.16493v1 Announce Type: new Abstract: As agents perform tasks autonomously in local and cloud environments, auditing their execution trajectories can help service providers identify risks and improve agent harnesses and foundation models. Our analysis of production and red-team trajectories shows that some risks are repeatedly missed across auditing configurations. Overall recall obscures which risks are missed and whether higher recall comes with more false positives on legitimate behavior. Existing benchmarks offer limited insight into these failures. Generated trajectories can contain inconsistent tool calls and responses, conspicuous risky actions, or repetitive attack patterns. Grouping results by risk type also makes it difficult to tell whether auditors overlooked evidence, accepted an unsupported conclusion, or lacked information needed to make a judgment. We introduce ReA-Bench, a diagnostic benchmark for auditing responsible agent behavior. It organizes auditing challenges into six tiers: internal safety knowledge, contradictions within trajectories, evidence retrieval in long contexts, verification of sources and reasoning, indirect steering, and missing information. It includes challenging benign cases in which actions resemble risky ones but are consistent with the task and its authorization. It also provides paired trajectory versions to test whether auditors detect the same risks more reliably when the trajectory is shortened or missing information is supplied. Most samples are drawn from real production trajectories, with scenarios manually selected and adapted to preserve realistic tasks and risks that could plausibly arise during execution.

## Supporting research on AI and children's safety

DevFeed: [Supporting research on AI and children's safety](<https://devfeed.tech/articles/supporting-research-on-ai-and-children-s-safety-130989.md>)

Original publisher: [Read original article](<https://openai.com/index/children-first-declaration>)

Published: 2026-11-12T00:00:00Z

Content type: news

Language: en

Sources: [OpenAI News](<https://devfeed.tech/sources/openai-news.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [ai safety](<https://devfeed.tech/topics/ai-safety.md>), [responsible-ai](<https://devfeed.tech/topics/responsible-ai.md>), [AI Research](<https://devfeed.tech/topics/ai-research.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [accountability](<https://devfeed.tech/tags/accountability.md>), [age-of-ai](<https://devfeed.tech/tags/age-of-ai.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-safety](<https://devfeed.tech/tags/ai-safety.md>), [children](<https://devfeed.tech/tags/children.md>), [development](<https://devfeed.tech/tags/development.md>), [eu-kids-act](<https://devfeed.tech/tags/eu-kids-act.md>), [global-affairs](<https://devfeed.tech/tags/global-affairs.md>), [legislation](<https://devfeed.tech/tags/legislation.md>), [measurement](<https://devfeed.tech/tags/measurement.md>), [mitigation](<https://devfeed.tech/tags/mitigation.md>), [openai](<https://devfeed.tech/tags/openai.md>), [research](<https://devfeed.tech/tags/research.md>), [risks](<https://devfeed.tech/tags/risks.md>), [safety](<https://devfeed.tech/tags/safety.md>), [scientific-research](<https://devfeed.tech/tags/scientific-research.md>), [standards](<https://devfeed.tech/tags/standards.md>), [support](<https://devfeed.tech/tags/support.md>), [teams](<https://devfeed.tech/tags/teams.md>), [tools](<https://devfeed.tech/tags/tools.md>), [young-people](<https://devfeed.tech/tags/young-people.md>)

### AI overview

OpenAI committed $2 million to support a scientific research network on children's rights and protection in the age of AI, following its signing of the Charter of Engagement for Safer AI for Children. The contribution funds shared tools to measure AI's risks and opportunities for young people. The charter sets out principles for safe, age-appropriate AI and safeguards research independence: teams control their conclusions, and findings--including negative or inconclusive results--will be published. OpenAI also supports youth AI safety legislation with enforceable protections that preserve young people's access to learning and creative tools, including default age-appropriate safeguards, parent tools, regular risk assessments and mitigation, and accountability. It says it will engage with European policymakers as the EU Kids Act develops.

### Source excerpt

OpenAI commits $2 million to research on AI and children's safety. The work supports shared tools to measure risks and opportunities for young people.

## Google DeepMind releases new advanced robotics AI model and next-generation gene prediction model

DevFeed: [Google DeepMind releases new advanced robotics AI model and next-generation gene prediction model](<https://devfeed.tech/articles/google-deepmind-releases-new-advanced-robotics-ai-model-and-next-generation-gene-prediction-model-129340.md>)

Original publisher: [Read original article](<https://siliconangle.com/2026/11/11/google-deepmind-releases-new-advanced-robotics-ai-model-and-next-generation-gene-prediction-model/>)

Author: Kyt Dotson

Published: 2026-11-11T16:30:22Z

Content type: news

Language: en

Sources: [SiliconANGLE](<https://devfeed.tech/sources/siliconangle.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>), [Robot Manipulation](<https://devfeed.tech/topics/robot-manipulation.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>)

Tags: [agile-robots](<https://devfeed.tech/tags/agile-robots.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-model](<https://devfeed.tech/tags/ai-model.md>), [alphabet](<https://devfeed.tech/tags/alphabet.md>), [alphagenome](<https://devfeed.tech/tags/alphagenome.md>), [alphagenome-2](<https://devfeed.tech/tags/alphagenome-2.md>), [alphasense](<https://devfeed.tech/tags/alphasense.md>), [deepmind](<https://devfeed.tech/tags/deepmind.md>), [dna](<https://devfeed.tech/tags/dna.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [google-deepmind](<https://devfeed.tech/tags/google-deepmind.md>), [human-cell-atlas](<https://devfeed.tech/tags/human-cell-atlas.md>), [jeff-cardenas](<https://devfeed.tech/tags/jeff-cardenas.md>), [mercedes-benz](<https://devfeed.tech/tags/mercedes-benz.md>), [nasdaq-goog](<https://devfeed.tech/tags/nasdaq-goog.md>), [news](<https://devfeed.tech/tags/news.md>), [prediction](<https://devfeed.tech/tags/prediction.md>), [robotics](<https://devfeed.tech/tags/robotics.md>), [robotics-ai-model](<https://devfeed.tech/tags/robotics-ai-model.md>), [sarah-teichmann](<https://devfeed.tech/tags/sarah-teichmann.md>), [the-latest](<https://devfeed.tech/tags/the-latest.md>), [top-story-6](<https://devfeed.tech/tags/top-story-6.md>), [vision-language-action](<https://devfeed.tech/tags/vision-language-action.md>)

### AI overview

Google DeepMind announced Gemini Robotics 2.5 and AlphaGenome 2. Robotics 2.5 is designed for dexterity, reliability, and safety in real-world settings. DeepMind reports results across more than 200 tasks, with task success rates of 30% to 100% and completion 20% to 30% faster than the previous version; Mercedes-Benz proof-of-concept tests packed automotive parts with 96% success. It supports multiple robot platforms and is rolling out through partners including Agile Robots, Apptronik, and Boston Dynamics. AlphaGenome 2 predicts DNA function, including gene expression, histone modification, chromatin accessibility, and DNA methylation. It adds cell type and state detail and, according to DeepMind, can adapt to new single-cell data without retraining. Its predictions can guide research, but require experimental validation; it is not approved for clinical or diagnostic use.

### Source excerpt

Alphabet Inc.'s artificial intelligence research lab, Google DeepMind, Tuesday debuted the next generation of Gemini Robotics, the company's most capable vision-language-action model to date for creating an "AI brain" for robotics. Separately, DeepMind announced AlphaGenome 2 today, a next-generation AI model that can predict how DNA sequences and their variations affect human cell types, creating [...] The post Google DeepMind releases new advanced robotics AI model and next-generation gene prediction model appeared first on SiliconANGLE.

## Just AI Governance and the Forbidden-Boundary Principle

DevFeed: [Just AI Governance and the Forbidden-Boundary Principle](<https://devfeed.tech/articles/just-ai-governance-and-the-forbidden-boundary-principle-128233.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.13007>)

Author: Na Young Ahn

Published: 2026-11-11T05:00:00Z

Content type: opinion

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [ai-ethics](<https://devfeed.tech/topics/ai-ethics.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [audit](<https://devfeed.tech/topics/audit.md>)

Tags: [actions](<https://devfeed.tech/tags/actions.md>), [agent](<https://devfeed.tech/tags/agent.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [ai-governance](<https://devfeed.tech/tags/ai-governance.md>), [alternatives](<https://devfeed.tech/tags/alternatives.md>), [architectures](<https://devfeed.tech/tags/architectures.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [audit](<https://devfeed.tech/tags/audit.md>), [authorization](<https://devfeed.tech/tags/authorization.md>), [boundary](<https://devfeed.tech/tags/boundary.md>), [compare](<https://devfeed.tech/tags/compare.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [contribution](<https://devfeed.tech/tags/contribution.md>), [controller](<https://devfeed.tech/tags/controller.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [governance](<https://devfeed.tech/tags/governance.md>), [just](<https://devfeed.tech/tags/just.md>)

### AI overview

The paper proposes a conceptual framework for evaluating just AI across normative, data, model, and governance layers. It maps six justice requirements to evidence, decision rights, and remedies, then applies a two-stage rule: exclude uses that violate independently justified minimum rights constraints and compare remaining options across performance and governance criteria. Its Forbidden-Boundary Principle says AI must not take externally consequential actions beyond pre-authorized limits. The proposed First-Principle Safe-Stop Protocol uses an independently governed policy monitor, mandatory execution gate, safe-state controller, audit trails, and accountable human authorization for recovery. The authors distinguish this normative and traceability contribution from Simplex and runtime assurance architectures; they claim neither a novel safety switch nor universal ethical compliance. No implementation, experimental results, numerical improvement, or verified latency bound is reported, so the framework proposes future evaluation rather than demonstrating operational safety.

### Source excerpt

arXiv:2611.13007v1 Announce Type: cross Abstract: Artificial intelligence (AI) increasingly shapes consequential decisions, yet predictive accuracy is not a sufficient justification for delegated authority. This conceptual study develops an integrated framework for assessing just AI across normative, data, model, and governance layers. Drawing on plural theories of justice, sociotechnical fairness research, and publicly available governance standards, it maps six justice requirements to observable evidence, decision rights, and remedies. It proposes a two-stage evaluation rule: exclude uses that fail independently justified minimum rights constraints, then compare eligible alternatives across multiple performance and governance criteria. As an explicitly limited normative analogy, Genesis chapter 2 motivates a Forbidden-Boundary Principle (FBP), under which an AI agent must not execute externally consequential actions outside pre-authorized boundaries. The resulting First-Principle Safe-Stop Protocol (FPSSP) comprises an independently governed policy monitor, a mandatory execution gate, a restricted or alternative safe-state controller, immutable-oriented audit trails, and accountable human authorization for recovery. We distinguish this normative and traceability contribution from existing Simplex and runtime assurance architectures; we do not claim a novel safety switch or formal proof of universal ethical compliance. A policy schema, threat model, test matrix, outcome definitions, and a prospective comparison design make the proposal falsifiable. No FPSSP implementation, experimental dataset, numerical improvement, or verified latency bound is reported. The framework supports future evaluation rather than constituting evidence of operational safety.

## When Coding Agents Get Arms: Safety Risks Across the Digital-Physical Boundary

DevFeed: [When Coding Agents Get Arms: Safety Risks Across the Digital-Physical Boundary](<https://devfeed.tech/articles/when-coding-agents-get-arms-safety-risks-across-the-digital-physical-boundary-126957.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.11438>)

Author: Yiming Sun, Mi Zhang

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Robotics](<https://devfeed.tech/topics/robotics.md>), [Physical AI](<https://devfeed.tech/topics/physical-ai.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [LLM security](<https://devfeed.tech/topics/llm-security.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>), [AI-assisted coding](<https://devfeed.tech/topics/ai-assisted-coding.md>), [agentic-coding](<https://devfeed.tech/topics/agentic-coding.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [coding-agents](<https://devfeed.tech/tags/coding-agents.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-mm](<https://devfeed.tech/tags/cs-mm.md>), [cs-ro](<https://devfeed.tech/tags/cs-ro.md>), [indirect-prompt-injection](<https://devfeed.tech/tags/indirect-prompt-injection.md>), [malicious](<https://devfeed.tech/tags/malicious.md>), [risks](<https://devfeed.tech/tags/risks.md>), [robot-arm](<https://devfeed.tech/tags/robot-arm.md>), [robustness](<https://devfeed.tech/tags/robustness.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

Frontier-model coding agents can control robot arms zero-shot, creating risks that cross from digital inputs into physical actions. Their broader capabilities may enable harmful tasks beyond earlier VLA and WAM systems, while indirect prompt injection in resources such as web pages or emails may influence robot behavior. The authors introduce ArmedAgent, a benchmark covering robustness, malicious use, and indirect injection across 36 tasks and five scenarios, evaluated in simulation and validated on a physical arm. Tests of several frontier models, including GPT-6-Astra, with widely used agent frameworks found substantial safety risks in current systems.

### Source excerpt

arXiv:2611.11438v1 Announce Type: cross Abstract: Advances in spatial understanding have enabled frontier models to power coding agents that control a real robot arm zero-shot and end-to-end, without task-specific demonstrations or retraining. This brings two new safety challenges. First, the extensive knowledge of frontier models lets these agents perform tasks that earlier VLA and WAM paradigms could not, opening the door to new forms of capability misuse. Second, coding agents can access digital resources such as web pages and emails. Threats in these resources, such as indirect prompt injection, can carry over into the physical world when the agent controls a robot. We therefore introduce ArmedAgent, the first systematic benchmark to evaluate both risks for coding agents performing zero-shot robot control. It covers robustness, malicious use, and indirect injection across 36 tasks in 5 scenarios, evaluated in simulation and validated on a physical robot arm. A distinctive portion of the tasks target harmful behaviors that earlier VLA paradigms could not perform. Testing several frontier models, including GPT-6-Astra, under widely used agent frameworks, we find substantial safety risks in current systems.

## Restoring General and Improving Domain-Specific Safety in Fine-Tuned LLMs Without Retraining

DevFeed: [Restoring General and Improving Domain-Specific Safety in Fine-Tuned LLMs Without Retraining](<https://devfeed.tech/articles/restoring-general-and-improving-domain-specific-safety-in-fine-tuned-llms-without-retraining-125161.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.10279>)

Author: Vishnu Kabir Chhabra, Ding Zhu, Zhihui Zhu, Xueru Zhang, Mohammad Mahdi Khalili

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [AI Foundation Models](<https://devfeed.tech/topics/ai-foundation-models.md>)

Tags: [activation](<https://devfeed.tech/tags/activation.md>), [arxiv](<https://devfeed.tech/tags/arxiv.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [domain](<https://devfeed.tech/tags/domain.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [rank](<https://devfeed.tech/tags/rank.md>), [safety](<https://devfeed.tech/tags/safety.md>), [weight](<https://devfeed.tech/tags/weight.md>)

### AI overview

SPECTRA aims to restore refusal behavior weakened by benign domain-specific fine-tuning, without retraining or domain-specific safety data. It transfers the base model's refusal direction into the fine-tuned model using an activation-aware, low-rank weight update, focused on a subspace the authors describe as causally active on harmful inputs. The abstract reports substantially improved refusal behavior across a comprehensive safety evaluation while preserving general coherence and domain knowledge, with negligible change in false refusal rates. Unlike preference optimization, the method requires no gradient-based optimization; the supplied abstract does not provide evaluation details or quantitative results.

### Source excerpt

arXiv:2611.10279v1 Announce Type: cross Abstract: Safety-aligned language models are known to suffer degradation in refusal behavior following domain-specific fine-tuning, even when the fine-tuning data is entirely benign. The predominant mitigation strategy, preference optimization on the fine-tuned model, is computationally expensive and requires domain-specific preference data that is often unavailable in practice. We propose SPECTRA, a training-free, weight-level method that restores refusal behavior by transferring the base model's refusal direction into the fine-tuned model's weights via an activation-aware, low-rank update, requiring no gradient-based optimization or domain-specific safety data. The low-rank design restricts the intervention to the subspace most causally active on harmful inputs, leaving benign behavior largely undisturbed by construction. Empirically, SPECTRA substantially improves refusal behavior across a comprehensive safety evaluation, while preserving general coherence, domain-specific knowledge, and producing negligible change in false refusal rates.

## Double Blind Evals: Resolving the Dual Confidentiality Dilemma in AI Safety Auditing

DevFeed: [Double Blind Evals: Resolving the Dual Confidentiality Dilemma in AI Safety Auditing](<https://devfeed.tech/articles/double-blind-evals-resolving-the-dual-confidentiality-dilemma-in-ai-safety-auditing-125569.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.12604>)

Author: Andrew Trask, Sol Messing, Vai Pahwa, Pegah Maham, Rene Kolga, Austin Frantz, Andrew Tash, Kate Thomas, Sean McGregor, George Balston, Patricia Paskov, Miles Brundage, Akriti Vij, Bennett Hillenbrand,

Published: 2026-11-10T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [ai security](<https://devfeed.tech/topics/ai-security.md>), [Cryptography](<https://devfeed.tech/topics/cryptography.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-safety](<https://devfeed.tech/tags/ai-safety.md>), [auditing](<https://devfeed.tech/tags/auditing.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [cryptographic](<https://devfeed.tech/tags/cryptographic.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [data](<https://devfeed.tech/tags/data.md>), [data-leakage](<https://devfeed.tech/tags/data-leakage.md>), [deepmind](<https://devfeed.tech/tags/deepmind.md>), [evals](<https://devfeed.tech/tags/evals.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [google](<https://devfeed.tech/tags/google.md>), [google-cloud](<https://devfeed.tech/tags/google-cloud.md>), [google-cloud-platform](<https://devfeed.tech/tags/google-cloud-platform.md>), [google-deepmind](<https://devfeed.tech/tags/google-deepmind.md>), [h100](<https://devfeed.tech/tags/h100.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [inference](<https://devfeed.tech/tags/inference.md>), [ip](<https://devfeed.tech/tags/ip.md>), [model](<https://devfeed.tech/tags/model.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

The paper presents "double-blind evals" to protect both an evaluator's prompts and a model owner's proprietary weights and inference code. It uses secure enclaves, which encrypt data in RAM at the hardware level, and says the approach provides cryptographic guarantees that prompts are not shared with the model owner. In a pilot, the authors evaluated Google DeepMind's Gemini 2.5 Flash Lite on a selection of the private AILuminate benchmark using an NVIDIA H100 secure enclave on Google Cloud Platform and OpenMined's PySyft. The authors describe this as the first use of the technology for mutual secrecy between a proprietary frontier-class model and a closed benchmark.

### Source excerpt

arXiv:2611.12604v1 Announce Type: cross Abstract: AI safety evaluations often involve sensitive prompts and proprietary models. Evaluators want to keep their evaluation prompts secret from model owners to prevent purposeful or incidental data leakage, ensuring longer usefulness of their benchmark. Model owners in turn wish to keep their proprietary model weights and inference code within their own secure infrastructure to protect their IP. We present a way forward for "double-blind evals", which provide cryptographic guarantees that an evaluator's prompts are not shared with the model owner, while simultaneously maintaining the confidentiality of the model weights and inference code. To accomplish this, we use secure enclaves that encrypt data in RAM at the hardware level. In a world-first pilot, we test this approach by evaluating a proprietary Google DeepMind model (Gemini 2.5 Flash Lite) against a selection of the private AILuminate benchmark corpus, using an NVIDIA H100 secure enclave on Google Cloud Platform, and using OpenMined's PySyft to maintain data and model privacy. We believe this effort marks the first use of this technology to provide mutual secrecy for one organization's frontier-class proprietary model weights and another organization's closed benchmark.

## What is Claude Mythos? And how is if different from Claude Fable?

DevFeed: [What is Claude Mythos? And how is if different from Claude Fable?](<https://devfeed.tech/articles/what-is-claude-mythos-and-how-is-if-different-from-claude-fable-128954.md>)

Original publisher: [Read original article](<https://zapier.com/blog/claude-mythos>)

Author: Harry Guinness

Published: 2026-11-10T04:00:00Z

Content type: article

Language: en

Sources: [Zapier](<https://devfeed.tech/sources/zapier.md>)

Topics: [Claude](<https://devfeed.tech/topics/claude.md>), [Cybersecurity](<https://devfeed.tech/topics/cybersecurity.md>), [Frontier AI](<https://devfeed.tech/topics/frontier-ai.md>), [anthropic](<https://devfeed.tech/topics/anthropic.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>)

Tags: [2026](<https://devfeed.tech/tags/2026.md>), [admin](<https://devfeed.tech/tags/admin.md>), [agent](<https://devfeed.tech/tags/agent.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-and-security](<https://devfeed.tech/tags/ai-and-security.md>), [ai-model](<https://devfeed.tech/tags/ai-model.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [claude](<https://devfeed.tech/tags/claude.md>), [claude-fable](<https://devfeed.tech/tags/claude-fable.md>), [claude-mythos](<https://devfeed.tech/tags/claude-mythos.md>), [claude-mythos-preview](<https://devfeed.tech/tags/claude-mythos-preview.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [fable](<https://devfeed.tech/tags/fable.md>), [glasswing](<https://devfeed.tech/tags/glasswing.md>), [mythos](<https://devfeed.tech/tags/mythos.md>), [mythos-preview](<https://devfeed.tech/tags/mythos-preview.md>), [national-security](<https://devfeed.tech/tags/national-security.md>), [productivity](<https://devfeed.tech/tags/productivity.md>), [project-glasswing](<https://devfeed.tech/tags/project-glasswing.md>), [security](<https://devfeed.tech/tags/security.md>)

### AI overview

Claude Mythos 5.2 and Claude Fable 5.2 are described as general-purpose models strong in coding, reasoning, and vision tasks. Their stated difference is that Fable has guardrails for cybersecurity, chemistry and biology, and model distillation; when those block a response, it falls back to Opus. Mythos is restricted to vetted organizations and eligible Enterprise customers, while Fable is available to eligible Pro, Max, Team, and some Enterprise subscribers and through the API. Anthropic says Mythos found thousands of severe vulnerabilities; Project Glasswing partners reportedly found and patched more than 10,000 high- or critical-severity bugs. The excerpt describes these capabilities as a security concern and says they emerged from advances in coding, reasoning, and autonomy. It also notes Fable's strong benchmark results, while its API pricing is stated as twice Opus 5.5's.

### Source excerpt

On April 7, 2026, Claude Mythos Preview was officially announced, but it was apparently too dangerous to release. According to Anthropic, Claude Mythos represented a unique cybersecurity threat (they claimed that "the fallout--for economies, public safety, and national security--could be severe.") Instead of releasing Mythos to the general public, they spun up Project Glasswing, a cybersecurity initiative that also involved some big-name companies. The idea was that they'd be able to deploy Mythos

## AI Policy Enforcement: How Enterprises Can Turn AI Governance Into Action

DevFeed: [AI Policy Enforcement: How Enterprises Can Turn AI Governance Into Action](<https://devfeed.tech/articles/ai-policy-enforcement-how-enterprises-can-turn-ai-governance-into-action-120979.md>)

Original publisher: [Read original article](<https://www.lyzr.ai/blog/ai-policy-enforcement/>)

Author: shreya

Published: 2026-11-06T05:26:14Z

Content type: article

Language: en

Sources: [Lyzr.ai](<https://devfeed.tech/sources/lyzr-ai.md>)

Topics: [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [policy-as-code](<https://devfeed.tech/topics/policy-as-code.md>), [Dynamic authorization rules](<https://devfeed.tech/topics/dynamic-authorization-rules.md>), [shadow AI](<https://devfeed.tech/topics/shadow-ai.md>), [ai regulation](<https://devfeed.tech/topics/ai-regulation.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [enterprise data protection](<https://devfeed.tech/topics/enterprise-data-protection.md>)

Tags: [acceptable-use](<https://devfeed.tech/tags/acceptable-use.md>), [access-control](<https://devfeed.tech/tags/access-control.md>), [accountability](<https://devfeed.tech/tags/accountability.md>), [actions](<https://devfeed.tech/tags/actions.md>), [adoption](<https://devfeed.tech/tags/adoption.md>), [adversarial](<https://devfeed.tech/tags/adversarial.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agent-permissions](<https://devfeed.tech/tags/agent-permissions.md>), [agent-sprawl](<https://devfeed.tech/tags/agent-sprawl.md>), [agent-studio](<https://devfeed.tech/tags/agent-studio.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [ai-governance](<https://devfeed.tech/tags/ai-governance.md>), [ai-policy](<https://devfeed.tech/tags/ai-policy.md>), [compliance](<https://devfeed.tech/tags/compliance.md>), [enterprises](<https://devfeed.tech/tags/enterprises.md>), [governance](<https://devfeed.tech/tags/governance.md>), [policy](<https://devfeed.tech/tags/policy.md>), [policy-enforcement](<https://devfeed.tech/tags/policy-enforcement.md>), [rules](<https://devfeed.tech/tags/rules.md>)

### AI overview

AI policy enforcement turns organizational rules into controls that govern what AI systems can access, disclose, and do, with human approval for consequential actions. The framework described combines agent identity and least-privilege permissions, data protection, behavioral guardrails, escalation, continuous monitoring, and audit trails. Enterprises are advised to inventory agents and owners, classify systems by risk, convert policies into operational rules, apply controls across deployment and execution, and review them as systems change. The article distinguishes this operational layer from broader AI governance and says deterministic controls should remain in place for critical authorization and transaction limits rather than relying on a model's interpretation alone. It presents Lyzr OpenController as a centralized governance layer for agent visibility, identity, access, security checks, and policy enforcement, while noting that controls do not automatically establish regulatory compliance.

### Source excerpt

An enterprise can have a detailed AI policy document, clearly defined access rules, and an entire team responsible for compliance. But what happens when an...

## Responsible GenAI Use During Active Armed Conflict: Evidence from Sudan's Emergency Response Rooms

DevFeed: [Responsible GenAI Use During Active Armed Conflict: Evidence from Sudan's Emergency Response Rooms](<https://devfeed.tech/articles/responsible-genai-use-during-active-armed-conflict-evidence-from-sudan-s-emergency-response-rooms-120258.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2611.07874>)

Author: Dalia Ali, Yearin Lee, Cheng Yu, Ro Encarnaci\\'on, Alsanosi Adam, Dana\\'e Metaxa, Ingmar Weber, Orestis Papakyriakopoulos

Published: 2026-11-06T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>)

Topics: [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [generative-ai-tools](<https://devfeed.tech/topics/generative-ai-tools.md>), [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [human review](<https://devfeed.tech/topics/human-review.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [choice](<https://devfeed.tech/tags/choice.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-hc](<https://devfeed.tech/tags/cs-hc.md>), [danger](<https://devfeed.tech/tags/danger.md>), [food](<https://devfeed.tech/tags/food.md>), [funding](<https://devfeed.tech/tags/funding.md>), [genai](<https://devfeed.tech/tags/genai.md>), [internet](<https://devfeed.tech/tags/internet.md>), [interviews](<https://devfeed.tech/tags/interviews.md>), [lead](<https://devfeed.tech/tags/lead.md>), [local](<https://devfeed.tech/tags/local.md>), [medical](<https://devfeed.tech/tags/medical.md>), [network](<https://devfeed.tech/tags/network.md>), [perspectives](<https://devfeed.tech/tags/perspectives.md>), [phone](<https://devfeed.tech/tags/phone.md>), [reports](<https://devfeed.tech/tags/reports.md>), [responsible-ai](<https://devfeed.tech/tags/responsible-ai.md>), [risk](<https://devfeed.tech/tags/risk.md>), [sharing](<https://devfeed.tech/tags/sharing.md>), [survey](<https://devfeed.tech/tags/survey.md>), [verification](<https://devfeed.tech/tags/verification.md>)

### AI overview

An exploratory study of Sudan's Emergency Response Rooms, based on a survey of 89 respondents and 15 interviews, finds that conflict can make GenAI valuable precisely when its outputs are hardest to verify. Responders used it when reaching human expertise was difficult or dangerous, but participants said it could not establish fast-changing local conditions and could contribute to harmful decisions without human verification. Responsible use also depends on safe access: phones or internet use may expose volunteers to danger, sharing sensitive information may put people at risk, and AI-assisted reports may weaken donor trust. Access is uneven, and some users relied on colleagues' expertise or local knowledge to check outputs. The findings emphasize judging when GenAI can be safely accessed and locally verified, and when limiting or avoiding it is more responsible.

### Source excerpt

arXiv:2611.07874v1 Announce Type: new Abstract: Armed conflict can increase the value of Generative AI (GenAI) while undermining the conditions required for its responsible use. Yet the perspectives of community-based humanitarian responders working under these conditions remain underrepresented in responsible AI research. We examine GenAI use in Sudan's Emergency Response Rooms (ERRs), a community-led humanitarian network, through an exploratory survey of 89 respondents and 15 semi-structured interviews with GenAI users and non-users. War reconfigures GenAI's role, making it most useful where its outputs are hardest to verify. ERR responders turned to GenAI when conflict made human expertise difficult or dangerous to reach. However, participants cautioned that GenAI could not independently establish rapidly changing local conditions, and that relying on its outputs could lead to harmful decisions when human verification was difficult. Risks arose before GenAI was used. For some volunteers, carrying a phone or accessing the internet could expose them to danger. Others were concerned that sharing sensitive beneficiary or operational information with GenAI could put people at risk. Participants feared that AI-assisted reports could undermine their credibility with donors, whose funding sustains the food and medical aid ERRs provide. Access to GenAI was uneven, and volunteers using it sometimes relied on colleagues with relevant expertise or local knowledge to verify its results. Our findings show that responsible use of GenAI during conflict depends not only on model performance or individual adoption, but also on whether responders can safely access these tools, verify their outputs against local conditions, and recognize when limiting or avoiding GenAI is the more responsible choice.

## Franklin Templeton uses OpenAI to support investment research

DevFeed: [Franklin Templeton uses OpenAI to support investment research](<https://devfeed.tech/articles/franklin-templeton-uses-openai-to-support-investment-research-120966.md>)

Original publisher: [Read original article](<https://openai.com/index/franklin-templeton>)

Published: 2026-11-05T00:00:00Z

Content type: news

Language: en

Sources: [OpenAI News](<https://devfeed.tech/sources/openai-news.md>)

Topics: [AI Integration Strategies](<https://devfeed.tech/topics/ai-integration-strategies.md>), [AI Research](<https://devfeed.tech/topics/ai-research.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-workflows](<https://devfeed.tech/tags/ai-workflows.md>), [connected-intelligence](<https://devfeed.tech/tags/connected-intelligence.md>), [investment](<https://devfeed.tech/tags/investment.md>), [openai](<https://devfeed.tech/tags/openai.md>), [portfolio](<https://devfeed.tech/tags/portfolio.md>), [research](<https://devfeed.tech/tags/research.md>), [risks](<https://devfeed.tech/tags/risks.md>)

### AI overview

Franklin Templeton is developing AI workflows to help portfolio managers compare research views and examine investment risks, starting with equity research. The firm says connecting its data through agents and a semantic layer improved results after a database-connected approach failed to capture how the data related. Its goal is to bring research, risk, compliance and trading perspectives together while preserving diversity of opinion and surfacing risks alongside investment ideas. The work has included Codex-supported hackathons; moving experiments toward production involves security review, expert support and data controls. The firm also describes practical labs, tool education and experimentation within defined risk guardrails. Human judgment remains central, and the excerpt presents a longer-term goal of making the connected intelligence foundation available across investment teams.

### Source excerpt

Starting with equity research, Franklin Templeton is developing AI workflows to help portfolio managers compare research views and examine investment risks.

## Sysdig Adds Runtime Security and Governance for AI Agents

DevFeed: [Sysdig Adds Runtime Security and Governance for AI Agents](<https://devfeed.tech/articles/sysdig-adds-runtime-security-and-governance-for-ai-agents-117126.md>)

Original publisher: [Read original article](<https://www.securityweek.com/sysdig-adds-runtime-security-and-governance-for-ai-agents/>)

Author: Kevin Townsend

Published: 2026-11-04T14:34:44Z

Content type: release

Language: en

Sources: [SecurityWeek](<https://devfeed.tech/sources/securityweek.md>)

Topics: [threat detection](<https://devfeed.tech/topics/threat-detection.md>), [observability](<https://devfeed.tech/topics/observability.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>)

Tags: [actions](<https://devfeed.tech/tags/actions.md>), [agent](<https://devfeed.tech/tags/agent.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [application-security](<https://devfeed.tech/tags/application-security.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [governance](<https://devfeed.tech/tags/governance.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [runtime-security](<https://devfeed.tech/tags/runtime-security.md>), [security](<https://devfeed.tech/tags/security.md>), [sysdig](<https://devfeed.tech/tags/sysdig.md>)

### AI overview

Sysdig AI Defense is presented as runtime security and governance for AI agents, using kernel-level telemetry to track what agents actually do rather than relying only on their own reports. It provides a live inventory of agents and related components, links agents to accountable people, and can flag risky actions for human review or block them in real time before completion. Policies can start in alert mode and move to enforcement when an organization is ready; templates map rules to frameworks including OWASP Top 10 for LLM Applications. A live action graph pairs an agent's stated intent with observed actions, access, and authority, while records capture applied policies and approvals. These are product capabilities claimed in the supplied excerpt.

### Source excerpt

Sysdig's platform uses runtime visibility to track AI agent actions and block risky behavior before it reaches production systems. The post Sysdig Adds Runtime Security and Governance for AI Agents appeared first on SecurityWeek.

## Companies going all in on AI could see their strategy backfire

DevFeed: [Companies going all in on AI could see their strategy backfire](<https://devfeed.tech/articles/companies-going-all-in-on-ai-could-see-their-strategy-backfire-116033.md>)

Original publisher: [Read original article](<https://www.helpnetsecurity.com/2026/11/04/ai-strategy-miscalculation-gartner-report/>)

Author: Anamarija Pogorelec

Published: 2026-11-04T05:30:45Z

Content type: news

Language: en

Sources: [Help Net Security](<https://devfeed.tech/sources/help-net-security.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [vulnerability management](<https://devfeed.tech/topics/vulnerability-management.md>), [national security](<https://devfeed.tech/topics/national-security.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-investments](<https://devfeed.tech/tags/ai-investments.md>), [ai-projects](<https://devfeed.tech/tags/ai-projects.md>), [ai-strategy](<https://devfeed.tech/tags/ai-strategy.md>), [cyber](<https://devfeed.tech/tags/cyber.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [energy](<https://devfeed.tech/tags/energy.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [gartner](<https://devfeed.tech/tags/gartner.md>), [governance](<https://devfeed.tech/tags/governance.md>), [investment](<https://devfeed.tech/tags/investment.md>), [news](<https://devfeed.tech/tags/news.md>), [report](<https://devfeed.tech/tags/report.md>), [risk](<https://devfeed.tech/tags/risk.md>), [risk-management](<https://devfeed.tech/tags/risk-management.md>), [strategy](<https://devfeed.tech/tags/strategy.md>), [workforce](<https://devfeed.tech/tags/workforce.md>)

### AI overview

Four of Gartner's five highest-ranked enterprise risks were AI-related, based on responses from 308 risk and audit leaders and executives. The article describes miscalculation when companies commit resources before validating a project's benefits, business fit, risk tolerance, and workforce readiness; underperforming projects can divert staff and funds. AI-assisted discovery of software vulnerabilities could outpace security teams' ability to fix them, while rivals that move beyond pilots may displace companies through better services or lower prices. Workforce skill gaps can also hinder adoption and returns. Gartner survey results indicate that 54% of 225 risk and assurance leaders documented AI both as a standalone risk and within other entries in 2025; only 17% of CFO survey respondents said more than half their AI projects delivered measurable revenue growth or cost savings. The article recommends assigning clear oversight and implementation roles, assessing effects on priorities and resources, validating readiness before scaling, and measuring outcomes such as whether time saved translates into productivity gains.

### Source excerpt

Four of the five highest-ranked enterprise risks in Gartner's Quarterly Emerging Risk Report were AI-related. AI strategy miscalculation and AI-driven competitive displacement debuted at No. 3 and No. 4, respectively. The AI workforce preparedness gap held fifth place. AI discovery of cyber vulnerabilities and geopolitical energy supply shocks held the top two spots for the second consecutive quarter. The rankings show a composite risk score based on responses from 308 enterprise risk management leaders, auditors ... More -> The post Companies going all in on AI could see their strategy backfire appeared first on Help Net Security.

## Google DeepMind Introduces Gemini 4 Carbon, Its Top Model for Cyber Defense and Coding

DevFeed: [Google DeepMind Introduces Gemini 4 Carbon, Its Top Model for Cyber Defense and Coding](<https://devfeed.tech/articles/google-deepmind-introduces-gemini-4-carbon-its-top-model-for-cyber-defense-and-coding-105399.md>)

Original publisher: [Read original article](<https://www.marktechpost.com/2026/10/28/google-deepmind-gemini-4-carbon-frontier-model/>)

Author: Asif Razzaq

Published: 2026-10-28T17:48:38Z

Content type: news

Language: en

Sources: [MarkTechPost](<https://devfeed.tech/sources/marktechpost.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-shorts](<https://devfeed.tech/tags/ai-shorts.md>), [applications](<https://devfeed.tech/tags/applications.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [coding](<https://devfeed.tech/tags/coding.md>), [cyber-defense](<https://devfeed.tech/tags/cyber-defense.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [editors-pick](<https://devfeed.tech/tags/editors-pick.md>), [enterprise-ai](<https://devfeed.tech/tags/enterprise-ai.md>), [gemini-4-carbon](<https://devfeed.tech/tags/gemini-4-carbon.md>), [google-deepmind](<https://devfeed.tech/tags/google-deepmind.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [new-releases](<https://devfeed.tech/tags/new-releases.md>), [security](<https://devfeed.tech/tags/security.md>), [staff](<https://devfeed.tech/tags/staff.md>), [tech-news](<https://devfeed.tech/tags/tech-news.md>), [technology](<https://devfeed.tech/tags/technology.md>)

### AI overview

Google DeepMind describes Gemini 4 Carbon as a hosted model for long-running coding and cybersecurity work, with early access limited to vetted cyber defenders and trusted partners. In Google's reported comparisons, it scored 88.2% on SEC-bench Pro, 54.8% on ExploitGym (run with mitigations off), and 71.0% on CWE-bench; it also led GraphWalks at 96.2%. It did not lead every benchmark: GPT-6 Astra scored higher on FrontierSWE, and Claude Opus 5.5 on OSWorld-2.1. Google reports improved internal safety and alignment results, but independent replication is not yet available. Public access has no announced date. Introductory pricing matches Argon at $2 per million input tokens and $10 per million output tokens, with cached input discounted 95%; prices later rise to $4 and $20.

### Source excerpt

Google DeepMind introduced Gemini 4 Carbon, a frontier model that scores 59 on the Artificial Analysis Intelligence Index and 88.2% on SEC-bench Pro. Access starts with vetted cyber defenders, at $2/$10 per million tokens. The post Google DeepMind Introduces Gemini 4 Carbon, Its Top Model for Cyber Defense and Coding appeared first on MarkTechPost.

## Risks Spelled Out for Anthropic Investors Include Possible Harms From Runaway AI

DevFeed: [Risks Spelled Out for Anthropic Investors Include Possible Harms From Runaway AI](<https://devfeed.tech/articles/risks-spelled-out-for-anthropic-investors-include-possible-harms-from-runaway-ai-101948.md>)

Original publisher: [Read original article](<https://www.securityweek.com/risks-spelled-out-for-anthropic-investors-include-possible-harms-from-runaway-ai/>)

Author: Associated Press

Published: 2026-10-27T10:44:20Z

Content type: news

Language: en

Sources: [SecurityWeek](<https://devfeed.tech/sources/securityweek.md>)

Topics: [future of AI](<https://devfeed.tech/topics/future-of-ai.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [risk-management](<https://devfeed.tech/topics/risk-management.md>)

Tags: [about](<https://devfeed.tech/tags/about.md>), [actions](<https://devfeed.tech/tags/actions.md>), [addition](<https://devfeed.tech/tags/addition.md>), [advanced](<https://devfeed.tech/tags/advanced.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-companies](<https://devfeed.tech/tags/ai-companies.md>), [ai-industry](<https://devfeed.tech/tags/ai-industry.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [anthropic-investors](<https://devfeed.tech/tags/anthropic-investors.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [first](<https://devfeed.tech/tags/first.md>), [include](<https://devfeed.tech/tags/include.md>), [initial-public-offering](<https://devfeed.tech/tags/initial-public-offering.md>), [investors](<https://devfeed.tech/tags/investors.md>), [possible](<https://devfeed.tech/tags/possible.md>), [post](<https://devfeed.tech/tags/post.md>), [presents](<https://devfeed.tech/tags/presents.md>), [public](<https://devfeed.tech/tags/public.md>), [public-offering](<https://devfeed.tech/tags/public-offering.md>), [risks](<https://devfeed.tech/tags/risks.md>)

### AI overview

Anthropic's SEC filing devotes 93 of its 335 pages to investor risk factors, including potential harms from rapidly advancing, increasingly autonomous AI. The company warns that models could outpace safety measures, act harmfully at scale, or be misused by bad actors to support cyberattacks, weapons development, surveillance, or repression. It also says AI-assisted research could exceed its ability to evaluate and safeguard new models. Business risks include difficulty retaining staff or navigating regulation, high compute costs and shortages, data-center scrutiny over environmental and resource impacts, and reliance on a small number of major customers and distribution channels. Anthropic presents investment in safety and alignment as a way to help manage AI risks, while acknowledging that failures or incidents across the frontier AI industry could bring reputational damage, public backlash, and regulation.

### Source excerpt

Anthropic presents its own initial public offering as a step toward mitigating the risks it believes AI poses. The post Risks Spelled Out for Anthropic Investors Include Possible Harms From Runaway AI appeared first on SecurityWeek.

## Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoring

DevFeed: [Compositional Safety Failures in Harness Evolution: Identification and Runtime Monitoring](<https://devfeed.tech/articles/compositional-safety-failures-in-harness-evolution-identification-and-runtime-monitoring-96629.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2609.33123>)

Author: Zhixiang Zhang, Zesen Liu, Wai Ip Lai, Hongxu chen, Dongdong She

Published: 2026-10-23T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Artificial Intelligence](<https://devfeed.tech/sources/arxiv-artificial-intelligence.md>), [arXiv: Software Engineering](<https://devfeed.tech/sources/arxiv-software-engineering.md>)

Topics: [Agent Harness](<https://devfeed.tech/topics/agent-harness.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [Monitoring](<https://devfeed.tech/topics/monitoring.md>), [computational complexity](<https://devfeed.tech/topics/computational-complexity.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agent-harnesses](<https://devfeed.tech/tags/agent-harnesses.md>), [behavior](<https://devfeed.tech/tags/behavior.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [complexity](<https://devfeed.tech/tags/complexity.md>), [component](<https://devfeed.tech/tags/component.md>), [components](<https://devfeed.tech/tags/components.md>), [composition](<https://devfeed.tech/tags/composition.md>), [cost](<https://devfeed.tech/tags/cost.md>), [costs](<https://devfeed.tech/tags/costs.md>), [cross](<https://devfeed.tech/tags/cross.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-se](<https://devfeed.tech/tags/cs-se.md>), [develop](<https://devfeed.tech/tags/develop.md>), [evolution](<https://devfeed.tech/tags/evolution.md>), [experiments](<https://devfeed.tech/tags/experiments.md>), [gap](<https://devfeed.tech/tags/gap.md>), [harness](<https://devfeed.tech/tags/harness.md>), [monitoring](<https://devfeed.tech/tags/monitoring.md>), [runtime](<https://devfeed.tech/tags/runtime.md>), [runtime-monitoring](<https://devfeed.tech/tags/runtime-monitoring.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

The abstract reports that individually safe, utility-preserving updates to agent harness components can interact to cause unsafe behavior. Across three safety-related benchmarks, the authors identify 43 pairwise and 18 irreducible three-way failures. To avoid the combinatorial cost of rechecking every combination as harnesses evolve, their method represents component states and higher-order interactions in a typed hypergraph, updating only the interaction neighborhood of changed states. Hypergraph-guided runtime monitoring reportedly mitigates these risks while preserving task utility and reducing checking costs; experiments also show a trade-off among safety, utility, and cost across safety mechanisms.

### Source excerpt

arXiv:2609.33123v3 Announce Type: replace-cross Abstract: Self-evolving agent harnesses continually update persistent components such as memory, prompts, skills, and tools. We call this process harness evolution. However, such evolution could introduce unexpected safety risks. Existing work studies harness misevolution and validates candidate harnesses or attributed individual component updates, leaving safety analysis of cross-component update interactions largely unexamined. To address this gap, we study compositional safety failures in harness evolution, where interactions among individually safe and utility-preserving component updates can produce undesirable or unsafe agent behavior, revealing a safety risk intrinsic to harness evolution. Across three safety-related benchmarks, we identify 43 pairwise and 18 irreducible 3-way compositional safety failures. Conventional solution incurs combinatorial complexity in validating cross-component interactions, leaving the safety checking impractical as the harness evolves. To solve this, we introduced a typed hypergraph that represents component states as nodes and safety-relevant higher-order interactions as hyperedges. When the harness changes, the hypergraph updates only the interaction neighborhood of the changed states rather than reconstructing the global composition space. Building on that, we develop a hypergraph-guided runtime monitoring mechanism. Experiments show that our method effectively mitigates compositional safety risks while preserving task utility and reducing interaction-checking costs, and further reveal an empirical safety-utility-cost trade-off across different safety mechanisms.

## OpenAI and Poland's NASK partner to advance AI safety and security

DevFeed: [OpenAI and Poland's NASK partner to advance AI safety and security](<https://devfeed.tech/articles/openai-and-poland-s-nask-partner-to-advance-ai-safety-and-security-97265.md>)

Original publisher: [Read original article](<https://openai.com/index/openai-nask-ai-safety-security-partnership>)

Published: 2026-10-23T00:00:00Z

Content type: release

Language: en

Sources: [OpenAI News](<https://devfeed.tech/sources/openai-news.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [ai safety](<https://devfeed.tech/topics/ai-safety.md>), [ai security](<https://devfeed.tech/topics/ai-security.md>), [Security research](<https://devfeed.tech/topics/security-research.md>), [Security](<https://devfeed.tech/topics/security.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-safety](<https://devfeed.tech/tags/ai-safety.md>), [ai-safety-research](<https://devfeed.tech/tags/ai-safety-research.md>), [ai-security](<https://devfeed.tech/tags/ai-security.md>), [ai-security-institute](<https://devfeed.tech/tags/ai-security-institute.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [artificial-intelligence-safety](<https://devfeed.tech/tags/artificial-intelligence-safety.md>), [attacks](<https://devfeed.tech/tags/attacks.md>), [authentication](<https://devfeed.tech/tags/authentication.md>), [capabilities](<https://devfeed.tech/tags/capabilities.md>), [digital](<https://devfeed.tech/tags/digital.md>), [ecosystem](<https://devfeed.tech/tags/ecosystem.md>), [global-affairs](<https://devfeed.tech/tags/global-affairs.md>), [openai](<https://devfeed.tech/tags/openai.md>), [partner](<https://devfeed.tech/tags/partner.md>), [poland](<https://devfeed.tech/tags/poland.md>), [research](<https://devfeed.tech/tags/research.md>), [safety](<https://devfeed.tech/tags/safety.md>), [safety-security](<https://devfeed.tech/tags/safety-security.md>), [security](<https://devfeed.tech/tags/security.md>), [technical](<https://devfeed.tech/tags/technical.md>)

### AI overview

OpenAI and Poland's NASK National Research Institute will explore AI safety, security and technical research through NASK's AI Safety Research Center, which serves as Poland's AISI. Their work is intended to evaluate increasingly capable AI systems, identify vulnerabilities and strengthen safeguards. The agreement also reflects a broader effort to develop shared approaches to capability evaluation, risk assessment, safeguard testing and incident reporting. Separately, CERT Polska, which operates within NASK, used OpenAI cyber-capable models accessed through Daybreak to help find six MikroTik RouterOS vulnerabilities; the vendor released fixes that CERT Polska said prevented the attacks it observed.

### Source excerpt

OpenAI and Poland's NASK are partnering on AI safety, security, and technical research to strengthen safeguards and support a more resilient digital ecosystem.

## Google Staff Resign In Backlash Over Its AI Contracts With Military

DevFeed: [Google Staff Resign In Backlash Over Its AI Contracts With Military](<https://devfeed.tech/articles/google-staff-resign-in-backlash-over-its-ai-contracts-with-military-95932.md>)

Original publisher: [Read original article](<https://tech.slashdot.org/story/26/10/22/0043216/google-staff-resign-in-backlash-over-its-ai-contracts-with-military>)

Author: BeauHD

Published: 2026-10-22T15:00:00Z

Content type: news

Language: en

Sources: [Slashdot](<https://devfeed.tech/sources/slashdot.md>)

Topics: [ai-ethics](<https://devfeed.tech/topics/ai-ethics.md>), [ai-governance](<https://devfeed.tech/topics/ai-governance.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [contracts](<https://devfeed.tech/tags/contracts.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [google](<https://devfeed.tech/tags/google.md>), [human-oversight](<https://devfeed.tech/tags/human-oversight.md>), [military](<https://devfeed.tech/tags/military.md>), [oversight](<https://devfeed.tech/tags/oversight.md>), [staff](<https://devfeed.tech/tags/staff.md>)

### AI overview

Some Google DeepMind staff have resigned or are considering leaving over the company's expanding military AI contracts. Former employees and other sources told the BBC they worry that recent deals broaden Pentagon uses of the technology while Google lacks meaningful oversight, visibility, or veto power over deployments. They also cited a gap between these uses and Google's stated AI principles of human oversight and alignment with international law and human rights. Employees described fear of speaking publicly because of contract restrictions and possible career risks. Google said its contracts undergo review for compliance with its acceptable-use policies and AI principles, and that staff have channels to raise concerns and protections against retaliation.

### Source excerpt

An anonymous reader quotes a report from the BBC: Google is facing a backlash from some staff members over the company's deployment of its AI technology for military use. The BBC has spoken to several tech workers who have either recently resigned from Google's AI company, Google DeepMind, or are in the process of leaving, over concerns with the tech firm's military contracts. Sofia Liguori, a London-based research engineer, is one of them. She resigned from Google DeepMind this week and spoke about her concerns exclusively with the BBC, despite her contract restricting her from doing so. "Realizing my company is pushing more and more for AI systems in military operations makes me feel ashamed to work at Google," Liguori said, speaking in a personal capacity. [...] After working for the company for three years, Liguori said she decided to resign over Google's increasing work with the US and Israeli militaries. "I don't agree with this direction and this has led me to lose faith in my company being true to its stated ethical values," she said. Those values, according to Google's AI Principles, include implementing AI with "human oversight" and aligning the technology with "international law and human rights." But former and current staff at the company, and experts the BBC spoke to, said they were concerned about the level of human oversight at critical moments. The tech workers said they are particularly worried about the AI military deals signed this year, because they greatly increase the scope of what the Pentagon can use the technology for. Andreas Kirsch, an AI researcher, also resigned from Google DeepMind earlier this month over his concerns. Kirsch told the BBC that he believes "Google's governance and oversight are not sufficient or meaningful enough to deploy AI safely and responsibly in military and classified settings" or "to develop artificial superintelligence safely in the future." "Google seems to have no right to control or veto how the Pentagon use

## RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactions

DevFeed: [RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactions](<https://devfeed.tech/articles/rubrix-rubric-driven-risk-mitigation-in-caregiver-ai-interactions-94685.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2601.13235>)

Author: Drishti Goel, Jeongah Lee, Qiuyue Joy Zhong, Violeta J. Rodriguez, Daniel S. Brown, Ravi Karkar, Dong Whi Yoo, Koustuv Saha

Published: 2026-10-22T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [Human-AI evaluation](<https://devfeed.tech/topics/human-ai-evaluation.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-evaluation](<https://devfeed.tech/tags/ai-evaluation.md>), [ai-evaluation-frameworks](<https://devfeed.tech/tags/ai-evaluation-frameworks.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [bias](<https://devfeed.tech/tags/bias.md>), [cs-ai](<https://devfeed.tech/tags/cs-ai.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-cy](<https://devfeed.tech/tags/cs-cy.md>), [cs-hc](<https://devfeed.tech/tags/cs-hc.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [cs-si](<https://devfeed.tech/tags/cs-si.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [dimensions](<https://devfeed.tech/tags/dimensions.md>), [domain](<https://devfeed.tech/tags/domain.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [framework](<https://devfeed.tech/tags/framework.md>), [information](<https://devfeed.tech/tags/information.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [models](<https://devfeed.tech/tags/models.md>), [queries](<https://devfeed.tech/tags/queries.md>), [reddit](<https://devfeed.tech/tags/reddit.md>), [release](<https://devfeed.tech/tags/release.md>), [risk](<https://devfeed.tech/tags/risk.md>), [risk-mitigation](<https://devfeed.tech/tags/risk-mitigation.md>)

### AI overview

RubRIX evaluates risks in AI responses to caregivers using five clinician-validated dimensions grounded in the Elements of an Ethic of Care: Inattention, Bias & Stigma, Information Inaccuracy, Uncritical Affirmation, and Epistemic Arrogance. The study applies the framework to six LLMs and more than 20,000 caregiver queries from Reddit and ALZConnected. Across models, one iteration of rubric-guided refinement reduced reported risk components by 45-98%. The authors present RubRIX as a domain-sensitive evaluation approach and release benchmark datasets for further research. These findings are specific to the described caregiving evaluation; the supplied excerpt does not detail individual model results or the refinement procedure.

### Source excerpt

arXiv:2601.13235v2 Announce Type: replace-cross Abstract: Caregivers seeking AI-mediated support express complex needs---information-seeking, emotional validation, and distress cues---that warrant careful evaluation of response safety and appropriateness. Existing AI evaluation frameworks, primarily focused on general risks (toxicity, hallucinations, policy violations, etc), may not adequately capture the nuanced risks of LLM-responses in caregiving-contexts. We introduce RubRIX (Rubric-based Risk Index), a theory-driven, clinician-validated framework for evaluating risks in LLM caregiving responses. Grounded in the Elements of an Ethic of Care, RubRIX operationalizes five empirically-derived risk dimensions: Inattention, Bias & Stigma, Information Inaccuracy, Uncritical Affirmation, and Epistemic Arrogance. We evaluate six state-of-the-art LLMs on over 20,000 caregiver queries from Reddit and ALZConnected. Rubric-guided refinement consistently reduced risk-components by 45-98% after one iteration across models. This work contributes a methodological approach for developing domain-sensitive, user-centered evaluation frameworks for high-burden contexts. Our findings highlight the importance of domain-sensitive, interactional risk evaluation for the responsible deployment of LLMs in caregiving support contexts. We release benchmark datasets to enable future research on contextual risk evaluation in AI-mediated support.

## OpenAI sued over children safety and data use

DevFeed: [OpenAI sued over children safety and data use](<https://devfeed.tech/articles/openai-sued-over-children-safety-and-data-use-88471.md>)

Original publisher: [Read original article](<https://www.malwarebytes.com/blog/ai/2026/10/openai-sued-over-children-safety-and-data-use>)

Author: Pieter Arntz

Published: 2026-10-16T10:51:20Z

Content type: news

Language: en

Sources: [Malwarebytes](<https://devfeed.tech/sources/malwarebytes.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [trust and safety](<https://devfeed.tech/topics/trust-and-safety.md>), [data loss prevention](<https://devfeed.tech/topics/data-loss-prevention.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [chatgpt](<https://devfeed.tech/tags/chatgpt.md>), [chatgpt-for-teens](<https://devfeed.tech/tags/chatgpt-for-teens.md>), [children](<https://devfeed.tech/tags/children.md>), [minors](<https://devfeed.tech/tags/minors.md>), [news](<https://devfeed.tech/tags/news.md>), [openai](<https://devfeed.tech/tags/openai.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [risk](<https://devfeed.tech/tags/risk.md>)

### AI overview

Eight US states and a mother suing on behalf of her children have brought separate lawsuits alleging that OpenAI's ChatGPT products put children's safety and privacy at risk. The disputes include allegations about harmful conversations, parental consent for children's data use, and whether safety controls work as intended; OpenAI disputes the claims.

### Source excerpt

Eight US states and a mother of two accuse the ChatGPT maker of putting children's safety and privacy at risk.

## IT jobs report: Employers consider AI risks and ethics

DevFeed: [IT jobs report: Employers consider AI risks and ethics](<https://devfeed.tech/articles/it-jobs-report-employers-consider-ai-risks-and-ethics-88527.md>)

Original publisher: [Read original article](<https://www.cio.com/article/4201347/information-technology-jobs-report.html>)

Author: Sarah K. White

Published: 2026-10-16T10:00:00Z

Content type: news

Language: en

Sources: [CIO](<https://devfeed.tech/sources/cio.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [Product Management](<https://devfeed.tech/topics/product-management.md>)

Tags: [ai-risks](<https://devfeed.tech/tags/ai-risks.md>), [careers](<https://devfeed.tech/tags/careers.md>), [careers-hiring-it-jobs-it-management-it-skills-and-training-salaries](<https://devfeed.tech/tags/careers-hiring-it-jobs-it-management-it-skills-and-training-salaries.md>), [cybersecurity](<https://devfeed.tech/tags/cybersecurity.md>), [edition-us](<https://devfeed.tech/tags/edition-us.md>), [engineering](<https://devfeed.tech/tags/engineering.md>), [hiring](<https://devfeed.tech/tags/hiring.md>), [it-jobs](<https://devfeed.tech/tags/it-jobs.md>), [it-management](<https://devfeed.tech/tags/it-management.md>), [it-skills-and-training](<https://devfeed.tech/tags/it-skills-and-training.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [language-en](<https://devfeed.tech/tags/language-en.md>), [salaries](<https://devfeed.tech/tags/salaries.md>), [storytype-news](<https://devfeed.tech/tags/storytype-news.md>)

### AI overview

The Dice September 2026 Jobs Report indicates U.S. IT job postings rose 17% year over year, while AI and machine learning postings grew 88%. Demand is increasing for AI skills, enterprise integration, cybersecurity, responsible AI, and financial operations roles.

### Source excerpt

The IT job hiring market appears to remain strong, as data from the Dice September 2026 Jobs Report shows that IT job postings continued to increase through September after experiencing a slight dip in August. Overall, the data shows that year over year, IT job postings rose 17% compared to September 2025. Two areas that saw the most growth include AI and ML, where tech postings grew 88% in September 2026 compared to 2025, about five times faster than the average growth rate for tech postings. As employees embrace AI tools and organizations realize AI implementation goals, they're shifting a hiring focus to security and finance roles, helping to manage and oversee emerging risks and threats as AI becomes commonplace. With this increased focus on security and finance, organizations are realizing their AI implementation strategies. And for companies ahead of the AI curve, the focus is now on cybersecurity, governance, responsible and ethical AI use, and financial operations to support AI costs. Skills that matter most AI skills continue to grow in demand year-over-year and month-over-month. September saw a sharp rise in demand for Claude skills and those including agentic AI, enterprise integration, and the ethical and responsible use of AI. These skills reflect similar patterns that show in the June data, suggesting they continue to be skills consistently in demand for tech workers. Comparing skills month-to-month, there were slight changes in demand, but electronic engineering remained the fastest growing skill since July, and skills for managing AI systems grew over September. There was also an increase in IT job postings from those looking for skills including creative problem solving, team performance management, and demonstration skills. As AI implementation takes hold and presents new risks and challenges to IT departments across every industry, companies are also shifting focusing on cybersecurity and critical thinking skills. September saw an increase in dema

## Measuring AI Reliability Through Robustness, Safety, and Governance

DevFeed: [Measuring AI Reliability Through Robustness, Safety, and Governance](<https://devfeed.tech/articles/measuring-ai-reliability-through-robustness-safety-and-governance-88647.md>)

Original publisher: [Read original article](<https://hackernoon.com/measuring-ai-reliability-through-robustness-safety-and-governance?source=rss>)

Author: Sunilkumar Reddy Eraganeni

Published: 2026-10-16T05:49:29Z

Content type: opinion

Language: en

Sources: [HackerNoon](<https://devfeed.tech/sources/hackernoon.md>)

Topics: [Responsibility & Safety](<https://devfeed.tech/topics/responsibility-safety.md>), [ai safety](<https://devfeed.tech/topics/ai-safety.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-governance-framework](<https://devfeed.tech/tags/ai-governance-framework.md>), [ai-incident-monitoring](<https://devfeed.tech/tags/ai-incident-monitoring.md>), [ai-model-benchmarks](<https://devfeed.tech/tags/ai-model-benchmarks.md>), [ai-reliability](<https://devfeed.tech/tags/ai-reliability.md>), [ai-risk-management](<https://devfeed.tech/tags/ai-risk-management.md>), [ai-safety-evaluation](<https://devfeed.tech/tags/ai-safety-evaluation.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [llm-red-teaming](<https://devfeed.tech/tags/llm-red-teaming.md>), [measuring](<https://devfeed.tech/tags/measuring.md>), [model-robustness](<https://devfeed.tech/tags/model-robustness.md>), [responsible-ai](<https://devfeed.tech/tags/responsible-ai.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

The article argues that model accuracy and latency alone do not show whether an AI system is safe or reliable in real use. It proposes measuring robustness, harmful and over-refusal outputs, governance, runtime checks, and post-launch incidents, while acknowledging that safety metrics are context-dependent and can be gamed. It recommends testing a system's worst plausible failure and assigning someone authority to stop a release if the test fails.

### Source excerpt

AI models can ace every benchmark and still cause harm. Here is a practical, layered way to measure safety, robustness and governance, not just accuracy.

[Next page](<https://devfeed.tech/topics/responsibility-safety.md?cursor=WyIyMDI2LTEwLTE2VDA1OjQ5OjI5KzAwOjAwIiwgIjBkMGU1ZmQ1LTg1OGMtNGYzMy04YzQyLTdlNjNjMjc0ZjQyZiJd>)