# Radioactivity

Published articles for Radioactivity.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Watermark Robustness and Radioactivity May Be at Odds in Federated Learning

DevFeed: [Watermark Robustness and Radioactivity May Be at Odds in Federated Learning](<https://devfeed.tech/articles/watermark-robustness-and-radioactivity-may-be-at-odds-in-federated-learning-111175.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2510.17033>)

Author: Leixu Huang, Zedian Shao, Teodora Baluta

Published: 2026-11-02T05:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>)

Topics: [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [watermarking](<https://devfeed.tech/topics/watermarking.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Adversarial attacks](<https://devfeed.tech/topics/adversarial-attacks.md>), [AI software supply chain security](<https://devfeed.tech/topics/ai-software-supply-chain-security.md>), [outlier-detection](<https://devfeed.tech/topics/outlier-detection.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>)

Tags: [accountability](<https://devfeed.tech/tags/accountability.md>), [adversarial](<https://devfeed.tech/tags/adversarial.md>), [aggregation](<https://devfeed.tech/tags/aggregation.md>), [clients](<https://devfeed.tech/tags/clients.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [data-provenance](<https://devfeed.tech/tags/data-provenance.md>), [distributed](<https://devfeed.tech/tags/distributed.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [filter](<https://devfeed.tech/tags/filter.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [outliers](<https://devfeed.tech/tags/outliers.md>), [provenance](<https://devfeed.tech/tags/provenance.md>), [radioactivity](<https://devfeed.tech/tags/radioactivity.md>), [robust](<https://devfeed.tech/tags/robust.md>), [robustness](<https://devfeed.tech/tags/robustness.md>), [server](<https://devfeed.tech/tags/server.md>), [signal](<https://devfeed.tech/tags/signal.md>), [synthetic](<https://devfeed.tech/tags/synthetic.md>), [watermark](<https://devfeed.tech/tags/watermark.md>)

### AI overview

In the evaluated federated learning setup, watermark signals remained detectable after fine-tuning--even when watermarked data made up only 6.6% of the data, with a reported p-value as low as 10⁻²⁴. But updates from watermarked synthetic data appeared as outliers relative to clean updates. A server acting adversarially could use strong robust aggregation to filter out those updates and the watermark signal while aiming to preserve model utility. None of the evaluated radioactive watermarks resisted this attack, suggesting a trade-off among radioactivity, robustness, and utility.

### Source excerpt

arXiv:2510.17033v2 Announce Type: replace Abstract: Federated learning (FL) enables fine-tuning large language models (LLMs) across distributed data sources. As these sources increasingly include LLM-generated text, provenance tracking becomes essential for accountability and transparency. We adapt LLM watermarking for FL data provenance, where a subset of clients computes local updates on watermarked data, and the server averages all updates into the global LLM. We find that several evaluated LLM watermarks remain radioactive in this setup: the watermark signal stays detectable after fine-tuning, with a $p-$value reaching $10^{-24}$ even when only 6.6% of data is watermarked. However, the server can act as an active adversary, aiming to preserve model utility while evading provenance tracking. We observe that updates from watermarked synthetic data appear as outliers relative to clean updates. Our adversary thus applies strong robust aggregation to filter out these outliers along with the watermark signal. All evaluated radioactive watermarks are not robust against such an adversarial server. Our work suggests fundamental trade-offs between radioactivity, robustness, and utility.

## Watermark Basins: Black-Box Detection of Distilled LLMs

DevFeed: [Watermark Basins: Black-Box Detection of Distilled LLMs](<https://devfeed.tech/articles/watermark-basins-black-box-detection-of-distilled-llms-103378.md>)

Original publisher: [Read original article](<https://arxiv.org/abs/2610.37266>)

Author: Hongyan Chang, Hady Elsahar, Tom Sander, Pierre Fernandez, Saeed Mahloujifar, Sylvestre-Alvise Rebuffi, Tom\\'a\\v{s} Sou\\v{c}ek, Tuan Tran, Valeriu Lacatusu, Surya Parimi, Rashel Moritz, Vanessa Stark,

Published: 2026-10-28T04:00:00Z

Content type: article

Language: en

Sources: [arXiv: Cryptography and Security](<https://devfeed.tech/sources/arxiv-cryptography-and-security.md>), [arXiv: Machine Learning](<https://devfeed.tech/sources/arxiv-machine-learning.md>)

Topics: [watermarking](<https://devfeed.tech/topics/watermarking.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [llm-reasoning](<https://devfeed.tech/topics/llm-reasoning.md>), [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>), [post-training](<https://devfeed.tech/topics/post-training.md>), [quantization](<https://devfeed.tech/topics/quantization.md>)

Tags: [alignment](<https://devfeed.tech/tags/alignment.md>), [api](<https://devfeed.tech/tags/api.md>), [cs-cl](<https://devfeed.tech/tags/cs-cl.md>), [cs-cr](<https://devfeed.tech/tags/cs-cr.md>), [cs-lg](<https://devfeed.tech/tags/cs-lg.md>), [detection](<https://devfeed.tech/tags/detection.md>), [distillation](<https://devfeed.tech/tags/distillation.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gradient](<https://devfeed.tech/tags/gradient.md>), [key](<https://devfeed.tech/tags/key.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llms](<https://devfeed.tech/tags/llms.md>), [models](<https://devfeed.tech/tags/models.md>), [parameter](<https://devfeed.tech/tags/parameter.md>), [post-training](<https://devfeed.tech/tags/post-training.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [queries](<https://devfeed.tech/tags/queries.md>), [radioactivity](<https://devfeed.tech/tags/radioactivity.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [signal](<https://devfeed.tech/tags/signal.md>), [space](<https://devfeed.tech/tags/space.md>), [statistics](<https://devfeed.tech/tags/statistics.md>), [watermark](<https://devfeed.tech/tags/watermark.md>)

### AI overview

WM-Basin detects possible API-based distillation by testing whether a suspect model's outputs carry a watermark-specific geometric signal. It queries the model through its API, maps generated text to gradients with a fixed clean probe model, removes ordinary task-related directions, and checks whether the residual aligns with the watermark basin. In evaluations on mathematical reasoning models from 135M to 8.2B parameters, it detected 79% of distilled models at n-gram=1 and 45% at n-gram=3 at a 0.1% false-positive rate, compared with 29% and 1.3% for the token-level baseline. The abstract says the signal persisted after quantization, pruning, and reinforcement-learning post-training. These results are reported for the evaluated settings; the supplied text does not establish performance beyond them.

### Source excerpt

arXiv:2610.37266v1 Announce Type: new Abstract: Proprietary language models and their reasoning traces are vulnerable to API-based distillation, where an adversary trains a student model on the teacher model's outputs. To obtain evidence of distillation, model providers can watermark the teacher's outputs, aiming to leave a radioactive signal in the student's outputs. Existing black-box detectors search for such radioactivity using token-level statistics of the suspect model's outputs. However, token-level signals are not always detectable, for instance when the distillation traces are sampled at a low temperature. In this work, we discover the watermark basin, a persistent signal that enables more reliable watermark detection: during fine-tuning, watermarked teacher traces embed a distinct, key-specific geometric signal in parameter space that lies orthogonal to the ordinary task-specific fine-tuning subspace. Building on this, we introduce Watermark Basin Alignment (WM-Basin), a black-box watermark detector that queries the suspect model through its API, without access to its weights or logits. WM-Basin maps generated text to gradient representations using a fixed clean probe model, projects out the ordinary fine-tuning task directions, and tests whether the residual gradient aligns with the watermark basin induced by the watermark key. We evaluate WM-Basin extensively across diverse teacher models and student architectures (from 135M to 8.2B parameters) distilled on mathematical reasoning. At a strict 0.1% false-positive rate, WM-Basin detects 79% of distilled models at n-gram=1 and 45% at n-gram=3, substantially improving over the state-of-the-art token-level baseline (29% and 1.3%, respectively). Because the watermark signal resides in a persistent basin, it survives post-distillation modifications including quantization, pruning, and reinforcement-learning post-training.