# Federated Learning

A decentralized machine learning approach that keeps training data on devices and builds a shared model from locally computed updates.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Scaling Federated Learning Across Docker, Kubernetes, and Slurm with NVIDIA FLARE

DevFeed: [Scaling Federated Learning Across Docker, Kubernetes, and Slurm with NVIDIA FLARE](<https://devfeed.tech/articles/scaling-federated-learning-across-docker-kubernetes-and-slurm-with-nvidia-flare-26915.md>)

Original publisher: [Read original article](<https://developer.nvidia.com/blog/scaling-federated-learning-across-docker-kubernetes-and-slurm-with-nvidia-flare/>)

Author: Elizabeth Goodman

Published: 2026-09-15T15:00:00Z

Content type: article

Language: en

Sources: [NVIDIA Developer](<https://devfeed.tech/sources/nvidia-developer.md>), [NVIDIA Technical Blog](<https://devfeed.tech/sources/nvidia-technical-blog.md>)

Topics: [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [Docker](<https://devfeed.tech/topics/docker.md>), [Kubernetes](<https://devfeed.tech/topics/kubernetes.md>), [Nvidia](<https://devfeed.tech/topics/nvidia.md>), [Server](<https://devfeed.tech/topics/server.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [compute](<https://devfeed.tech/tags/compute.md>), [configuration](<https://devfeed.tech/tags/configuration.md>), [container](<https://devfeed.tech/tags/container.md>), [data-analytics-processing](<https://devfeed.tech/tags/data-analytics-processing.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [docker](<https://devfeed.tech/tags/docker.md>), [docker-container](<https://devfeed.tech/tags/docker-container.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [job](<https://devfeed.tech/tags/job.md>), [kubernetes](<https://devfeed.tech/tags/kubernetes.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [nvidia-flare](<https://devfeed.tech/tags/nvidia-flare.md>), [server](<https://devfeed.tech/tags/server.md>)

### AI overview

This article explains how NVIDIA FLARE scales federated learning across sites with different infrastructure, including Docker, Kubernetes, and Slurm. Its two-layer architecture separates persistent federation services from on-demand job execution, while allowing each site to retain local control over compute, data, secrets, and scheduling.

### Source excerpt

Federated learning (FL) projects often begin with a straightforward setup: one server, a few clients, and one dataset at each site. As those projects grow, the...

## Social learning: Collaborative learning with large language models

DevFeed: [Social learning: Collaborative learning with large language models](<https://devfeed.tech/articles/social-learning-collaborative-learning-with-large-language-models-28564.md>)

Original publisher: [Read original article](<http://blog.research.google/2024/03/social-learning-collaborative-learning.html>)

Author: Google AI (noreply@blogger.com)

Published: 2024-03-07T18:15:00Z

Content type: article

Language: en

Sources: [Google Research](<https://devfeed.tech/sources/google-research.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Learning](<https://devfeed.tech/topics/learning.md>)

Tags: [datasets](<https://devfeed.tech/tags/datasets.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [few-shot](<https://devfeed.tech/tags/few-shot.md>), [few-shot-learning](<https://devfeed.tech/tags/few-shot-learning.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [machine-intelligence](<https://devfeed.tech/tags/machine-intelligence.md>), [natural-language-processing](<https://devfeed.tech/tags/natural-language-processing.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [research](<https://devfeed.tech/tags/research.md>), [use-cases](<https://devfeed.tech/tags/use-cases.md>)

### AI overview

This Google Research article presents a privacy-aware social learning framework in which large language models teach one another using natural language rather than shared gradients. It describes evaluations involving spam detection, grade-school mathematics, and text-based question answering, including settings where labeled examples cannot be directly shared because of privacy concerns.

### Source excerpt

Posted by Amirkeivan Mohtashami, Research Intern, and Florian Hartmann, Software Engineer, Google Research Large language models (LLMs) have significantly improved the state of the art for solving tasks specified using natural language, often reaching performance close to that of people. As these models increasingly enable assistive agents, it could be beneficial for them to learn effectively from each other, much like people do in social settings, which would allow LLM-based agents to improve each other's performance. To discuss the learning processes of humans, Bandura and Walters described the concept of social learning in 1977, outlining different models of observational learning used by people. One common method of learning from others is through a verbal instruction (e.g., from a teacher) that describes how to engage in a particular behavior. Alternatively, learning can happen through a live model by mimicking a live example of the behavior. Given the success of LLMs mimicking human communication, in our paper "Social Learning: Towards Collaborative Learning with Large Language Models", we investigate whether LLMs are able to learn from each other using social learning. To this end, we outline a framework for social learning in which LLMs share knowledge with each other in a privacy-aware manner using natural language. We evaluate the effectiveness of our framework on various datasets, and propose quantitative methods that measure privacy in this setting. In contrast to previous approaches to collaborative learning, such as common federated learning approaches that often rely on gradients, in our framework, agents teach each other purely using natural language. Social learning for LLMs To extend social learning to language models, we consider the scenario where a student LLM should learn to solve a task from multiple teacher entities that already know that task. In our paper, we evaluate the student's performance on a variety of tasks, such as spam detection i

## Advances in private training for production on-device language models

DevFeed: [Advances in private training for production on-device language models](<https://devfeed.tech/articles/advances-in-private-training-for-production-on-device-language-models-28546.md>)

Original publisher: [Read original article](<http://blog.research.google/2024/02/advances-in-private-training-for.html>)

Author: Google AI (noreply@blogger.com)

Published: 2024-02-21T20:15:00Z

Content type: article

Language: en

Sources: [Google Research](<https://devfeed.tech/sources/google-research.md>)

Topics: [Language models](<https://devfeed.tech/topics/language-models.md>), [Federated Learning](<https://devfeed.tech/topics/federated-learning.md>), [Google](<https://devfeed.tech/topics/google.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>)

Tags: [differential-privacy](<https://devfeed.tech/tags/differential-privacy.md>), [federated-learning](<https://devfeed.tech/tags/federated-learning.md>), [gboard](<https://devfeed.tech/tags/gboard.md>), [google](<https://devfeed.tech/tags/google.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [on-device-learning](<https://devfeed.tech/tags/on-device-learning.md>), [phones](<https://devfeed.tech/tags/phones.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [production](<https://devfeed.tech/tags/production.md>), [research](<https://devfeed.tech/tags/research.md>), [responsible-ai](<https://devfeed.tech/tags/responsible-ai.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

This Google Research article describes advances in privately training Gboard's on-device language models. It explains how federated learning keeps training data on users' devices while differential privacy provides formal privacy guarantees. The article reports that all Gboard next-word-prediction neural language models use federated learning with formal differential privacy guarantees, across more than 30 models, 7 or more languages, and 15 or more countries.

### Source excerpt

Posted by Zheng Xu, Research Scientist, and Yanxiang Zhang, Software Engineer, Google Language models (LMs) trained to predict the next word given input text are the key technology for many applications [1, 2]. In Gboard, LMs are used to improve users' typing experience by supporting features like next word prediction (NWP), Smart Compose, smart completion and suggestion, slide to type, and proofread. Deploying models on users' devices rather than enterprise servers has advantages like lower latency and better privacy for model usage. While training on-device models directly from user data effectively improves the utility performance for applications such as NWP and smart text selection, protecting the privacy of user data for model training is important. Gboard features powered by on-device language models. In this blog we discuss how years of research advances now power the private training of Gboard LMs, since the proof-of-concept development of federated learning (FL) in 2017 and formal differential privacy (DP) guarantees in 2022. FL enables mobile phones to collaboratively learn a model while keeping all the training data on device, and DP provides a quantifiable measure of data anonymization. Formally, DP is often characterized by (ε, δ) with smaller values representing stronger guarantees. Machine learning (ML) models are considered to have reasonable DP guarantees for ε=10 and strong DP guarantees for ε=1 when δ is small. As of today, all NWP neural network LMs in Gboard are trained with FL with formal DP guarantees, and all future launches of Gboard LMs trained on user data require DP. These 30+ Gboard on-device LMs are launched in 7+ languages and 15+ countries, and satisfy (ɛ, δ)-DP guarantees of small δ of 10-10 and ɛ between 0.994 and 13.69. To the best of our knowledge, this is the largest known deployment of user-level DP in production at Google or anywhere, and the first time a strong DP guarantee of ɛ < 1 is announced for models trained directly on