# How LinkedIn Reduced GPU Memory Usage by 60% for LLM Training

DevFeed: [How LinkedIn Reduced GPU Memory Usage by 60% for LLM Training](<https://devfeed.tech/articles/how-linkedin-reduced-gpu-memory-usage-by-60-for-llm-training-17974.md>)

Original publisher: [Read original article](<https://newsletter.betterstack.com/p/how-linkedin-reduced-gpu-memory-usage>)

Author: Richard Oliver Bray

Published: 2025-01-16T15:19:14Z

Content type: tutorial

Language: en

Sources: [Hacking Scale by Better Stack](<https://devfeed.tech/sources/hacking-scale-by-better-stack.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [GPU optimization](<https://devfeed.tech/topics/gpu-optimization.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Library](<https://devfeed.tech/topics/library.md>), [LLM Techniques](<https://devfeed.tech/topics/llm-techniques.md>)

Tags: [gpu](<https://devfeed.tech/tags/gpu.md>), [library](<https://devfeed.tech/tags/library.md>), [llm](<https://devfeed.tech/tags/llm.md>), [memory](<https://devfeed.tech/tags/memory.md>), [performance](<https://devfeed.tech/tags/performance.md>), [techniques](<https://devfeed.tech/tags/techniques.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

This article explains how LinkedIn improved the efficiency of training large language models. It describes the resource demands of pre-training and reports that LinkedIn reduced GPU memory usage by 60% by applying selected GPU performance techniques in a library.

## Source excerpt

LinkedIn hand-picked the best GPU performance techniques and put them in a library