# 755GB to 395GB: How Bitdeer AI Halves GLM-5.3's GPU Footprint

DevFeed: [755GB to 395GB: How Bitdeer AI Halves GLM-5.3's GPU Footprint](<https://devfeed.tech/articles/755gb-to-395gb-how-bitdeer-ai-halves-glm-5-3-s-gpu-footprint-87579.md>)

Original publisher: [Read original article](<https://www.bitdeer.ai/en/blog/755gb-to-395gb-how-bitdeer-ai-halves-glm-5-3s-gpu-footprint/>)

Author: Evelyn Xiong

Published: 2026-10-05T08:33:27Z

Content type: article

Language: en

Sources: [Bitdeer AI Cloud](<https://devfeed.tech/sources/bitdeer-ai-cloud.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>), [baseten](<https://devfeed.tech/topics/baseten.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-applications](<https://devfeed.tech/tags/ai-applications.md>), [artificial-analysis](<https://devfeed.tech/tags/artificial-analysis.md>), [awq](<https://devfeed.tech/tags/awq.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [deepseek](<https://devfeed.tech/tags/deepseek.md>), [deepseek-v3](<https://devfeed.tech/tags/deepseek-v3.md>), [experts](<https://devfeed.tech/tags/experts.md>), [fp8](<https://devfeed.tech/tags/fp8.md>), [glm](<https://devfeed.tech/tags/glm.md>), [glm-5-3](<https://devfeed.tech/tags/glm-5-3.md>), [gpu](<https://devfeed.tech/tags/gpu.md>)

## AI overview

Bitdeer AI describes quantizing GLM-5.3 to W4AFP8, reducing its checkpoint from 755 GB to about 395 GB so it can serve on one 8-GPU node. Its expert-parallel GPTQ pipeline reduces calibration memory and checkpoint build time compared with AWQ. The reported evaluations found similar scores across the compared quantized checkpoints, while expert-parallel GPTQ used fewer output tokens on two benchmarks.

## Source excerpt

We quantized GLM-5.3, down to 4-bit experts with FP8 activations. The result is a checkpoint of about 395 GB that serves on a single node.