# Granite 4.0 Nano: Just how small can you go?

DevFeed: [Granite 4.0 Nano: Just how small can you go?](<https://devfeed.tech/articles/granite-4-0-nano-just-how-small-can-you-go-7258.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/ibm-granite/granite-4-nano>)

Author: Kate Soule; Rameswar Panda

Published: 2025-10-28T14:59:38Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [ibm](<https://devfeed.tech/topics/ibm.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [llama.cpp](<https://devfeed.tech/topics/llama-cpp.md>), [MLX](<https://devfeed.tech/topics/mlx.md>), [vllm](<https://devfeed.tech/topics/vllm.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [Loop Engineering](<https://devfeed.tech/topics/loop-engineering.md>), [gemma](<https://devfeed.tech/topics/gemma.md>), [qwen](<https://devfeed.tech/topics/qwen.md>), [Google](<https://devfeed.tech/topics/google.md>)

Tags: [apache](<https://devfeed.tech/tags/apache.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [code](<https://devfeed.tech/tags/code.md>), [data](<https://devfeed.tech/tags/data.md>), [development](<https://devfeed.tech/tags/development.md>), [gemma](<https://devfeed.tech/tags/gemma.md>), [google](<https://devfeed.tech/tags/google.md>), [ibm](<https://devfeed.tech/tags/ibm.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [math](<https://devfeed.tech/tags/math.md>), [mlx](<https://devfeed.tech/tags/mlx.md>), [model](<https://devfeed.tech/tags/model.md>), [model-development](<https://devfeed.tech/tags/model-development.md>), [models](<https://devfeed.tech/tags/models.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

IBM introduces Granite 4.0 Nano, a family of compact language models for edge and on-device applications. The release includes hybrid-SSM and traditional transformer variants ranging from roughly 350M to 1.5B parameters, supports vLLM, llama.cpp, and MLX, and is released under the Apache 2.0 license. The article reports strong performance across knowledge, math, code, safety, instruction-following, and tool-calling benchmarks.

## Source excerpt

Today we are excited to share Granite 4.0 Nano, our smallest models yet, released as part of IBM's Granite 4.0 model family. Designed for the edge and on-device applications, these models demonstrate excellent performance for their size and represent IBM's continued commitment to develop powerful, useful, models that don't require hundreds of billions of parameters to get the job done.