# SmolLM - blazingly fast and remarkably powerful

DevFeed: [SmolLM - blazingly fast and remarkably powerful](<https://devfeed.tech/articles/smollm-blazingly-fast-and-remarkably-powerful-7481.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/smollm>)

Author: Loubna Ben Allal; Anton Lozhkov; Elie Bakouch

Published: 2024-07-16T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [Python](<https://devfeed.tech/topics/python.md>), [mixtral](<https://devfeed.tech/topics/mixtral.md>), [human feedback](<https://devfeed.tech/topics/human-feedback.md>), [Meta](<https://devfeed.tech/topics/meta.md>), [Microsoft](<https://devfeed.tech/topics/microsoft.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [community](<https://devfeed.tech/tags/community.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [inference](<https://devfeed.tech/tags/inference.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [llm](<https://devfeed.tech/tags/llm.md>), [local](<https://devfeed.tech/tags/local.md>), [mixtral](<https://devfeed.tech/tags/mixtral.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [python](<https://devfeed.tech/tags/python.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [research](<https://devfeed.tech/tags/research.md>), [science](<https://devfeed.tech/tags/science.md>), [synthetic-data](<https://devfeed.tech/tags/synthetic-data.md>)

## AI overview

This blog post introduces SmolLM, a family of small language models with 135M, 360M, and 1.7B parameters. It describes the curated SmolLM-Corpus training data, including synthetic and educational content, and reports evaluation results showing strong performance across reasoning and world-knowledge benchmarks. The article also discusses local-device use, inference costs, privacy, data curation, training, and model evaluation.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.