# Welcome to the Falcon 3 Family of Open Models!

DevFeed: [Welcome to the Falcon 3 Family of Open Models!](<https://devfeed.tech/articles/welcome-to-the-falcon-3-family-of-open-models-7190.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/falcon3>)

Author: Falcon LLM TII UAE

Published: 2024-12-17T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Open Source](<https://devfeed.tech/topics/open-source.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Mamba](<https://devfeed.tech/topics/mamba.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [Post-training optimization](<https://devfeed.tech/topics/post-training-optimization.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [code](<https://devfeed.tech/tags/code.md>), [community](<https://devfeed.tech/tags/community.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mamba](<https://devfeed.tech/tags/mamba.md>), [models](<https://devfeed.tech/tags/models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [performance](<https://devfeed.tech/tags/performance.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [releases](<https://devfeed.tech/tags/releases.md>), [research](<https://devfeed.tech/tags/research.md>), [science](<https://devfeed.tech/tags/science.md>), [techniques](<https://devfeed.tech/tags/techniques.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

Falcon3 is a family of open models designed to improve science, mathematics, and code capabilities across small and medium language-model scales. The article describes transformer-based and pure state-space variants, training and scaling methods, compact models produced with pruning and knowledge distillation, multiple quantized formats, and benchmark results against comparable models.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.