# Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters

DevFeed: [Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters](<https://devfeed.tech/articles/aleph-alpha-releases-kolibri-a-78-1b-open-weight-english-german-moe-model-with-only-3-46b-active-parameters-64551.md>)

Original publisher: [Read original article](<https://www.marktechpost.com/2026/10/04/aleph-alpha-releases-kolibri-a-78-1b-open-weight-english-german-moe-model-with-only-3-46b-active-parameters/>)

Author: Asif Razzaq

Published: 2026-10-04T07:01:04Z

Content type: news

Language: en

Sources: [MarkTechPost](<https://devfeed.tech/sources/marktechpost.md>)

Topics: [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [long-context](<https://devfeed.tech/topics/long-context.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>)

Tags: [agentic-ai](<https://devfeed.tech/tags/agentic-ai.md>), [ai-infrastructure](<https://devfeed.tech/tags/ai-infrastructure.md>), [ai-paper-summary](<https://devfeed.tech/tags/ai-paper-summary.md>), [ai-shorts](<https://devfeed.tech/tags/ai-shorts.md>), [aleph-alpha](<https://devfeed.tech/tags/aleph-alpha.md>), [applications](<https://devfeed.tech/tags/applications.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [editors-pick](<https://devfeed.tech/tags/editors-pick.md>), [for-devs](<https://devfeed.tech/tags/for-devs.md>), [fp8](<https://devfeed.tech/tags/fp8.md>), [kolibri](<https://devfeed.tech/tags/kolibri.md>), [language-model](<https://devfeed.tech/tags/language-model.md>), [large-language-model](<https://devfeed.tech/tags/large-language-model.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [new-releases](<https://devfeed.tech/tags/new-releases.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [software-engineering](<https://devfeed.tech/tags/software-engineering.md>), [staff](<https://devfeed.tech/tags/staff.md>), [tech-news](<https://devfeed.tech/tags/tech-news.md>), [technology](<https://devfeed.tech/tags/technology.md>), [uncategorized](<https://devfeed.tech/tags/uncategorized.md>)

## AI overview

Aleph Alpha released Kolibri, an English-German open-weight MoE language model with 78.1 billion total parameters and 3.46 billion active per token. The article covers its hybrid attention architecture, training, company-reported benchmarks and vLLM deployment. Apache 2.0 FP8 weights support deployment on a single B200 or H200, with context configurable up to 1,048,576 tokens.

## Source excerpt

Aleph Alpha has released Kolibri, a 78.1B-parameter English-German Mixture-of-Experts model that activates only 3.46B parameters per token. It has a 1M-token context and per-request reasoning effort, and its Apache 2.0 FP8 weights run on a single B200 or H200. The post Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters appeared first on MarkTechPost.