# Ettin Suite: SoTA Paired Encoders and Decoders

DevFeed: [Ettin Suite: SoTA Paired Encoders and Decoders](<https://devfeed.tech/articles/ettin-suite-sota-paired-encoders-and-decoders-7185.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/ettin>)

Author: Orion Weller; K Ricci; Marc Marone; Antoine Chaffin; Dawn Lawrie; Ben Van Durme

Published: 2025-07-16T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Machine Learning & Artificial Intelligence](<https://devfeed.tech/topics/machine-learning-artificial-intelligence.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [datasets](<https://devfeed.tech/topics/datasets.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [bert](<https://devfeed.tech/tags/bert.md>), [community](<https://devfeed.tech/tags/community.md>), [comparisons](<https://devfeed.tech/tags/comparisons.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model-development](<https://devfeed.tech/tags/model-development.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-collab](<https://devfeed.tech/tags/open-source-collab.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [research](<https://devfeed.tech/tags/research.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [training](<https://devfeed.tech/tags/training.md>)

## AI overview

The article introduces Ettin, a suite of paired encoder-only and decoder-only language models ranging from 17M to 1B parameters. The models are trained with identical data, architectures, and recipes, enabling controlled comparisons between masked and causal language modeling. Ettin reports state-of-the-art performance for open-data models and explores converting models between encoder and decoder architectures.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.