# nlp

Published articles for nlp.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps

DevFeed: [Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps](<https://devfeed.tech/articles/fine-tuning-a-350m-model-for-better-structured-outputs-in-100-grpo-steps-7235.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/grpo-with-trl-ifstruct>)

Author: Leonie Monigatti; ben burtenshaw; Sergio Paniego

Published: 2026-09-03T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [community](<https://devfeed.tech/tags/community.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [grpo](<https://devfeed.tech/tags/grpo.md>), [guide](<https://devfeed.tech/tags/guide.md>), [json](<https://devfeed.tech/tags/json.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [python](<https://devfeed.tech/tags/python.md>), [rl](<https://devfeed.tech/tags/rl.md>), [training](<https://devfeed.tech/tags/training.md>), [trl](<https://devfeed.tech/tags/trl.md>)

### AI overview

A tutorial on fine-tuning a 350M language model with GRPO to improve structured-output and JSON Schema compliance, then evaluating it on the IFStruct benchmark.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers

DevFeed: [Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers](<https://devfeed.tech/articles/training-and-finetuning-multi-vector-embedding-models-with-sentence-transformers-7526.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/train-multi-vector-encoder>)

Author: Tom Aarsen

Published: 2026-08-26T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [AI search](<https://devfeed.tech/topics/ai-search.md>), [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>)

Tags: [community](<https://devfeed.tech/tags/community.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [guide](<https://devfeed.tech/tags/guide.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

A tutorial on finetuning multi-vector embedding models with Sentence Transformers. It explains late-interaction token-level retrieval, training components, and domain-specific retrieval improvements.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Multi-Vector (Late Interaction) Embedding Models with Sentence Transformers

DevFeed: [Multi-Vector (Late Interaction) Embedding Models with Sentence Transformers](<https://devfeed.tech/articles/multi-vector-late-interaction-embedding-models-with-sentence-transformers-7360.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/multi-vector-encoder>)

Author: Tom Aarsen; Antoine Chaffin; Raphael Sourty

Published: 2026-08-18T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [community](<https://devfeed.tech/tags/community.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [guide](<https://devfeed.tech/tags/guide.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [vector](<https://devfeed.tech/tags/vector.md>)

### AI overview

This article explains multi-vector, or late-interaction, embedding models with Sentence Transformers. It covers token-level representations, MaxSim scoring, retrieval over text and page images, integration with search systems, and index-size tradeoffs.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## DCD: доменно-ориентированная архитектура для построения RAG-систем

DevFeed: [DCD: доменно-ориентированная архитектура для построения RAG-систем](<https://devfeed.tech/articles/dcd-rag-23998.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/redmadrobot/articles/1049030/>)

Author: redmadrobot (red\_mad\_robot)

Published: 2026-06-18T09:42:21Z

Content type: article

Language: ru

Sources: [Redmadrobot EN](<https://devfeed.tech/sources/redmadrobot-en.md>), [Redmadrobot RU](<https://devfeed.tech/sources/redmadrobot-ru.md>)

Topics: [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [collection](<https://devfeed.tech/tags/collection.md>), [domain](<https://devfeed.tech/tags/domain.md>), [genai](<https://devfeed.tech/tags/genai.md>), [llm](<https://devfeed.tech/tags/llm.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [rag](<https://devfeed.tech/tags/rag.md>), [tag-1cd610c0e518](<https://devfeed.tech/tags/tag-1cd610c0e518.md>), [tag-68e701e78517](<https://devfeed.tech/tags/tag-68e701e78517.md>), [tag-7bc388df28ed](<https://devfeed.tech/tags/tag-7bc388df28ed.md>), [tag-d89cae10e887](<https://devfeed.tech/tags/tag-d89cae10e887.md>)

### AI overview

The article introduces DCD (Domain-Collection-Document), a hierarchical architecture for organizing knowledge and processing queries in RAG systems. It describes domain-based search restriction, multi-stage routing, structured model outputs, smart chunking, hybrid search, and validation mechanisms intended to improve retrieval and generation quality in heterogeneous document collections.

### Source excerpt

Привет! Это Роботы. Недавно мы выпустили статью на arXiv, где представили архитектурный подход DCD (Domain-Collection-Document) для структурирования пространства знаний и обработки запросов в RAG-системах. Мы провели подробные эксперименты, оценили работу подхода на собственном бенчмарке и показали, как он влияет на качество поиска и генерации в сравнении с другими подобными методами. А теперь хотим здесь рассказать о ключевых идеях, лежащих в основе DCD Design. Читать далее

## Beyond LoRA: Can you beat the most popular fine-tuning technique?

DevFeed: [Beyond LoRA: Can you beat the most popular fine-tuning technique?](<https://devfeed.tech/articles/beyond-lora-can-you-beat-the-most-popular-fine-tuning-technique-7439.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/peft-beyond-lora>)

Author: Benjamin Bossan; Sayak Paul; Marian Tietz; Kashif Rasul

Published: 2026-06-18T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [community](<https://devfeed.tech/tags/community.md>), [diffusers](<https://devfeed.tech/tags/diffusers.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [guide](<https://devfeed.tech/tags/guide.md>), [lora](<https://devfeed.tech/tags/lora.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [peft](<https://devfeed.tech/tags/peft.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [stable-diffusion](<https://devfeed.tech/tags/stable-diffusion.md>), [training](<https://devfeed.tech/tags/training.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

The article examines parameter-efficient fine-tuning (PEFT) for open models, focusing on whether LoRA is always the best technique. It explains how PEFT reduces memory requirements, can enable fine-tuning of quantized models, and offers a unified API for multiple techniques.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Introducing the Ettin Reranker Family

DevFeed: [Introducing the Ettin Reranker Family](<https://devfeed.tech/articles/introducing-the-ettin-reranker-family-7186.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/ettin-reranker>)

Author: Tom Aarsen

Published: 2026-05-19T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [long-context](<https://devfeed.tech/topics/long-context.md>), [Agent Skill](<https://devfeed.tech/topics/agent-skill.md>)

Tags: [ai-coding](<https://devfeed.tech/tags/ai-coding.md>), [community](<https://devfeed.tech/tags/community.md>), [long-context](<https://devfeed.tech/tags/long-context.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [ranking](<https://devfeed.tech/tags/ranking.md>), [research](<https://devfeed.tech/tags/research.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>)

### AI overview

The article introduces six Sentence Transformers CrossEncoder rerankers built on Ettin ModernBERT encoders. It explains their distillation-based training, retrieval-then-rerank usage, quality and cost trade-offs, and support for up to 8K tokens of context.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Эволюция данных: генетический алгоритм в задаче классификации текстов

DevFeed: [Эволюция данных: генетический алгоритм в задаче классификации текстов](<https://devfeed.tech/articles/article-23997.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/redmadrobot/articles/1027238/>)

Author: evgeneration (red\_mad\_robot)

Published: 2026-04-23T19:05:42Z

Content type: article

Language: ru

Sources: [Redmadrobot EN](<https://devfeed.tech/sources/redmadrobot-en.md>), [Redmadrobot RU](<https://devfeed.tech/sources/redmadrobot-ru.md>)

Topics: [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [evolution](<https://devfeed.tech/tags/evolution.md>), [llm](<https://devfeed.tech/tags/llm.md>), [ml](<https://devfeed.tech/tags/ml.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [prompt](<https://devfeed.tech/tags/prompt.md>), [tag-1cd610c0e518](<https://devfeed.tech/tags/tag-1cd610c0e518.md>), [tag-1f12060c781a](<https://devfeed.tech/tags/tag-1f12060c781a.md>), [tag-2d1b71a8786f](<https://devfeed.tech/tags/tag-2d1b71a8786f.md>), [tag-7bc388df28ed](<https://devfeed.tech/tags/tag-7bc388df28ed.md>), [tag-9bf5e01ce62e](<https://devfeed.tech/tags/tag-9bf5e01ce62e.md>), [tag-9d8cf70dc46c](<https://devfeed.tech/tags/tag-9d8cf70dc46c.md>)

### AI overview

The article describes using a genetic algorithm to evolve prompts that generate training data for text-classification models. The approach was motivated by poor results from synthetic datasets and manual prompt iteration, with prompt fitness evaluated by classifier performance on a fixed test set.

### Source excerpt

Привет! Меня зовут Женя Андриевская. Я -- NLP-инженер в лаборатории R&D red_mad_robot. Сегодня расскажу, как мы призвали на помощь эволюцию, чтобы улучшить качество данных в задачах классификации текстов. Да-да, ту самую эволюцию, с мутациями и скрещиваниями -- только в мире данных, промптов и LLM. Читать далее

## QIMMA قِمّة ⛰: A Quality-First Arabic LLM Leaderboard

DevFeed: [QIMMA قِمّة ⛰: A Quality-First Arabic LLM Leaderboard](<https://devfeed.tech/articles/qimma-a-quality-first-arabic-llm-leaderboard-7511.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/tiiuae/qimma-arabic-leaderboard>)

Author: Leen AlQadi; Ahmed Alzubaidi; Mohammed Alyafeai; Maitha Alhammadi; Shaikha Alsuwaidi; Omar saif alkaabi; Basma Boussaha; Hakim Hacid

Published: 2026-04-21T10:09:58Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Ground truth / benchmark quality](<https://devfeed.tech/topics/ground-truth-benchmark-quality.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [LLMs](<https://devfeed.tech/topics/llms.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Code](<https://devfeed.tech/topics/code.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [blog](<https://devfeed.tech/tags/blog.md>), [code](<https://devfeed.tech/tags/code.md>), [data](<https://devfeed.tech/tags/data.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [llm](<https://devfeed.tech/tags/llm.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>)

### AI overview

QIMMA is a quality-first Arabic LLM leaderboard that validates benchmark data before evaluating models. It addresses translation issues, annotation errors, encoding problems, cultural bias, reproducibility gaps, and fragmented task coverage. The platform combines native Arabic content, systematic validation, code evaluation, and public per-sample inference outputs across 109 subsets from 14 benchmarks and more than 52,000 samples.

### Source excerpt

A Blog post by Technology Innovation Institute on Hugging Face

## Training and Finetuning Multimodal Embedding & Reranker Models with Sentence Transformers

DevFeed: [Training and Finetuning Multimodal Embedding & Reranker Models with Sentence Transformers](<https://devfeed.tech/articles/training-and-finetuning-multimodal-embedding-reranker-models-with-sentence-transformers-7527.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/train-multimodal-sentence-transformers>)

Author: Tom Aarsen

Published: 2026-04-16T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [multimodal](<https://devfeed.tech/topics/multimodal.md>), [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [community](<https://devfeed.tech/tags/community.md>), [data](<https://devfeed.tech/tags/data.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [models](<https://devfeed.tech/tags/models.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [performance](<https://devfeed.tech/tags/performance.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>), [train](<https://devfeed.tech/tags/train.md>), [training](<https://devfeed.tech/tags/training.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

A practical guide to fine-tuning multimodal Sentence Transformer embedding and reranker models for visual document retrieval. It explains the training pipeline and shows how domain-specific fine-tuning improved retrieval performance from 0.888 to 0.947 in the example evaluation.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Fine-tuning a DistilBERT classifier with numerical and text inputs

DevFeed: [Fine-tuning a DistilBERT classifier with numerical and text inputs](<https://devfeed.tech/articles/fine-tuning-a-distilbert-classifier-with-numerical-and-text-inputs-30004.md>)

Original publisher: [Read original article](<https://engineering.freeagent.com/2026/04/10/fine-tuning-a-distilbert-classifier-with-numerical-and-text-inputs/>)

Author: Paloma Jol

Published: 2026-04-10T10:04:33Z

Content type: tutorial

Language: en

Sources: [FreeAgent](<https://devfeed.tech/sources/freeagent.md>)

Topics: [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Transformer](<https://devfeed.tech/topics/transformer.md>), [foundation-models](<https://devfeed.tech/topics/foundation-models.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Kaggle](<https://devfeed.tech/topics/kaggle.md>), [scikit-learn](<https://devfeed.tech/topics/scikit-learn.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [aws](<https://devfeed.tech/tags/aws.md>), [data](<https://devfeed.tech/tags/data.md>), [data-ml](<https://devfeed.tech/tags/data-ml.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [encoding](<https://devfeed.tech/tags/encoding.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [kaggle](<https://devfeed.tech/tags/kaggle.md>), [llms](<https://devfeed.tech/tags/llms.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [performance](<https://devfeed.tech/tags/performance.md>), [text-classification](<https://devfeed.tech/tags/text-classification.md>), [training-data](<https://devfeed.tech/tags/training-data.md>), [validation](<https://devfeed.tech/tags/validation.md>)

### AI overview

This tutorial explains how to fine-tune a DistilBERT text classifier while incorporating a numerical feature into the same network. It uses the Kaggle wine reviews dataset, combining review descriptions with price and preprocessing the data for training, validation, and testing.

### Source excerpt

Text classification is often done through fine-tuning of a pretrained foundation model with domain-specific data. In FreeAgent we use transformer based models to automatically classify incoming bank transactions. Specifically we use a DistilBERT model that is fine-tuned on hundreds of millions of bank transactions with customer-labelled accounting categories. The model inputs are currently text-based, built from a combination of bank transaction descriptions and amounts. In this post we describe an approach to fine-tuning the DistilBERT model and training the classifier including the numerical amount feature as a single network.

## Multimodal Embedding & Reranker Models with Sentence Transformers

DevFeed: [Multimodal Embedding & Reranker Models with Sentence Transformers](<https://devfeed.tech/articles/multimodal-embedding-reranker-models-with-sentence-transformers-7361.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/multimodal-sentence-transformers>)

Author: Tom Aarsen

Published: 2026-04-09T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Cloud](<https://devfeed.tech/topics/cloud.md>)

Tags: [cloud](<https://devfeed.tech/tags/cloud.md>), [community](<https://devfeed.tech/tags/community.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [rag](<https://devfeed.tech/tags/rag.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

This article explains how multimodal embedding and reranker models in Sentence Transformers map text, images, audio, and video into shared spaces or score cross-modal pairs. It covers visual document retrieval, cross-modal search, multimodal RAG, hardware requirements, model loading, and similarity computation.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Natural Language Processing (NLP) Series

DevFeed: [Natural Language Processing (NLP) Series](<https://devfeed.tech/articles/natural-language-processing-nlp-series-4513.md>)

Original publisher: [Read original article](<https://feeds.feedblitz.com/~/952881911/0/baeldung/cs>)

Author: baeldung

Published: 2026-04-01T15:52:18Z

Content type: tutorial

Language: en

Sources: [Baeldung - CS](<https://devfeed.tech/sources/baeldung-cs.md>)

Topics: [Natural language processing](<https://devfeed.tech/topics/nlp.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [artificial-intelligence-series-natural-language-processing](<https://devfeed.tech/tags/artificial-intelligence-series-natural-language-processing.md>), [guide](<https://devfeed.tech/tags/guide.md>), [natural-language-processing](<https://devfeed.tech/tags/natural-language-processing.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [series](<https://devfeed.tech/tags/series.md>)

### AI overview

A guide series covering the core areas of natural language processing.

### Source excerpt

This guide walks through the core areas of NLP. The post Natural Language Processing (NLP) Series first appeared on Baeldung on Computer Science. Related Stories What Is Aspect-Based Sentiment Analysis? What Are Language Models in NLP? Sorting Algorithms Series

## Как маскировать персональные данные на изображениях: наш эксперимент с OCR и NER

DevFeed: [Как маскировать персональные данные на изображениях: наш эксперимент с OCR и NER](<https://devfeed.tech/articles/ocr-ner-23996.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/redmadrobot/articles/1011450/>)

Author: andrivasg (red\_mad\_robot)

Published: 2026-03-17T15:55:37Z

Content type: tutorial

Language: ru

Sources: [Redmadrobot EN](<https://devfeed.tech/sources/redmadrobot-en.md>), [Redmadrobot RU](<https://devfeed.tech/sources/redmadrobot-ru.md>)

Topics: [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [pii](<https://devfeed.tech/topics/pii.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [computer-vision](<https://devfeed.tech/tags/computer-vision.md>), [llm](<https://devfeed.tech/tags/llm.md>), [ner](<https://devfeed.tech/tags/ner.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [ocr](<https://devfeed.tech/tags/ocr.md>), [pii](<https://devfeed.tech/tags/pii.md>), [red-mad-robot](<https://devfeed.tech/tags/red-mad-robot.md>), [rnd](<https://devfeed.tech/tags/rnd.md>), [tag-601fbc7112a4](<https://devfeed.tech/tags/tag-601fbc7112a4.md>), [tag-7bc388df28ed](<https://devfeed.tech/tags/tag-7bc388df28ed.md>), [tag-9bf5e01ce62e](<https://devfeed.tech/tags/tag-9bf5e01ce62e.md>), [tag-b92bf5906bbd](<https://devfeed.tech/tags/tag-b92bf5906bbd.md>), [tag-ef0b1bf200df](<https://devfeed.tech/tags/tag-ef0b1bf200df.md>)

### AI overview

The article describes red_mad_robot's experiment using OCR combined with a NER model to detect and selectively mask personally identifiable information in images without training specialized visual detectors. On a dataset of 40 annotated images, the pipeline masked 90% of personal data while falsely masking 14% of text polygons; performance declined on difficult real-world photographs.

### Source excerpt

Всем привет! Меня зовут Андрей Иванов, я NLP-исследователь в R&D red_mad_robot. Мы разрабатываем систему Guardrails для защиты персональных данных (PII) и фильтрации небезопасного контента. В этой статье расскажу, как мы решали задачу точечного маскирования PII на картинках без обучения специальных визуальных детекторов. Разберём связку оптического распознавания символов (OCR) с NER-моделью, покажем метрики на реальных данных, раскроем ограничения подхода и наши решения для их преодоления. Читать далее

## Highlights of Booking.com's publication in 2025

DevFeed: [Highlights of Booking.com's publication in 2025](<https://devfeed.tech/articles/highlights-of-booking-com-s-publication-in-2025-30451.md>)

Original publisher: [Read original article](<https://booking.ai/highlights-of-booking-coms-publication-in-2025-1c1a6deba066?source=rss----4d265f07defc---4>)

Author: Yang Yang

Published: 2026-01-20T09:20:13Z

Content type: article

Language: en

Sources: [Booking.com Data Science](<https://devfeed.tech/sources/booking-com-data-science.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Language models](<https://devfeed.tech/topics/language-models.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [recommendation systems](<https://devfeed.tech/topics/recommendation-systems.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [Inference](<https://devfeed.tech/topics/inference.md>)

Tags: [2025](<https://devfeed.tech/tags/2025.md>), [ai](<https://devfeed.tech/tags/ai.md>), [booking](<https://devfeed.tech/tags/booking.md>), [compression](<https://devfeed.tech/tags/compression.md>), [data-science](<https://devfeed.tech/tags/data-science.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [inference](<https://devfeed.tech/tags/inference.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [latency](<https://devfeed.tech/tags/latency.md>), [neurips](<https://devfeed.tech/tags/neurips.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [publication](<https://devfeed.tech/tags/publication.md>)

### AI overview

Booking.com highlights its 2025 machine learning publications, including papers accepted at major conferences and research on applying Medusa speculative decoding and knowledge distillation to travel-related language model tasks.

### Source excerpt

At Booking.com, our mission is to make experiencing the world easier for everyone. We are committed to investing in cutting-edge technology that removes the barriers to travel, enabling seamless connections between millions of travelers and unforgettable experiences, diverse transportation options, and exceptional accommodations. The intersection of academic rigor and industry application is where true transformation happens. In 2025, our ML community bridged this gap more effectively than ever, contributing vital new insights to the global scientific community. With 8 out of 13 papers accepted at premier conferences -- including NeurIPS, SIGIR, KDD, and ACL -- our colleagues have demonstrated world-class expertise in AI, NLP, recommendation systems, uplift modeling, etc. These aren't just theoretical wins; they are the engines of innovation that allow us to push technological boundaries, ensuring our platform remains the most sophisticated and intuitive guide in the ever-evolving travel industry. Below, we highlight some of the key achievements and insights from these groundbreaking works. Speed Without Sacrifice: Fine-Tuning Language Models with Medusa and Knowledge Distillation in Travel Applications By Daniel Zagyva, Emmanouil Stergiadis, Laurens Van Der Maas, Aleksandra Dokic, Eran Fainman, Ilya Gusev, Moran Beladev Best paper award of 2025 ACL Industry Track https://aclanthology.org/2025.acl-industry.48/ In high-stakes industrial NLP applications, balancing generation quality with speed and efficiency presents significant challenges. We address them by investigating two complementary optimization approaches: Medusa for speculative decoding and knowledge distillation (KD) for model compression. We demonstrate the practical application of these techniques in real-world travel domain tasks, including trip planning, smart filters, and generating accommodation descriptions. We introduce modifications to the Medusa implementation, starting with base pre-trained models

## MCP Tool Registry: автоматизированное создание систем RAG

DevFeed: [MCP Tool Registry: автоматизированное создание систем RAG](<https://devfeed.tech/articles/mcp-tool-registry-rag-24033.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/redmadrobot/articles/982004/>)

Author: maksimov\_m (red\_mad\_robot)

Published: 2025-12-30T16:07:23Z

Content type: tutorial

Language: ru

Sources: [Redmadrobot EN](<https://devfeed.tech/sources/redmadrobot-en.md>), [Redmadrobot RU](<https://devfeed.tech/sources/redmadrobot-ru.md>)

Topics: [Model Context Protocol](<https://devfeed.tech/topics/model-context-protocol.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Tool](<https://devfeed.tech/topics/tool.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [model-context-protocol](<https://devfeed.tech/tags/model-context-protocol.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [rag](<https://devfeed.tech/tags/rag.md>), [tag-41e9f0e0da78](<https://devfeed.tech/tags/tag-41e9f0e0da78.md>), [tag-68e701e78517](<https://devfeed.tech/tags/tag-68e701e78517.md>), [tag-db2a5a2010aa](<https://devfeed.tech/tags/tag-db2a5a2010aa.md>), [tag-ebcf3e175cd3](<https://devfeed.tech/tags/tag-ebcf3e175cd3.md>), [tool](<https://devfeed.tech/tags/tool.md>), [workflows](<https://devfeed.tech/tags/workflows.md>)

### AI overview

This Russian-language developer article presents MCP Tool Registry, a central registry for managing MCP servers used to build Retrieval Augmented Generation systems. It explains how RAG and Model Context Protocol address LLM limitations around context and access to external tools and data, and describes registry-based orchestration of multi-step workflows across multiple servers.

### Source excerpt

Всем привет! Меня зовут Максим Максимов, я -- NLP-инженер в AI R&D лаборатории в red_mad_robot. Мы работаем с прикладными AI-системами, проводим эксперименты и проверяем архитектурные подходы в реальных сценариях. Современные AI-архитектуры всё чаще выносят прикладную логику за пределы LLM -- в инструменты, внешние источники данных и правила их оркестрации. Модель выступает вычислительным ядром, а ценность формируется на уровне системы вокруг неё. Из этого подхода в R&D-лаборатории вырос MCP Tool Registry -- центральный реестр для управления системой серверов, необходимых для построения RAG. В этой статье я подробно расскажу, из каких частей состоит MCP Tool Registry, как он работает и покажу его применение на практическом примере. Читать далее

## Контроль против гибкости: два подхода к созданию AI-агентов

DevFeed: [Контроль против гибкости: два подхода к созданию AI-агентов](<https://devfeed.tech/articles/ai-24030.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/redmadrobot/articles/966628/>)

Author: Mentalitet (red\_mad\_robot)

Published: 2025-11-14T17:15:42Z

Content type: article

Language: ru

Sources: [Redmadrobot EN](<https://devfeed.tech/sources/redmadrobot-en.md>), [Redmadrobot RU](<https://devfeed.tech/sources/redmadrobot-ru.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Langgraph](<https://devfeed.tech/topics/langgraph.md>), [SDKs](<https://devfeed.tech/topics/sdks.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [cursor](<https://devfeed.tech/topics/cursor.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [cursor](<https://devfeed.tech/tags/cursor.md>), [development](<https://devfeed.tech/tags/development.md>), [development-kit](<https://devfeed.tech/tags/development-kit.md>), [langgraph](<https://devfeed.tech/tags/langgraph.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llm-05dacf5e57d9](<https://devfeed.tech/tags/llm-05dacf5e57d9.md>), [llm-12323b29df45](<https://devfeed.tech/tags/llm-12323b29df45.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [openai](<https://devfeed.tech/tags/openai.md>), [red-mad-robot](<https://devfeed.tech/tags/red-mad-robot.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [software-development](<https://devfeed.tech/tags/software-development.md>), [tag-1605473766c5](<https://devfeed.tech/tags/tag-1605473766c5.md>), [tag-61cd5a476b1d](<https://devfeed.tech/tags/tag-61cd5a476b1d.md>), [tag-68e701e78517](<https://devfeed.tech/tags/tag-68e701e78517.md>), [tag-93edcb27480f](<https://devfeed.tech/tags/tag-93edcb27480f.md>), [tag-b0a411324cb6](<https://devfeed.tech/tags/tag-b0a411324cb6.md>), [tag-dd24610a6838](<https://devfeed.tech/tags/tag-dd24610a6838.md>)

### AI overview

The article compares code-first and graph-first approaches to building multi-agent systems. It describes how LLMs coordinate tools and other agents, including ReAct, handoff, agent-as-tool, and group-chat patterns, drawing on the author's development experience and documentation from OpenAI and LangGraph.

### Source excerpt

Привет! Меня зовут Женя Орлов, я руковожу NLP-разработкой в red_mad_robot. Мы экспериментируем с мультиагентными системами и изучаем, как LLM ведут себя в разных архитектурах. В процессе накопилось много наблюдений и рабочих инсайтов -- хочу поделиться тем, что помогает нам при проектировании AI-агентов. В последнее время внимание инженеров и исследователей привлекают агентные архитектуры -- системы, где LLM координирует работу внутренних инструментов и других моделей. Разберём два основных подхода к построению агентных систем. Читать далее

## Sentence Transformers is joining Hugging Face!

DevFeed: [Sentence Transformers is joining Hugging Face!](<https://devfeed.tech/articles/sentence-transformers-is-joining-hugging-face-7472.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/sentence-transformers-joins-hf>)

Author: Tom Aarsen

Published: 2025-10-22T00:00:00Z

Content type: news

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [announcement](<https://devfeed.tech/tags/announcement.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [community](<https://devfeed.tech/tags/community.md>), [contributors](<https://devfeed.tech/tags/contributors.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [natural-language-processing](<https://devfeed.tech/tags/natural-language-processing.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>)

### AI overview

Sentence Transformers, also known as SentenceBERT or SBERT, is joining Hugging Face. The popular open-source library generates embeddings that capture semantic meaning and supports natural language processing tasks such as semantic search, similarity analysis, clustering, and paraphrase mining. It will remain community-driven under the Apache 2.0 license, with contributions welcomed from researchers, developers, and enthusiasts.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## AI Agents and Multi-Agent Systems: A Practical Case for Analyzing and Fixing Code Vulnerabilities

DevFeed: [AI Agents and Multi-Agent Systems: A Practical Case for Analyzing and Fixing Code Vulnerabilities](<https://devfeed.tech/articles/article-24028.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/redmadrobot/articles/957300/>)

Author: redmadrobot (red\_mad\_robot)

Published: 2025-10-16T15:18:12Z

Content type: tutorial

Language: ru

Sources: [Redmadrobot EN](<https://devfeed.tech/sources/redmadrobot-en.md>), [Redmadrobot RU](<https://devfeed.tech/sources/redmadrobot-ru.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-agents](<https://devfeed.tech/tags/ai-agents.md>), [graph](<https://devfeed.tech/tags/graph.md>), [llm](<https://devfeed.tech/tags/llm.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [sast](<https://devfeed.tech/tags/sast.md>), [systems](<https://devfeed.tech/tags/systems.md>), [tag-1605473766c5](<https://devfeed.tech/tags/tag-1605473766c5.md>), [tag-4d5248fd6bfe](<https://devfeed.tech/tags/tag-4d5248fd6bfe.md>), [workflow](<https://devfeed.tech/tags/workflow.md>)

### AI overview

The article explains the defining characteristics and autonomy levels of AI agents, focusing on workflow agents and multi-agent systems. It presents a practical case involving a multi-agent environment for automatically analyzing and fixing code vulnerabilities.

### Source excerpt

Привет! Меня зовут Егор Козлов, я работаю NLP-инженером в red_mad_robot. Мы активно внедряем в бизнес AI-агентов -- автономных и полуавтономных программных сущностей, которые самостоятельно выполняют задачи и принимают решения в интересах бизнеса. В статье расскажу о принципах работы AI-агентов -- с особым вниманием к workflow-агентам и мультиагентным системам (MAS). И поделюсь практическим кейсом внедрения мультиагентной среды для автоматического анализа и исправления уязвимостей в коде. Читать далее

## Introducing RTEB: A New Standard for Retrieval Evaluation

DevFeed: [Introducing RTEB: A New Standard for Retrieval Evaluation](<https://devfeed.tech/articles/introducing-rteb-a-new-standard-for-retrieval-evaluation-7460.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/rteb>)

Author: Frank Liu; Kenneth Enevoldsen; Solomatin Roman; Isaac Chung; Tom Aarsen; Fődi, Zoltán

Published: 2025-10-01T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [LLM evaluation / benchmarking](<https://devfeed.tech/topics/llm-evaluation-benchmarking.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [generalization in machine learning](<https://devfeed.tech/topics/generalization-in-machine-learning.md>), [recommendation systems](<https://devfeed.tech/topics/recommendation-systems.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [community](<https://devfeed.tech/tags/community.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [developers](<https://devfeed.tech/tags/developers.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [models](<https://devfeed.tech/tags/models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open](<https://devfeed.tech/tags/open.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rag](<https://devfeed.tech/tags/rag.md>), [recommendation-systems](<https://devfeed.tech/tags/recommendation-systems.md>), [research](<https://devfeed.tech/tags/research.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [search](<https://devfeed.tech/tags/search.md>), [zero-shot](<https://devfeed.tech/tags/zero-shot.md>)

### AI overview

Hugging Face introduces the beta Retrieval Embedding Benchmark (RTEB), designed to evaluate the retrieval accuracy and generalization of embedding models in real-world applications. It combines open and private datasets to provide a fairer, more transparent, application-focused evaluation standard.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Accelerating Qwen3-8B Agent on Intel® Core™ Ultra with Depth-Pruned Draft Models

DevFeed: [Accelerating Qwen3-8B Agent on Intel® Core™ Ultra with Depth-Pruned Draft Models](<https://devfeed.tech/articles/accelerating-qwen3-8b-agent-on-intel-coretm-ultra-with-depth-pruned-draft-models-7292.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/intel-qwen3-agent>)

Author: Igor Margulis; Ofir Zafrir; Shira Guskin; Guy Boudoukh; Pedro Cuenca

Published: 2025-09-29T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [qwen](<https://devfeed.tech/topics/qwen.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [intel](<https://devfeed.tech/topics/intel.md>), [smolagents](<https://devfeed.tech/topics/smolagents.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [ai-agent](<https://devfeed.tech/tags/ai-agent.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [hub](<https://devfeed.tech/tags/hub.md>), [inference](<https://devfeed.tech/tags/inference.md>), [intel](<https://devfeed.tech/tags/intel.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llm](<https://devfeed.tech/tags/llm.md>), [models](<https://devfeed.tech/tags/models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [qwen](<https://devfeed.tech/tags/qwen.md>), [smolagents](<https://devfeed.tech/tags/smolagents.md>)

### AI overview

The article explains how to accelerate the Qwen3-8B agent on an Intel Lunar Lake integrated GPU using OpenVINO.GenAI. Speculative decoding with Qwen3-0.6B as a draft model achieves about a 1.3x speedup, while pruning the draft model increases the speedup to about 1.4x. It also demonstrates running a fast, local AI agent with smolagents.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Detecting hallucinations in RAG systems with circuit tracing and attribution graphs

DevFeed: [Detecting hallucinations in RAG systems with circuit tracing and attribution graphs](<https://devfeed.tech/articles/circuit-tracing-24026.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/redmadrobot/articles/951118/>)

Author: IrinaKoshkina (red\_mad\_robot)

Published: 2025-09-26T18:30:09Z

Content type: tutorial

Language: ru

Sources: [Redmadrobot EN](<https://devfeed.tech/sources/redmadrobot-en.md>), [Redmadrobot RU](<https://devfeed.tech/sources/redmadrobot-ru.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [anthropic](<https://devfeed.tech/topics/anthropic.md>)

Tags: [anthropic](<https://devfeed.tech/tags/anthropic.md>), [circuit](<https://devfeed.tech/tags/circuit.md>), [llm](<https://devfeed.tech/tags/llm.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [rag](<https://devfeed.tech/tags/rag.md>), [red-mad-robot](<https://devfeed.tech/tags/red-mad-robot.md>), [tag-0444141ce356](<https://devfeed.tech/tags/tag-0444141ce356.md>), [tag-3f4d1152a2b4](<https://devfeed.tech/tags/tag-3f4d1152a2b4.md>), [tag-73f5f2c76797](<https://devfeed.tech/tags/tag-73f5f2c76797.md>), [tag-b6914c0b0244](<https://devfeed.tech/tags/tag-b6914c0b0244.md>), [tag-d27a0708d400](<https://devfeed.tech/tags/tag-d27a0708d400.md>), [tracing](<https://devfeed.tech/tags/tracing.md>), [transcoder](<https://devfeed.tech/tags/transcoder.md>)

### AI overview

The article explains an approach to detecting hallucinations in retrieval-augmented generation systems by examining model computation graphs with Anthropic's framework, cross-layer transcoders, and attribution graphs. It presents an implementation for analyzing Qwen2.5-7B and reports 85% detection accuracy on a test dataset for a simple implementation.

### Source excerpt

Всем привет! Меня зовут Ирина, я NLP-инженер в red_mad_robot, занимаюсь научными исследованиями интерпретируемости LLM и анализом механизмов внутренних вычислений моделей, чтобы применять полученные результаты на практике. Например, сегодня хочу рассказать, как мы подошли к решению задачи детекции галлюцинаций LLM в RAG системах со стороны исследования графов размышлений модели -- с помощью интересного фреймворка от Anthropic. В статье поговорим, как использовать cross-layer transcoders и атрибуционные графы для детекции галлюцинаций в RAG системах. Рассмотрим пример реализации детектора на графах для анализа модели Qwen2.5-7B и практические примеры использования. Спойлер: на простой реализации получили точность детекции 85% на тестовом датасете. Читать далее

## mmBERT: ModernBERT goes Multilingual

DevFeed: [mmBERT: ModernBERT goes Multilingual](<https://devfeed.tech/articles/mmbert-modernbert-goes-multilingual-7354.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/mmbert>)

Author: Marc Marone; Orion Weller; William Fleshman; Eugene Yang; Dawn Lawrie; Ben Van Durme

Published: 2025-09-09T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Training AI Models](<https://devfeed.tech/topics/training-ai-models.md>), [Machine Learning & Artificial Intelligence](<https://devfeed.tech/topics/machine-learning-artificial-intelligence.md>), [datasets](<https://devfeed.tech/topics/datasets.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [Data Quality](<https://devfeed.tech/topics/data-quality.md>), [Boilerplate](<https://devfeed.tech/topics/boilerplate.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [blog-post](<https://devfeed.tech/tags/blog-post.md>), [community](<https://devfeed.tech/tags/community.md>), [data-quality](<https://devfeed.tech/tags/data-quality.md>), [datasets](<https://devfeed.tech/tags/datasets.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-collab](<https://devfeed.tech/tags/open-source-collab.md>), [performance](<https://devfeed.tech/tags/performance.md>), [research](<https://devfeed.tech/tags/research.md>), [speed](<https://devfeed.tech/tags/speed.md>), [training](<https://devfeed.tech/tags/training.md>)

### AI overview

This blog post introduces mmBERT, a massively multilingual encoder model trained on more than 3 trillion tokens across over 1,800 languages. It describes performance and speed improvements over earlier multilingual models, the model's ModernBERT-based architecture, and a progressive strategy for adding languages and balancing training data.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Welcome EmbeddingGemma, Google's new efficient embedding model

DevFeed: [Welcome EmbeddingGemma, Google's new efficient embedding model](<https://devfeed.tech/articles/welcome-embeddinggemma-google-s-new-efficient-embedding-model-7180.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/embeddinggemma>)

Author: Tom Aarsen; Joshua; Alvaro Bartolome; Aritra Roy Gosthipaty; Pedro Cuenca; Sergio Paniego

Published: 2025-09-04T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Google](<https://devfeed.tech/topics/google.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [transformers.js](<https://devfeed.tech/topics/transformers-js.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [onnx](<https://devfeed.tech/topics/onnx.md>), [dataset](<https://devfeed.tech/topics/dataset.md>), [LangChain](<https://devfeed.tech/topics/langchain.md>), [llamaindex](<https://devfeed.tech/topics/llamaindex.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [community](<https://devfeed.tech/tags/community.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [google](<https://devfeed.tech/tags/google.md>), [guide](<https://devfeed.tech/tags/guide.md>), [langchain](<https://devfeed.tech/tags/langchain.md>), [llamaindex](<https://devfeed.tech/tags/llamaindex.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [onnx](<https://devfeed.tech/tags/onnx.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [rag](<https://devfeed.tech/tags/rag.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>), [transformers-js](<https://devfeed.tech/tags/transformers-js.md>)

### AI overview

Google introduces EmbeddingGemma, a compact multilingual embedding model designed for fast, efficient on-device use. The article covers its architecture, training, multilingual capabilities, benchmark performance, framework integrations, and domain fine-tuning for retrieval applications.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## 🇵🇭 FilBench - Can LLMs Understand and Generate Filipino?

DevFeed: [🇵🇭 FilBench - Can LLMs Understand and Generate Filipino?](<https://devfeed.tech/articles/filbench-can-llms-understand-and-generate-filipino-7198.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/filbench>)

Author: Lj V. Miranda; Elyanah Aco; Conner Manuel; Jan Christian Blaise Cruz; Joseph Imperial; Daniel van Strien; Nathan Habib; Clémentine Fourrier

Published: 2025-08-12T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Language models](<https://devfeed.tech/topics/language-models.md>), [Human-AI evaluation](<https://devfeed.tech/topics/human-ai-evaluation.md>)

Tags: [cebuano](<https://devfeed.tech/tags/cebuano.md>), [community](<https://devfeed.tech/tags/community.md>), [evaluation](<https://devfeed.tech/tags/evaluation.md>), [filipino](<https://devfeed.tech/tags/filipino.md>), [generate](<https://devfeed.tech/tags/generate.md>), [generation](<https://devfeed.tech/tags/generation.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [philippines](<https://devfeed.tech/tags/philippines.md>), [tagalog](<https://devfeed.tech/tags/tagalog.md>), [testing](<https://devfeed.tech/tags/testing.md>)

### AI overview

FilBench is an evaluation suite for assessing how LLMs understand and generate Tagalog, Filipino, and Cebuano. It evaluates cultural knowledge, classical NLP, reading comprehension, and translation-oriented generation across 12 tasks.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

[Next page](<https://devfeed.tech/tags/nlp.md?cursor=WyIyMDI1LTA4LTEyVDAwOjAwOjAwKzAwOjAwIiwgIjA0ZmUwZWYyLTQ1ZTctNDYxMC04NjZlLWVlZTIwZDRiMzk4NyJd>)