# Transformers

Transformers is a model-definition framework for machine-learning models in text, computer vision, audio, video, and multimodal applications, supporting inference and training.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Agentic Engineering in Python: From Vibes to Evidence

DevFeed: [Agentic Engineering in Python: From Vibes to Evidence](<https://devfeed.tech/articles/agentic-engineering-in-python-from-vibes-to-evidence-21091.md>)

Original publisher: [Read original article](<https://realpython.com/agentic-engineering/>)

Author: Ben Batman

Published: 2026-09-14T14:00:00Z

Content type: tutorial

Language: en

Sources: [Real Python](<https://devfeed.tech/sources/real-python.md>)

Topics: [Loop Engineering](<https://devfeed.tech/topics/loop-engineering.md>), [AI Agent](<https://devfeed.tech/topics/ai-agent.md>), [Python](<https://devfeed.tech/topics/python.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Code review](<https://devfeed.tech/topics/code-review.md>), [Test-driven development](<https://devfeed.tech/topics/tdd.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [agentic-engineering](<https://devfeed.tech/tags/agentic-engineering.md>), [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [cheat-sheet](<https://devfeed.tech/tags/cheat-sheet.md>), [code-review](<https://devfeed.tech/tags/code-review.md>), [learning](<https://devfeed.tech/tags/learning.md>), [python](<https://devfeed.tech/tags/python.md>), [tests](<https://devfeed.tech/tags/tests.md>)

### AI overview

This tutorial presents agentic engineering in Python as a disciplined workflow for delegating bounded tasks to AI coding agents while retaining human control over intent, constraints, review, and release decisions. It explains execution and acceptance loops, the Engineering Evidence Ladder, and the RECAP review method for evaluating agent-generated changes with tests, type hints, refactoring, and code review.

### Source excerpt

Move from vibe coding to agentic engineering in Python, using tests, types, and code review to prove an AI agent's changes are safe to keep.

## Открываем претрейн Alice AI Search: как устроена модель быстрых ответов Алисы на Поиске

DevFeed: [Открываем претрейн Alice AI Search: как устроена модель быстрых ответов Алисы на Поиске](<https://devfeed.tech/articles/alice-ai-search-24897.md>)

Original publisher: [Read original article](<https://habr.com/ru/companies/yandex/articles/1080654/>)

Author: pet67 (Яндекс)

Published: 2026-09-11T06:05:13Z

Content type: article

Language: ru

Sources: [Яндекс - Как мы делаем Яндекс / Статьи](<https://devfeed.tech/sources/source.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI search](<https://devfeed.tech/topics/ai-search.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>)

Tags: [agentic](<https://devfeed.tech/tags/agentic.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-search](<https://devfeed.tech/tags/ai-search.md>), [alice-ai](<https://devfeed.tech/tags/alice-ai.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [llm](<https://devfeed.tech/tags/llm.md>), [ml](<https://devfeed.tech/tags/ml.md>), [moe](<https://devfeed.tech/tags/moe.md>), [rl](<https://devfeed.tech/tags/rl.md>), [tag-178bc8f01f24](<https://devfeed.tech/tags/tag-178bc8f01f24.md>), [tag-4004cf5948d3](<https://devfeed.tech/tags/tag-4004cf5948d3.md>), [tag-61cd5a476b1d](<https://devfeed.tech/tags/tag-61cd5a476b1d.md>), [tag-d89cae10e887](<https://devfeed.tech/tags/tag-d89cae10e887.md>), [tag-e6d9cc1f0757](<https://devfeed.tech/tags/tag-e6d9cc1f0757.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

This developer article explains the Alice AI Search pipeline for generating fast answers, including its search and context-processing stages, shorter information contexts, a sparse Mixture-of-Experts architecture combined with an Encoder-Decoder, and online reinforcement learning from user behavior signals. It also announces the open release of the Alice AI-T5-35B-A0.6B Base model, with external inference available through Hugging Face Transformers while optimized production inference remains internal to Yandex.

### Source excerpt

Быстрый ответ Алисы AI -- это самый массовый генеративный продукт Яндекса и первое соприкосновение с Алисой для пользователей Поиска. Даже в час пиковой нагрузки пользователь должен получить лаконичный ответ за считаные секунды. Для этого мы, команда Alice AI Search, адаптируем весь пайплайн быстрых ответов -- от собственного претрейна с кастомной архитектурой до онлайн-rl-обучения на поведенческие сигналы пользователей. В статье разберём, как устроен генеративный ответ в Поиске, и расскажем про основные улучшения июньского релиза: как мы ускорили ответы за счёт коротких инфоконтекстов, зачем совместили Encoder-Decoder с разреженной MoE-архитектурой и как обучение на реальных пользовательских сигналах повлияло на качество и использование продукта. Кроме того, мы выложили в открытый доступ обученную с нуля модель Alice AI-T5-35B-A0.6B Base с тем ограничением, что внешним пользователям доступен инференс через Hugging Face Transformers, а оптимизированный production-инференс пока доступен только внутри Яндекса. Читать далее

## This Week In AI Research (🗓 9-16 July 26)

DevFeed: [This Week In AI Research (🗓 9-16 July 26)](<https://devfeed.tech/articles/this-week-in-ai-research-9-16-july-26-18287.md>)

Original publisher: [Read original article](<https://www.intoai.pub/p/this-week-in-ai-research-9-16-july>)

Author: Dr. Ashish Bamania

Published: 2026-07-22T09:14:26Z

Content type: article

Language: en

Sources: [Into AI](<https://devfeed.tech/sources/into-ai.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [AI Research](<https://devfeed.tech/topics/ai-research.md>), [releases](<https://devfeed.tech/topics/releases.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [long-context](<https://devfeed.tech/topics/long-context.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [architecture](<https://devfeed.tech/tags/architecture.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [context-window](<https://devfeed.tech/tags/context-window.md>), [llms](<https://devfeed.tech/tags/llms.md>), [models](<https://devfeed.tech/tags/models.md>), [moe](<https://devfeed.tech/tags/moe.md>), [open](<https://devfeed.tech/tags/open.md>), [releases](<https://devfeed.tech/tags/releases.md>), [research](<https://devfeed.tech/tags/research.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

A weekly roundup of AI research papers and releases, covering Kimi K3, Expanded Hyper-Connections, VideoChat3, and other developments. It describes Kimi K3's architecture, context window, benchmark performance, and limitations, and summarizes xHC's reported efficiency improvements.

### Source excerpt

The top 10 AI research papers and releases this week (Kimi K3, Inkling, WanSong v1.0, Bonsai 27B, and many more)

## Everything a Senior Engineer Needs to Know About What's Inside an LLM

DevFeed: [Everything a Senior Engineer Needs to Know About What's Inside an LLM](<https://devfeed.tech/articles/everything-a-senior-engineer-needs-to-know-about-what-s-inside-an-llm-37412.md>)

Original publisher: [Read original article](<https://www.pathtostaff.com/p/everything-a-senior-engineer-needs>)

Author: Sidwyn Koh

Published: 2026-06-20T17:00:09Z

Content type: tutorial

Language: en

Sources: [Path to Staff](<https://devfeed.tech/sources/path-to-staff.md>)

Topics: [Large Language Model](<https://devfeed.tech/topics/llm.md>), [model architecture](<https://devfeed.tech/topics/model-architecture.md>), [Neural Network](<https://devfeed.tech/topics/neural-network.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [architecture](<https://devfeed.tech/tags/architecture.md>), [learning](<https://devfeed.tech/tags/learning.md>), [llms](<https://devfeed.tech/tags/llms.md>), [models](<https://devfeed.tech/tags/models.md>), [neural-network](<https://devfeed.tech/tags/neural-network.md>)

### AI overview

This tutorial explains the architecture and internal components of large language models, including the role of neural networks, recurrent neural networks, transformers, and diffusion models. It is part of a series covering AI systems in depth.

### Source excerpt

Learn what AI models are made of

## Transformers v5: Simple model definitions powering the AI ecosystem

DevFeed: [Transformers v5: Simple model definitions powering the AI ecosystem](<https://devfeed.tech/articles/transformers-v5-simple-model-definitions-powering-the-ai-ecosystem-7537.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/transformers-v5>)

Author: Lysandre; Arthur Zucker; Cyril Vallez; Vaibhav Srivastav

Published: 2025-12-01T00:00:00Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Transformers](<https://devfeed.tech/topics/transformers.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [model architecture](<https://devfeed.tech/topics/model-architecture.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [announcement](<https://devfeed.tech/tags/announcement.md>), [community](<https://devfeed.tech/tags/community.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [model-architecture](<https://devfeed.tech/tags/model-architecture.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [python](<https://devfeed.tech/tags/python.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [v5](<https://devfeed.tech/tags/v5.md>)

### AI overview

Hugging Face announces Transformers v5, focusing on simpler model definitions and improvements for training, inference, and production. The article describes the library's growth to more than 400 model architectures and over 1.2 billion installs, along with modular design intended to improve maintenance, integration, and collaboration.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Link Graveyard: A snapshot of my abandoned browser tabs

DevFeed: [Link Graveyard: A snapshot of my abandoned browser tabs](<https://devfeed.tech/articles/link-graveyard-a-snapshot-of-my-abandoned-browser-tabs-33473.md>)

Original publisher: [Read original article](<https://timkellogg.me/blog/2025/09/13/link-graveyard>)

Published: 2025-09-13T00:00:00Z

Content type: article

Language: en

Sources: [Tim Kellogg](<https://devfeed.tech/sources/tim-kellogg.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Graphs](<https://devfeed.tech/topics/graphs.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [Meta](<https://devfeed.tech/topics/meta.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [browser](<https://devfeed.tech/tags/browser.md>), [graph](<https://devfeed.tech/tags/graph.md>), [llms](<https://devfeed.tech/tags/llms.md>), [meta](<https://devfeed.tech/tags/meta.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [snapshot](<https://devfeed.tech/tags/snapshot.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

A personal roundup of abandoned browser tabs, briefly annotated with comments on AI research, language models, agentic and coding abilities, datasets, AI consciousness, and related writing.

### Source excerpt

A dump of all my browser tabs on my phone, briefly annotated

## Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers

DevFeed: [Tricks from OpenAI gpt-oss YOU 🫵 can use with transformers](<https://devfeed.tech/articles/tricks-from-openai-gpt-oss-you-can-use-with-transformers-7193.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/faster-transformers>)

Author: Aritra Roy Gosthipaty; Sergio Paniego; Vaibhav Srivastav; Pedro Cuenca; Arthur Zucker; Nathan Habib; Cyril Vallez

Published: 2025-09-11T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Transformers](<https://devfeed.tech/topics/transformers.md>), [gpt-oss](<https://devfeed.tech/topics/gpt-oss.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [CUDA](<https://devfeed.tech/topics/cuda.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [C++](<https://devfeed.tech/topics/c-plus-plus.md>), [Python](<https://devfeed.tech/topics/python.md>)

Tags: [c-plus-plus](<https://devfeed.tech/tags/c-plus-plus.md>), [cuda](<https://devfeed.tech/tags/cuda.md>), [gpt-oss](<https://devfeed.tech/tags/gpt-oss.md>), [guide](<https://devfeed.tech/tags/guide.md>), [llms](<https://devfeed.tech/tags/llms.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openai](<https://devfeed.tech/tags/openai.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [python](<https://devfeed.tech/tags/python.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

This article explains performance improvements in the Transformers toolkit, including specialized kernels, kernel fusion, Flash Attention, and pre-built kernel binaries. It highlights how GPT-OSS, a Mixture of Experts model, uses custom kernels distributed through the Hub.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Welcome GPT OSS, the new open-source model family from OpenAI!

DevFeed: [Welcome GPT OSS, the new open-source model family from OpenAI!](<https://devfeed.tech/articles/welcome-gpt-oss-the-new-open-source-model-family-from-openai-7567.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/welcome-openai-gpt-oss>)

Author: Vaibhav Srivastav; Pedro Cuenca; Lewis Tunstall; Clem 🤗; Matthew Carrigan; Clémentine Fourrier; Célina Hanouti; Lucain Pouget; Marc Sun; Simon Pagezy

Published: 2025-08-05T00:00:00Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [gpt-oss](<https://devfeed.tech/topics/gpt-oss.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [inference-providers](<https://devfeed.tech/topics/inference-providers.md>), [llama.cpp](<https://devfeed.tech/topics/llama-cpp.md>), [moe](<https://devfeed.tech/topics/moe.md>), [Ollama](<https://devfeed.tech/topics/ollama.md>), [Python](<https://devfeed.tech/topics/python.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [vllm](<https://devfeed.tech/topics/vllm.md>)

Tags: [api](<https://devfeed.tech/tags/api.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [community](<https://devfeed.tech/tags/community.md>), [gpt](<https://devfeed.tech/tags/gpt.md>), [gpt-oss](<https://devfeed.tech/tags/gpt-oss.md>), [inference-providers](<https://devfeed.tech/tags/inference-providers.md>), [javascript](<https://devfeed.tech/tags/javascript.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [llm](<https://devfeed.tech/tags/llm.md>), [moe](<https://devfeed.tech/tags/moe.md>), [ollama](<https://devfeed.tech/tags/ollama.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [openai](<https://devfeed.tech/tags/openai.md>), [python](<https://devfeed.tech/tags/python.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [vllm](<https://devfeed.tech/tags/vllm.md>)

### AI overview

Hugging Face welcomes OpenAI's gpt-oss open-source model family. The article describes the models' Apache 2.0 licensing, local deployment options, reasoning and tool-use capabilities, MoE architecture, quantization, supported inference implementations, and access through Inference Providers and the Responses API.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Holo1: New family of GUI automation VLMs powering GUI agent Surfer-H

DevFeed: [Holo1: New family of GUI automation VLMs powering GUI agent Surfer-H](<https://devfeed.tech/articles/holo1-new-family-of-gui-automation-vlms-powering-gui-agent-surfer-h-7002.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/Hcompany/holo1>)

Author: Mats L Richter; Pierre-Louis Cedoz

Published: 2025-06-03T13:27:59Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [computer-use](<https://devfeed.tech/topics/computer-use.md>), [browsers](<https://devfeed.tech/topics/browsers.md>), [Website](<https://devfeed.tech/topics/website.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Localization (l10n)](<https://devfeed.tech/topics/localization.md>)

Tags: [agents](<https://devfeed.tech/tags/agents.md>), [ai](<https://devfeed.tech/tags/ai.md>), [automation](<https://devfeed.tech/tags/automation.md>), [benchmarks](<https://devfeed.tech/tags/benchmarks.md>), [browsers](<https://devfeed.tech/tags/browsers.md>), [cost](<https://devfeed.tech/tags/cost.md>), [gui](<https://devfeed.tech/tags/gui.md>), [models](<https://devfeed.tech/tags/models.md>), [modular](<https://devfeed.tech/tags/modular.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [performance](<https://devfeed.tech/tags/performance.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [vlms](<https://devfeed.tech/tags/vlms.md>), [web](<https://devfeed.tech/tags/web.md>)

### AI overview

Holo1 is an open-source family of Action VLMs for understanding web interfaces and locating UI elements precisely. Holo1-3B and Holo1-7B are released on Hugging Face with the WebClick benchmark; Holo1-7B reports 76.2% average accuracy on common UI localization benchmarks. The article also describes Surfer-H, a browser-based web automation agent built with separate policy, localization, and validation components.

### Source excerpt

Surfer-H, a web-native agent that interacts with browsers like a human relies on the Holo1. Holo1 is the first family of open-source Action VLMs designed specifically for deep web UI understanding and precise localization. The family includes Holo1-3B and Holo1-7B models, with the latter achieving 76.2% average accuracy on common UI localization benchmarks--the highest among small-size models.

## Welcome Llama 4 Maverick & Scout on Hugging Face

DevFeed: [Welcome Llama 4 Maverick & Scout on Hugging Face](<https://devfeed.tech/articles/welcome-llama-4-maverick-scout-on-hugging-face-7338.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/llama4-release>)

Author: ben burtenshaw; Vaibhav Srivastav; Pedro Cuenca; Clem 🤗; Rajat Arya; Jared Sulzdorf; Lysandre

Published: 2025-04-05T00:00:00Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [llama](<https://devfeed.tech/topics/llama.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Mixture of Experts (MoE)](<https://devfeed.tech/topics/mixture-of-experts-moe.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [tgi](<https://devfeed.tech/topics/tgi.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>)

Tags: [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llama](<https://devfeed.tech/tags/llama.md>), [meta](<https://devfeed.tech/tags/meta.md>), [mixture-of-experts-moe](<https://devfeed.tech/tags/mixture-of-experts-moe.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [tgi](<https://devfeed.tech/tags/tgi.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

Hugging Face announces the release of Meta's Llama 4 Maverick and Scout, natively multimodal models built with an autoregressive Mixture-of-Experts architecture. The article describes their parameter sizes, expert counts, training data, language support, quantization options, licensing, and integration with the Hugging Face Hub, Transformers, TRL, and TGI.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## The NLP Course is becoming the LLM Course

DevFeed: [The NLP Course is becoming the LLM Course](<https://devfeed.tech/articles/the-nlp-course-is-becoming-the-llm-course-7339.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/llm-course>)

Author: ben burtenshaw; Vaibhav Srivastav; Lewis Tunstall; Florent Daudens; Pedro Cuenca; Tom Aarsen; Eliott Coyac; Mishig ᠮᠢᠰᠾᠢᠭ; Sergio Paniego; Julien Chaumond

Published: 2025-04-03T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [LLMs](<https://devfeed.tech/topics/llms.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Natural language processing](<https://devfeed.tech/topics/nlp.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [spaces](<https://devfeed.tech/topics/spaces.md>), [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>)

Tags: [education](<https://devfeed.tech/tags/education.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm-course](<https://devfeed.tech/tags/llm-course.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [nlp-course](<https://devfeed.tech/tags/nlp-course.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>), [spaces](<https://devfeed.tech/tags/spaces.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

Hugging Face is renaming and expanding its NLP course as The LLM course. The refreshed curriculum adds material on fine-tuning LLMs, reasoning models, inference, retrieval, and modern NLP methods while retaining foundational tasks such as classification and named entity recognition.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Finally, a Replacement for BERT: Introducing ModernBERT

DevFeed: [Finally, a Replacement for BERT: Introducing ModernBERT](<https://devfeed.tech/articles/finally-a-replacement-for-bert-introducing-modernbert-7356.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/modernbert>)

Author: Benjamin Warner; Antoine Chaffin; Benjamin Clavié; Orion Weller; Oskar Hallström; Said Taghadouini; Alexis Gallagher; Raja Biswas; Faisal Ladhak; Tom Aarsen

Published: 2024-12-19T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>), [recommendation systems](<https://devfeed.tech/topics/recommendation-systems.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [community](<https://devfeed.tech/tags/community.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [flash-attention-2](<https://devfeed.tech/tags/flash-attention-2.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source-collab](<https://devfeed.tech/tags/open-source-collab.md>), [performance](<https://devfeed.tech/tags/performance.md>), [rag](<https://devfeed.tech/tags/rag.md>), [research](<https://devfeed.tech/tags/research.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

The article introduces ModernBERT, a family of encoder-only models designed as improved replacements for BERT-like models. It describes 8,192-token context, stronger downstream performance, faster processing, base and large model sizes, compatibility with Transformers, and use cases including retrieval, classification, question answering, entity extraction, RAG pipelines, and recommendation systems. It also recommends Flash Attention 2 when supported by the GPU.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## SmolVLM - small yet mighty Vision Language Model

DevFeed: [SmolVLM - small yet mighty Vision Language Model](<https://devfeed.tech/articles/smolvlm-small-yet-mighty-vision-language-model-7484.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/smolvlm>)

Author: Andres Marafioti; merve; Miquel Farré; Elie Bakouch; Pedro Cuenca

Published: 2024-11-26T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [smolvlm](<https://devfeed.tech/topics/smolvlm.md>), [vlm](<https://devfeed.tech/topics/vlm.md>), [multimodal-ai](<https://devfeed.tech/topics/multimodal-ai.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Open Source Models & Datasets](<https://devfeed.tech/topics/open-source-models-datasets.md>), [GPU](<https://devfeed.tech/topics/gpu.md>)

Tags: [apache](<https://devfeed.tech/tags/apache.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [multimodal-ai](<https://devfeed.tech/tags/multimodal-ai.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [open](<https://devfeed.tech/tags/open.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [smolvlm](<https://devfeed.tech/tags/smolvlm.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [trl](<https://devfeed.tech/tags/trl.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

This article introduces SmolVLM, a family of small, fast, memory-efficient 2B vision-language models released fully open source under the Apache 2.0 license. It describes the model variants, architecture, training resources, Transformers integration, demo, fine-tuning script, and efficient local or on-device deployment.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Faster Text Generation with Self-Speculative Decoding

DevFeed: [Faster Text Generation with Self-Speculative Decoding](<https://devfeed.tech/articles/faster-text-generation-with-self-speculative-decoding-7307.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/layerskip>)

Author: Aritra Roy Gosthipaty; Mostafa Elhoushi; Pedro Cuenca; Vaibhav Srivastav

Published: 2024-11-20T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [text-generation](<https://devfeed.tech/topics/text-generation.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Latency](<https://devfeed.tech/topics/latency.md>), [Deployment](<https://devfeed.tech/topics/deployment.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>)

Tags: [benchmark](<https://devfeed.tech/tags/benchmark.md>), [collaboration](<https://devfeed.tech/tags/collaboration.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [latency](<https://devfeed.tech/tags/latency.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [research](<https://devfeed.tech/tags/research.md>), [text-generation](<https://devfeed.tech/tags/text-generation.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

This article explains self-speculative decoding, a technique that uses the early layers of a large language model to generate draft tokens and its deeper layers to verify them. With specialized training, the approach can accelerate text generation, reduce computational costs and latency, save memory, and enable inference on smaller GPUs. The article also demonstrates the method with the transformers library, code examples, benchmarks, and practical deployment guidance.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Introducing HUGS - Scale your AI with Open Models

DevFeed: [Introducing HUGS - Scale your AI with Open Models](<https://devfeed.tech/articles/introducing-hugs-scale-your-ai-with-open-models-7255.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/hugs>)

Author: Philipp Schmid; Jeff Boudier; Alvaro Bartolome; Simon Pagezy; Violette

Published: 2024-10-23T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [tgi](<https://devfeed.tech/topics/tgi.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [Microservices](<https://devfeed.tech/topics/microservices.md>), [API](<https://devfeed.tech/topics/api.md>), [Hardware](<https://devfeed.tech/topics/hardware.md>)

Tags: [accelerate](<https://devfeed.tech/tags/accelerate.md>), [accelerators](<https://devfeed.tech/tags/accelerators.md>), [ai](<https://devfeed.tech/tags/ai.md>), [ai-accelerator](<https://devfeed.tech/tags/ai-accelerator.md>), [amd](<https://devfeed.tech/tags/amd.md>), [announcement](<https://devfeed.tech/tags/announcement.md>), [api](<https://devfeed.tech/tags/api.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [aws](<https://devfeed.tech/tags/aws.md>), [aws-inferentia](<https://devfeed.tech/tags/aws-inferentia.md>), [azure](<https://devfeed.tech/tags/azure.md>), [digitalocean](<https://devfeed.tech/tags/digitalocean.md>), [enterprise](<https://devfeed.tech/tags/enterprise.md>), [gcp](<https://devfeed.tech/tags/gcp.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [microservices](<https://devfeed.tech/tags/microservices.md>), [model-deployment](<https://devfeed.tech/tags/model-deployment.md>), [models](<https://devfeed.tech/tags/models.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [partnerships](<https://devfeed.tech/tags/partnerships.md>), [performance](<https://devfeed.tech/tags/performance.md>), [technologies](<https://devfeed.tech/tags/technologies.md>), [text-generation](<https://devfeed.tech/tags/text-generation.md>), [tgi](<https://devfeed.tech/tags/tgi.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

Hugging Face introduces HUGS, optimized zero-configuration inference microservices for deploying open models in an organization's own infrastructure. Built on Hugging Face technologies including Text Generation Inference and Transformers, HUGS targets efficient, hardware-optimized deployment across NVIDIA and AMD GPUs, with AWS Inferentia and Google TPU support planned. It provides an OpenAI-compatible API and is designed to reduce deployment complexity and time for AI applications.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Fixing Gradient Accumulation

DevFeed: [Fixing Gradient Accumulation](<https://devfeed.tech/articles/fixing-gradient-accumulation-7222.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/gradient_accumulation>)

Author: Lysandre; Arthur Zucker; Zachary Mueller; Yih-Dar SHIEH; Benjamin Bossan; Pedro Cuenca

Published: 2024-10-16T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [gradient\_accumulation](<https://devfeed.tech/topics/gradient-accumulation.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [bug](<https://devfeed.tech/tags/bug.md>), [gradient-accumulation](<https://devfeed.tech/tags/gradient-accumulation.md>), [training](<https://devfeed.tech/tags/training.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

The article explains a bug in gradient accumulation for token-level tasks, where averaging per-batch losses produced results that did not match full-batch training. It describes a fix that accounts for the total number of non-padding tokens and introduces an API for supplying custom loss functions.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Faster Assisted Generation with Dynamic Speculation

DevFeed: [Faster Assisted Generation with Dynamic Speculation](<https://devfeed.tech/articles/faster-assisted-generation-with-dynamic-speculation-7177.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/dynamic_speculation_lookahead>)

Author: Jonathan Mamou; Oren Pereg; Joao Gante; Lewis Tunstall; Daniel Korat; Nadav Timor; Moshe Wasserblat

Published: 2024-10-08T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [large-language-models](<https://devfeed.tech/topics/large-language-models.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [inference](<https://devfeed.tech/tags/inference.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [large-language-models](<https://devfeed.tech/tags/large-language-models.md>), [latency](<https://devfeed.tech/tags/latency.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [research](<https://devfeed.tech/tags/research.md>), [tokens](<https://devfeed.tech/tags/tokens.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

The article explains dynamic speculation lookahead for accelerating large language model inference through speculative decoding. A fast draft model generates candidate tokens, while a larger target model verifies them in parallel. It presents an oracle-based method that identifies the maximum number of draft tokens accepted at each iteration, aiming to reduce inference latency beyond static and heuristic schedules.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Llama can now see and run on your device - welcome Llama 3.2

DevFeed: [Llama can now see and run on your device - welcome Llama 3.2](<https://devfeed.tech/articles/llama-can-now-see-and-run-on-your-device-welcome-llama-3-2-7337.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/llama32>)

Author: merve; Philipp Schmid; Omar Sanseviero; Vaibhav Srivastav; Lewis Tunstall; Aritra Roy Gosthipaty; Pedro Cuenca

Published: 2024-09-25T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [llama](<https://devfeed.tech/topics/llama.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [Meta](<https://devfeed.tech/topics/meta.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>), [inference-endpoints](<https://devfeed.tech/topics/inference-endpoints.md>), [tgi](<https://devfeed.tech/topics/tgi.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [inference-endpoints](<https://devfeed.tech/tags/inference-endpoints.md>), [llama](<https://devfeed.tech/tags/llama.md>), [llm](<https://devfeed.tech/tags/llm.md>), [llms](<https://devfeed.tech/tags/llms.md>), [meta](<https://devfeed.tech/tags/meta.md>), [model](<https://devfeed.tech/tags/model.md>), [models](<https://devfeed.tech/tags/models.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>), [retrieval](<https://devfeed.tech/tags/retrieval.md>), [tgi](<https://devfeed.tech/tags/tgi.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

Meta's Llama 3.2 release introduces multimodal Vision models in 11B and 90B sizes, smaller text-only 1B and 3B models for on-device use, and vision-enabled Llama Guard 3. The article describes their capabilities, architecture, supported languages, inference examples, and integrations with Hugging Face Transformers, TGI, Inference Endpoints, Google Cloud, Amazon SageMaker, and DELL Enterprise Hub.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Improving Hugging Face Training Efficiency Through Packing with Flash Attention 2

DevFeed: [Improving Hugging Face Training Efficiency Through Packing with Flash Attention 2](<https://devfeed.tech/articles/improving-hugging-face-training-efficiency-through-packing-with-flash-attention-2-7433.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/packing-with-FA2>)

Author: Rhui Dih Lee; Arthur Zucker; Achintya Kundu; Laura Wynter; Raghu Ganti; Mayank Mishra

Published: 2024-08-21T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [datasets](<https://devfeed.tech/topics/datasets.md>)

Tags: [datasets](<https://devfeed.tech/tags/datasets.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [flash-attention-2](<https://devfeed.tech/tags/flash-attention-2.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [models](<https://devfeed.tech/tags/models.md>), [packing](<https://devfeed.tech/tags/packing.md>), [padding](<https://devfeed.tech/tags/padding.md>), [training](<https://devfeed.tech/tags/training.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

The article explains how Hugging Face improves training throughput by packing instruction-tuning sequences without padding while using Flash Attention 2. A new data collator preserves sequence boundaries and can provide up to 2x higher throughput while maintaining convergence quality, with measured gains varying by dataset and sequence-length variance.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Announcing New Hugging Face and KerasHub integration

DevFeed: [Announcing New Hugging Face and KerasHub integration](<https://devfeed.tech/articles/announcing-new-hugging-face-and-kerashub-integration-7301.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/keras-hub-integration>)

Author: Aritra Roy Gosthipaty

Published: 2024-07-10T00:00:00Z

Content type: news

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Keras](<https://devfeed.tech/topics/keras.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [gemma](<https://devfeed.tech/topics/gemma.md>), [llama](<https://devfeed.tech/topics/llama.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [gemma](<https://devfeed.tech/tags/gemma.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [json](<https://devfeed.tech/tags/json.md>), [keras](<https://devfeed.tech/tags/keras.md>), [llama](<https://devfeed.tech/tags/llama.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [open-source-collab](<https://devfeed.tech/tags/open-source-collab.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [tensorflow](<https://devfeed.tech/tags/tensorflow.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

The article announces an integration between Hugging Face Transformers and KerasHub through a shared model save format. It allows KerasHub users to load many Transformers checkpoints, initially including Gemma, Llama 3, and PaliGemma, and use them with TensorFlow, JAX, or PyTorch backends. The integration handles conversion of configuration variables, weight names, and tokenizer vocabularies internally.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Our Transformers Code Agent beats the GAIA benchmark 🏅

DevFeed: [Our Transformers Code Agent beats the GAIA benchmark 🏅](<https://devfeed.tech/articles/our-transformers-code-agent-beats-the-gaia-benchmark-7123.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/beating-gaia>)

Author: Aymeric Roucher; Sergei Petrov

Published: 2024-07-01T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [gaia](<https://devfeed.tech/topics/gaia.md>), [Benchmark](<https://devfeed.tech/topics/benchmark.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [smolagents](<https://devfeed.tech/topics/smolagents.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Graphs](<https://devfeed.tech/topics/graphs.md>), [Retrieval-Augmented Generation](<https://devfeed.tech/topics/retrieval-augmented-generation.md>)

Tags: [agent](<https://devfeed.tech/tags/agent.md>), [agents](<https://devfeed.tech/tags/agents.md>), [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [benchmark](<https://devfeed.tech/tags/benchmark.md>), [code](<https://devfeed.tech/tags/code.md>), [community](<https://devfeed.tech/tags/community.md>), [gaia](<https://devfeed.tech/tags/gaia.md>), [leaderboard](<https://devfeed.tech/tags/leaderboard.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [nlp](<https://devfeed.tech/tags/nlp.md>), [research](<https://devfeed.tech/tags/research.md>), [retrieval-augmented-generation](<https://devfeed.tech/tags/retrieval-augmented-generation.md>), [smolagents](<https://devfeed.tech/tags/smolagents.md>), [tool](<https://devfeed.tech/tags/tool.md>), [tools](<https://devfeed.tech/tags/tools.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

The article presents a Transformers Code Agent that achieved top performance on the GAIA benchmark. It explains how LLM-based agents use tools and dynamically change their execution graph, and notes that the framework has since been upgraded to the standalone smolagents library.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Introducing the Hugging Face Embedding Container for Amazon SageMaker

DevFeed: [Introducing the Hugging Face Embedding Container for Amazon SageMaker](<https://devfeed.tech/articles/introducing-the-hugging-face-embedding-container-for-amazon-sagemaker-7464.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/sagemaker-huggingface-embedding>)

Author: Philipp Schmid; Jeff Boudier

Published: 2024-06-07T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Amazon SageMaker](<https://devfeed.tech/topics/amazon-sagemaker.md>), [Amazon Bedrock](<https://devfeed.tech/topics/amazon-bedrock.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Embeddings](<https://devfeed.tech/topics/embeddings.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [sentence-transformers](<https://devfeed.tech/topics/sentence-transformers.md>), [AWS IAM](<https://devfeed.tech/topics/aws-iam.md>)

Tags: [amazon-sagemaker](<https://devfeed.tech/tags/amazon-sagemaker.md>), [aws](<https://devfeed.tech/tags/aws.md>), [batching](<https://devfeed.tech/tags/batching.md>), [cloud](<https://devfeed.tech/tags/cloud.md>), [container](<https://devfeed.tech/tags/container.md>), [embedding](<https://devfeed.tech/tags/embedding.md>), [embeddings](<https://devfeed.tech/tags/embeddings.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [partnership](<https://devfeed.tech/tags/partnership.md>), [prometheus](<https://devfeed.tech/tags/prometheus.md>), [sdk](<https://devfeed.tech/tags/sdk.md>), [sentence-transformers](<https://devfeed.tech/tags/sentence-transformers.md>), [telemetry](<https://devfeed.tech/tags/telemetry.md>), [tracing](<https://devfeed.tech/tags/tracing.md>)

### AI overview

This tutorial explains how to deploy open embedding models to Amazon SageMaker using the Hugging Face Embedding Container. It uses Text Embeddings Inference for efficient, production-ready serving and covers container selection, CPU and GPU variants, batching, and observability features.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Hugging Face redesigns Transformers documentation for developers building AI products

DevFeed: [Hugging Face redesigns Transformers documentation for developers building AI products](<https://devfeed.tech/articles/making-sense-of-this-mess-7534.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/transformers-docs-redesign>)

Author: Steven Liu

Published: 2024-06-07T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Transformers](<https://devfeed.tech/topics/transformers.md>), [Documentation](<https://devfeed.tech/topics/documentation.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [AI Development](<https://devfeed.tech/topics/ai-development.md>)

Tags: [community](<https://devfeed.tech/tags/community.md>), [developers](<https://devfeed.tech/tags/developers.md>), [documentation](<https://devfeed.tech/tags/documentation.md>), [how-to](<https://devfeed.tech/tags/how-to.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [transformers](<https://devfeed.tech/tags/transformers.md>)

### AI overview

Hugging Face describes a redesign of the Transformers documentation to address its disjointed structure and make it more useful for developers building AI products. The redesign emphasizes code-first, solution-oriented content, integrated explanations of beginner machine learning concepts, and progressive learning.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## PaliGemma - Google's Cutting-Edge Open Vision Language Model

DevFeed: [PaliGemma - Google's Cutting-Edge Open Vision Language Model](<https://devfeed.tech/articles/paligemma-google-s-cutting-edge-open-vision-language-model-7435.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/paligemma>)

Author: merve; Andreas P. Steiner; Pedro Cuenca

Published: 2024-05-14T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [vlm](<https://devfeed.tech/topics/vlm.md>), [Google](<https://devfeed.tech/topics/google.md>), [Transformers](<https://devfeed.tech/topics/transformers.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Human-AI evaluation](<https://devfeed.tech/topics/human-ai-evaluation.md>), [smolvlm](<https://devfeed.tech/topics/smolvlm.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [google](<https://devfeed.tech/tags/google.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [ocr](<https://devfeed.tech/tags/ocr.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [transformers](<https://devfeed.tech/tags/transformers.md>), [vision](<https://devfeed.tech/tags/vision.md>)

### AI overview

PaliGemma is a family of open vision-language models from Google that accepts images and text and produces text. The article describes its SigLIP image encoder, Gemma text decoder, model variants, resolutions, precisions, Transformers integration, and use for tasks such as captioning, referring segmentation, and OCR.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

[Next page](<https://devfeed.tech/topics/transformers.md?cursor=WyIyMDI0LTA1LTE0VDAwOjAwOjAwKzAwOjAwIiwgImRkZmUxYWZmLWY4MTYtNGRjMC04Yzc0LTc4OWIyNzFhY2Q0NiJd>)