# diffusion-transformers

Transformer-based diffusion-model architecture that replaces a U-Net backbone with a transformer operating on latent image patches.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Bringing Nunchaku 4-bit Diffusion Inference to Diffusers

DevFeed: [Bringing Nunchaku 4-bit Diffusion Inference to Diffusers](<https://devfeed.tech/articles/bringing-nunchaku-4-bit-diffusion-inference-to-diffusers-7368.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/nunchaku-diffusers>)

Author: Pham Hong Vinh; Sayak Paul

Published: 2026-07-23T00:00:00Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [diffusers](<https://devfeed.tech/topics/diffusers.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [NVFP4](<https://devfeed.tech/topics/nvfp4.md>), [GPU](<https://devfeed.tech/topics/gpu.md>), [NCCL](<https://devfeed.tech/topics/nccl.md>)

Tags: [diffusers](<https://devfeed.tech/tags/diffusers.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [diffusion-transformers](<https://devfeed.tech/tags/diffusion-transformers.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [hardware](<https://devfeed.tech/tags/hardware.md>), [inference](<https://devfeed.tech/tags/inference.md>), [kernels](<https://devfeed.tech/tags/kernels.md>), [memory](<https://devfeed.tech/tags/memory.md>), [nvfp4](<https://devfeed.tech/tags/nvfp4.md>), [nvidia](<https://devfeed.tech/tags/nvidia.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [speed](<https://devfeed.tech/tags/speed.md>)

### AI overview

This article explains how Nunchaku brings 4-bit diffusion inference to Hugging Face Diffusers. It describes SVDQuant's W4A4 approach, integration of pre-quantized checkpoints without local CUDA compilation, and hardware requirements for NVFP4 and INT4 variants.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Mistral's Open TTS, Anthropic's Activation Translator, and Matt Pocock's Skills Repo: Tokenizer #28

DevFeed: [Mistral's Open TTS, Anthropic's Activation Translator, and Matt Pocock's Skills Repo: Tokenizer #28](<https://devfeed.tech/articles/mistral-s-open-tts-anthropic-s-activation-translator-and-matt-pocock-s-skills-repo-tokenizer-28-18343.md>)

Original publisher: [Read original article](<https://newsletter.artofsaience.com/p/mistrals-open-tts-anthropics-activation>)

Author: Sairam Sundaresan

Published: 2026-05-17T16:49:38Z

Content type: article

Language: en

Sources: [Gradient Ascent](<https://devfeed.tech/sources/gradient-ascent.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [anthropic](<https://devfeed.tech/topics/anthropic.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [MCP](<https://devfeed.tech/topics/mcp.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [Retrieval Augmented Generation (RAG)](<https://devfeed.tech/topics/retrieval-augmented-generation-rag.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [anthropic](<https://devfeed.tech/tags/anthropic.md>), [articles](<https://devfeed.tech/tags/articles.md>), [claude](<https://devfeed.tech/tags/claude.md>), [github](<https://devfeed.tech/tags/github.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [mcp](<https://devfeed.tech/tags/mcp.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [rag](<https://devfeed.tech/tags/rag.md>), [safety](<https://devfeed.tech/tags/safety.md>)

### AI overview

A weekly AI and machine learning resource roundup covering Anthropic safety evaluation work, large-model training on a single GPU, unified multimodal video generation, agent systems, semantic code search, and related papers, videos, articles, tools, and learning resources.

### Source excerpt

This week's most valuable resources

## Netflix's VOID: Fixing the Physics Problem in Video Editing

DevFeed: [Netflix's VOID: Fixing the Physics Problem in Video Editing](<https://devfeed.tech/articles/netflix-s-void-fixing-the-physics-problem-in-video-editing-28523.md>)

Original publisher: [Read original article](<https://blog.risingstack.com/netflix-void/>)

Author: RisingStack Engineering

Published: 2026-04-06T22:41:15Z

Content type: article

Language: en

Sources: [RisingStack](<https://devfeed.tech/sources/risingstack.md>)

Topics: [AI Models](<https://devfeed.tech/topics/ai-models.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [Netflix](<https://devfeed.tech/topics/netflix.md>), [Simulation](<https://devfeed.tech/topics/simulation.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-models](<https://devfeed.tech/tags/ai-models.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [netflix](<https://devfeed.tech/tags/netflix.md>), [simulation](<https://devfeed.tech/tags/simulation.md>), [training](<https://devfeed.tech/tags/training.md>), [video](<https://devfeed.tech/tags/video.md>)

### AI overview

The article explains Netflix's VOID model for removing objects from videos while also recomputing their downstream physical effects. It describes VOID as a counterfactual video-generation system using video diffusion and training data produced with physics simulation and human-object interaction data.

### Source excerpt

There's a familiar trick in modern video editing with AI - taking an object out, slapping some new background in, - and calling it good. It does the trick for simple things, but it all falls apart the moment the object actually starts to move or interact with anything. Take a domino chain for example, [...] The post Netflix's VOID: Fixing the Physics Problem in Video Editing appeared first on RisingStack Engineering.

## LLaDA: A Diffusion-Based Language Model for Revisable Text Generation

DevFeed: [LLaDA: A Diffusion-Based Language Model for Revisable Text Generation](<https://devfeed.tech/articles/llada-llms-that-don-t-gaslight-you-33456.md>)

Original publisher: [Read original article](<https://timkellogg.me/blog/2025/02/17/diffusion>)

Published: 2025-02-17T00:00:00Z

Content type: article

Language: en

Sources: [Tim Kellogg](<https://devfeed.tech/sources/tim-kellogg.md>)

Topics: [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI Architecture](<https://devfeed.tech/topics/ai-architecture.md>)

Tags: [ai-architecture](<https://devfeed.tech/tags/ai-architecture.md>), [consistency](<https://devfeed.tech/tags/consistency.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [hallucinations](<https://devfeed.tech/tags/hallucinations.md>), [language](<https://devfeed.tech/tags/language.md>), [llms](<https://devfeed.tech/tags/llms.md>), [model](<https://devfeed.tech/tags/model.md>)

### AI overview

The article introduces LLaDA, a language model that uses diffusion rather than autoregressive next-token prediction. It explains how this approach can generate and revise text globally, potentially helping with hallucinations, reasoning loops, and coherence in structured writing such as contracts.

### Source excerpt

A new language model uses diffusion instead of next-token prediction. That means the text it can back out of a hallucination before it commits. This is a big win for areas like law & contracts, where global consistency is valued

## Memory-efficient Diffusion Transformers with Quanto and Diffusers

DevFeed: [Memory-efficient Diffusion Transformers with Quanto and Diffusers](<https://devfeed.tech/articles/memory-efficient-diffusion-transformers-with-quanto-and-diffusers-7450.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/quanto-diffusers>)

Author: Sayak Paul; David Corvoysier

Published: 2024-07-30T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [diffusers](<https://devfeed.tech/topics/diffusers.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [optimum](<https://devfeed.tech/topics/optimum.md>), [PyTorch](<https://devfeed.tech/topics/pytorch.md>), [stable-diffusion](<https://devfeed.tech/topics/stable-diffusion.md>), [text-to-image](<https://devfeed.tech/topics/text-to-image.md>), [benchmarking](<https://devfeed.tech/topics/benchmarking.md>)

Tags: [benchmarking](<https://devfeed.tech/tags/benchmarking.md>), [diffusers](<https://devfeed.tech/tags/diffusers.md>), [diffusion-transformers](<https://devfeed.tech/tags/diffusion-transformers.md>), [efficiency](<https://devfeed.tech/tags/efficiency.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [guide](<https://devfeed.tech/tags/guide.md>), [optimum](<https://devfeed.tech/tags/optimum.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [quality](<https://devfeed.tech/tags/quality.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [sd3](<https://devfeed.tech/tags/sd3.md>), [text-to-image](<https://devfeed.tech/tags/text-to-image.md>)

### AI overview

This tutorial explains how to reduce the memory requirements of Transformer-based diffusion pipelines using Quanto quantization utilities from the Diffusers library. It benchmarks FP8 quantization on PixArt-Sigma, Stable Diffusion 3, and Aura Flow, reporting memory savings with slightly higher latency and little quality degradation.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Diffusers welcomes Stable Diffusion 3

DevFeed: [Diffusers welcomes Stable Diffusion 3](<https://devfeed.tech/articles/diffusers-welcomes-stable-diffusion-3-7469.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/sd3>)

Author: Dhruv Nair; YiYi Xu; Sayak Paul; Alvaro Somoza; Kashif Rasul; Apolinário from multimodal AI art

Published: 2024-06-12T00:00:00Z

Content type: release

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [stable-diffusion](<https://devfeed.tech/topics/stable-diffusion.md>), [diffusers](<https://devfeed.tech/topics/diffusers.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [text-to-image](<https://devfeed.tech/topics/text-to-image.md>), [multimodal](<https://devfeed.tech/topics/multimodal.md>), [lora](<https://devfeed.tech/topics/lora.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [diffusers](<https://devfeed.tech/tags/diffusers.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [guide](<https://devfeed.tech/tags/guide.md>), [inference](<https://devfeed.tech/tags/inference.md>), [lora](<https://devfeed.tech/tags/lora.md>), [multimodal](<https://devfeed.tech/tags/multimodal.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [sd3](<https://devfeed.tech/tags/sd3.md>), [stable-diffusion](<https://devfeed.tech/tags/stable-diffusion.md>), [text-to-image](<https://devfeed.tech/tags/text-to-image.md>)

### AI overview

The article announces Stable Diffusion 3 Medium, a 2B-parameter latent diffusion model. It describes the MMDiT architecture, multimodal text and image processing, rectified flow matching, inference support through a new scheduler, and accompanying Diffusers, DreamBooth, and LoRA resources.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.

## Random Things I Liked, Mar 2023

DevFeed: [Random Things I Liked, Mar 2023](<https://devfeed.tech/articles/random-things-i-liked-mar-2023-38431.md>)

Original publisher: [Read original article](<https://khmylov.com/2023/03/random-things-i-liked-mar-2023/>)

Author: Andrew Khmylov

Published: 2023-03-27T00:00:00Z

Content type: opinion

Language: en

Sources: [Despite the odds](<https://devfeed.tech/sources/despite-the-odds.md>)

Topics: [LLMs](<https://devfeed.tech/topics/llms.md>), [AsyncAPI Specification](<https://devfeed.tech/topics/asyncapi.md>), [diffusion-transformers](<https://devfeed.tech/topics/diffusion-transformers.md>), [Concurrent Programming](<https://devfeed.tech/topics/concurrent-programming.md>), [Prompt Engineering](<https://devfeed.tech/topics/prompt-engineering.md>), [OCaml](<https://devfeed.tech/topics/ocaml.md>), [OpenAPI Specification](<https://devfeed.tech/topics/openapi.md>)

Tags: [diffusion](<https://devfeed.tech/tags/diffusion.md>), [language-models](<https://devfeed.tech/tags/language-models.md>), [ocaml](<https://devfeed.tech/tags/ocaml.md>), [openapi](<https://devfeed.tech/tags/openapi.md>), [programming](<https://devfeed.tech/tags/programming.md>), [reasoning](<https://devfeed.tech/tags/reasoning.md>)

### AI overview

A personal roundup of developer topics and papers the author liked in March 2023, covering Automerge 2.0, AsyncAPI for event-based architecture, using external tools with large language models, diffusion-based image reconstruction from brain activity, effect handlers in OCaml, and prompt-based perspectives on LLM behavior.

### Source excerpt

Automerge 2.0 https://automerge.org/blog/automerge-2/ The complete rewrite of Automerge dropped right after discussing CRDTs optimizations the last time, addressing performance concerns. AsyncAPI https://www.asyncapi.com/docs It's like Swagger/OpenAPI, but for event-based architecture. I've been working with events and messages for quite a long time now, and tried some approaches to spec description, like Protocol Buffers, but it just didn't feel right. Too much hassle and not so much benefits. I'm eager to try this one though. LLMs + external tools = 🔥 As of today, large language models are trained on "static" data sets, they don't have a memory, and don't know about the world around them. However, if the only thing they do and do so extremely well is predicting next token, it's only natural to wonder "why can't we teach the model to predict some API call when it needs external data?". There have been a couple of papers on that topic: Toolformer: Language Models Can Teach Themselves to Use Tools ReAct: Synergizing Reasoning and Acting in Language Models Reading your mind with diffusion models I've already noticed multiple times that casual news headlines today sound exactly like futuristic imaginations from the original Deus Ex game, but this paper, "High-resolution image reconstruction with latent diffusion models from human brain activity", takes it to the next level. The research behind this has been going on for more than a decade, and the recent advances in computational capabilities and diffusion models accelerated the progress. Concurrent Programming with Effect Handlers https://github.com/ocaml-multicore/ocaml-effects-tutorial Every developer is familiar with exceptions. Algebraic effects take them to the next level of abstraction, and expose the manipulation of control flow as a first-class citizen. This is a nice write-up and a collection of examples of various effects implementations in OCaml. The Waluigi Effect https://www.lesswrong.com/posts/D7PumeYTDP