# xformers

Published articles for xformers.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Profiling in PyTorch (Part 3): Attention is all you profile

DevFeed: [Profiling in PyTorch (Part 3): Attention is all you profile](<https://devfeed.tech/articles/profiling-in-pytorch-part-3-attention-is-all-you-profile-7521.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/torch-attention-profile>)

Author: Aritra Roy Gosthipaty; Sergio Paniego; Sayak Paul; Rémi Ouazan Reboul

Published: 2026-07-10T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [AI, ML & Data Engineering](<https://devfeed.tech/topics/ai-ml-data-engineering.md>), [jobs](<https://devfeed.tech/topics/jobs.md>), [cpu](<https://devfeed.tech/topics/cpu.md>)

Tags: [artificial-intelligence](<https://devfeed.tech/tags/artificial-intelligence.md>), [cudnn](<https://devfeed.tech/tags/cudnn.md>), [flash](<https://devfeed.tech/tags/flash.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [jobs](<https://devfeed.tech/tags/jobs.md>), [kernel](<https://devfeed.tech/tags/kernel.md>), [profile](<https://devfeed.tech/tags/profile.md>), [pytorch](<https://devfeed.tech/tags/pytorch.md>), [torch](<https://devfeed.tech/tags/torch.md>), [traces](<https://devfeed.tech/tags/traces.md>), [xformers](<https://devfeed.tech/tags/xformers.md>)

### AI overview

A PyTorch profiling tutorial examines naive attention, identifying its primitive operations and the CPU and GPU kernels they launch.

### Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.