# Arm & ExecuTorch 0.7: Bringing Generative AI to the masses

DevFeed: [Arm & ExecuTorch 0.7: Bringing Generative AI to the masses](<https://devfeed.tech/articles/arm-executorch-0-7-bringing-generative-ai-to-the-masses-6987.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/Arm/executorch-0-dot-7>)

Author: EricSondhi; Gian Marco Iodice

Published: 2025-08-13T14:55:10Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Arm](<https://devfeed.tech/topics/arm.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [Raspberry Pi](<https://devfeed.tech/topics/raspberry-pi.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-accelerator](<https://devfeed.tech/tags/ai-accelerator.md>), [android](<https://devfeed.tech/tags/android.md>), [arm](<https://devfeed.tech/tags/arm.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cross-platform](<https://devfeed.tech/tags/cross-platform.md>), [developers](<https://devfeed.tech/tags/developers.md>), [edge-ai](<https://devfeed.tech/tags/edge-ai.md>), [generative](<https://devfeed.tech/tags/generative.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [memory](<https://devfeed.tech/tags/memory.md>), [onnx](<https://devfeed.tech/tags/onnx.md>), [performance](<https://devfeed.tech/tags/performance.md>), [raspberry-pi](<https://devfeed.tech/tags/raspberry-pi.md>), [smartphones](<https://devfeed.tech/tags/smartphones.md>)

## AI overview

Arm's KleidiAI will be enabled by default in the upcoming ExecuTorch 0.7 beta, providing automatic AI acceleration through ExecuTorch and XNNPack on current and older Arm-based devices. The article explains how this can improve model startup time, latency, and memory efficiency, making Generative AI and large language models more practical on mobile devices and Raspberry Pi 5. It also describes how the Arm SDOT instruction accelerates low-precision matrix multiplication used by LLMs.

## Source excerpt

With Arm's recent SME2 announcement, the role of Arm KleidiAI is increasingly clear as Arm's AI accelerator layer powering the next wave of AI. By embedding into widely-used Edge AI frameworks like XNNPack, MediaPipe, MNN, ONNX Runtime, and even llama.cpp, KleidiAI has delivered substantial performance improvements with no code changes required by developers.