# MediaPipe

Published articles for MediaPipe.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Building a Real-Time 3D Face Mask with MediaPipe, Threlte and Three.js

DevFeed: [Building a Real-Time 3D Face Mask with MediaPipe, Threlte and Three.js](<https://devfeed.tech/articles/building-a-real-time-3d-face-mask-with-mediapipe-threlte-and-three-js-4342.md>)

Original publisher: [Read original article](<https://tympanus.net/codrops/2026/09/06/building-a-real-time-3d-face-mask-with-mediapipe-threlte-and-three-js/>)

Author: Marek Jóźwiak

Published: 2026-09-06T13:09:52Z

Content type: tutorial

Language: en

Sources: [Codrops](<https://devfeed.tech/sources/codrops.md>)

Topics: [Three.js webcam](<https://devfeed.tech/topics/three-js-webcam.md>)

Tags: [3d](<https://devfeed.tech/tags/3d.md>), [3d-face-mask](<https://devfeed.tech/tags/3d-face-mask.md>), [canonical-face-model](<https://devfeed.tech/tags/canonical-face-model.md>), [creative-coding](<https://devfeed.tech/tags/creative-coding.md>), [face-landmarks](<https://devfeed.tech/tags/face-landmarks.md>), [face-mesh](<https://devfeed.tech/tags/face-mesh.md>), [face-tracking](<https://devfeed.tech/tags/face-tracking.md>), [facial-landmarks](<https://devfeed.tech/tags/facial-landmarks.md>), [generative-graphics](<https://devfeed.tech/tags/generative-graphics.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [inference](<https://devfeed.tech/tags/inference.md>), [interactive-3d](<https://devfeed.tech/tags/interactive-3d.md>), [javascript-3d](<https://devfeed.tech/tags/javascript-3d.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [mediapipe-face-landmarker](<https://devfeed.tech/tags/mediapipe-face-landmarker.md>), [mesh](<https://devfeed.tech/tags/mesh.md>), [real-time](<https://devfeed.tech/tags/real-time.md>), [real-time-3d](<https://devfeed.tech/tags/real-time-3d.md>), [real-time-face-tracking](<https://devfeed.tech/tags/real-time-face-tracking.md>), [svelte](<https://devfeed.tech/tags/svelte.md>), [three-js](<https://devfeed.tech/tags/three-js.md>), [three-js-face-mask](<https://devfeed.tech/tags/three-js-face-mask.md>), [three-js-webcam](<https://devfeed.tech/tags/three-js-webcam.md>), [threlte](<https://devfeed.tech/tags/threlte.md>), [threlte-three-js](<https://devfeed.tech/tags/threlte-three-js.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>), [tutorials](<https://devfeed.tech/tags/tutorials.md>), [video](<https://devfeed.tech/tags/video.md>), [vision](<https://devfeed.tech/tags/vision.md>), [wasm](<https://devfeed.tech/tags/wasm.md>), [webcam](<https://devfeed.tech/tags/webcam.md>), [webcam-effects](<https://devfeed.tech/tags/webcam-effects.md>), [webcam-face-tracking](<https://devfeed.tech/tags/webcam-face-tracking.md>), [webgl](<https://devfeed.tech/tags/webgl.md>), [webgl-face-tracking](<https://devfeed.tech/tags/webgl-face-tracking.md>)

### AI overview

Tutorial on building a real-time textured 3D face mask by mapping MediaPipe face landmarks onto a Three.js mesh with Threlte.

### Source excerpt

Learn how MediaPipe's face landmarks, Google's canonical face model, and Three.js come together to create a real-time textured 3D face mask.

## Building an AI Tennis Coach with MediaPipe and Claude

DevFeed: [Building an AI Tennis Coach with MediaPipe and Claude](<https://devfeed.tech/articles/building-an-ai-tennis-coach-with-mediapipe-and-claude-39645.md>)

Original publisher: [Read original article](<https://www.gauravsarma.com/posts/2026-02-25_building-ai-tennis-coach-mediapipe-claude>)

Published: 2026-02-25T00:00:00Z

Content type: tutorial

Language: en

Sources: [Gaurav Sarma's Blog](<https://devfeed.tech/sources/gaurav-sarma-s-blog.md>)

Topics: [Streamlit](<https://devfeed.tech/topics/streamlit.md>), [MediaPipe Face Landmarker](<https://devfeed.tech/topics/mediapipe-face-landmarker.md>), [Claude](<https://devfeed.tech/topics/claude.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Code](<https://devfeed.tech/topics/code.md>), [math](<https://devfeed.tech/topics/math.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [app](<https://devfeed.tech/tags/app.md>), [building](<https://devfeed.tech/tags/building.md>), [code](<https://devfeed.tech/tags/code.md>), [floating-point](<https://devfeed.tech/tags/floating-point.md>), [laptop](<https://devfeed.tech/tags/laptop.md>), [math](<https://devfeed.tech/tags/math.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [pipeline](<https://devfeed.tech/tags/pipeline.md>), [speed](<https://devfeed.tech/tags/speed.md>)

### AI overview

This tutorial explains how to build a Streamlit AI tennis-coaching app using MediaPipe pose detection and Claude. The pipeline analyzes uploaded tennis video, calculates joint angles and swing timing, overlays a skeleton on the footage, and generates coaching feedback grounded in the computed measurements.

### Source excerpt

. [Building an AI Tennis Coach with MediaPipe and Claude](building-an-ai-tennis-coach-mediapipe-claude-cover...

## Arm & ExecuTorch 0.7: Bringing Generative AI to the masses

DevFeed: [Arm & ExecuTorch 0.7: Bringing Generative AI to the masses](<https://devfeed.tech/articles/arm-executorch-0-7-bringing-generative-ai-to-the-masses-6987.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/Arm/executorch-0-dot-7>)

Author: EricSondhi; Gian Marco Iodice

Published: 2025-08-13T14:55:10Z

Content type: article

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [Arm](<https://devfeed.tech/topics/arm.md>), [Generative AI](<https://devfeed.tech/topics/generative-ai.md>), [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [AI Inference](<https://devfeed.tech/topics/ai-inference.md>), [cpu](<https://devfeed.tech/topics/cpu.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [Raspberry Pi](<https://devfeed.tech/topics/raspberry-pi.md>), [Latency](<https://devfeed.tech/topics/latency.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-accelerator](<https://devfeed.tech/tags/ai-accelerator.md>), [android](<https://devfeed.tech/tags/android.md>), [arm](<https://devfeed.tech/tags/arm.md>), [cpu](<https://devfeed.tech/tags/cpu.md>), [cross-platform](<https://devfeed.tech/tags/cross-platform.md>), [developers](<https://devfeed.tech/tags/developers.md>), [edge-ai](<https://devfeed.tech/tags/edge-ai.md>), [generative](<https://devfeed.tech/tags/generative.md>), [generative-ai](<https://devfeed.tech/tags/generative-ai.md>), [large-language-models-llms](<https://devfeed.tech/tags/large-language-models-llms.md>), [latency](<https://devfeed.tech/tags/latency.md>), [llama-cpp](<https://devfeed.tech/tags/llama-cpp.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [memory](<https://devfeed.tech/tags/memory.md>), [onnx](<https://devfeed.tech/tags/onnx.md>), [performance](<https://devfeed.tech/tags/performance.md>), [raspberry-pi](<https://devfeed.tech/tags/raspberry-pi.md>), [smartphones](<https://devfeed.tech/tags/smartphones.md>)

### AI overview

Arm's KleidiAI will be enabled by default in the upcoming ExecuTorch 0.7 beta, providing automatic AI acceleration through ExecuTorch and XNNPack on current and older Arm-based devices. The article explains how this can improve model startup time, latency, and memory efficiency, making Generative AI and large language models more practical on mobile devices and Raspberry Pi 5. It also describes how the Arm SDOT instruction accelerates low-precision matrix multiplication used by LLMs.

### Source excerpt

With Arm's recent SME2 announcement, the role of Arm KleidiAI is increasingly clear as Arm's AI accelerator layer powering the next wave of AI. By embedding into widely-used Edge AI frameworks like XNNPack, MediaPipe, MNN, ONNX Runtime, and even llama.cpp, KleidiAI has delivered substantial performance improvements with no code changes required by developers.

## Getting Started with Gemma 3 LLM on Android for On-Device Inference

DevFeed: [Getting Started with Gemma 3 LLM on Android for On-Device Inference](<https://devfeed.tech/articles/get-started-with-gemma-3-llm-on-android-now-24908.md>)

Original publisher: [Read original article](<https://blog.blundellapps.co.uk/get-started-with-gemma-3-llm-on-android-now/>)

Author: blundell

Published: 2025-03-12T22:11:14Z

Content type: tutorial

Language: en

Sources: [Blundell](<https://devfeed.tech/sources/blundell.md>)

Topics: [gemma](<https://devfeed.tech/topics/gemma.md>), [On-device AI](<https://devfeed.tech/topics/on-device-ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Android](<https://devfeed.tech/topics/android.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [MediaPipe](<https://devfeed.tech/topics/mediapipe.md>), [App](<https://devfeed.tech/topics/app.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>)

Tags: [android](<https://devfeed.tech/tags/android.md>), [androiddev](<https://devfeed.tech/tags/androiddev.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gemma](<https://devfeed.tech/tags/gemma.md>), [inference](<https://devfeed.tech/tags/inference.md>), [intermediate](<https://devfeed.tech/tags/intermediate.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [reference](<https://devfeed.tech/tags/reference.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

### AI overview

A tutorial for integrating the Gemma 3 1B open-weight language model into an Android app for on-device inference. It covers downloading the model after installation, using MediaPipe for inference, and the trade-offs involving model size, performance, and device compatibility.

### Source excerpt

This post gets you started with the new Gemma 3 model for on-device inference. Giving you the simplest steps to get started with AI on Android. Gemma 3 1B is a new model size in the Gemma family of open weight models. When deploying small language models (SLMs) in production settings, models need to be small [...] The post Get started with Gemma 3 LLM on Android now! first appeared on Blundell.

## AI Image Classification for PEZ Collectors | Vertex AI & MediaPipe on Android

DevFeed: [AI Image Classification for PEZ Collectors | Vertex AI & MediaPipe on Android](<https://devfeed.tech/articles/ai-image-classification-for-pez-collectors-vertex-ai-mediapipe-on-android-41667.md>)

Original publisher: [Read original article](<http://mikewolfson.com/blog/2023/12/6/3gffavrqiz0mmay1hk8vx6dsvdmmr3>)

Author: Mike Wolfson

Published: 2024-03-26T18:00:00Z

Content type: tutorial

Language: en

Sources: [My Big Appetite - Mike Wolfson](<https://devfeed.tech/sources/my-big-appetite-mike-wolfson.md>)

Topics: [Artificial Intelligence](<https://devfeed.tech/topics/ai.md>), [data](<https://devfeed.tech/topics/data.md>), [App](<https://devfeed.tech/topics/app.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [Website](<https://devfeed.tech/topics/website.md>), [MediaPipe](<https://devfeed.tech/topics/mediapipe.md>), [Google](<https://devfeed.tech/topics/google.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [android](<https://devfeed.tech/tags/android.md>), [app](<https://devfeed.tech/tags/app.md>), [classification](<https://devfeed.tech/tags/classification.md>), [data](<https://devfeed.tech/tags/data.md>), [dataset](<https://devfeed.tech/tags/dataset.md>), [devices](<https://devfeed.tech/tags/devices.md>), [google](<https://devfeed.tech/tags/google.md>), [image-classification](<https://devfeed.tech/tags/image-classification.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [pez](<https://devfeed.tech/tags/pez.md>), [tech](<https://devfeed.tech/tags/tech.md>), [vertex](<https://devfeed.tech/tags/vertex.md>), [vertex-ai](<https://devfeed.tech/tags/vertex-ai.md>)

### AI overview

This tutorial describes building an image-classification model to distinguish visually similar PEZ dispensers. It covers creating a labeled photo dataset, training the model with Vertex AI, and using MediaPipe to support integration on smartphones or websites.

### Source excerpt

I've always had a soft spot for PEZ dispensers and have been collecting them for over 30 years. These quirky little collectibles come in an incredible variety of shapes and characters. But there's more to PEZ than just fun; some dispensers can be quite valuable depending on their age and variation. To address the challenge of identification, I harnessed the power of AI to create an image classification model that could help identify these subtle differences. Use Case: Identifying PEZ dispensers Identifying the precise type of PEZ dispenser isn't always easy. Take Mickey Mouse dispensers, for example. While even a novice collector can broadly identify it as Mickey, subtle differences in the face or eyes could separate a common version from a prized rarity. A $1 Mickey and a $150 Mickey can look awfully similar. To illustrate the problem, these Mickey Mouse dispensers look similar, but are worth drastically different amounts (from left-to-right). Mickey Die-Cut (1961) - $125 Mickey B (1989) - $15 Mickey C (1997) - $1 It is fairly easy for even an untrained human to tell the difference between these dispensers. There are obvious differences between the shape of the face, and the eyes. Could a Computer Tell the Difference? I decided to see if I could train a custom image classification model to distinguish between PEZ dispensers. That model, in theory, could be embedded into a mobile app or a website, giving PEZ enthusiasts a tool to aid in identification. For this project, I embraced technologies from Google: Vertex AI to manage my image dataset and train the model, and MediaPipe for easy integration onto edge devices like smartphones. Step 1: Picture This - Building the Dataset Like any good AI project, I needed data. My original plan was to scrape images from the web, but there simply weren't enough consistent, high-quality pictures for the level of detail I wanted. The best solution? Become a PEZ photographer! I gathered a dozen dispensers from my collection and met

## MobileDiffusion: Rapid text-to-image generation on-device

DevFeed: [MobileDiffusion: Rapid text-to-image generation on-device](<https://devfeed.tech/articles/mobilediffusion-rapid-text-to-image-generation-on-device-28544.md>)

Original publisher: [Read original article](<http://blog.research.google/2024/01/mobilediffusion-rapid-text-to-image.html>)

Author: Google AI (noreply@blogger.com)

Published: 2024-01-31T21:59:00Z

Content type: article

Language: en

Sources: [Google Research](<https://devfeed.tech/sources/google-research.md>)

Topics: [Machine learning](<https://devfeed.tech/topics/machine-learning.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [text-to-image](<https://devfeed.tech/topics/text-to-image.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [model-deployment](<https://devfeed.tech/topics/model-deployment.md>), [Optimization](<https://devfeed.tech/topics/optimization.md>), [Android](<https://devfeed.tech/topics/android.md>), [iOS](<https://devfeed.tech/topics/ios.md>), [MediaPipe](<https://devfeed.tech/topics/mediapipe.md>)

Tags: [android](<https://devfeed.tech/tags/android.md>), [computer-vision](<https://devfeed.tech/tags/computer-vision.md>), [deployment](<https://devfeed.tech/tags/deployment.md>), [diffusion](<https://devfeed.tech/tags/diffusion.md>), [generation](<https://devfeed.tech/tags/generation.md>), [image](<https://devfeed.tech/tags/image.md>), [inference](<https://devfeed.tech/tags/inference.md>), [ios](<https://devfeed.tech/tags/ios.md>), [machine-learning](<https://devfeed.tech/tags/machine-learning.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [on-device-learning](<https://devfeed.tech/tags/on-device-learning.md>), [optimization](<https://devfeed.tech/tags/optimization.md>), [text-to-image](<https://devfeed.tech/tags/text-to-image.md>)

### AI overview

Google researchers introduce MobileDiffusion, a latent diffusion model designed for on-device text-to-image generation. Using DiffusionGAN for one-step sampling, it was tested on premium iOS and Android devices and generated 512x512 images in about half a second with a 520-million-parameter model.

### Source excerpt

Posted by Yang Zhao, Senior Software Engineer, and Tingbo Hou, Senior Staff Software Engineer, Core ML Text-to-image diffusion models have shown exceptional capabilities in generating high-quality images from text prompts. However, leading models feature billions of parameters and are consequently expensive to run, requiring powerful desktops or servers (e.g., Stable Diffusion, DALL-E, and Imagen). While recent advancements in inference solutions on Android via MediaPipe and iOS via Core ML have been made in the past year, rapid (sub-second) text-to-image generation on mobile devices has remained out of reach. To that end, in "MobileDiffusion: Subsecond Text-to-Image Generation on Mobile Devices", we introduce a novel approach with the potential for rapid text-to-image generation on-device. MobileDiffusion is an efficient latent diffusion model specifically designed for mobile devices. We also adopt DiffusionGAN to achieve one-step sampling during inference, which fine-tunes a pre-trained diffusion model while leveraging a GAN to model the denoising step. We have tested MobileDiffusion on iOS and Android premium devices, and it can run in half a second to generate a 512x512 high-quality image. Its comparably small model size of just 520M parameters makes it uniquely suited for mobile deployment. Rapid text-to-image generation on-device. Background The relative inefficiency of text-to-image diffusion models arises from two primary challenges. First, the inherent design of diffusion models requires iterative denoising to generate images, necessitating multiple evaluations of the model. Second, the complexity of the network architecture in text-to-image diffusion models involves a substantial number of parameters, regularly reaching into the billions and resulting in computationally expensive evaluations. As a result, despite the potential benefits of deploying generative models on mobile devices, such as enhancing user experience and addressing emerging privacy concer