# Getting Started with Gemma 3 LLM on Android for On-Device Inference

DevFeed: [Getting Started with Gemma 3 LLM on Android for On-Device Inference](<https://devfeed.tech/articles/get-started-with-gemma-3-llm-on-android-now-24908.md>)

Original publisher: [Read original article](<https://blog.blundellapps.co.uk/get-started-with-gemma-3-llm-on-android-now/>)

Author: blundell

Published: 2025-03-12T22:11:14Z

Content type: tutorial

Language: en

Sources: [Blundell](<https://devfeed.tech/sources/blundell.md>)

Topics: [gemma](<https://devfeed.tech/topics/gemma.md>), [On-device AI](<https://devfeed.tech/topics/on-device-ai.md>), [Large Language Model](<https://devfeed.tech/topics/llm.md>), [Android](<https://devfeed.tech/topics/android.md>), [Inference](<https://devfeed.tech/topics/inference.md>), [MediaPipe](<https://devfeed.tech/topics/mediapipe.md>), [App](<https://devfeed.tech/topics/app.md>), [Fine-tuning](<https://devfeed.tech/topics/fine-tuning.md>)

Tags: [android](<https://devfeed.tech/tags/android.md>), [androiddev](<https://devfeed.tech/tags/androiddev.md>), [fine-tuning](<https://devfeed.tech/tags/fine-tuning.md>), [gemma](<https://devfeed.tech/tags/gemma.md>), [inference](<https://devfeed.tech/tags/inference.md>), [intermediate](<https://devfeed.tech/tags/intermediate.md>), [llm](<https://devfeed.tech/tags/llm.md>), [mediapipe](<https://devfeed.tech/tags/mediapipe.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [reference](<https://devfeed.tech/tags/reference.md>), [tutorial](<https://devfeed.tech/tags/tutorial.md>)

## AI overview

A tutorial for integrating the Gemma 3 1B open-weight language model into an Android app for on-device inference. It covers downloading the model after installation, using MediaPipe for inference, and the trade-offs involving model size, performance, and device compatibility.

## Source excerpt

This post gets you started with the new Gemma 3 model for on-device inference. Giving you the simplest steps to get started with AI on Android. Gemma 3 1B is a new model size in the Gemma family of open weight models. When deploying small language models (SLMs) in production settings, models need to be small [...] The post Get started with Gemma 3 LLM on Android now! first appeared on Blundell.