# Build intelligent Android apps: On-device inference

DevFeed: [Build intelligent Android apps: On-device inference](<https://devfeed.tech/articles/build-intelligent-android-apps-on-device-inference-4221.md>)

Original publisher: [Read original article](<https://android-developers.googleblog.com/2026/07/android-on-device-inference.html>)

Author: Android Developers (noreply@blogger.com)

Published: 2026-07-21T13:00:00Z

Content type: article

Language: en

Sources: [Android Developers Blog](<https://devfeed.tech/sources/android-developers-blog.md>), [Android Developers Blog](<https://devfeed.tech/sources/android-developers-blog-2.md>)

Topics: [AI Chat](<https://devfeed.tech/topics/ai-chat.md>)

Tags: [android](<https://devfeed.tech/tags/android.md>), [api](<https://devfeed.tech/tags/api.md>), [gemini](<https://devfeed.tech/tags/gemini.md>), [inference](<https://devfeed.tech/tags/inference.md>), [llm](<https://devfeed.tech/tags/llm.md>), [model](<https://devfeed.tech/tags/model.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [performance](<https://devfeed.tech/tags/performance.md>), [privacy](<https://devfeed.tech/tags/privacy.md>)

## AI overview

The article explains how to use Gemini Nano through ML Kit's Prompt API to add on-device LLM features to an Android travel app. Its example summarizes itineraries and generates preparation tips and local phrases while processing data locally.

## Source excerpt

Posted by Caren Chang, Developer Relations Engineer, Android Developer Relations Welcome back to the blog post series "Build intelligent Android apps" where we take a basic Android app and transform it into a personalized, intelligent, and agentic experience. In our previous post we introduced Jetpacker, the demo app we'll use throughout this series. In this blog post, we will share how you can use Gemini Nano through ML Kit's Prompt API to build intelligent on-device features. Building intelligent on-device features refers to the ability to process prompts and data directly on a device without sending data to a server. This offers a few advantages: User data can be processed locally on the device, preserving user privacy Functionality of the model is reliable even with spotty or no internet connection No additional cloud inference cost, since everything runs on the user's hardware With the benefits of on-device in mind, we identified three features to add in Jetpacker that can improve the user experience: summarizing trip itineraries, managing expenses, and capturing voice notes. On-device features in Jetpacker: Summarizing trip itineraries, managing expenses, and voice notes High quality tailored summarization of short texts The itinerary screen gives users a quick overview of all activities for a given trip. Since this screen contains a lot of information, it can quickly become overwhelming. To help users prepare without feeling overwhelmed, we can add a 'Get ready for your trip' section at the top. The romantic Paris trip is summarized as a classic Parisian adventure blending art, sights, and delicious food. A tip and some useful phrases are also added. By inputting a trip itinerary and asking an LLM to summarize it, we can generate a quick summary of the trip along with packing tips and useful local phrases. This is a great use case for an on-device model for several reasons: Performance and quality: Both the input and output text are relatively short. With tha