# LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

DevFeed: [LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!](<https://devfeed.tech/articles/llm-inference-on-edge-a-fun-and-easy-guide-to-run-llms-via-react-native-on-your-phone-7340.md>)

Original publisher: [Read original article](<https://huggingface.co/blog/llm-inference-on-edge>)

Author: Mohamed Mekkouri; Marc Sun

Published: 2025-03-07T00:00:00Z

Content type: tutorial

Language: en

Sources: [Hugging Face - Blog](<https://devfeed.tech/sources/hugging-face-blog.md>)

Topics: [LLMs](<https://devfeed.tech/topics/llms.md>), [React Native](<https://devfeed.tech/topics/react-native.md>), [Mobile](<https://devfeed.tech/topics/mobile.md>), [quantization](<https://devfeed.tech/topics/quantization.md>), [Compression](<https://devfeed.tech/topics/compression.md>), [Open Source](<https://devfeed.tech/topics/open-source.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>)

Tags: [community](<https://devfeed.tech/tags/community.md>), [compression](<https://devfeed.tech/tags/compression.md>), [guide](<https://devfeed.tech/tags/guide.md>), [hub](<https://devfeed.tech/tags/hub.md>), [hugging-face](<https://devfeed.tech/tags/hugging-face.md>), [llms](<https://devfeed.tech/tags/llms.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [offline](<https://devfeed.tech/tags/offline.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [privacy](<https://devfeed.tech/tags/privacy.md>), [quantization](<https://devfeed.tech/tags/quantization.md>), [react-native](<https://devfeed.tech/tags/react-native.md>)

## AI overview

A practical tutorial for building a privacy-focused React Native mobile app that runs LLMs locally on Android and iOS. It covers downloading models from the Hugging Face hub, loading GGUF files, selecting models for mobile hardware, and understanding quantization formats and their performance trade-offs.

## Source excerpt

We're on a journey to advance and democratize artificial intelligence through open source and open science.