# Google Launches LiteRT Tensor API for Building, Customizing, and Optimizing ML Models for On-Device

DevFeed: [Google Launches LiteRT Tensor API for Building, Customizing, and Optimizing ML Models for On-Device](<https://devfeed.tech/articles/google-launches-litert-tensor-api-for-building-customizing-and-optimizing-ml-models-for-on-device-115569.md>)

Original publisher: [Read original article](<https://www.infoq.com/news/2026/11/litert-tensor-api/>)

Author: Sergio De Simone

Published: 2026-11-03T19:00:00Z

Content type: news

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [LiteRT](<https://devfeed.tech/topics/litert.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [ai-ml-data-engineering](<https://devfeed.tech/tags/ai-ml-data-engineering.md>), [android](<https://devfeed.tech/tags/android.md>), [api](<https://devfeed.tech/tags/api.md>), [authoring](<https://devfeed.tech/tags/authoring.md>), [build](<https://devfeed.tech/tags/build.md>), [building](<https://devfeed.tech/tags/building.md>), [c-plus-plus](<https://devfeed.tech/tags/c-plus-plus.md>), [cross-platform](<https://devfeed.tech/tags/cross-platform.md>), [developers](<https://devfeed.tech/tags/developers.md>), [development](<https://devfeed.tech/tags/development.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [execution](<https://devfeed.tech/tags/execution.md>), [flexibility](<https://devfeed.tech/tags/flexibility.md>), [google](<https://devfeed.tech/tags/google.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [introduced](<https://devfeed.tech/tags/introduced.md>), [ios](<https://devfeed.tech/tags/ios.md>), [launches](<https://devfeed.tech/tags/launches.md>), [learning](<https://devfeed.tech/tags/learning.md>), [litert](<https://devfeed.tech/tags/litert.md>), [litert-tensor-api](<https://devfeed.tech/tags/litert-tensor-api.md>), [ml](<https://devfeed.tech/tags/ml.md>), [ml-data-engineering](<https://devfeed.tech/tags/ml-data-engineering.md>), [ml-models](<https://devfeed.tech/tags/ml-models.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [models](<https://devfeed.tech/tags/models.md>), [news](<https://devfeed.tech/tags/news.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [optimizing](<https://devfeed.tech/tags/optimizing.md>), [tensorflow](<https://devfeed.tech/tags/tensorflow.md>)

## AI overview

Google's LiteRT Tensor API lets developers define machine-learning computation graphs operation by operation in C++, then run the same graphs through LiteRT on CPU, GPU, and NPU targets without rewriting for each backend. The source highlights direct loading of checkpoint weights, including `.safetensors`, and zero-copy buffer interoperability across preprocessing, inference, and postprocessing. It says coding agents can generate and optimize the C++ graphs. In Google's reported SAM 2 tests, the same code ran on GPUs using Metal on a Mac and iPhone and OpenCL on Android; on a MacBook Pro, it was about 1.5x faster than Apple MLX in the stated fp16 image-encoder plus mask-decoder comparison. Arm's Laurence Moroney advised starting with model conversion and using the C++ API when graph-level control or accelerator-side preprocessing and postprocessing are needed. Planned improvements include ML Drift support, more NPU-friendly operations, full-graph quantization, and broader dynamic-shape support.

## Source excerpt

Google has introduced the LiteRT Tensor API, a lightweight C++ API that allows developers to build, customize, and optimize machine learning models directly for on-device execution. According to Google, it combines the flexibility of native model authoring with cross-platform portability. By Sergio De Simone