# litert tensor api

Published articles for litert tensor api.

This is one page of public article previews, not the complete archive. Follow Next page to continue. Summaries are not the original full articles.

## Google Launches LiteRT Tensor API for Building, Customizing, and Optimizing ML Models for On-Device

DevFeed: [Google Launches LiteRT Tensor API for Building, Customizing, and Optimizing ML Models for On-Device](<https://devfeed.tech/articles/google-launches-litert-tensor-api-for-building-customizing-and-optimizing-ml-models-for-on-device-115569.md>)

Original publisher: [Read original article](<https://www.infoq.com/news/2026/11/litert-tensor-api/>)

Author: Sergio De Simone

Published: 2026-11-03T19:00:00Z

Content type: news

Language: en

Sources: [InfoQ](<https://devfeed.tech/sources/infoq.md>)

Topics: [LiteRT](<https://devfeed.tech/topics/litert.md>), [Model Development](<https://devfeed.tech/topics/model-development.md>), [hugging face](<https://devfeed.tech/topics/hugging-face.md>), [OpenAI](<https://devfeed.tech/topics/openai.md>)

Tags: [ai](<https://devfeed.tech/tags/ai.md>), [ai-coding-agents](<https://devfeed.tech/tags/ai-coding-agents.md>), [ai-ml-data-engineering](<https://devfeed.tech/tags/ai-ml-data-engineering.md>), [android](<https://devfeed.tech/tags/android.md>), [api](<https://devfeed.tech/tags/api.md>), [authoring](<https://devfeed.tech/tags/authoring.md>), [build](<https://devfeed.tech/tags/build.md>), [building](<https://devfeed.tech/tags/building.md>), [c-plus-plus](<https://devfeed.tech/tags/c-plus-plus.md>), [cross-platform](<https://devfeed.tech/tags/cross-platform.md>), [developers](<https://devfeed.tech/tags/developers.md>), [development](<https://devfeed.tech/tags/development.md>), [edge-computing](<https://devfeed.tech/tags/edge-computing.md>), [execution](<https://devfeed.tech/tags/execution.md>), [flexibility](<https://devfeed.tech/tags/flexibility.md>), [google](<https://devfeed.tech/tags/google.md>), [gpu](<https://devfeed.tech/tags/gpu.md>), [introduced](<https://devfeed.tech/tags/introduced.md>), [ios](<https://devfeed.tech/tags/ios.md>), [launches](<https://devfeed.tech/tags/launches.md>), [learning](<https://devfeed.tech/tags/learning.md>), [litert](<https://devfeed.tech/tags/litert.md>), [litert-tensor-api](<https://devfeed.tech/tags/litert-tensor-api.md>), [ml](<https://devfeed.tech/tags/ml.md>), [ml-data-engineering](<https://devfeed.tech/tags/ml-data-engineering.md>), [ml-models](<https://devfeed.tech/tags/ml-models.md>), [mobile](<https://devfeed.tech/tags/mobile.md>), [models](<https://devfeed.tech/tags/models.md>), [news](<https://devfeed.tech/tags/news.md>), [on-device](<https://devfeed.tech/tags/on-device.md>), [open-source](<https://devfeed.tech/tags/open-source.md>), [optimizing](<https://devfeed.tech/tags/optimizing.md>), [tensorflow](<https://devfeed.tech/tags/tensorflow.md>)

### AI overview

Google's LiteRT Tensor API lets developers define machine-learning computation graphs operation by operation in C++, then run the same graphs through LiteRT on CPU, GPU, and NPU targets without rewriting for each backend. The source highlights direct loading of checkpoint weights, including `.safetensors`, and zero-copy buffer interoperability across preprocessing, inference, and postprocessing. It says coding agents can generate and optimize the C++ graphs. In Google's reported SAM 2 tests, the same code ran on GPUs using Metal on a Mac and iPhone and OpenCL on Android; on a MacBook Pro, it was about 1.5x faster than Apple MLX in the stated fp16 image-encoder plus mask-decoder comparison. Arm's Laurence Moroney advised starting with model conversion and using the C++ API when graph-level control or accelerator-side preprocessing and postprocessing are needed. Planned improvements include ML Drift support, more NPU-friendly operations, full-graph quantization, and broader dynamic-shape support.

### Source excerpt

Google has introduced the LiteRT Tensor API, a lightweight C++ API that allows developers to build, customize, and optimize machine learning models directly for on-device execution. According to Google, it combines the flexibility of native model authoring with cross-platform portability. By Sergio De Simone