From f9599927a8630cb98ade08ea3fc5b1e9bdd8e955 Mon Sep 17 00:00:00 2001 From: john-rocky Date: Sat, 5 Sep 2026 05:17:30 +0900 Subject: [PATCH] Android inference: add Phi-4-mini-reasoning on LiteRT-LM --- md/01.Introduction/03/Android_Inference.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/md/01.Introduction/03/Android_Inference.md b/md/01.Introduction/03/Android_Inference.md index 2dfafe3aa..00ac6603c 100644 --- a/md/01.Introduction/03/Android_Inference.md +++ b/md/01.Introduction/03/Android_Inference.md @@ -39,4 +39,8 @@ If you want to use `.gguf` files in the cloud and on edge devices simultaneously 2. Download the APK file (148MB) and install it on your device. 3. Launch the MLC Chat app. You'll see a list of AI models, including Phi-3-mini. +### Run Phi-4-mini-reasoning with LiteRT-LM + +[Phi-4-mini-reasoning](https://huggingface.co/litert-community/Phi-4-mini-reasoning) is available as a community-converted int4 `.litertlm` bundle for Google's [LiteRT-LM](https://github.com/google-ai-edge/LiteRT-LM) on-device runtime. On Android it runs on CPU or GPU through the [Google AI Edge Gallery](https://github.com/google-ai-edge/gallery) app (import the bundle from Hugging Face inside the app) or through the LiteRT-LM Kotlin API; the same bundle also runs on iOS, macOS, Linux and Windows. The model card lists the measured speeds and the run commands. + In summary, Phi-3-mini opens up exciting possibilities for generative AI on edge devices, and you can start exploring its capabilities on Android.