Simple LLM package for ios devices.

Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro

codebase for "MELTing Point: Mobile Evaluation of Language Transformers"

Dockerfiles for poetry/mlc-llm(rk3588)/...

An example of integrating local LLMS using mlc-llm into an iOS app

A React Native application that enables on-device Large Language Model (LLM) chat functionality with intelligent context management. Built with TypeScript and modern React Native practices.

Privacy-first on-device LLM inference for Android. Real-time AI conversations without data leaving your phone. Powered by MLC-LLM.

Pre-built TVM Windows x64 binaries with LLVM support - enables MLC-LLM model conversion on Windows

Inference runtime benchmarks, configs, and production setup for a Jetson Orin Nano Super 8GB — llama.cpp, ONNX Runtime, MLC-LLM, Gemma 4, multimodal

Android agent runtime and workflow compiler for local LLM-powered screen/API automation

Android AI inference server with OpenAI-compatible API. Turn your phone into a local LLM co-processor — runs MLC LLM (GGUF) + LiteRT-LM (.litertlm) with dual-engine routing, bearer auth, thermal governor, KV cache, and resumable model downloads. No cloud, no GPU, no friction.

A real-time 3D street view chatting with built-in AI powered by WebGPU.