#cplusplus
LiteRT is Google's free framework for running fast machine learning and generative AI on phones, computers, and web without cloud help. It uses GPU and NPU for up to 2x speed boosts, zero-copy data handling, and async execution on Android, iOS, Linux, and more, plus easy PyTorch model conversion. You benefit by building quick, private apps like real-time image editing or chatbots that work offline on everyday devices, saving battery and boosting performance.
https://github.com/google-ai-edge/LiteRT