Find similar content

Source channel @githubtrending · Post #15554 · Mar 12

#cplusplus LiteRT is Google's free framework for running fast machine learning and generative AI on phones, computers, and web without cloud help. It uses GPU and NPU for up to 2x speed boosts, zero-copy data handling, and async execution on Android, iOS, Linux, and more, plus easy PyTorch model conversion. You benefit by building quick, private apps like real-time image editing or chatbots that work offline on everyday devices, saving battery and boosting performance. https://github.com/google-ai-edge/LiteRT

Hashtags

#cplusplus

Results

1 similar post found

Search: #phi3

当前筛选 #phi3清除筛选

GitHub Trends

@githubtrending · Post #15348 · 12/20/2025, 12:00 PM

Find similar View

#go#gemma3#go#gpt_oss#granite4#llama#llama3#llm#on_device_ai#phi3#qwen3#qwen3vl#sdk#stable_diffusion#vlm NexaSDK runs AI models locally on CPUs, GPUs, and NPUs with a single command, supports GGUF/MLX/.nexa formats, and offers NPU-first Android and macOS support for fast, multimodal (text, image, audio) inference, plus an OpenAI‑compatible API for easy integration. This gives you low-latency, private on-device AI across laptops, phones, and embedded systems, reduces cloud costs and data exposure, and lets you deploy and test new models immediately on target hardware for faster development and better user experience. https://github.com/NexaAI/nexa-sdk

Hashtags

#go #gemma3 #gpt_oss #granite4 #llama #llama3 #llm #on_device_ai #phi3 #qwen3 #qwen3vl #sdk #stable_diffusion #vlm