Find similar content

Source channel @githubtrending · Post #14974 · Jul 19

#cplusplus ik_llama.cpp is an improved version of llama.cpp that runs faster on CPUs and hybrid GPU/CPU setups. It supports many new advanced quantization methods, which help models use less memory and run more efficiently. It also offers better performance for special models like DeepSeek and MoE, with faster prompt processing and token generation. You can run it on various hardware, including Android, and it has features to control where model data is stored (CPU or GPU). This means you get quicker AI responses and can handle bigger or more complex models smoothly on your computer or device[2][1][4]. https://github.com/ikawrakow/ik_llama.cpp

Hashtags

#cplusplus

Results

1 similar post found

Search: #mdl

当前筛选 #mdl清除筛选

GitHub Trends

@githubtrending · Post #15271 · 11/05/2025, 12:30 PM

Find similar View

#cplusplus#arm#baidu#deep_learning#embedded#fpga#mali#mdl#mobile#mobile_deep_learning#neural_network Paddle Lite is a lightweight, high-performance deep learning inference framework designed to run AI models efficiently on mobile, embedded, and edge devices. It supports multiple platforms like Android, iOS, Linux, Windows, and macOS, and languages including C++, Java, and Python. You can easily convert models from other frameworks to PaddlePaddle format, optimize them for faster and smaller deployment, and run them with ready-made examples. This helps you deploy AI applications quickly on various devices with low memory use and fast speed, making it ideal for real-time, resource-limited environments. It also supports many hardware accelerators for better performance. https://github.com/PaddlePaddle/Paddle-Lite

Hashtags

#cplusplus #arm #baidu #deep_learning #embedded #fpga #mali #mdl #mobile #mobile_deep_learning #neural_network