#jupyter_notebook#chinese_llm#chinese_nlp#finetune#generative_ai#instruct_gpt#instruction_set#llama#llm#lora#open_models#open_source#open_source_models#qlora
AirLLM is a tool that lets you run very large AI models on computers with limited memory by using a smart layer-by-layer loading technique instead of traditional compression methods. You can run a 70-billion-parameter model on just 4GB of GPU memory, or even a 405-billion-parameter model on 8GB, without losing model quality. The benefit is that you can use powerful AI models on affordable hardware without expensive upgrades, and the tool also offers optional compression features that can speed up performance by up to 3 times while maintaining accuracy.
https://github.com/lyogavin/airllm
💡 今日金句
当你停止创造,你的才能就不再重要,你所拥有的只剩下你的品味。
而品味会裹挟你,让你排斥他人、变得狭隘。
所以,创造。
When you don’t create things, you become defined by your tastes rather than
ability. your tastes only narrow & exclude people. so create.― Why The Lucky
Stiff
via 今日金句
标签: #create#your#tastes
⚡️探索号频道
⚡️探索者频道
⚡️探索者交流群
⚡️ Youtube 频道:科技探索者
每天推荐有趣内容,欢迎订阅、转发。