Find similar content

Source channel @githubtrending · Post #15432 · Jan 23

#jupyter_notebook#chinese_llm#chinese_nlp#finetune#generative_ai#instruct_gpt#instruction_set#llama#llm#lora#open_models#open_source#open_source_models#qlora AirLLM is a tool that lets you run very large AI models on computers with limited memory by using a smart layer-by-layer loading technique instead of traditional compression methods. You can run a 70-billion-parameter model on just 4GB of GPU memory, or even a 405-billion-parameter model on 8GB, without losing model quality. The benefit is that you can use powerful AI models on affordable hardware without expensive upgrades, and the tool also offers optional compression features that can speed up performance by up to 3 times while maintaining accuracy. https://github.com/lyogavin/airllm

Hashtags

#jupyter_notebook #chinese_llm #chinese_nlp #finetune #generative_ai #instruct_gpt #instruction_set #llama #llm #lora #open_models #open_source #open_source_models #qlora

Results

42 similar posts found

Search: #rhilip

当前筛选 #rhilip清除筛选

PTPP Actions

@PTPPAction · Post #2399 · 10/19/2024, 12:10 PM

Find similar View

#Rhilip#open 抢先体验版本不保证稳定性 feat: add lemonhd commit Merge branch 'dev' into dev * feat: add lemonhd 描述屏幕截图 2024-10-19 193700 屏幕截图 2024-10-19 193218

Hashtags

#rhilip #open

PTPP Actions

@PTPPAction · Post #1982 · 05/10/2024, 02:05 PM

Find similar View

#Rhilip:dev_full_vite #Rhilip#open 抢先体验版本不保证稳定性 build: full use vite to build pkg deps: use vite plugin to provide node polyfills 移除webpack构建部分，全部转为vite构建。普通用户请勿在生产环境中使用本pr的相关action构建。

Hashtags

#rhilip #open

PTPP Actions

@PTPPAction · Post #1970 · 05/08/2024, 03:50 PM

Find similar View

#Rhilip:dev_full_vite #Rhilip#open build: full use vite to build pkg

Hashtags

#rhilip #open

PTPP Actions

@PTPPAction · Post #1967 · 05/08/2024, 03:45 PM

Find similar View

#Rhilip:dev_full_vite #Rhilip#open build: full use vite to build pkg