#jupyter_notebook#chinese_llm#chinese_nlp#finetune#generative_ai#instruct_gpt#instruction_set#llama#llm#lora#open_models#open_source#open_source_models#qlora
AirLLM is a tool that lets you run very large AI models on computers with limited memory by using a smart layer-by-layer loading technique instead of traditional compression methods. You can run a 70-billion-parameter model on just 4GB of GPU memory, or even a 405-billion-parameter model on 8GB, without losing model quality. The benefit is that you can use powerful AI models on affordable hardware without expensive upgrades, and the tool also offers optional compression features that can speed up performance by up to 3 times while maintaining accuracy.
https://github.com/lyogavin/airllm
#typescript#local_first#notetaking#open_source#react#rust#tauri#typescript
Hyprnote is a tool that helps you with meeting notes. It records and transcribes meetings, then creates useful summaries from the notes. What's special about Hyprnote is that it works offline using open-source models, so you don't need the internet to use it. It's also very flexible because you can add or create extensions to make it work better for you. This means you can use it anywhere, even without internet, and it helps keep your notes organized and private.
https://github.com/fastrepl/hyprnote
Mili Secures $2M Funding Round
Mili has successfully raised $2 million in funding as of December 17, 2024. The AI-powered platform aims to enhance workflows and improve client experiences, reducing the burden of note-taking tasks.
Learn more: Mili
#Funding#AI#Mili#Startups#Tech#Workflows#Investment#ClientExperience#NoteTaking#Efficiency#Innovation