#jupyter_notebook#chinese_llm#chinese_nlp#finetune#generative_ai#instruct_gpt#instruction_set#llama#llm#lora#open_models#open_source#open_source_models#qlora
AirLLM is a tool that lets you run very large AI models on computers with limited memory by using a smart layer-by-layer loading technique instead of traditional compression methods. You can run a 70-billion-parameter model on just 4GB of GPU memory, or even a 405-billion-parameter model on 8GB, without losing model quality. The benefit is that you can use powerful AI models on affordable hardware without expensive upgrades, and the tool also offers optional compression features that can speed up performance by up to 3 times while maintaining accuracy.
https://github.com/lyogavin/airllm
https://mborgerson.com/creating-an-executable-from-a-python-script/
Creating an Executable from a Python Script
Python is one of my favorite programming languages. That being said, if you've ever had to deploy an application written in Python then you know just how painful it can be.
#PyInstaller
http://www.pyinstaller.org/
#PyInstaller is a program that #freezes (#packages) Python programs into #stand_alone#executables, under Windows, Linux, Mac OS X, FreeBSD, Solaris and AIX. Its main advantages over similar tools are that PyInstaller works with Python 2.7 and 3.3—3.5, it builds smaller executables thanks to transparent compression, it is fully multi-platform, and use the OS support to load the dynamic libraries, thus ensuring full compatibility.
https://www.infoworld.com/article/3230202/python/6-essential-libraries-for-every-python-developer.html
6 essential libraries for every Python developer
Whether you're compiling Python for speed, building native UIs for Python desktop apps, or refining existing Python code, these Python projects have you covered
Python has seen wide adoption across industries and disciplines by dint of being easy to work with. But it has also been aided by a wealth of third-party projects—libraries, add-ons, and complementary development efforts—that extend the language to an ever widening range of use cases.
#PyPy
#CFFI(C Foreign Function Interface library)
#PyInstaller
#PBR(Python Build Reasonableness)
#WxPython
#Mypy