Find similar content

Source channel @githubtrending · Post #15263 · Nov 2

#python#deep_learning#inference#llm#nlp#pytorch#transformer Nano-vLLM is a small, fast, and easy-to-understand tool for running large language models offline. It matches the speed of bigger systems like vLLM but uses only about 1,200 lines of clean Python code, making it simple to read and modify. It includes smart features like prefix caching and tensor parallelism to boost performance. You can install it easily and run models like Qwen3-0.6B on your own GPU. This tool is great if you want fast, efficient AI inference without complex setups, ideal for learning, research, or small deployments on limited hardware. https://github.com/GeeeekExplorer/nano-vllm

Hashtags

#python #deep_learning #inference #llm #nlp #pytorch #transformer

Results

1 similar post found

Search: #rommapp

当前筛选 #rommapp清除筛选

GitHub Trends

@githubtrending · Post #14875 · 06/28/2025, 12:30 PM

Find similar View

#python#emulation#open_source#retrogaming#rommapp#self_hosted RomM is a powerful, self-hosted ROM manager that helps you organize, browse, and play your game collection easily through a clean web interface. It supports over 400 gaming platforms and enriches your library with metadata, artwork, and achievements from popular databases like IGDB and Retroachievements. You can play games directly in your browser using built-in emulators, manage multi-disk games, DLCs, mods, and share your collection with friends securely. RomM works on desktop and mobile, making game management simple and accessible anywhere, enhancing your gaming experience by keeping everything organized and playable in one place. https://github.com/rommapp/romm

Hashtags

#python #emulation #open_source #retrogaming #rommapp #self_hosted