Find similar content

Source channel @githubtrending · Post #15263 · Nov 2

#python#deep_learning#inference#llm#nlp#pytorch#transformer Nano-vLLM is a small, fast, and easy-to-understand tool for running large language models offline. It matches the speed of bigger systems like vLLM but uses only about 1,200 lines of clean Python code, making it simple to read and modify. It includes smart features like prefix caching and tensor parallelism to boost performance. You can install it easily and run models like Qwen3-0.6B on your own GPU. This tool is great if you want fast, efficient AI inference without complex setups, ideal for learning, research, or small deployments on limited hardware. https://github.com/GeeeekExplorer/nano-vllm

Hashtags

#python #deep_learning #inference #llm #nlp #pytorch #transformer

Results

3 similar posts found

Search: #frontends

当前筛选 #frontends清除筛选

Libreware

@libreware · Post #1177 · 09/10/2023, 03:41 PM

Find similar View

Proxy Redirect #Userscript Redirection userscript for privacy-oriented and open-source proxy #frontends. Proxy Redirect automatically redirects to instances of privacy-oriented frontends, such as Scribe, Nitter, Libreddit, etc. This allows more reliable access to available public instances per service, while also helping to distribute traffic more evenly across all instances and avoid performance bottlenecks and rate-limiting. https://openuserjs.org/scripts/sjehuda/Proxy_Redirect

Hashtags

#userscript #frontends

Libreware

@libreware · Post #913 · 03/18/2021, 04:10 PM

Find similar View

Front-ends for evil sites/platforms: Youtube - Source: https://github.com/iv-org/invidious - Instances: https://api.invidious.io Twitter - Source: https://github.com/zedeus/nitter - Instances: https://github.com/zedeus/nitter/wiki/Instances Twitter+YouTube -Source: https://github.com/ytorg/Yotter -Instances: https://github.com/ytorg/Yotter#public-instances Why do I have to register to use Yotter? Instagram - Source: https://sr.ht/~cadence/bibliogram/ - Instances: https://git.sr.ht/~cadence/bibliogram-docs/tree/master/docs/Instances.md Reddit - Sources: https://github.com/spikecodes/libreddit (1) https://codeberg.org/teddit/teddit (2) - Instances: https://github.com/spikecodes/libreddit#instances (1) https://codeberg.org/teddit/teddit#instances (2) Google Translate - Sources: https://sr.ht/~yerinalexey/gtranslate/ (1) https://git.sr.ht/~metalune/simplytranslate_web (2) - Instances: https://gtranslate.metalune.xyz/ (1) https://translate.metalune.xyz/ (2) Google Search Engine - Source: https://github.com/benbusby/whoogle-search - Instances: https://github.com/benbusby/whoogle-search#public-instances P.S. JavaScript isn't required for any core functionality with these front-ends 📡@NoGoolag📡@Libreware #frontends#yt#alternatives

Hashtags

#frontends #yt #alternatives

Libreware

@libreware · Post #1176 · 09/08/2023, 01:49 AM

Find similar View

LibRedirect A web extension that redirects YouTube, Twitter, TikTok, and other websites to alternative privacy friendly frontends https://libredirect.github.io https://github.com/libredirect/browser_extension #frontends#browser#extension

Hashtags

#frontends #browser #extension