TGTGInsighttelegram intelligenceLIVE / telegram public index
← GitHub Trends

TGINSIGHT SIMILAR POSTS

Find similar content

Source channel @githubtrending · Post #15263 · Nov 2

#python#deep_learning#inference#llm#nlp#pytorch#transformer Nano-vLLM is a small, fast, and easy-to-understand tool for running large language models offline. It matches the speed of bigger systems like vLLM but uses only about 1,200 lines of clean Python code, making it simple to read and modify. It includes smart features like prefix caching and tensor parallelism to boost performance. You can install it easily and run models like Qwen3-0.6B on your own GPU. This tool is great if you want fast, efficient AI inference without complex setups, ideal for learning, research, or small deployments on limited hardware. https://github.com/GeeeekExplorer/nano-vllm

Results

4 similar posts found

Search: #local

当前筛选 #local清除筛选
ADMINISTRACION Y DERECHO

@derechoadministrativo · Post #171 · 12/10/2022, 10:41 AM

⚖El TS fija doctrina sobre la capacidad y competencia de los plenos municipales para pronunciarse sobre cuestiones políticas de carácter internacional #local#jurisprudencia https://laadministracionaldia.inap.es/noticia.asp?id=1228267

Machinelearning

@ai_machinelearning_big_data · Post #8255 · 08/12/2025, 02:32 PM

🚀Jan-v1: локальная 4B-модель для веба — опенсорсная альтернатива Perplexity Pro 📌Что умеет - SimpleQA: 91% точности, чуть выше Perplexity Pro — и всё это полностью локально. - Сценарии: быстрый веб-поиск и глубокое исследование (Deep Research). Из чего сделана - Базируется на Qwen3-4B-Thinking (контекст до 256k), дообучена в Jan на рассуждение и работу с инструментами. Где запускать - Jan, llama.cpp или vLLM. Как включить поиск в Jan - Settings → Experimental Features → On - Settings → MCP Servers → включите поисковый MCP (например, Serper) Модели - Jan-v1-4B: https://huggingface.co/janhq/Jan-v1-4B - Jan-v1-4B-GGUF: https://huggingface.co/janhq/Jan-v1-4B-GGUF @ai_machinelearning_big_data #ai#ml#local#Qwen#Jan

GitHub Trends

@githubtrending · Post #15580 · 03/23/2026, 11:30 AM

#go#cli#database#database_management#dbms#environment#local#postgres#postgresql#supabase Supabase CLI lets you run Supabase locally, manage database migrations, deploy functions, generate types from your schema, and make secure API calls. Install easily via npm (`npm i supabase --save-dev`), Homebrew, Scoop, or binaries for any OS, then run `supabase init` and `supabase start` to launch your full stack with local URLs and keys. This benefits you by speeding up development, testing changes offline without cloud costs, ensuring type safety, and simplifying CI/CD for reliable deploys. https://github.com/supabase/cli