TGTGInsighttelegram intelligenceLIVE / telegram public index
← GitHub Trends

TGINSIGHT SIMILAR POSTS

Find similar content

Source channel @githubtrending · Post #14834 · Jun 17

#cuda DeepEP is a special communication library for Mixture-of-Experts (MoE) models. It helps these models work faster and more efficiently by improving how data is shared between different parts of the system. DeepEP supports low-precision operations and can handle data transfer between different types of connections, like NVLink and RDMA. This makes it very useful for both training and using AI models, especially when speed is important. Users benefit from faster processing times and better performance overall. https://github.com/deepseek-ai/DeepEP

Hashtags

Results

1 similar post found

Search: #openweights

当前筛选 #openweights清除筛选
Machinelearning

@ai_machinelearning_big_data · Post #8680 · 10/02/2025, 05:01 PM

✔️IBM представила Granite 4.0 — новое семейство open-weights языковых моделей от 3B до 32B параметров. Четыре новые модели: - Granite 4.0 H Small - 32B/9B активных параметров - Granite 4.0 H Tiny - 7B/1B - Granite 4.0 H Micro - 3B/3B - Granite 4.0 Micro - 3B/3B Benchmarking (Artificial Analysis Index): - Granite 4.0 H Small: 23 балла (на 8 выше Granite 3.3 8B), обходит Gemma 3 27B (22), но уступает Mistral Small 3.2 (29) и Qwen3 30B A3B (37). - Granite 4.0 Micro: 16 баллов, выше Gemma 3 4B (15) и LFM 2 2.6B (12). ⚡ Token efficiency: - Granite 4.0 Small — 5.2M токенов - Granite 4.0 Micro — 6.7M токенов Обе модели заметно эффективнее Granite 3.3 8B и большинства non-reasoning моделей <40B. Детали: - Контекст: до 128K токенов - Лицензия: Apache 2.0 - Granite 4.0 H Small доступна на Replicate по $0.06 / $0.25 за 1M input/output токенов - Все модели доступны на Hugging Face - Модель Micro (3.4B) можно запускать полностью локально. 🔗 Hugging Face: https://huggingface.co/collections/unsloth/granite-40-68ddf64b4a8717dc22a9322d 🔗Unsloth: https://docs.unsloth.ai/new/ibm-granite-4.0 @ai_machinelearning_big_data #AI#IBM#Granite4#LLM#OpenWeights