🌟 AI Sunday Wonders: Meet TinyLlama, the 550MB AI Model Trained on 3 Trillion Tokens Hello, everyone! In the world of AI, smaller models are gaining immense popularity due to their efficiency on edge devices with limited memory and processing power. Enter TinyLlama, a groundbreaking project led by a research assistant at Singapore University of Technology and Design. Despite its tiny 550MB size, TinyLlama is pre-trained on a massive three trillion tokens. This compact model holds great promise for various applications, including real-time machine translation without the need for an internet connection. The project aims to complete the training of this 1.1 billion Llama model in just 90 days, utilizing 16 A100-40G GPUs. You can track its progress and loss metrics in real-time. TinyLlama shares the same architecture and tokenizer as Meta's Llama 2, making it compatible with open-source projects built on Llama. TinyLlama joins the league of smaller language models like Pythia-1b and MPT-1b, offering developers efficient options for creating cutting-edge AI applications. #TinyLlama#AIModel#AIResearch#MachineLearning#AIInnovation#TinyButMighty
TGTGInsighttelegram intelligenceLIVE / telegram public index
前段时间一直被MajdataPlay的外键输入问题困扰：有玩家反映majplay会无征兆地出现拖判和吃音，但是内屏一切正常 因为我是第一次接触游戏开发，IO这方面也完全没经验 一开始我和bb本怀疑是线程调度的问题，即：IO线程时间片被其他线程挤占了，导致IO线程无法及时处理HID设备回报。为了验证这个猜想，我们尝试提高了IO线程的优先级，照旧 接下来我怀疑是我那套框架有问题：majplay是根据上一帧与这一帧的按键状态判断按键是不是"click"。为此我重写了这部分的实现，改进了IO线程与主线程之间的交互，问题照旧....... 到这里我已经怀疑这不是majplay的锅：IO线程没有任何异常，IO线程与主线程的交互没有问题，Note判定逻辑也没有问题，那就是设备确实没有回报给majplay或者设备发过来的回报中按键确实没有按下，但是大佬说hdd没有这种问题.....（人已经快崩溃了，这完全看不透也摸不着，因为我用单片机模拟玩家打高速纵连是完全没有问题的，我在家里用手台测试也没有问题） 到最后，bb本灵光一闪，说有没有可能是led刷新率过高，把按键控制板干爆炸了？我们让大佬把led刷新间隔从16ms改成100ms，吃音问题瞬间没有了，无语了 。。。。。。。。。。。。。。。。。。。。 adx是一个控制板同时管理按键和led，为什么我没有遇到吃音问题呢，因为我的手台不是adx的... #dev
Hashtags
Results
找到 1 条相似帖子
搜索 #tinybutmighty
当前筛选 #tinybutmighty清除筛选