#cuda
DeepEP is a special communication library for Mixture-of-Experts (MoE) models. It helps these models work faster and more efficiently by improving how data is shared between different parts of the system. DeepEP supports low-precision operations and can handle data transfer between different types of connections, like NVLink and RDMA. This makes it very useful for both training and using AI models, especially when speed is important. Users benefit from faster processing times and better performance overall.
https://github.com/deepseek-ai/DeepEP
🌐Opening ceremony of ARMY 2022 International Military and Technical Forum and International Army Games 2022 took place in the Patriot Military-Patriotic Park of Culture and Leisure of the Armed Forces of the Russian Federation
#MoD@mod_russia_en