#python#large_language_models#machine_learning_systems#natural_language_processing
Flash Linear Attention (FLA) is a fast, memory-efficient library for advanced linear attention models used in transformers, written in PyTorch and Triton, and compatible with NVIDIA, AMD, and Intel GPUs. It offers many state-of-the-art linear attention models and fused modules that speed up training and reduce memory use. You can easily replace standard attention layers in your models with FLA’s efficient versions, improving training and inference speed, especially for long sequences. FLA supports hybrid models mixing linear and standard attention, and integrates with Hugging Face Transformers for easy use and evaluation. This helps you train and run large language models faster and with less memory, making your AI projects more efficient and scalable.
https://github.com/fla-org/flash-linear-attention
#ML
😎
FREE RESOURCES TO LEARN MACHINE LEARNING
Intro to ML by MIT Free Course
Machine Learning for Everyone FREE BOOK
ML Crash Course by Google
Advanced Machine Learning with Python Github
Practical Machine Learning Tools and Techniques Free Book
Python Machine Learning for beginners
-----
Main channel: @repo_science
Coupons: @freecoupons_reposcience
-----
#ML
🧠
Machine Learning Expert
El aprendizaje automático es un vasto campo con muchos conceptos clave que conocer. Nuestro curso intensivo cubre todos los componentes básicos que necesita para sumergirse en el aprendizaje automático del mundo real.
✍️Ryan Doan | Ex-Amazon ML Infrastructure Engineer
🌐En
📆2022
🔗Link
-----
Main channel:@repo_science
Coupons:@freecoupons_reposcience
-----
#ml
What’s Really Going On in Machine Learning? Some Minimal Models—Stephen Wolfram Writings
https://writings.stephenwolfram.com/2024/08/whats-really-going-on-in-machine-learning-some-minimal-models/
#ml
Meta's second version of segment anything.
https://github.com/facebookresearch/segment-anything-2
They have a nice demo:
https://sam2.metademolab.com/
#ml
I was searching for a tool to visualize computational graphs and ran into this preprint. The hierarchical visualization idea is quite nice.
https://arxiv.org/abs/2212.10774
#ml
Like a dictionary
Kunc, Vladim’ir, and Jivr’i Kl’ema. 2024. “Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks.” arXiv [Cs.LG], February. http://arxiv.org/abs/2402.09092.
#ml
I got interested in satellite data last year and played with it a bit. It's fantastic. The spatiotemporal nature of it brings up a lot of interesting questions.
Then I saw this paper today:
Rolf, Esther, Konstantin Klemmer, Caleb Robinson, and Hannah Kerner. 2024. “Mission Critical -- Satellite Data Is a Distinct Modality in Machine Learning.” arXiv [Cs.LG], February. http://arxiv.org/abs/2402.01444.
#ml
Jelassi S, Brandfonbrener D, Kakade SM, Malach E. Repeat after me: Transformers are better than state space models at copying. arXiv [cs.LG]. 2024. Available: http://arxiv.org/abs/2402.01032
Not surprising at all when you have direct access to a long context. But hey, look at this title.