Skip to main content

DINO - Explained!

CodeEmporiumMarch 23, 202624:06ai_ml_education

Summary

This video explains DINO (DIstillation with NO labels), a advanced self-supervised learning technique within AI. It is highly relevant for educators and students who are learning advanced machine learning concepts, specifically in the fields of computer vision and self-supervised model training.

Description

In this video, we take a look at DIstillation with NO labels. What is it? Why do we have it? How does it look? ABOUT ME โญ• Subscribe: https://www.youtube.com/c/CodeEmporium?sub_confirmation=1 ๐Ÿ“š Medium Blog: https://medium.com/@dataemporium ๐Ÿ’ป Github: https://github.com/ajhalthor ๐Ÿ‘” LinkedIn: https://www.linkedin.com/in/ajay-halthor-477974bb/ RESOURCES [1 ๐Ÿ“š] Main Paper: https://arxiv.org/pdf/2104.14294 [2 ๐Ÿ“š] Slides: https://link.excalidraw.com/p/readonly/ccVu9FUIwD5miDWgdK3s [3 ๐Ÿ“š] Vision Transformers paper: https://arxiv.org/pdf/2010.11929 [4 ๐Ÿ“š] BERT paper: https://arxiv.org/pdf/1810.04805 PLAYLISTS FROM MY CHANNEL โญ• Reinforcement Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9kS--NgVz0EPNyEmygV1Ha&si=AuThDZJwG19cgTA8 Natural Language Processing: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE&si=LsVy8RDPu8jeO-cc โญ• Transformers from Scratch: https://youtube.com/playlist?list=PLTl9hO2Oobd_bzXUpzKMKA3liq2kj6LfE โญ• ChatGPT Playlist: https://youtube.com/playlist?list=PLTl9hO2Oobd9coYT6XsTraTBo4pL1j4HJ โญ• Convolutional Neural Networks: https://youtube.com/playlist?list=PLTl9hO2Oobd9U0XHz62Lw6EgIMkQpfz74 โญ• The Math You Should Know : https://youtube.com/playlist?list=PLTl9hO2Oobd-_5sGLnbgE8Poer1Xjzz4h โญ• Probability Theory for Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd9bPcq0fj91Jgk_-h1H_W3V โญ• Coding Machine Learning: https://youtube.com/playlist?list=PLTl9hO2Oobd82vcsOnvCNzxrZOlrz3RiD MATH COURSES (7 day free trial) ๐Ÿ“• Mathematics for Machine Learning: https://imp.i384100.net/MathML ๐Ÿ“• Calculus: https://imp.i384100.net/Calculus ๐Ÿ“• Statistics for Data Science: https://imp.i384100.net/AdvancedStatistics ๐Ÿ“• Bayesian Statistics: https://imp.i384100.net/BayesianStatistics ๐Ÿ“• Linear Algebra: https://imp.i384100.net/LinearAlgebra ๐Ÿ“• Probability: https://imp.i384100.net/Probability OTHER RELATED COURSES (7 day free trial) ๐Ÿ“• โญ Deep Learning Specialization: https://imp.i384100.net/Deep-Learning ๐Ÿ“• Python for Everybody: ht