Lecture

Transformers in Vision

Description

This lecture covers the evolution of visual intelligence models, from traditional architectures to the rise of Transformers in computer vision and natural language processing. It explores the key concepts of Convolutional Neural Networks, Recurrent Neural Networks, and the recent advancements in image classification leaderboards. The lecture delves into the inner workings of Transformers, focusing on multi-headed self-attention mechanisms, positional encodings, and feed-forward layers. It also discusses the importance of attention mechanisms in understanding images and text, showcasing various forms of attention and their applications in visual tasks.

This video is available exclusively on Mediaspace for a restricted audience. Please log in to MediaSpace to access it if you have the necessary permissions.

Watch on Mediaspace
About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.