Lecture

Sparse Communication: Transformations and Applications

Description

This lecture by the instructor covers the evolution from sparse modeling to sparse communication, focusing on the use of sparse transformations in neural networks for natural language processing tasks. The talk explores various sparse regularization techniques, such as sparse neuron activations and structured sparsity, and their applications in machine-human communication. It delves into the concepts of sparsemax, entmax, and mixed distributions, highlighting their role in bridging the gap between discrete and continuous models. The lecture also discusses the implications of sparse communication for explainability and emergent communication in machine learning.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.