Covers transformer architecture and subquadratic attention mechanisms, focusing on efficient approximations and their applications in machine learning.
Explores the Eigenstate Thermalization Hypothesis in quantum systems, emphasizing the random matrix theory and the behavior of observables in thermal equilibrium.