Publication

Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data

Related publications (31)

Validation and Application of Hysteresis Loss Model for HTS Stacks and Conductors for Fusion Applications

Numerous conductor designs for pulsed magnets based on High Temperature Superconductors (HTS), featuring stacks of tapes are currently being proposed. A major contribution to the AC losses is expected to be given by hysteresis losses. Several numerical mod ...

IEEE Institute of Electrical and Electronics Engineers2024

Few-shot Learning for Efficient and Effective Machine Learning Model Adaptation

Arnout Jan J Devos

Machine learning (ML) enables artificial intelligent (AI) agents to learn autonomously from data obtained from their environment to perform tasks. Modern ML systems have proven to be extremely effective, reaching or even exceeding human intelligence. Altho ...

EPFL2024

Reliable data-driven decision-making through optimal transport

Bahar Taskesen

Decision-making permeates every aspect of human and societal development, from individuals' daily choices to the complex decisions made by communities and institutions. Central to effective decision-making is the discipline of optimization, which seeks th ...

EPFL2024

Reducing uncertainties in response predictions of earthquake-damaged masonry buildings using data from image-based inspection

Ian Smith, Katrin Beyer, Bryan German Pantoja Rosero, Mathias Christian Haindl Carvallo

Image information about the state of a building after an earthquake, which can be collected without endangering the post-earthquake reconnaissance activities, can be used to reduce uncertainties in response predictions for future seismic events. This paper ...

Springer2024

Fusing Pre-existing Knowledge and Machine Learning for Enhanced Building Thermal Modeling and Control

Loris Di Natale

Buildings play a pivotal role in the ongoing worldwide energy transition, accounting for 30% of the global energy consumption. With traditional engineering solutions reaching their limits to tackle such large-scale problems, data-driven methods and Machine ...

EPFL2024

Seismic Testing of Adjacent Interacting Masonry Structures – Analysis of a Blind Prediction

Katrin Beyer, Igor Tomic, Andrea Penna

Masonry aggregates, which emerged as layouts of cities and villages became denser, make up historical centres all over the world. In these aggregates, neighbouring structures may share structural walls that are joined at the interfaces by mortar or interlo ...

Springer2024

Data-Driven Control Synthesis using Koopman Operator: A Robust Approach

Alireza Karimi, Mert Eyuboglu, Nathan Russell Powell

This paper proposes a data-driven control design method for nonlinear systems that builds upon the Koopman operator framework. In particular, the Koopman operator is used to lift the nonlinear dynamics to a higher-dimensional space where the so-called obse ...

2024

Augmented Memory: Sample-Efficient Generative Molecular Design with Reinforcement Learning

Philippe Schwaller, Jeff Guo

Sample efficiency is a fundamental challenge in de novo molecular design. Ideally, molecular generative models should learn to satisfy a desired objective under minimal calls to oracles (computational property predictors). This problem becomes more apparen ...

Amer Chemical Soc2024

Efficient Continual Finite-Sum Minimization

Volkan Cevher, Efstratios Panteleimon Skoulakis, Leello Tadesse Dadi

Given a sequence of functions

f_1,\ldots,f_n

with

f_i:\mathcal{D}\mapsto \mathbb{R}

, finite-sum minimization seeks a point

{x}^\star \in \mathcal{D}

minimizing

\sum_{j=1}^nf_j(x)/n

. In this work, we propose a key twist into the finite-sum minimizat ...

2024

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Gaston Jean Lenczner, Thiên-Anh Claris Nguyen, Marc Conrad Russwurm

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

Efficient Continual Finite-Sum Minimization

Volkan Cevher, Efstratios Panteleimon Skoulakis, Leello Tadesse Dadi

Given a sequence of functions

f_1,\ldots,f_n

with

f_i:\mathcal{D}\mapsto \mathbb{R}

, finite-sum minimization seeks a point

{x}^\star \in \mathcal{D}

minimizing

\sum_{j=1}^nf_j(x)/n

. In this work, we propose a key twist into the finite-sum minimizat ...

2024