Publication
Regularized Diffusion Adaptation via Conjugate Smoothing
Publications associées (37)
Extensions of Peer Prediction Incentive Mechanisms
As large, data-driven artificial intelligence models become ubiquitous, guaranteeing high data quality is imperative for constructing models. Crowdsourcing, community sensing, and data filtering have long been the standard approaches to guaranteeing or imp ...
EPFL2024Efficient local linearity regularization to overcome catastrophic overfitting
Volkan Cevher, Grigorios Chrysos, Fanghui Liu, Elias Abad Rocamora
Catastrophic overfitting (CO) in single-step adversarial training (AT) results in abrupt drops in the adversarial test accuracy (even down to 0%). For models trained with multi-step AT, it has been observed that the loss function behaves locally linearly w ...
2024Memory of Motion for Initializing Optimization in Robotics
Many robotics problems are formulated as optimization problems. However, most optimization solvers in robotics are locally optimal and the performance depends a lot on the initial guess. For challenging problems, the solver will often get stuck at poor loc ...
EPFL2022Semi-Discrete Optimal Transport: Hardness, Regularization and Numerical Solution
Daniel Kuhn, Soroosh Shafieezadeh Abadeh, Bahar Taskesen
Semi-discrete optimal transport problems, which evaluate the Wasserstein distance between a discrete and a generic (possibly non-discrete) probability measure, are believed to be computationally hard. Even though such problems are ubiquitous in statistics, ...
2021Comparison of non-parametric T2 relaxometry methods for myelin water quantification
Jean-Philippe Thiran, Tobias Kober, Tom Hilbert, Erick Jorge Canales Rodriguez, Marco Pizzolato, Gian Franco Piredda, Thomas Yu, Alessandro Daducci, Nicolas Kunz
Multi-component T2 relaxometry allows probing tissue microstructure by assessing compartment-specific T2 relaxation times and water fractions, including the myelin water fraction. Non-negative least squares (NNLS) with zero-order Tikhonov regularization is ...
2021Wasserstein Distributionally Robust Learning
Many decision problems in science, engineering, and economics are affected by uncertainty, which is typically modeled by a random variable governed by an unknown probability distribution. For many practical applications, the probability distribution is onl ...
EPFL2020From Data to Decisions: Distributionally Robust Optimization is Optimal
Daniel Kuhn, Peyman Mohajerin Esfahani
We study stochastic programs where the decision-maker cannot observe the distribution of the exogenous uncertainties but has access to a finite set of independent samples from this distribution. In this setting, the goal is to find a procedure that transfo ...
2020Scalable Stochastic Optimization: Scenario Reduction with Guarantees
Stochastic optimization is a popular modeling paradigm for decision-making under uncertainty and has a wide spectrum of applications in management science, economics and engineering. However, the stochastic optimization models one faces in practice are int ...
EPFL2020Distributional Robustness in Mechanism Design
Mechanism design theory examines the design of allocation mechanisms or incentive systems involving multiple rational but self-interested agents and plays a central role in many societally important problems in economics. In mechanism design problems, agen ...
EPFL2020A Unifying Representer Theorem for Inverse Problems and Machine Learning
Regularization addresses the ill-posedness of the training problem in machine learning or the reconstruction of a signal from a limited number of measurements. The method is applicable whenever the problem is formulated as an optimization task. The standar ...
2020