Publications related to Hessian Schatten-Norm Regularization for Linear Inverse Problems

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

Non-convex constrained optimization problems have become a powerful framework for modeling a wide range of machine learning problems, with applications in k-means clustering, large- scale semidefinite programs (SDPs), and various other tasks. As the perfor ...

EPFL2023

Learning of Continuous and Piecewise-Linear Functions With Hessian Total-Variation Regularization

Michaël Unser, Shayan Aziznejad, Joaquim Gonçalves Garcia Barreto Campos

We develop a novel 2D functional learning framework that employs a sparsity-promoting regularization based on second-order derivatives. Motivated by the nature of the regularizer, we restrict the search space to the span of piecewise-linear box splines shi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Optimization Over Banach Spaces: A Unified View on Supervised Learning and Inverse Problems

Shayan Aziznejad

In this thesis, we reveal that supervised learning and inverse problems share similar mathematical foundations. Consequently, we are able to present a unified variational view of these tasks that we formulate as optimization problems posed over infinite-di ...

EPFL2022

Predicting in Uncertain Environments: Methods for Robust Machine Learning

Paul Thierry Yves Rolland

One of the main goal of Artificial Intelligence is to develop models capable of providing valuable predictions in real-world environments. In particular, Machine Learning (ML) seeks to design such models by learning from examples coming from this same envi ...

EPFL2022

Convex optimization in sums of Banach spaces

Michaël Unser, Shayan Aziznejad

We characterize the solution of a broad class of convex optimization problems that address the reconstruction of a function from a finite number of linear measurements. The underlying hypothesis is that the solution is decomposable as a finite sum of compo ...

2021

KPC: Learning-Based Model Predictive Control with Deterministic Guarantees

Colin Neil Jones, Yuning Jiang, Paul Scharnhorst, Emilio Maddalena

We propose Kernel Predictive Control (KPC), a learning-based predictive control strategy that enjoys deterministic guarantees of safety. Noise-corrupted samples of the unknown system dynamics are used to learn several models through the formalism of non-pa ...

2021

Convergence of adaptive algorithms for constrained weakly convex optimization

Volkan Cevher, Ahmet Alacaoglu, Yurii Malitskyi

We analyze the adaptive first order algorithm AMSGrad, for solving a constrained stochastic optimization problem with a weakly convex objective. We prove the

\tilde O(t^{-1/2})

rate of convergence for the squared norm of the gradient of Moreau envelope, ...

2021

A Unifying Representer Theorem for Inverse Problems and Machine Learning

Michaël Unser

Regularization addresses the ill-posedness of the training problem in machine learning or the reconstruction of a signal from a limited number of measurements. The method is applicable whenever the problem is formulated as an optimization task. The standar ...

2020

Bootstrapping massive quantum field theories

Denis Karateev

We propose a new non-perturbative method for studying UV complete unitary quantum field theories (QFTs) with a mass gap in general number of spacetime dimensions. The method relies on unitarity formulated as positive semi-definiteness of the matrix of inne ...

SPRINGER2020

Maximum-likelihood estimation of kinetic parameters via the extent-based incremental approach

Dominique Bonvin, Julien Léo Billeter, Diogo Filipe Mateus Rodrigues

For lumped homogeneous reaction systems, this paper presents a kinetic model identification scheme that provides maximum-likelihood parameter estimates and guarantees convergence to global optimality. The use of the extent-based incremental approach allows ...

PERGAMON-ELSEVIER SCIENCE LTD2019

Hessian Schatten-Norm Regularization for Linear Inverse Problems

Graph Chatbot

Chat with Graph Search

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

Learning of Continuous and Piecewise-Linear Functions With Hessian Total-Variation Regularization

Optimization Over Banach Spaces: A Unified View on Supervised Learning and Inverse Problems

Predicting in Uncertain Environments: Methods for Robust Machine Learning

Convex optimization in sums of Banach spaces

KPC: Learning-Based Model Predictive Control with Deterministic Guarantees

Convergence of adaptive algorithms for constrained weakly convex optimization

A Unifying Representer Theorem for Inverse Problems and Machine Learning

Bootstrapping massive quantum field theories

Maximum-likelihood estimation of kinetic parameters via the extent-based incremental approach

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

Bootstrapping massive quantum field theories

Optimization Over Banach Spaces: A Unified View on Supervised Learning and Inverse Problems

Convex optimization in sums of Banach spaces

Maximum-likelihood estimation of kinetic parameters via the extent-based incremental approach

KPC: Learning-Based Model Predictive Control with Deterministic Guarantees

A Unifying Representer Theorem for Inverse Problems and Machine Learning

Predicting in Uncertain Environments: Methods for Robust Machine Learning

Convergence of adaptive algorithms for constrained weakly convex optimization

Learning of Continuous and Piecewise-Linear Functions With Hessian Total-Variation Regularization