Publications related to Fast Projection Onto Convex Smooth Constraints

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

Non-convex constrained optimization problems have become a powerful framework for modeling a wide range of machine learning problems, with applications in k-means clustering, large- scale semidefinite programs (SDPs), and various other tasks. As the perfor ...

EPFL2023

A Spatial Branch and Bound Algorithm for Continuous Pricing with Advanced Discrete Choice Demand Modeling

Michel Bierlaire

In this paper, we present a spatial branch and bound algorithm to tackle the continuous pricing problem, where demand is captured by an advanced discrete choice model (DCM). Advanced DCMs, like mixed logit or latent class models, are capable of modeling de ...

2023

Perspective Aware Road Obstacle Detection

Pascal Fua, Mathieu Salzmann, Krzysztof Maciej Lis, Sina Honari

While road obstacle detection techniques have become increasingly effective, they typically ignore the fact that, in practice, the apparent size of the obstacles decreases as their distance to the vehicle increases. In this letter, we account for this by c ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

On The Convergence Of Stochastic Primal-Dual Hybrid Gradient

Volkan Cevher, Ahmet Alacaoglu

In this paper, we analyze the recently proposed stochastic primal-dual hybrid gradient (SPDHG) algorithm and provide new theoretical results. In particular, we prove almost sure convergence of the iterates to a solution with convexity and linear convergenc ...

SIAM PUBLICATIONS2022

Information-driven transitions in projections of underdamped dynamics

Daniel Maria Busiello, Giorgio Nicoletti, Amos Maritan

Low-dimensional representations of underdamped systems often provide useful insights and analytical tractability. Here, we build such representations via information projections, obtaining an optimal model that captures the most information on observed spa ...

AMER PHYSICAL SOC2022

A first-order primal-dual method with adaptivity to local smoothness

Volkan Cevher, Maria-Luiza Vladarean

We consider the problem of finding a saddle point for the convex-concave objective

\min_x \max_y f(x) + \langle Ax, y\rangle - g^*(y)

, where

f

is a convex function with locally Lipschitz gradient and

g

is convex and possibly non-smooth. We propose an ...

2021

Adaptation in Stochastic Algorithms: From Nonsmooth Optimization to Min-Max Problems and Beyond

Ahmet Alacaoglu

Stochastic gradient descent (SGD) and randomized coordinate descent (RCD) are two of the workhorses for training modern automated decision systems. Intriguingly, convergence properties of these methods are not well-established as we move away from the spec ...

EPFL2021

Joint Angular Refinement and Reconstruction for Single-Particle Cryo-EM

Michaël Unser, Laurène Donati, Emmanuel Emilien Louis Soubies, Mona Zehni

Single-particle cryo-electron microscopy (cryo-EM) reconstructs the three-dimensional (3D) structure of bio-molecules from a large set of 2D projection images with random and unknown orientations. A crucial step in the single-particle cryo-EM pipeline is 3 ...

2020

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

Ali H. Sayed, Sulaiman A S A E Alghunaim, Ming Yan

This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function coupling all agents. This scenario arises in many machine learning and engineering ...

IEEE2020

Adaptive Gradient Descent without Descent

Konstantin Mishchenko

We present a strikingly simple proof that two rules are sufficient to automate gradient descent: 1) don’t increase the stepsize too fast and 2) don’t overstep the local curvature. No need for functional values, no line search, no information about the func ...

2020

Fast Projection Onto Convex Smooth Constraints

Graph Chatbot

Chat with Graph Search

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

A Spatial Branch and Bound Algorithm for Continuous Pricing with Advanced Discrete Choice Demand Modeling

Perspective Aware Road Obstacle Detection

On The Convergence Of Stochastic Primal-Dual Hybrid Gradient

Information-driven transitions in projections of underdamped dynamics

A first-order primal-dual method with adaptivity to local smoothness

Adaptation in Stochastic Algorithms: From Nonsmooth Optimization to Min-Max Problems and Beyond

Joint Angular Refinement and Reconstruction for Single-Particle Cryo-EM

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features

Adaptive Gradient Descent without Descent

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

A Spatial Branch and Bound Algorithm for Continuous Pricing with Advanced Discrete Choice Demand Modeling

Information-driven transitions in projections of underdamped dynamics

Adaptive Gradient Descent without Descent

Joint Angular Refinement and Reconstruction for Single-Particle Cryo-EM

Adaptation in Stochastic Algorithms: From Nonsmooth Optimization to Min-Max Problems and Beyond

On The Convergence Of Stochastic Primal-Dual Hybrid Gradient

A first-order primal-dual method with adaptivity to local smoothness

Perspective Aware Road Obstacle Detection

A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features