Publications related to Scalable Convex Methods for Phase Retrieval

Safe Zeroth-Order Convex Optimization Using Quadratic Local Approximations

Giancarlo Ferrari Trecate, Maryam Kamgarpour, Yuning Jiang, Baiwei Guo

We address black-box convex optimization problems, where the objective and constraint functions are not explicitly known but can be sampled within the feasible set. The challenge is thus to generate a sequence of feasible points converging towards an optim ...

2023

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

Mehmet Fatih Sahin

Non-convex constrained optimization problems have become a powerful framework for modeling a wide range of machine learning problems, with applications in k-means clustering, large- scale semidefinite programs (SDPs), and various other tasks. As the perfor ...

EPFL2023

A first-order primal-dual method with adaptivity to local smoothness

Volkan Cevher, Maria-Luiza Vladarean

We consider the problem of finding a saddle point for the convex-concave objective

\min_x \max_y f(x) + \langle Ax, y\rangle - g^*(y)

, where

f

is a convex function with locally Lipschitz gradient and

g

is convex and possibly non-smooth. We propose an ...

2021

A Newton Frank-Wolfe method for constrained self-concordant minimization

Volkan Cevher, Quoc Tran Dinh

We develop a new Newton Frank-Wolfe algorithm to solve a class of constrained self-concordant minimization problems using linear minimization oracles (LMO). Unlike L-smooth convex functions, where the Lipschitz continuity of the objective gradient holds gl ...

SPRINGER2021

Large Steps in Inverse Rendering of Geometry

Wenzel Alban Jakob, Baptiste Alexandre Marie Philippe Claude Nicolet

Inverse reconstruction from images is a central problem in many scientific and engineering disciplines. Recent progress on differentiable rendering has led to methods that can efficiently differentiate the full process of image formation with respect to mi ...

ASSOC COMPUTING MACHINERY2021

Adaptive Gradient Descent without Descent

Konstantin Mishchenko

We present a strikingly simple proof that two rules are sufficient to automate gradient descent: 1) don’t increase the stepsize too fast and 2) don’t overstep the local curvature. No need for functional values, no line search, no information about the func ...

2020

A Non-Euclidean Gradient Descent Framework for Non-Convex Matrix Factorization

Volkan Cevher, Anastasios Kyrillidis, Ya-Ping Hsieh, Rabeeh Karimi Mahabadi, Yu-Chun Kao

We study convex optimization problems that feature low-rank matrix solutions. In such scenarios, non-convex methods offer significant advantages over convex methods due to their lower space complexity as well as faster convergence speed. Moreover, many of ...

2018

A Data-Driven Frequency-Domain Approach for Robust Controller Design via Convex Optimization

Achille Nicoletti

The objective of this dissertation is to develop data-driven frequency-domain methods for designing robust controllers through the use of convex optimization algorithms. Many of today's industrial processes are becoming more complex, and modeling accurate ...

EPFL2018

Distributed Modifier-Adaptation Schemes for the Real-Time Optimization of Interconnected Systems in the Presence of Structural Plant-Model Mismatch

Dominique Bonvin, René Uwe Schneider, Predrag Milosavljevic

The desire to operate chemical processes in a safe and economically optimal way has motivated the development of so-called real-time optimization (RTO) methods [1]. For continuous processes, these methods aim to compute safe and optimal steady-state set ...

2016

MATHICSE Technical Report : Multi space reduced basis preconditioners for large-scale parametrized PDEs

Alfio Quarteroni, Simone Deparis, Andrea Manzoni, Niccolò Dal Santo

In this work we introduce a new two-level preconditioner for the efficient solution of large scale linear systems arising from the discretization of parametrized PDEs. The proposed preconditioner combines in a multiplicative way a reduced basis solver, whi ...

MATHICSE2016

Scalable Convex Methods for Phase Retrieval

Graph Chatbot

Chat with Graph Search

Safe Zeroth-Order Convex Optimization Using Quadratic Local Approximations

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

A first-order primal-dual method with adaptivity to local smoothness

A Newton Frank-Wolfe method for constrained self-concordant minimization

Large Steps in Inverse Rendering of Geometry

Adaptive Gradient Descent without Descent

A Non-Euclidean Gradient Descent Framework for Non-Convex Matrix Factorization

A Data-Driven Frequency-Domain Approach for Robust Controller Design via Convex Optimization

Distributed Modifier-Adaptation Schemes for the Real-Time Optimization of Interconnected Systems in the Presence of Structural Plant-Model Mismatch

MATHICSE Technical Report : Multi space reduced basis preconditioners for large-scale parametrized PDEs

A Newton Frank-Wolfe method for constrained self-concordant minimization

A first-order primal-dual method with adaptivity to local smoothness

Augmented Lagrangian Methods for Provable and Scalable Machine Learning

Safe Zeroth-Order Convex Optimization Using Quadratic Local Approximations

Large Steps in Inverse Rendering of Geometry

Adaptive Gradient Descent without Descent

A Non-Euclidean Gradient Descent Framework for Non-Convex Matrix Factorization

A Data-Driven Frequency-Domain Approach for Robust Controller Design via Convex Optimization

Distributed Modifier-Adaptation Schemes for the Real-Time Optimization of Interconnected Systems in the Presence of Structural Plant-Model Mismatch

MATHICSE Technical Report : Multi space reduced basis preconditioners for large-scale parametrized PDEs