Publication

Data-Driven Control and Optimization under Noisy and Uncertain Conditions

Baiwei Guo
2023
EPFL thesis
Abstract

Control systems operating in real-world environments often face disturbances arising from measurement noise and model mismatch. These factors can significantly impact the perfor- mance and safety of the system. In this thesis, we aim to leverage data to derive near-optimal solutions to robust control and optimization problems despite the uncertainties.The first part focuses on data-driven robust optimal control of linear systems for trajectory tracking under measurement noise. Existing data-driven methods based on behavioral system theory use historical system trajectories to formulate robust optimal control problems. These approaches employ regularization terms to avoid overfitting. However, the corresponding suboptimality bounds are conservative due to the influence of the regularization terms on prediction error analysis. To overcome this problem, we derive two prediction error bounds which can be embedded in regularization-free robust control methods. One is attained by using bootstrap methods when resampling is affordable and the other relies on perturbation analysis of the behavioral model. These bounds enable the design of open-loop control inputs and closed-loop controllers to minimize the upper bound for the worst-case cost, while ensuring robust constraint satisfaction and suboptimality bounds that decrease to zero as noise diminishes.The second part of this thesis addresses constrained optimization problems with model uncertainties. We assume that the objective and constraint functions are not known but can be queried while all the samples have to be feasible. This setting, called safe zeroth-order optimization, can be applied to various control problems including optimal power flow and controller tuning where system models are only partially known and safety (sample feasibility) is essential. To derive a stationary point, we propose a novel method, SZO- QQ, that iteratively constructs convex subproblems through local approximations of the unknown functions. These subproblems are easier to solve than those arising in Bayesian Optimization. We show that the iterates of SZO-QQ converge to the neighborhood of a stationary point. We also analyze the sample complexity needed to achieve a certain level of accuracy and demonstrate that SZO-QQ is more sample-efficient than log-barrier-based zeroth-order methods. To further enhance sample and computation efficiency, we propose SZO-LP, a variant of SZO-QQ that solves linear programs in each iteration. Experiments on an optimal power flow problem in a 30-bus grid highlight the scalability of our algorithms.

About this result
This page is automatically generated and may contain information that is not correct, complete, up-to-date, or relevant to your search query. The same applies to every other page on this website. Please make sure to verify the information with EPFL's official sources.
Related concepts (38)
Mathematical optimization
Mathematical optimization (alternatively spelled optimisation) or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfields: discrete optimization and continuous optimization. Optimization problems arise in all quantitative disciplines from computer science and engineering to operations research and economics, and the development of solution methods has been of interest in mathematics for centuries.
Control theory
Control theory is a field of control engineering and applied mathematics that deals with the control of dynamical systems in engineered processes and machines. The objective is to develop a model or algorithm governing the application of system inputs to drive the system to a desired state, while minimizing any delay, overshoot, or steady-state error and ensuring a level of control stability; often with the aim to achieve a degree of optimality. To do this, a controller with the requisite corrective behavior is required.
Closed-loop controller
A closed-loop controller or feedback controller is a control loop which incorporates feedback, in contrast to an open-loop controller or non-feedback controller. A closed-loop controller uses feedback to control states or outputs of a dynamical system. Its name comes from the information path in the system: process inputs (e.g., voltage applied to an electric motor) have an effect on the process outputs (e.g., speed or torque of the motor), which is measured with sensors and processed by the controller; the result (the control signal) is "fed back" as input to the process, closing the loop.
Show more
Related publications (211)

Quantifying the Unknown: Data-Driven Approaches and Applications in Energy Systems

Paul Scharnhorst

In light of the challenges posed by climate change and the goals of the Paris Agreement, electricity generation is shifting to a more renewable and decentralized pattern, while the operation of systems like buildings is increasingly electrified. This calls ...
EPFL2024

Data-Driven Control Synthesis using Koopman Operator: A Robust Approach

Alireza Karimi, Mert Eyuboglu, Nathan Russell Powell

This paper proposes a data-driven control design method for nonlinear systems that builds upon the Koopman operator framework. In particular, the Koopman operator is used to lift the nonlinear dynamics to a higher-dimensional space where the so-called obse ...
2024

Violation-aware contextual Bayesian optimization for controller performance optimization with unmodeled constraints

Colin Neil Jones, Bratislav Svetozarevic, Wenjie Xu

We study the problem of performance optimization of closed -loop control systems with unmodeled dynamics. Bayesian optimization (BO) has been demonstrated to be effective for improving closed -loop performance by automatically tuning controller gains or re ...
Elsevier Sci Ltd2024
Show more
Related MOOCs (32)
Digital Signal Processing I
Basic signal processing concepts, Fourier analysis and filters. This module can be used as a starting point or a basic refresher in elementary DSP
Digital Signal Processing II
Adaptive signal processing, A/D and D/A. This module provides the basic tools for adaptive filtering and a solid mathematical framework for sampling and quantization
Digital Signal Processing III
Advanced topics: this module covers real-time audio processing (with examples on a hardware board), image processing and communication system design.
Show more

Graph Chatbot

Chat with Graph Search

Ask any question about EPFL courses, lectures, exercises, research, news, etc. or try the example questions below.

DISCLAIMER: The Graph Chatbot is not programmed to provide explicit or categorical answers to your questions. Rather, it transforms your questions into API requests that are distributed across the various IT services officially administered by EPFL. Its purpose is solely to collect and recommend relevant references to content that you can explore to help you answer your questions.