Publications by Amirreza Heidari

A trustworthy reinforcement learning framework for autonomous control of a large-scale complex heating system: Simulation and field implementation

François Maréchal, Luc Girardin, Amirreza Heidari

Traditional control approaches heavily rely on hard-coded expert knowledge, complicating the development of optimal control solutions as system complexity increases. Deep Reinforcement Learning (DRL) offers a selflearning control solution, proving advantag ...

Elsevier BV2025

DeepValve: Development and experimental testing of a Reinforcement Learning control framework for occupant-centric heating in offices

Dolaana Khovalyg, Amirreza Heidari

Space heating controls in offices usually follow static schedules detached from actual occupancy, which results in energy waste by unnecessarily heating vacant offices. The uniqueness of stochastic occupancy profile and thermal response time of each office ...

2023

Customized Neural Network training to predict the highly imbalanced data of domestic hot water usage

Dolaana Khovalyg, Amirreza Heidari

Despite space heating and cooling, the energy use for hot water production has not changed significantly over time and accounts for a big share in modern, well-insulated buildings. The main challenge of hot water generation lies in the highly stochastic na ...

CLIMA 2022 conference2022

Reinforcement learning for occupant-centric operation of residential energy system

François Maréchal, Dolaana Khovalyg, Amirreza Heidari

Occupant behavior is a highly stochastic phenomenon, which is known as a key challenge for the optimal control of residential energy systems. With the increasing share of renewable energy in the building sector, the volatile nature of renewable energy is a ...

TU Delft2022

Reinforcement Learning for the occupant-centric operation of building energy systems: Theoretical and experimental investigations

Amirreza Heidari

Occupant behavior, defined as the presence and energy-related actions of occupants, is today known as a key driver of building energy use. Closing the gap between what is provided by building energy systems and what is actually needed by occupants requires ...

EPFL2022

Reinforcement Learning for proactive operation of residential energy systems by learning stochastic occupant behavior and fluctuating solar energy: Balancing comfort, hygiene and energy use

François Maréchal, Dolaana Khovalyg, Amirreza Heidari

When it comes to residential buildings, there are several stochastic parameters, such as renewable energy production, outdoor air conditions, and occupants’ behavior, that are hard to model and predict accurately, with some being unique in each specific bu ...

2022

An occupant-centric control framework for balancing comfort, energy use and hygiene in hot water systems: A model-free reinforcement learning approach

François Maréchal, Dolaana Khovalyg, Amirreza Heidari

Occupants' behavior is a major source of uncertainty for the optimal operation of building energy systems. The highly stochastic hot water use behavior of occupants has led to conservative operational strategies for hot water systems, that try to ensure oc ...

2022

Adaptive hot water production based on Supervised Learning

Alexandre Massoud Alahi, Dolaana Khovalyg, Amirreza Heidari

A major challenge in the common approach of hot water generation in residential houses lies in the highly stochastic nature of domestic hot water (DHW) demand. Learning hot water use behavior enables water heating systems to continuously adapt to the stoch ...

2021

An adaptive control framework based on Reinforcement learning to balance energy, comfort and hygiene in heat pump water heating systems

François Maréchal, Dolaana Khovalyg, Amirreza Heidari

A major challenge in the operation of water heating systems lies in the highly stochastic nature of occupant behavior in hot water use, which varies over di,erent buildings and can change over the time. However, the current operational strategies of water ...

IOP PUBLISHING LTD2021

Optimal design and operation of a building energy hub: A comparison of exergy-based and energy-based optimization in Swiss and Italian case studies

Dolaana Khovalyg, Flourentzos Flourentzou, Joshua Pereira, Amirreza Heidari

With growing concerns on global warming, exergy-based design methods for energy hubs (EHs) in the urban context have been recently investigated to promote more rational and efficient use of energy sources. This study aims to compare exergy-based multi-obje ...

Elsevier2021