Publications

Mar, 2024

Conference Paper

A Transfer Learning Strategy for Improving the Data Efficiency of Deep Reinforcement Learning Control in Smart Buildings

Reinforcement learning (RL) is a powerful tool that has shown promising results in many domains such as robotics and game-playing. Because RL algorithms learn optimal control policies by continuously interacting with their environments, these algorithms require a lot of data to learn, which limits their application to a wide range of domains. For this reason, there is an i…

Mar, 2024

Conference Paper

Autonomous Anomaly Detection for MPC Forecasts of HVAC Systems in Residential Communities

The use of residential heating, ventilation, and air conditioning (HVAC) to shift peak demand or provide ancillary services is a potential solution in the presence of older grids and distributed renewables. However, to ensure the efficient use of devices, utilities need to accurately forecast the load and adopt error correction schemes when necessary. While significant the…

Jan, 2024

Conference Paper

Using Synchronization as an Indicator of Controllability in a Fleet of Water Heaters

Peak reduction is an important concern that can help reduce the growing stress on distribution grid and allow to defer investments in new capacity. However, the growing concern for customer privacy and comfort may impact the performance of load control for residential devices. Water heaters represent a convenient way of reducing peak due to their ability to store thermal e…

Jan, 2024

Conference Paper

Impact of Control on Availability and Cycling of Residential HVAC in a Real-World Experiment

Demand response is an important emerging part of smart grids and there is a large stream of research from theoretical and modeling perspectives. However, there is relatively little experimental evidence that could help researchers and building operators make informed decisions on best practices for modeling, developing, and deployment of control mechanisms. We contribute t…

Jan, 2024

Conference Paper

Peak Reduction Using Mode Adjustment of Heat Pump Water Heaters in a Residential Neighborhood

Building electrification is putting pressure on distribution grid worldwide. Peak reduction is an important concern that can help reduce the growing stress and allow to defer investments in new capacity. Water heaters represent a convenient way of reducing peak because they are less dependent on weather, and their storage volume allows for asynchronous water heating and ho…

Jan, 2024

Conference Paper

The Empirical Effect of Fleet Optimization on Synchronization and Rebound Effects in Heat Pump Water Heaters

Demand response is a growing concept in light of the internet of things and an increasing need for grid flexibility. Water heaters are one of the preferred devices for providing demand response for grid services and peak management due to their capability to store energy. The efficient use of water heaters for demand response requires consideration of the associated load e…

Jan, 2024

Conference Paper

Experimental Evidence on Latency in a Fleet of Controllable Water Heaters

Demand response is an important emerging part of smart grids with wide coverage in theoretical and modeling research. However, experimental evidence on the real-life behavior of controllable loads is still limited. We present observations regarding latency and communication aspects of the operation on a fleet of residential water heaters in a smart neighborhood in Atlanta,…

Jan, 2024

Conference Paper

Findings from Design and Operation of Connected Neighborhoods

Distributed energy resources and load management are an important emerging part of smart grids. Concurrent management of homeowner preferences and utility objectives requires an intelligent negotiation strategy supported by physical infrastructure that learns, optimizes, and controls the system. While there is a wide body of research related to modelling and simulation of…

Jan, 2024

Conference Paper

Analysis of Building Model Forecasts using Autonomous HVAC Optimization System for Residential Neighborhood

Heating, ventilation, and air conditioning (HVAC) systems account for the highest share of home energy consumption in the United States. Optimized HVAC control can provide thermal improved comfort to the occupants, improve energy efficiency, reduce energy cost, and support grid services. In this paper, we discuss a multi-agent and cloud-based software framework that has be…

Dec, 2023

ORNL Report

Scalable Load Management 2020 Q2

Dec, 2023

Journal

COVID-19 Pandemic Ramifications on Residential Smart Homes Energy Use Load Profiles

The COVID-19 pandemic has significantly affected people’s behavioral patterns and schedules because of stay-at-home orders and a reduction of social interactions. Therefore, the shape of electrical loads associated with residential buildings has also changed. In this paper, we quantify the changes and perform a detailed analysis on how the load shapes have changed, and we…

Nov, 2023

ORNL Report

Scalable Load Management System using Reinforcement Learning-FY22Q1