Cooperative multi-agent actor-critic for privacy-preserving load scheduling in a residential microgrid

Authors

Zhaoming Qin, Tsinghua University, Beijing, China
Nanqing Dong, University of Oxford, United Kingdom
Eric P. Xing, Carnegie Mellon University, United States & Mohamed bin Zayed University of Artificial IntelligenceFollow
Junwei Cao, Tsinghua University, Beijing, China

Document Type

Article

Publication Title

arXiv

Abstract

As a scalable data-driven approach, multi-agent reinforcement learning (MARL) has made remarkable advances in solving the cooperative residential load scheduling problems. However, the common centralized training strategy of MARL algorithms raises privacy risks for involved households. In this work, we propose a privacy-preserving multi-agent actor-critic framework where the decentralized actors are trained with distributed critics, such that both the decentralized execution and the distributed training do not require the global state information. The proposed framework can preserve the privacy of the households while simultaneously learn the multi-agent credit assignment mechanism implicitly. The simulation experiments demonstrate that the proposed framework significantly outperforms the existing privacy-preserving actor-critic framework, and can achieve comparable performance to the state-of-the-art actor-critic framework without privacy constraints. Copyright © 2021, The Authors. All rights reserved.

DOI

10.48550/arXiv.2110.02784

Publication Date

10-6-2021

Keywords

Cryptography and Security (cs.CR), Machine Learning (cs.LG); Multiagent Systems (cs.MA)

Comments

IR Deposit conditions: non-described

Preprint: arXiv

Recommended Citation

Z. Qin, N. Dong, E. Xing, and J. Cao, "Cooperative multi-agent actor-critic for privacy-preserving load scheduling in a residential microgrid", arXiv, Oct. 2021, doi: 10.48550/arXiv.2110.02784