Portrait of Arian Shah Kamrani is unavailable

Arian Shah Kamrani

Alumni

Publications

Multi-agent deep reinforcement learning with online and fair optimal dispatch of EV aggregators
Arian Shah Kamrani
Anoosh Dini
Hanane Dagdougui
Keyhan Sheshyekani
The growing popularity of electric vehicles (EVs) and the unpredictable behavior of EV owners have attracted attention to real-time coordina… (see more)tion of EVs charging management. This paper presents a hierarchical structure for charging management of EVs by integrating fairness and efficiency concepts within the operations of the distribution system operator (DSO) while utilizing a multi-agent deep reinforcement learning (MADRL) framework to tackle the complexities of energy purchasing and distribution among EV aggregators (EVAs). At the upper level, DSO calculates the maximum allowable power for each EVA based on power flow constraints to ensure grid safety. Then, it finds the optimal efficiency-jain tradeoff (EJT) point, where it sells the highest energy amount while ensuring equitable energy distribution. At the lower level, initially, each EVA acts as an agent employing a double deep Q-network (DDQN) with adaptive learning rates and prioritized experience replay to determine optimal energy purchases from the DSO. Then, the real-time smart dispatch (RSD) controller prioritizes EVs for energy dispatch based on relevant EVs information. Findings indicate the proposed enhanced DDQN outperforms deep deterministic policy gradient (DDPG) and proximal policy optimization (PPO) in cumulative rewards and convergence speed. Finally, the framework’s performance is evaluated against uncontrolled charging and the first come first serve (FCFS) scenario using the 118-bus distribution system, demonstrating superior performance in maintaining safe operation of the grid while reducing charging costs for EVAs. Additionally, the framework’s integration with renewable energy sources (RESs), such as photovoltaic (PV), demonstrates its potential to enhance grid reliability. • Introduces a scalable MADRL framework for real-time EV charging and energy distribution. • Ensures fairness via an Efficiency-Jain Tradeoff (EJT) strategy at the DSO level. • Enhances agent convergence with DDQN using adaptive learning rates and prioritized replay. • Preserves stakeholder privacy with decentralized control and minimal data sharing. • Balances grid reliability with equitable energy allocation under dynamic uncertainties.
2025-01-08
Machine Learning with Applications (published)
doi.org
A Two-Stage Optimization Framework for Electric Vehicle Fleet Day-ahead Charging Management
Arian Shah Kamrani
Hanane Dagdougui
Nowadays electric vehicles (EVs) have become one of the important means of transportation all over the world. The importance of EV owners’… (see more) privacy as well as smart EV fleet charging has always been one of the challenges in smart charging planning and management. Furthermore, in smart charging, the distribution system operator must also coordinate with EV aggregators to insure that the power system is operated within security limits while reducing charging costs and satisfying EV users’ energy needs. In this paper, a semi-private framework for EV owners has been introduced which solves a two-stage optimization problem for the smart control of EV charging. This framework considers charging cost reduction and peak load shaving as well as satisfying power grid constraints. At the higher stage, based on optimal power flow calculations, the proposed control signals are transferred to the lower stage in order to facilitate optimal scheduling in accordance with the mentioned goals. The obtained results based on the proposed optimal method implemented on the IEEE 33-bus network show that compared to uncontrolled charging, the cost of charging and the peak of the network are reduced by 5.31% and 4.90%, respectively. Moreover, all the constraints of the power grid are satisfied.
2023-08-12
2023 IEEE 11th International Conference on Smart Energy Grid Engineering (SEGE) (published)
doi.org