Current-constraint speed regulation for PMSM based on port-controlled Hamiltonian realization and deep deterministic policy gradient

Authors

Min Wang, Yanhong Liu, Qi Wang, Patrick Wheeler

Abstract

To ensure overcurrent protection, fast dynamic performance and good robustness, a novel speed regulation controller is proposed. The interconnection and damping assignment passivity-based control (IDA-PBC) of Port-controlled Hamiltonian (PCH) systems has the advantages of simple structure and explicit physical meaning. On account of fast dynamic performance and q-axis current-constraint are contradictory, this paper presents a current-constraint speed regulation method for the permanent magnet synchronous motor (PMSM) based on port-controlled Hamiltonian (PCH) realization and deep deterministic policy gradient (DDPG) to balance them. First, a modified IDA-PBC controller with integral action(IA) is constructed, which can regulate the speed and the current of the PMSM simultaneously, and be more suitable for practical applications due to the addition of IA. For both current-constraint and fast dynamic performance, the reinforcement learning of DDPG is utilized to find the optimal parameters of the controller. Finally, experiments are carried out to verify the effectiveness and robustness of the method.

Citation

• Journal: IEICE Electronics Express
• Year: 2024
• Volume: 21
• Issue: 2
• Pages: 20230516–20230516
• Publisher: Institute of Electronics, Information and Communications Engineers (IEICE)
• DOI: 10.1587/elex.20.20230516

BibTeX

@article{Wang_2024,
  title={{Current-constraint speed regulation for PMSM based on port-controlled Hamiltonian realization and deep deterministic policy gradient}},
  volume={21},
  ISSN={1349-2543},
  DOI={10.1587/elex.20.20230516},
  number={2},
  journal={IEICE Electronics Express},
  publisher={Institute of Electronics, Information and Communications Engineers (IEICE)},
  author={Wang, Min and Liu, Yanhong and Wang, Qi and Wheeler, Patrick},
  year={2024},
  pages={20230516--20230516}
}

Download the bib file

References

• Wang, Q. et al. A Low-Complexity Optimal Switching Time-Modulated Model-Predictive Control for PMSM With Three-Level NPC Converter. IEEE Trans. Transp. Electrific. 6, 1188–1198 (2020) – 10.1109/tte.2020.3012352
• Yang, H., Huang, X., Shen, Q., Li, Z. & Wu, M. A loss minimization control method for IPMSM drive system based on improved gradient descent algorithm. IEICE Electron. Express 19, 20220069–20220069 (2022) – 10.1587/elex.19.20220069
• Zeng, Q. & Chen, Y. Sensorless control for PMSM in underwater propeller based on improved phase-locked loop. IEICE Electron. Express 18, 20210111–20210111 (2021) – 10.1587/elex.18.20210111
• Wang, W. et al. Current Harmonic Suppression for Permanent-Magnet Synchronous Motor Based on Chebyshev Filter and PI Controller. IEEE Trans. Magn. 57, 1–6 (2021) – 10.1109/tmag.2020.3017671
• Wang, C. & Zhu, Z. Q. Fuzzy Logic Speed Control of Permanent Magnet Synchronous Machine and Feedback Voltage Ripple Reduction in Flux-Weakening Operation Region. IEEE Trans. on Ind. Applicat. 56, 1505–1517 (2020) – 10.1109/tia.2020.2967673
• Changliang Xia, Chen Guo & Tingna Shi. A Neural-Network-Identifier and Fuzzy-Controller-Based Algorithm for Dynamic Decoupling Control of Permanent-Magnet Spherical Motor. IEEE Trans. Ind. Electron. 57, 2868–2878 (2010) – 10.1109/tie.2009.2036030
• Yang, H., Bai, Y. & Chien, Y.-R. Generalized super-twisting sliding mode control of permanent magnet synchronous motor based on sinusoidal saturation function. IEICE Electron. Express 19, 20220066–20220066 (2022) – 10.1587/elex.19.20220066
• Cai, F., Yang, F., Chai, Q. & Jiang, J. Model predictive current control for dual three-phase PMSM with hybrid voltage vector. IEICE Electron. Express 19, 20220340–20220340 (2022) – 10.1587/elex.19.20220340
• van der Schaft, A. L2 - Gain and Passivity Techniques in Nonlinear Control. Communications and Control Engineering (Springer London, 2000). doi:10.1007/978-1-4471-0507-7 – 10.1007/978-1-4471-0507-7
• Ortega, R., van der Schaft, A., Maschke, B. & Escobar, G. Interconnection and damping assignment passivity-based control of port-controlled Hamiltonian systems. Automatica 38, 585–596 (2002) – 10.1016/s0005-1098(01)00278-3
• Zeng, J., Zhang, Z. & Qiao, W. An Interconnection and Damping Assignment Passivity-Based Controller for a DC–DC Boost Converter With a Constant Power Load. IEEE Trans. on Ind. Applicat. 50, 2314–2322 (2014) – 10.1109/tia.2013.2290872
• Pang, S. et al. Interconnection and Damping Assignment Passivity-Based Control Applied to On-Board DC–DC Power Converter System Supplying Constant Power Load. IEEE Trans. on Ind. Applicat. 55, 6476–6485 (2019) – 10.1109/tia.2019.2938149
• Zhang, T. & Xia, J. Interconnection and Damping Assignment Passivity-Based Impedance Control of a Compliant Assistive Robot for Physical Human–Robot Interactions. IEEE Robot. Autom. Lett. 4, 538–545 (2019) – 10.1109/lra.2019.2891434
• J. Harandi, M. R. & Taghirad, H. D. Adaptive interconnection and damping assignment passivity‐based control for an underactuated cable‐driven robot. Adaptive Control & Signal 35, 2487–2498 (2021) – 10.1002/acs.3332
• Khanchoul, M., Hilairet, M. & Normand-Cyrot, D. A passivity-based controller under low sampling for speed control of PMSM. Control Engineering Practice 26, 20–27 (2014) – 10.1016/j.conengprac.2013.12.013
• Wu, Z., Wu, C., Jia, W. & Zhao, L. Sensorless speed H∞ control for PMSM based on energy function. Optim Control Appl Methods 38, 949–955 (2017) – 10.1002/oca.2300
• Uddin, M. N., Zhai, Z. & Amin, I. K. Port Controlled Hamilton With Dissipation-Based Speed Control of IPMSM Drive. IEEE Trans. Power Electron. 35, 1742–1752 (2020) – 10.1109/tpel.2019.2918679
• Guo, T., Sun, Z., Wang, X., Li, S. & Zhang, K. A Simple Current-Constrained Controller for Permanent-Magnet Synchronous Motor. IEEE Trans. Ind. Inf. 15, 1486–1495 (2019) – 10.1109/tii.2018.2860968
• Wang, Y., Yu, H. & Liu, Y. Speed-Current Single-Loop Control With Overcurrent Protection for PMSM Based on Time-Varying Nonlinear Disturbance Observer. IEEE Trans. Ind. Electron. 69, 179–189 (2022) – 10.1109/tie.2021.3051594
• Backstepping control with integral action of PMSM integrated according to the MRAS observer. IOSRJEEE 9, 59–69 (2014) – 10.9790/1676-09415969
• de Moura, J. P., Rego, P. H. M. & da Fonseca Neto, J. V. Online discrete-time LQR controller design with integral action for bulk Bucket Wheel Reclaimer operational processes via Action-Dependent Heuristic Dynamic Programming. ISA Transactions 90, 294–310 (2019) – 10.1016/j.isatra.2019.01.010
• Donaire, A. & Junco, S. On the addition of integral action to port-controlled Hamiltonian systems. Automatica 45, 1910–1916 (2009) – 10.1016/j.automatica.2009.04.006
• [23] T.P. Lillicrap, et al.: “Continuous control with deep reinforcement learning,” Computer Science 8 (2015) (DOI: 10.32657/10356/90191).
• Sutton, R. S. & Barto, A. G. Reinforcement Learning: An Introduction. IEEE Trans. Neural Netw. 9, 1054–1054 (1998) – 10.1109/tnn.1998.712192
• Mnih, V. et al. Human-level control through deep reinforcement learning. Nature 518, 529–533 (2015) – 10.1038/nature14236
• [26] S. David, et al.: “Deterministic policy gradient algorithms,” 31st International Conference on Machine Learning (2014).
• Peng, J. & Yuan, Y. Moving Object Grasping Method of Mechanical Arm Based on Deep Deterministic Policy Gradient and Hindsight Experience Replay. JACIII 26, 51–57 (2022) – 10.20965/jaciii.2022.p0051
• Wei, Z. et al. Deep Deterministic Policy Gradient-DRL Enabled Multiphysics-Constrained Fast Charging of Lithium-Ion Battery. IEEE Trans. Ind. Electron. 69, 2588–2598 (2022) – 10.1109/tie.2021.3070514
• Ying, F., Liu, H., Jiang, R. & Yin, X. Trajectory Generation for Multiprocess Robotic Tasks Based on Nested Dual-Memory Deep Deterministic Policy Gradient. IEEE/ASME Trans. Mechatron. 27, 4643–4653 (2022) – 10.1109/tmech.2022.3160605
• Kommuri, S. K., Lee, S. B. & Veluvolu, K. C. Robust Sensors-Fault-Tolerance With Sliding Mode Estimation and Control for PMSM Drives. IEEE/ASME Trans. Mechatron. 23, 17–28 (2018) – 10.1109/tmech.2017.2783888
• Zhu, C. et al. Global fast terminal sliding mode control strategy for permanent magnet synchronous motor based on load torque Luenberger observer. IEICE Electron. Express 18, 20210348–20210348 (2021) – 10.1587/elex.18.20210348