Skip to feedback

Award Abstract # 1839387
EAGER/Collaborative Research: Real-Time: Hybrid Control Architectures Combining Physical Models and Real-time Learning

NSF Org: CMMI
Division of Civil, Mechanical, and Manufacturing Innovation
Recipient: UNIVERSITY OF VERMONT & STATE AGRICULTURAL COLLEGE
Initial Amendment Date: August 20, 2018
Latest Amendment Date: August 20, 2018
Award Number: 1839387
Award Instrument: Standard Grant
Program Manager: Robert Landers
CMMI
 Division of Civil, Mechanical, and Manufacturing Innovation
ENG
 Directorate for Engineering
Start Date: September 1, 2018
End Date: August 31, 2020 (Estimated)
Total Intended Award Amount: $149,879.00
Total Awarded Amount to Date: $149,879.00
Funds Obligated to Date: FY 2018 = $149,879.00
History of Investigator:
  • Luis Duffaut Espinosa (Principal Investigator)
    lduffaut@uvm.edu
Recipient Sponsored Research Office: University of Vermont & State Agricultural College
85 S PROSPECT STREET
BURLINGTON
VT  US  05405-1704
(802)656-3660
Sponsor Congressional District: 00
Primary Place of Performance: University of Vermont & State Agricultural College
VT  US  05405-0156
Primary Place of Performance
Congressional District:
00
Unique Entity Identifier (UEI): Z94KLERAG5V9
Parent UEI:
NSF Program(s): Special Initiatives
Primary Program Source: 01001819DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 030E, 034E, 7916, 8024, 9102, 9150
Program Element Code(s): 164200
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.041

ABSTRACT

Machine learning has become a focus of many researchers as effective solution to many complex engineering problems. At its core machine learning are the methods that provide computers ways to learn using available data. Artificial neural networks (ANN) have traditionally been the backbone of machine learning methods. While these learning systems certainly have their strengths, they also have limitations in the context of control engineering. For example, physics based models often provide key physical insight into the design of control systems for power grids, autonomous vehicles, and robots. So completely discarding such models in the context of learning based control systems is often counterproductive. This EArly-concept Grant for Exploratory Research (EAGER) project aims to develop a new, foundational and innovative control architecture which combines the advantages of model based design methods with those of real-time learning. The architecture is based on recent advances in the mathematical modeling of dynamical systems. While well suited for a variety of applications in engineering, biology, and ecology, the target application is the safe and reliable control of smart grids. The latter are clearly of vital importance for future economic development and the security of the nation's constantly evolving energy distribution system. Project outcomes will provide practical solutions to complex energy management problems involving uncertain power demands, energy limits, and use of renewable resources while at the same time maintaining grid stability and reliability.

The hybrid control architecture involves a given system and an assumed physical model both driven by the same control input. The measured difference between their outputs defines an error system. The key idea is to use a generic input-output representation known as a Chen-Fliess functional series to describe this unknown error system. The series coefficients are estimated in real-time via a minimum mean-square error estimator. Effectively, the conventional artificial neuron is replaced here by this new type of learning unit to approximate the error system. The control problem is solved via predictive control using the assumed model and the learned error system. The enabling technology is recent advances in the numerical approximation of Chen-Fliess series which make it possible to implement the scheme in discrete-time. The specific objectives of the project are to (1) advance the theoretical foundations that underpin real-time learning for control applications, including the cascading of these new learning units for deep learning (2) optimize and adapt the novel theoretical results for real-time control of smart grids to provide a priori performance guarantees. The main problem here lies in the uncertainty coming from the over-simplified/poorly modeled dynamics of the grid in addition to the action of renewable resources.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 12)
Duffaut Espinosa, Luis A. and Gray, W. Steven and Venkatesh, G. S. "Learning Control for Voltage and Frequency Regulation of an Infinite Bus System" Proc. 24st International Conference on System Theory, Control and Computing , 2020 https://doi.org/10.1109/ICSTCC50638.2020.9259638 Citation Details
Duffaut Espinosa, Luis A. and Khurram, Adil and Almassalkhi, Mads "A Virtual Battery Model for Packetized Energy Management" 59th IEEE Conference on Decision and Control , 2020 https://doi.org/ Citation Details
Espinosa, L. A. Duffaut and Khurram, Adil and Almassalkhi, Mads "Reference-Tracking Control Policies for Packetized Coordination of Heterogeneous DER Populations" IEEE Transactions on Control Systems Technology , v.29 , 2021 https://doi.org/10.1109/TCST.2020.3039492 Citation Details
Espinosa, Luis A. and Almassalkhi, Mads "A Packetized Energy Management Macromodel With Quality of Service Guarantees for Demand-Side Resources" IEEE Transactions on Power Systems , v.35 , 2020 https://doi.org/10.1109/TPWRS.2020.2981436 Citation Details
Gray, W. Steven and Venkatesh, G. S. and Duffaut Espinosa, Luis A. "Combining Learning and Model Based Control: Case Study for Single-Input Lotka-Volterra System" Proceedings of the ... American Control Conference , 2019 Citation Details
Gray, W. Steven and Venkatesh, G.S. and Duffaut Espinosa, Luis A. "Nonlinear system identification for multivariable control via discrete-time ChenFliess series" Automatica , v.119 , 2020 https://doi.org/10.1016/j.automatica.2020.109085 Citation Details
Gray, W. Steven and Venkatesh, G. S. and Espinosa, Luis A. "Discrete-time Chen Series for Time Discretization and Machine Learning" 2019 53rd Annual Conference on Information Sciences and Systems (CISS) , 2019 10.1109/ciss.2019.8692913 Citation Details
H. Mavalizadeh, L. A. "Decentralized Frequency Control using Packet-based Energy Coordination,`" 2020 IEEE International Conference on Communications, Control, and Computing Technologies for Smart Grids , 2020 https://doi.org/ Citation Details
Khurram, Adil and Malhame, R. and Duffaut Espinosa, Luis A. and Almassalkhi, Mads R. "Identification of Water Demand Process of Electric Water Heaters from Energy Measurements" XXI Power Systems Computation Conference , 2020 https://doi.org/ Citation Details
Khurram, Adil and Malhame, R. and Duffaut Espinosa, Luis A. and Almassalkhi, Mads R. "Identification of Water Demand Process of Electric Water Heaters from Energy Measurements" XXI Power Systems Computation Conference , 2020 https://doi.org/ Citation Details
Khurram, Adil and Malhamé, Roland and Duffaut Espinosa, Luis and Almassalkhi, Mads "Identification of hot water end-use process of electric water heaters from energy measurements" Electric Power Systems Research , v.189 , 2020 https://doi.org/10.1016/j.epsr.2020.106625 Citation Details
(Showing: 1 - 10 of 12)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

This project developed and tested a new type of data-driven machine learning architecture for the control of complex systems, such as conventional power generation machines on a grid, to improve their performance and reliability. Image 1 shows an example where a power generator is controlled by conventional means but also augmented by learning units in order to maintain a constant frequency and output voltage. This new approach combines both model-based design methods with those of real-time learning and data-driven control using an actor-critic paradigm. In particular, it was shown that online data-driven learning can be used to improve the robustness against model uncertainty by augmenting traditional engineering control systems in a way that avoids competition between them during normal operation but actively compensates or adapts when the system undergoes changes or is under stress. To support our claim, image 2 illustrates the response of a synchronous generator machine to a sudden change in its inertia. Without learning the machine does not maintain the desire unity output voltage.

Specific outcomes include new learning and adaptive design methodologies, proof of concept simulations, and novel techniques for real-time implementation. Stimulated by these discoveries, new analytical tools were developed and new directions on the applicability of the learning-based hybrid controller were identified. These help understand how interconnected nonlinear systems such as biological neutral networks, internet communications systems, and transportation systems behave under a variety of real-work situations as well as the potential for the data-driven control of distributed energy resources (DERs) for power systems balancing affected by renewable resources uncertainty. Image 3 shows how a complex system comprised of DER can be used for tracking a power signal. The system is highly uncertain and will benefit from the tools and models developed in this project to produce an appropriate data-driven adaptive control policy. 


Last Modified: 12/29/2020
Modified by: Luis A Duffaut Espinosa

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page