Can reinforcement learning revolutionize control technology? The Cognitive Train/Test System for Reinforcement Learning using Labs (CTRL) project sets up an infrastructure for independent control in the distribution grid.

The project offers an infrastructure for training control concepts for distributed plants. Agents are prepared for their areas of application from simulated pretraining and realistic hardware-in-the-loop methods to field tests. As a result, an agent independently maintains voltage stability in a local grid transformer.

The project is interesting to:

Power plant manufacturers

Goals

  • Designing a tool chain for the development, testing, and establishment of a reinforcement learning (RL) agent for control concepts in energy system technology
  • Developing a validation plan for offline training, RCP optimization, and testing, hardware-in-the-loop optimization and validation as well as field testing
  • Integrating adaptive black-box approaches and flexible communication links between the reinforcement learning agent, the controlled test system, and the energy system
  • Testing the tool chain by developing, testing, and establishing an RL agent for the intelligent control of local grid transformers
Dr.-Ing. Ron Brandl

Projekt manager

Fraunhofer IEE

+49 (0) 561 7294-103

Methods

Control applications are usually based on a heterogenous method, i.e. a combination of complex systems that are partly independent of each other. The methods used in the project are particularly suitable for working with this complex system.

The following steps were taken to identify a suitable RL agent:

  1. Offline training: Developing an RL agent (type, size, parameterization)
  2. RCP training: Mapping real interfaces and real-time performance
  3. HIL training/testing: Testing and optimization in realistic application
  4. Field validation: Testing in the realistic area of application

Project information

Project participants, Fraunhofer IEE

Dr. Ron Brandl, Juan Montoya

Project period

2020

Share this Spotlight with your network.

KESL2RPN - Stromnetz managt selbstständig HerausforderungenKESL2RPN – Power grid manages challenges independently