Deep learning

Pure mathematics

Mathematics

Stochastic neural network

Politics

Recurrent neural network

Model predictive control

Political science

Artificial intelligence

Control (management)

Representation (politics)

Computer science

Control theory (sociology)

Rectifier (neural networks)

Artificial neural network

Function approximation

Affine transformation

IEEE Transactions on Cybernetics

We show that artificial neural networks with rectifier units as activation functions can exactly represent the piecewise affine function that results from the formulation of model predictive control (MPC) of linear time-invariant systems. The choice of deep neural networks is particularly interesting as they can represent exponentially many more affine regions compared to networks with only one hidden layer. We provide theoretical bounds on the minimum number of hidden layers and neurons per layer that a neural network should have to exactly represent a given MPC law. The proposed approach has a strong potential as an approximation method of predictive control laws, leading to a better approximation quality and significantly smaller memory requirements than previous approaches, as we illustrate via simulation examples. We also suggest different alternatives to correct or quantify the approximation error. Since the online evaluation of neural networks is extremely simple, the approximated controllers can be deployed on low-power embedded devices with small storage capacity, enabling the implementation of advanced decision-making strategies for complex cyber-physical systems with limited computing capabilities.

Efficient Representation and Approximation of Model Predictive Control Laws via Deep Learning