|
||||||||
Linearization - Python Automation and Machine Learning for ICs - - An Online Book - |
||||||||
Python Automation and Machine Learning for ICs http://www.globalsino.com/ICs/ | ||||||||
Chapter/Index: Introduction | A | B | C | D | E | F | G | H | I | J | K | L | M | N | O | P | Q | R | S | T | U | V | W | X | Y | Z | Appendix | ||||||||
================================================================================= Linearization is a process of approximating a nonlinear model with a linear one around a specific operating point. This is often done to simplify the analysis and design of control strategies, such as applying linear control techniques like the Linear Quadratic Regulator (LQR). The linearization process involves finding the first-order Taylor series expansion of the nonlinear model. Figure 3661a shows an example of linearization. The grey dash line indicates the selected operating point mentioned below. Figure 3661a. Linearization. The general steps to linearize a nonlinear model are: i) Understand the Nonlinear Equation: For instance, in the non-linear mode of reinforcement learning (RL), we can have, Here, the derivatives can be different velocities. ii) Select an Operating Point: Choose an operating point around which you want to linearize the model. This is the point at which you'll evaluate the nonlinear equations and compute the linearization. For the RL case, we select an point iii) Define State and Input Variables: Identify the state variables (x) and input variables (u) in your nonlinear model. These are the variables that describe the system's state and the control inputs. iv) Write Down Nonlinear Equations: Express the nonlinear dynamic equations of the system. These equations might be in the form of differential equations or discrete-time update equations, depending on the nature of the system. v) Compute Partial Derivatives: Compute the partial derivatives of the nonlinear equations with respect to the state variables and control inputs. These derivatives represent the sensitivity of the system's dynamics to changes in the state and control input. vi) Evaluate Derivatives at the Operating Point: Substitute the values of the state and control input at the chosen operating point into the partial derivatives. This gives you the linearization evaluated at the operating point. vii) Form Linearized Equations: Combine the linearized terms to form a set of linearized equations that describe the system's dynamics around the operating point. The linearized equations are typically in the form of For the RL case, we then have, where, St+1 represents the next state of the system. Equation 3661c is an approximation of the state transition in a nonlinear system, linearized around an operating point. When we consider both state s and action a, then Equation 3661c becomes, The overall equation is an approximation that combines both the local linear behavior (given by the Jacobian term) and the baseline behavior (given by the function evaluation term). The linearization is useful for analyzing the system's behavior near the operating point and for designing control strategies, especially when linear control methods such as the Linear Quadratic Regulator (LQR) are applied.
============================================
|
||||||||
================================================================================= | ||||||||
|
||||||||