A discrete random time-evolution model defined by , where
- is the time
- is the state of the model
- is a Random variable dependent on the state at the previous time .
- defines our chosen controls over the system.
- is the control-input model.
- is the system’s noise.