A discrete random time-evolution model defined by , where

  • is the time
  • is the state of the model
  • is a Random variable dependent on the state at the previous time .
  • defines our chosen controls over the system.
  • is the control-input model.
  • is the system’s noise.