Analyze discrete-state systems through transition matrices, communicating classes, stationary distributions, reversibility, and mixing times.
