Markov Chains

Formats Non-Member Member
$31.0 $31.0
Learn how you can qualify for the best price for this item!
Become an IEEE Member or Subscribe to
IEEE Xplore for exclusive pricing!
close button

puzzle piece

IEEE membership options for an individual and IEEE Xplore subscriptions for an organization offer the most affordable access to essential journal articles, conference papers, standards, books, and eLearning courses.

Learn more about:

IEEE membership

IEEE Xplore subscriptions

1 Author(s)

This chapter contains sections titled:

  • Memoryless Property of the Exponential Distribution

  • Finite-Dimensional Distributions and Stationarity

  • The Poisson (Counting) Process on R+

  • Continuous-Time, Time-Homogeneous Markov Processes with Countable State Space

  • Birth-Death Markov Chains

  • Modeling Time-Series Data Using a Markov Chain

  • Simulating a Markov Chain

  • Overview of Discrete-Time Markov Chains

  • Martingales Adapted to Discrete Time Markov Chains

  • Problems