Skip to main content Accessibility help
×
  1. Home
  2. Books
  3. Markov Chains
  • Cited by 930
      • Show more authors
      • You may already have access via personal or institutional login
    • Select format
    • Publisher:
      Cambridge University Press
      Publication date:
      June 2012
      February 1997
      ISBN:
      9780511810633
      9780521633963
      DOI:
      https://doi.org/10.1017/CBO9780511810633
      Dimensions:
      Weight & Pages:
      Dimensions:
      (253 x 177 mm)
      Weight & Pages:
      0.47kg, 254 Pages
      • Subjects:
      Communications and Signal Processing, Engineering, General Statistics and Probability, Applied Probability and Stochastic Networks, Statistics and Probability
      Series:
      Cambridge Series in Statistical and Probabilistic Mathematics (2)
    You may already have access via personal or institutional login
    • Selected: Digital
    Add to cart View cart Buy from Cambridge.org
    Subjects:
    Communications and Signal Processing, Engineering, General Statistics and Probability, Applied Probability and Stochastic Networks, Statistics and Probability
    Series:
    Cambridge Series in Statistical and Probabilistic Mathematics (2)
    Information

    Book description

    Markov chains are central to the understanding of random processes. This is not only because they pervade the applications of random processes, but also because one can calculate explicitly many quantities of interest. This textbook, aimed at advanced undergraduate or MSc students with some background in basic probability theory, focuses on Markov chains and quickly develops a coherent and rigorous theory whilst showing also how actually to apply it. Both discrete-time and continuous-time chains are studied. A distinguishing feature is an introduction to more advanced topics such as martingales and potentials in the established context of Markov chains. There are applications to simulation, economics, optimal control, genetics, queues and many other topics, and exercises and examples drawn both from theory and practice. It will therefore be an ideal text either for elementary courses on random processes or those that are more oriented towards applications.

    Reviews

    ‘This is an admirable book, treating the topic with mathematical rigour and clarity, mixed with helpful informality; and emphasising numerous applications to a wide range of subjects.’

    D. V. Lindley Source: The Mathematical Gazette

    ‘My overall impression of this book is very positive … this is the best introduction to the subject that I have come across.’

    Source: Contemporary Physics

    ‘An instructor looking for a suitable text, at the level of a Master of Mathematics degree, can use this book with confidence and enthusiasm.’

    John Haigh - University of Sussex

    ‘We recently based a seminar on this book … it is well suited for an elementary, technically modest, but still rigorous introduction into the heart of a lively and relevant area of stochastic processes.’

    M. Scheutzow Source: Zentralblatt MATH

    Refine List

    Actions for selected content:

    Select all | Deselect all
    • View selected items
    • Export citations
    • Download PDF (zip)
    • Save to Kindle
    • Save to Dropbox
    • Save to Google Drive

    Save Search

    You can save your searches here and later view and run them again in "My saved searches".

    Please provide a title, maximum of 40 characters.
    Cancel
    ×

    Contents

    Contents

    Metrics

    Full text views

    Total number of HTML views: 0
    Total number of PDF views: 0 *
    Loading metrics...

    Book summary page views

    Total views: 0 *
    Loading metrics...

    * Views captured on Cambridge Core between #date#. This data will be updated every 24 hours.

    Usage data cannot currently be displayed.

    Accessibility standard: Unknown

    Why this information is here

    This section outlines the accessibility features of this content - including support for screen readers, full keyboard navigation and high-contrast display options. This may not be relevant for you.

    Accessibility Information

    Accessibility compliance for the PDF of this book is currently unknown and may be updated in the future.