Loading…

Expectations for Nonreversible Markov Chains

Bounds are given for an irreducible Markov chain on the probability that the time average of a functional on the state space exceeds its stationary expectation, without assuming reversibility. The bounds are in terms of the singular values of the discrete generator.

Saved in:
Bibliographic Details
Published in:Journal of mathematical analysis and applications 1998-04, Vol.220 (2), p.585-596
Main Author: Dinwoodie, I.H.
Format: Article
Language:English
Subjects:
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Bounds are given for an irreducible Markov chain on the probability that the time average of a functional on the state space exceeds its stationary expectation, without assuming reversibility. The bounds are in terms of the singular values of the discrete generator.
ISSN:0022-247X
1096-0813
DOI:10.1006/jmaa.1997.5850