In the paper two approaches to the problem of estimation of transition probabilities are considered. The approach by McCullagh and Nelder [5], based on the independent model and the quasi-likelihood function, is compared with the approach based on the marginal model and the standard likelihood function. The estimates following from these two approaches are illustrated on a simple example which was used by McCullagh and Nelder.
2
Dostęp do pełnego tekstu na zewnętrznej witrynie WWW
We provide a generalization of Ueno's inequality for n-step transition probabilities of Markov chains in a general state space. Our result is relevant to the study of adaptive control problems and approximation problems in the theory of discrete-time Markov decision processes and stochastic games.
JavaScript jest wyłączony w Twojej przeglądarce internetowej. Włącz go, a następnie odśwież stronę, aby móc w pełni z niej korzystać.