Wyniki wyszukiwania

Sortuj według:

Ogranicz wyniki do:

Estimates for perturbations of discounted Markov chains on general spaces

100%

Montes-de-Oca R., Sakhanenko A., Salem-Silva F.

Applicationes Mathematicae

2003

tom 30

nr 1

39-53

We analyse a Markov chain and perturbations of the transition probability and the one-step cost function (possibly unbounded) defined on it. Under certain conditions, of Lyapunov and Harris type, we obtain new estimates of the effects of such perturbations via an index of perturbations, defined as the difference of the total expected discounted costs between the original Markov chain and the perturbed one. We provide an example which illustrates our analysis.

Estimates for perturbations of general discounted Markov control chains

100%

Montes-de-Oca R., Sakhanenko A., Salem-Silva F.

Applicationes Mathematicae

2003

tom 30

nr 3

287-304

We extend previous results of the same authors ([11]) on the effects of perturbation in the transition probability of a Markov cost chain for discounted Markov control processes. Supposing valid, for each stationary policy, conditions of Lyapunov and Harris type, we get upper bounds for the index of perturbations, defined as the difference of the total expected discounted costs for the original Markov control process and the perturbed one. We present examples that satisfy our conditions.

Ograniczanie wyników

2 Applicationes Mathematicae

2 Montes-de-Oca R.

2 Sakhanenko A.

2 Salem-Silva F.

2 2003

Wyniki wyszukiwania

Estimates for perturbations of discounted Markov chains on general spaces

Estimates for perturbations of general discounted Markov control chains