ArticleOriginal scientific text

Title

The first exit of almost strongly recurrent semi-Markov processes

Authors 1, 2

Affiliations

  1. Institute of Mathematics, University of Gdańsk, Wita Stwosza 57, 80-952 Gdańsk-Oliwa, Poland
  2. Chair of Mathematics, Naval Academy, 81-919 Gdynia-Oksywie, Poland

Abstract

Let Xn(·), n ∈ N, be a sequence of homogeneous semi-Markov processes (HSMP) on a countable set K, all with the same initial p.d. concentrated on a non-empty proper subset J. The subrenewal kernels which are restrictions of the corresponding renewal kernels Qn on K×K to J×J are assumed to be suitably convergent to a renewal kernel P (on J×J). The HSMP on J corresponding to P is assumed to be strongly recurrent. Let [πj; j ∈ J] be the stationary p.d. of the embedded Markov chain. In terms of the averaged p.d.f. Fϑ(t):=j,kJπjPj,k(t), t ∈ i+, and its Laplace-Stieltjes transform wF~ϑ, the above assumptions imply: The time TnJ of the first exit of Xn(·) from J has a limit p.d. (up to some constant factors) iff 1 - wF~ϑ is regularly varying at 0 with a positive degree, say α ∈ (0,1]. Then the transform of the limit p.d.f. equals wG~(α)(s)=(1+sα)-1, Re s ≥ 0. This extends the results by V. S. Korolyuk and A. F. Turbin (1976) obtained for α = 1 under essentially stronger conditions.

Keywords

limit distribution, Markov renewal, first exit, extended exponential p.d, semi-Markov, recurrent Markov processes

Bibliography

  1. S. Asmussen, Applied Probability and Queues, Wiley, Chichester, 1987.
  2. W. Feller, An Introduction to Probability Theory and Its Applications, Vol. 2, Wiley, New York, 1971.
  3. I. B. Gertsbakh, Asymptotic methods in reliability theory : a review, Adv. Appl. Probab. 16 (1984), 147-175.
  4. J. Keilson, A limit theorem for passage times in ergodic regenerative processes, Ann. Math. Statist. 37 (1966), 866-870.
  5. B. Kopociński, An Outline of Renewal and Reliability Theory, PWN, Warszawa, 1973 (in Polish).
  6. V. S. Korolyuk and A. F. Turbin, Semi-Markov Processes and Their Applications, Naukova Dumka, Kiev, 1976 (in Russian).
  7. E. Seneta, Regularly Varying Functions, Lecture Notes in Math. 508, Springer, Berlin, 1976.
  8. D. S. Silvestrov, Semi-Markov Processes with a Discrete State Space, Sovetskoe Radio, Moscow, 1980 (in Russian).
  9. A. D. Solovyev, Asymptotic behavior of the time of the first occurrence of a rare event, Engnrg. Cybernetics 9 (1971), 1038-1048.
  10. A. D. Solovyev, Analytical Methods of the Reliability Theory, WNT, Warszawa, 1979 (in Polish).
  11. A. F. Turbin, Applications of the inversion of linear operators perturbed on the spectrum to some asymptotic problems connected with Markov chains and semi-Markov processes, Teor. Veroyatnost. i Mat. Statist., Kiev, 1972 (in Russian).
Pages:
285-304
Main language of publication
English
Received
1994-08-05
Accepted
1995-01-30
Published
1995
Exact and natural sciences