Computing the Matrix G of Multi-Dimensional Markov Chains of M/G/1 Type

We consider <i>M</i>d-M/G/1 processes, which are irreducible discrete-time Markov chains consisting of two components. The first component is a nonnegative integer vector, while the second component indicates the state (or phase) of the external environment. The level of a state is defin...

Full description

Saved in:
Bibliographic Details
Main Authors: Valeriy Naumov, Konstantin Samouylov
Format: Article
Language:English
Published: MDPI AG 2025-04-01
Series:Mathematics
Subjects:
Online Access:https://www.mdpi.com/2227-7390/13/8/1223
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We consider <i>M</i>d-M/G/1 processes, which are irreducible discrete-time Markov chains consisting of two components. The first component is a nonnegative integer vector, while the second component indicates the state (or phase) of the external environment. The level of a state is defined by the minimum value in its first component. The matrix <b>G</b> of the process represents the conditional probabilities that, starting from a given state of a certain level, the Markov chain will first reach a lower level in a specific state. This study aims to develop an effective algorithm for computing matrices <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><mstyle mathvariant="bold" mathsize="normal"><mi>G</mi></mstyle></semantics></math></inline-formula> for <i>M</i>d-M/G/1 processes.
ISSN:2227-7390