|
Quasi-birth–death Process
In queueing models, a discipline within the mathematical theory of probability, the quasi-birth–death process describes a generalisation of the birth–death process. As with the birth-death process it moves up and down between levels one at a time, but the time between these transitions can have a more complicated distribution encoded in the blocks. Discrete time The stochastic matrix describing the Markov chain has block structure ::P=\begin A_1^\ast & A_2^\ast \\ A_0^\ast & A_1 & A_2 \\ & A_0 & A_1 & A_2 \\ && A_0 & A_1 & A_2 \\ &&& \ddots & \ddots & \ddots \end where each of ''A''0, ''A''1 and ''A''2 are matrices and ''A''*0, ''A''*1 and ''A''*2 are irregular matrices for the first and second levels. Continuous time The transition rate matrix for a quasi-birth-death process has a tridiagonal block structure ::Q=\begin B_ & B_ \\ B_ & A_1 & A_2 \\ & A_0 & A_1 & A_2 \\ && A_0 & A_1 & A_2 \\ &&& A_0 & A_1 & A_2 \\ &&&& \ddots & \ddots & \ddots \end where each of ''B''00, '' ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Queueing Model
Queueing theory is the mathematical study of waiting lines, or queues. A queueing model is constructed so that queue lengths and waiting time can be predicted. Queueing theory is generally considered a branch of operations research because the results are often used when making business decisions about the resources needed to provide a service. Queueing theory has its origins in research by Agner Krarup Erlang when he created models to describe the system of Copenhagen Telephone Exchange company, a Danish company. The ideas have since seen applications including telecommunication, traffic engineering, computing and, particularly in industrial engineering, in the design of factories, shops, offices and hospitals, as well as in project management. Spelling The spelling "queueing" over "queuing" is typically encountered in the academic research field. In fact, one of the flagship journals of the field is '' Queueing Systems''. Single queueing nodes A queue, or queueing nod ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Theory Of Probability
Probability theory is the branch of mathematics concerned with probability. Although there are several different probability interpretations, probability theory treats the concept in a rigorous mathematical manner by expressing it through a set of axioms. Typically these axioms formalise probability in terms of a probability space, which assigns a measure taking values between 0 and 1, termed the probability measure, to a set of outcomes called the sample space. Any specified subset of the sample space is called an event. Central subjects in probability theory include discrete and continuous random variables, probability distributions, and stochastic processes (which provide mathematical abstractions of non-deterministic or uncertain processes or measured quantities that may either be single occurrences or evolve over time in a random fashion). Although it is not possible to perfectly predict random events, much can be said about their behavior. Two major results in probability ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Birth–death Process
The birth–death process (or birth-and-death process) is a special case of continuous-time Markov process where the state transitions are of only two types: "births", which increase the state variable by one and "deaths", which decrease the state by one. The model's name comes from a common application, the use of such models to represent the current size of a population where the transitions are literal births and deaths. Birth–death processes have many applications in demography, queueing theory, performance engineering, epidemiology, biology and other areas. They may be used, for example, to study the evolution of bacteria, the number of people with a disease within a population, or the number of customers in line at the supermarket. When a birth occurs, the process goes from state ''n'' to ''n'' + 1. When a death occurs, the process goes from state ''n'' to state ''n'' − 1. The process is specified by birth rates \_ and death rates \_. Recu ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Stochastic Matrix
In mathematics, a stochastic matrix is a square matrix used to describe the transitions of a Markov chain. Each of its entries is a nonnegative real number representing a probability. It is also called a probability matrix, transition matrix, substitution matrix, or Markov matrix. The stochastic matrix was first developed by Andrey Markov at the beginning of the 20th century, and has found use throughout a wide variety of scientific fields, including probability theory, statistics, mathematical finance and linear algebra, as well as computer science and population genetics. There are several different definitions and types of stochastic matrices: :A right stochastic matrix is a real square matrix, with each row summing to 1. :A left stochastic matrix is a real square matrix, with each column summing to 1. :A doubly stochastic matrix is a square matrix of nonnegative real numbers with each row and column summing to 1. In the same vein, one may define a stochastic vector (also ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Markov Chain
A Markov chain or Markov process is a stochastic model describing a sequence of possible events in which the probability of each event depends only on the state attained in the previous event. Informally, this may be thought of as, "What happens next depends only on the state of affairs ''now''." A countably infinite sequence, in which the chain moves state at discrete time steps, gives a discrete-time Markov chain (DTMC). A continuous-time process is called a continuous-time Markov chain (CTMC). It is named after the Russian mathematician Andrey Markov. Markov chains have many applications as statistical models of real-world processes, such as studying cruise control systems in motor vehicles, queues or lines of customers arriving at an airport, currency exchange rates and animal population dynamics. Markov processes are the basis for general stochastic simulation methods known as Markov chain Monte Carlo, which are used for simulating sampling from complex probability dist ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Transition Rate Matrix
Transition or transitional may refer to: Mathematics, science, and technology Biology * Transition (genetics), a point mutation that changes a purine nucleotide to another purine (A ↔ G) or a pyrimidine nucleotide to another pyrimidine (C ↔ T) * Transitional fossil, any fossilized remains of a lifeform that exhibits the characteristics of two distinct taxonomic groups * A phase during childbirth contractions during which the cervix completes its dilation Gender and sex * Gender transitioning, the process of changing one's gender presentation to accord with one's internal sense of one's gender – the idea of what it means to be a man or woman * Sex reassignment therapy, the physical aspect of a gender transition Physics * Phase transition, a transformation of the state of matter; for example, the change between a solid and a liquid, between liquid and gas or between gas and plasma * Quantum phase transition, a phase transformation between different quantum phases * Quantum ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Tridiagonal Matrix
In linear algebra, a tridiagonal matrix is a band matrix that has nonzero elements only on the main diagonal, the subdiagonal/lower diagonal (the first diagonal below this), and the supradiagonal/upper diagonal (the first diagonal above the main diagonal). For example, the following matrix is tridiagonal: :\begin 1 & 4 & 0 & 0 \\ 3 & 4 & 1 & 0 \\ 0 & 2 & 3 & 4 \\ 0 & 0 & 1 & 3 \\ \end. The determinant of a tridiagonal matrix is given by the ''continuant'' of its elements. An orthogonal transformation of a symmetric (or Hermitian) matrix to tridiagonal form can be done with the Lanczos algorithm. Properties A tridiagonal matrix is a matrix that is both upper and lower Hessenberg matrix. In particular, a tridiagonal matrix is a direct sum of ''p'' 1-by-1 and ''q'' 2-by-2 matrices such that — the dimension of the tridiagonal. Although a general tridiagonal matrix is not necessarily symmetric or Hermitian, many of those that arise when solving linear algebra problems have one of th ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Continuous-time Markov Chain
A continuous-time Markov chain (CTMC) is a continuous stochastic process in which, for each state, the process will change state according to an exponential random variable and then move to a different state as specified by the probabilities of a stochastic matrix. An equivalent formulation describes the process as changing state according to the least value of a set of exponential random variables, one for each possible state it can move to, with the parameters determined by the current state. An example of a CTMC with three states \ is as follows: the process makes a transition after the amount of time specified by the holding time—an exponential random variable E_i, where ''i'' is its current state. Each random variable is independent and such that E_0\sim \text(6), E_1\sim \text(12) and E_2\sim \text(18). When a transition is to be made, the process moves according to the jump chain, a discrete-time Markov chain with stochastic matrix: :\begin 0 & \frac & \frac \\ \frac & 0 ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Semi-Markov Process
In probability and statistics, a Markov renewal process (MRP) is a random process that generalizes the notion of Markov jump processes. Other random processes like Markov chains, Poisson processes and renewal processes can be derived as special cases of MRP's. Definition Consider a state space \mathrm. Consider a set of random variables (X_n,T_n), where T_n are the jump times and X_n are the associated states in the Markov chain (see Figure). Let the inter-arrival time, \tau_n=T_n-T_. Then the sequence (X_n,T_n) is called a Markov renewal process if : \begin & \Pr(\tau_\le t, X_=j\mid(X_0, T_0), (X_1, T_1),\ldots, (X_n=i, T_n)) \\ pt= & \Pr(\tau_\le t, X_=j\mid X_n=i)\, \forall n \ge1,t\ge0, i,j \in \mathrm \end Relation to other stochastic processes # If we define a new stochastic process Y_t:=X_n for t \in _n,T_), then the process Y_t is called a semi-Markov process. Note the main difference between an MRP and a semi-Markov process is that the former is defined as a two- ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Jackson Network
In queueing theory, a discipline within the mathematical theory of probability, a Jackson network (sometimes Jacksonian network) is a class of queueing network where the equilibrium distribution is particularly simple to compute as the network has a product-form solution. It was the first significant development in the theory of networks of queues, and generalising and applying the ideas of the theorem to search for similar product-form solutions in other networks has been the subject of much research, including ideas used in the development of the Internet. The networks were first identified by James R. Jackson A version from January 1963 is available at http://www.dtic.mil/dtic/tr/fulltext/u2/296776.pdf and his paper was re-printed in the journal ''Management Science’s'' ‘Ten Most Influential Titles of Management Sciences First Fifty Years.’ Jackson was inspired by the work of Burke and Reich, though Jean Walrand notes "product-form results … rea much less immediate r ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Countably
In mathematics, a set is countable if either it is finite or it can be made in one to one correspondence with the set of natural numbers. Equivalently, a set is ''countable'' if there exists an injective function from it into the natural numbers; this means that each element in the set may be associated to a unique natural number, or that the elements of the set can be counted one at a time, although the counting may never finish due to an infinite number of elements. In more technical terms, assuming the axiom of countable choice, a set is ''countable'' if its cardinality (its number of elements) is not greater than that of the natural numbers. A countable set that is not finite is said countably infinite. The concept is attributed to Georg Cantor, who proved the existence of uncountable sets, that is, sets that are not countable; for example the set of the real numbers. A note on terminology Although the terms "countable" and "countably infinite" as defined here are quite com ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
Matrix Geometric Method
In probability theory, the matrix geometric method is a method for the analysis of quasi-birth–death processes, continuous-time Markov chain whose transition rate matrices with a repetitive block structure. The method was developed "largely by Marcel F. Neuts and his students starting around 1975." Method description The method requires a transition rate matrix with tridiagonal block structure as follows ::Q=\begin B_ & B_ \\ B_ & A_1 & A_2 \\ & A_0 & A_1 & A_2 \\ && A_0 & A_1 & A_2 \\ &&& A_0 & A_1 & A_2 \\ &&&& \ddots & \ddots & \ddots \end where each of ''B''00, ''B''01, ''B''10, ''A''0, ''A''1 and ''A''2 are matrices. To compute the stationary distribution ''π'' writing ''π'' ''Q'' = 0 the balance equations are considered for sub-vectors ''π''''i'' ::\begin \pi_0 B_ + \pi_1 B_ &= 0\\ \pi_0 B_ + \pi_1 A_1 + \pi_2 A_0 &= 0\\ \pi_1 A_2 + \pi_2 A_1 + \pi_3 A_0 &= 0 \\ & \vdots \\ \pi_ A_2 + \pi_i A_1 + \pi_ A_0 &= 0\\ & \vdots \\ \end Observe that the re ... [...More Info...] [...Related Items...] OR: [Wikipedia] [Google] [Baidu] |
.svg "Click for more on -> Theory Of Probability")
.png "Click for more on -> Jackson Network")
