The queue at stage 3 forms a continuous-parameter homogeneous Markov chain with the state spaces {0,1,2,.

,3} and is often termed as birth-death process. The process is in state k at time t+h, if one of the following mutually exclusive and collectively exhaustive events occurs: 1) The system is in state k at time t, and no changes of state occur in the interval (t, t+h), the associated conditional probability is Pk,k(t,t+h)=1-qk(t)*h+o(h)=1-(+)*h+o(h) k k