Estimating the Infinitesimal Generator of a Continuous Time, Finite State Markov Process

Let \Z (t), t > 0\ be a separable, continuous time Markov Process with stationary transition probabilities P₈₉ (t), i, j = 1, 2, , M. Under suitable regularity conditions, the matrix of transition probabilities, P (t), can be expressed in the form P (t) = tQ, where Q is an M M matrix and is called the "infinitesimal generator" for the process. In this paper, a density on the space of sample functions over [0, t) is constructed. This density depends upon Q. If Q is unknown, the maximum likelihood estimate Q (k, t) = \|q₈₉ (k, t) \|, based upon k independent realizations of the process over 0, t) can be derived. If each state has positive probability of being occupied during 0, t) and if the number of independent observations, k, grows larger (t held fixed), then q₈₉ is strongly consistent and the joint distribution of the set \k^{1{2} (q₈₉ - q₈₉) \}₈ ₉ (suitably normalized), is asymptotically normal with zero mean and covariance equal to the identity matrix. If k is held fixed (at one, say) and if t grows large, then q₈₉ is again strongly consistent and the joint distribution of the set \t^{1{2} (q₈₉ - q₈₉) \}₈ ₉ (suitably normalized), is asymptotically normal with zero mean and covariance equal to the identity matrix, provided that the process \Z (t), t > 0\ is positively regular. The asymptotic variances of the q₈₉ are computed in both cases.