Hostname: page-component-848d4c4894-wg55d Total loading time: 0 Render date: 2024-06-02T03:50:10.131Z Has data issue: false hasContentIssue false
  • English
  • Français

Maximum likelihood estimates of incorrect Markov models for time series and the derivation of AIC

Published online by Cambridge University Press:  14 July 2016

Yosihiko Ogata
Yosihiko Ogata*
Affiliation:
The Institute of Statistical Mathematics, Tokyo
*
∗Postal address: The Institute of Statistical Mathematics, 4–6–7 Minami-Azabu, Minato-Ku, Tokyo, Japan.
Get access Rights & Permissions [Opens in a new window]

Abstract

The asymptotic behavior of the maximum likelihood estimators of Markov models or autoregressive models are given when the true distribution is not a member of the assumed parametric family. The derivation of Akaike's Information Criterion is reviewed for this case.

Keywords

AICAUTOREGRESSIVE MODELERGODIC STATIONARY PROCESSMAXIMAL CORRELATION COEFFICIENTMAXIMUM LIKELIHOOD ESTIMATORNEGATIVE ENTROPY
Type
Research Papers
Information
Journal of Applied Probability , Volume 17 , Issue 1 , March 1980 , pp. 59 - 72
Copyright
Copyright © Applied Probability Trust 1980 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

[1] Akaike, H. (1970) Statistical predictor identification. Ann. Inst. Statist. Math. 22, 203–217.CrossRefGoogle Scholar
[2] Akaike, H. (1973) Information theory and an extension of maximum likelihood principle. In Proc. 2nd Internat. Symp. Information Theory , ed. Petrov, B. N. and Csáki, F., Akadémiai Kiadó, Budapest, 267–281.Google Scholar
[3] Akaike, H. (1976) Canonical correlation analysis of time series and the use of an information criterion. In System Identification: Advances and Case studies, ed. Mehra, R. K. and Laiontis, D. G., Academic Press, New York, 27–96.CrossRefGoogle Scholar
[4] Akaike, H. (1977) On entropy maximization principle. In Applications of Statistics, ed. Krishnaiah, P. R., North-Holland, Amsterdam, 27–41.Google Scholar
[5] Berk, K. N. (1974) Consistent autoregressive spectral estimates. Ann. Statist. 2, 489–502.Google Scholar
[6] Billingsley, P. (1961) Statistical Inference for Markov Processes. University of Chicago Press.Google Scholar
[7] Bloomfield, P. (1972) On the error of prediction of a time series. Biometrika 59, 501–507.CrossRefGoogle Scholar
[8] Grenander, U. and Rosenblatt, M. (1954) An extension of a theorem of G. Szegö and its application to the study of stochastic processes. Trans. Amer. Math. Soc. 76, 112–126.Google Scholar
[9] Huber, P. J. (1967) The behavior of maximum likelihood estimates under nonstandard conditions. Proc. 5th Berkeley Symp. Math. Statist. Prob. 1, 221–233.Google Scholar
[10] Ibragimov, I. A. (1970) On the spectrum of stationary Gaussian sequences satisfying the strong mixing condition II, Sufficient conditions, mixing rate. Theory Prob. Appl. 15, 85–106.Google Scholar
[11] Ibragimov, I. A. and Linnik, Yu. V. (1971) Independent and Stationary Sequences of Random Variables. Wolters–Noordhoff, Groningen.Google Scholar
[12] Inagaki, N. and Ogata, Y. (1975) The weak convergence of the likelihood ratio random fields and its application. Ann. Inst. Statist. Math. 27, 391–419.CrossRefGoogle Scholar
[13] Kolmogorov, A. N. and Rozanov, Yu. A. (1960) On strong mixing conditions for stationary Gaussian processes. Theory Prob. Appl. 5, 204–208.Google Scholar
[14] Ogata, Y. (1978) The asymptotic behavior of maximum likelihood estimators for stationary point processes. Ann. Inst. Statist. Math. 30, 243–261.CrossRefGoogle Scholar
[15] Ogata, Y. and Inagaki, N. (1977) The weak convergence of likelihood ratio random fields for Markov observations. Ann. Inst. Statist. Math. 29, 165–187.Google Scholar
[16] Shibata, R. (1979) Asymptotically efficient selection of the order of the model for estimating parameters of a linear process. Ann. Statist. 7.Google Scholar
[17] Walker, A. M. (1964) Asymptotic properties of least-squares estimates of parameters of the spectrum of a stationary non-deterministic time series. J. Austral. Math. Soc. 4, 363–384.Google Scholar
[18] Whittle, P. (1962) Gaussian estimation in stationary time series. Bull. I.S.I. 39, 105–129.Google Scholar