Introduction to Akaike (1973) Information Theory and an Extension of the Maximum Likelihood Principle

Published on Jan 1, 1992
· DOI :10.1007/978-1-4612-0919-5_37
J. deLeeuw1
Estimated H-index: 1
(UCLA: University of California, Los Angeles)
Sources
Abstract
The problem of estimating the dimensionality of a model occurs in various forms in applied statistics: estimating the number of factors in factor analysis, estimating the degree of a polynomial describing the data, selecting the variables to be introduced in a multiple regression equation, estimating the order of an AR or MA time series model, and so on.
📖 Papers frequently viewed together
13.6k Citations
27.3k Citations
9,609 Citations
References16
Newest
I study the typical configuration of a Cp plot when the number of variables in the regression problem is large and there are many weak effects. I show that a particular configuration that is very commonly seen can arise in a simple way. I give a formula by means of which the risk incurred by the “minimum CP ” rule can be estimated.
2,115 CitationsSource
We discuss the interpretation of C p -plots and show how they can be calibrated in several ways. We comment on the practice of using the display as a basis for formal selection of a subset-regression model, and extend the range of application of the device to encompass arbitrary linear estimates of the regression coefficients, for example Ridge estimates.
1,078 CitationsSource
#1Victor Solo (Johns Hopkins University)H-Index: 2
91 CitationsSource
#1Dan GroveH-Index: 1
#2Y. SakamotoH-Index: 2
Last. Genshiro KitagawaH-Index: 32
view all 4 authors...
53 CitationsSource
#1Stanley L. Sclove (UIC: University of Illinois at Chicago)H-Index: 16
A review of model-selection criteria is presented, with a view toward showing their similarities. It is suggested that some problems treated by sequences of hypothesis tests may be more expeditiously treated by the application of model-selection criteria. Consideration is given to application of model-selection criteria to some problems of multivariate analysis, especially the clustering of variables, factor analysis and, more generally, describing a complex of variables.
1,112 CitationsSource
#1Hamparsum Bozdogan (UVA: University of Virginia)H-Index: 21
During the last fifteen years, Akaike's entropy-based Information Criterion (AIC) has had a fundamental impact in statistical model evaluation problems. This paper studies the general theory of the AIC procedure and provides its analytical extensions in two ways without violating Akaike's main principles. These extensions make AIC asymptotically consistent and penalize overparameterization more stringently to pick only the simplest of the “true” models. These selection criteria are called CAIC a...
2,430 CitationsSource
By using a simple example a minimax type optimality of the minimum AIC procedure for the selection of models is demonstrated.
504 CitationsSource
The number of digits it takes to write down an observed sequence x"1, ..., x"N of a time series depends on the model with its parameters that one assumes to have generated the observed data. Accordingly, by finding the model which minimizes the description length one obtains estimates of both the integer-valued structure parameters and the real-valued system parameters.
4,770 CitationsSource
243 CitationsSource
The problem of selecting one of a number of models of different dimensions is treated by finding its Bayes solution, and evaluating the leading terms of its asymptotic expansion. These terms are a valid large-sample criterion beyond the Bayesian context, since they do not depend on the a priori distribution.
27.3k CitationsSource
Cited By88
Newest
#1Christopher W Liu (SGH: Singapore General Hospital)H-Index: 2
#2M. Gabrielle Pagé (UdeM: Université de Montréal)H-Index: 14
Last. Hance Clarke (U of T: University of Toronto)H-Index: 30
view all 26 authors...
Purpose Chronic post-surgical pain (CPSP) is a highly prevalent complication following thoracic surgery. This is a prospective cohort study that aims to describe the pain trajectories of patients undergoing thoracic surgery beginning preoperatively and up to 1 year after surgery METHODS: Two hundred and seventy nine patients undergoing elective thoracic surgery were enrolled. Participants filled out a preoperative questionnaire containing questions about their sociodemographic information, comor...
Source
#1Corina Graif (PSU: Pennsylvania State University)H-Index: 12
#2Brittany N. Freelin (PSU: Pennsylvania State University)H-Index: 1
Last. Daniel Kifer (PSU: Pennsylvania State University)H-Index: 37
view all 6 authors...
AbstractResearch on communities and crime has predominantly focused on social conditions within an area or in its immediate proximity. However, a growing body of research shows that people often tr...
6 CitationsSource
#1Taoran Liu (JNU: Jinan University)H-Index: 3
#1Taoran Liu (UG: University of Groningen)H-Index: 1
Last. Wai-Kit Ming (JNU: Jinan University)H-Index: 11
view all 10 authors...
BACKGROUND: Misdiagnosis, arbitrary charges and annoying queues, and clinic waiting times among others are long-standing phenomena in the medical industry across the world, These factors can con-tribute to patient anxiety about misdiagnosis by clinicians. However, with the increasing use of big data growth in biomedical and healthcare communities, the performance of artificial intelligence (Al) techniques of diagnosis is improving, and can help avoid medical practice errors, including under the ...
1 CitationsSource
#1Laura Cárdenas-Ortiz (U of S: University of Saskatchewan)H-Index: 2
#2Nicholas J. BaylyH-Index: 12
Last. Keith A. Hobson (U of S: University of Saskatchewan)H-Index: 115
view all 0 authors...
Source
#1Adelino J. C. Juga (UEM: Eduardo Mondlane University)H-Index: 2
#2Niel Hens (University of Antwerp)H-Index: 52
Last. Marc Aerts (University of Hasselt)H-Index: 44
view all 4 authors...
Recent studies suggest that a large proportion of new HIV-1 infections in mature epidemics occurs within discordant couples, making discordancy a major contributor to the spread of HIV/AIDS in Africa. This paper aims at assessing changes over a five-year period (2009–2015) on the (risk) factors associated with HIV serodiscordance among couples in Mozambique, using cross-sectional data from the INSIDA and IMASIDA surveys. The pooled data of both surveys were analyzed using a joint model for three...
Source
#1Maxime Sèbe ('IFREMER': IFREMER)H-Index: 2
#2Christos A. Kontovas (LJMU: Liverpool John Moores University)H-Index: 15
Last. Linwood PendletonH-Index: 28
view all 3 authors...
Abstract Collisions between ships and whales raise environmental, safety, and economic concerns. The management of whale-ship collisions, however, lacks a holistic approach, unlike the management of other types of wildlife-vehicle collisions, which have been more standardized for several years now. In particular, safety and economic factors are routinely omitted in the assessment of proposed mitigation solutions to ship strikes, possibly leading to under-compliance and a lack of acceptance from ...
3 CitationsSource
#1Carlos BazanH-Index: 4
#2Hannah GaultoisH-Index: 2
Last. Nafisa BelalH-Index: 2
view all 10 authors...
The study aims to test the applicability of a variant of the model proposed by Hockerts (2017) for assessing the social entrepreneurial intention (SEI) of male and female students. It extends the model by incorporating the university's environment and support system (ESS) as an additional more distal construct. The university's ESS, coupled with the experience with social, cultural and environmental issues can affect SEI by influencing the more proximal precursors of empathy towards others, perc...
2 CitationsSource
#1Carlos Bazan (MUN: Memorial University of Newfoundland)H-Index: 4
#2Aparajita Datta (MUN: Memorial University of Newfoundland)H-Index: 1
Last. Jada Jones (MUN: Memorial University of Newfoundland)H-Index: 1
view all 6 authors...
Many researchers have studied gender differences in the entrepreneurial intention of students by analyzing the influence of several intrinsic and extrinsic factors on the antecedents of entrepreneurial intention. Fewer researchers have analyzed the influence of the university’s environment and support system on the precursors of the entrepreneurial intention of students in general and of female students in particular. This study aims to fill that gap by analyzing the influence of the university’...
2 CitationsSource
We provide a novel family of generative block-models for random graphs that naturally incorporates degree distributions: the block-constrained configuration model. Block-constrained configuration models build on the generalized hypergeometric ensemble of random graphs and extend the well-known configuration model by enforcing block-constraints on the edge-generating process. The resulting models are practical to fit even to large networks. These models provide a new, flexible tool for the study ...
1 CitationsSource
#1Xu ChenH-Index: 10
Last. Per Svensson (KI: Karolinska Institutet)H-Index: 18
view all 5 authors...
Background and objectives Metabolic syndrome is a cluster of risk factors associated with CKD. By studying the genetic and environmental influences on how traits of metabolic syndrome correlate with CKD, the understanding of the etiological relationships can be improved. Design, setting, participants, & measurements From the population-based TwinGene project within the Swedish Twin Registry, 4721 complete twin pairs (9442 European ancestry participants) were included in this cross-sectional twin...
Source