Validity and reliability of Mini-Mental State Examination in Older Adults in China: Inline Mini-Mental State Examination with cognitive functions

© Invalid date by the Authors. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution -Noncommercial 4.0 International License (CC-by the license) ( https://creativecommons.org/licenses/by-nc/4.0/ )

Download PDF

Cite

XML

Abstract

The main aim of the study is to validate the factor structure of the Mini-Mental State Examination (MMSE) of China’s older population using the Chinese Longitudinal Healthy Longevity Survey. The validation process used the exploratory factor analysis (EFA) to determine the number of dimensions of MMSE, the confirmatory factor analysis (CFA) to confirm the factorial structure of MMSE, and the factorial invariance to conclude the factor structure does not differ between the young-old (aged 65 – 79) and old-old (aged 80 or older). The results of the EFAs suggested two possible factor structures: A six-factor and a seven-factor solution. The seven-factor confirmatory factor model turned out as the best fit by comparison to the four competing confirmatory models. Strict factorial invariance was attained for the two age groups, indicating a high level of measurement equality, a property of invariance was seldom achieved in the literature of factorial invariance studies. In comparison to the MMSE literature that focused solely on EFA that aims to establish a single summated score, the present study suggests using EFA, CFA, and factorial invariance that takes into consideration of measurement errors as the preferred procedure since it establishes the appropriate MMSE dimensionality that is in line with their respective cognitive functions.

Keywords

Mini-Mental State Examination

Validation

Exploratory factor analysis

Confirmatory factor analysis

Factorial invariance

References

[1]

Arevalo-Rodriguez I, Smailagic N, Roqué-Figuls M, et al. (2021). Mini-mental state examination (MMSE) for the early detection of dementia in people with mild cognitive impairment (MCI). Cochrane Database of Systematic Reviews, 7(7):CD010783. https:// doi.org/10.1002/14651858.CD010783.pub3

[2]

Baek MJ, Kim K, Park YH, et al. (2016). The validity and reliability of the MMSE-2 for detecting mild cognitive impairment and Alzheimer’s disease in a Korean population. PLoS One, 11(9):e0163792. https://doi.org/10.1371/journal.pone.0163792

[3]

Bartlett MS. (1951). The effect of standardization on a Chi-Square approximation in factor analysis. Biometrika, 38:337-344. https:// doi.org/10.1093/biomet/38.3-4.337

[4]

Bentler PM. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107:238-246. https://doi.org/10.1037/0033- 2909.107.2.238

[5]

Bentler PM. (1995). EQS 5 [Computer Program]. Encino, CA: Multivariate Software Inc.

[6]

Bollen K and Lennox R. (1991). Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin, 110:305-314. https://doi.org/10.1037/0033-2909.110.2.305

[7]

Bollen KA. (1989). Structural Equations with Latent Variables. New York: Wiley.

[8]

Brown TA. (2006). Confirmatory Factor Analysis for Applied Research. New York: The Guilford Press.

[9]

Browne MW and Cudeck R. (1992). Alternative ways of assessing model fit. Sociological Methods and Research, 21:230-258. https:// doi.org/10.1177/0049124192021002005

[10]

Burke SL, Grudzien A, Burgess A, et al. (2021). The utility of cognitive screeners in the detection of dementia spectrum disorders in Spanish-speaking populations. Journal of Geriatric Psychiatry and Neurology, 34(2):102-118. https://doi. org/10.1177/0891988720915513

[11]

Cattell RB. (1966). The scree test for the number of factors. Multivariate Behavioral Research, 1:245-276. https://doi.org/10.1207/ s15327906mbr0102_10

[12]

Cheung GW and Rensvold RB. (2002). Evaluating goodness of fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2):233-255. https://doi.org/10.1207/s15328007sem0902_5

[13]

CLHLS. (2020). Chinese Longitudinal Healthy Longevity Survey, Data Collection and Quality Control Procedures. Available from: https://sites.duke.edu/centerforaging/programs/chinese-longitudinal-healthy-longevity-survey-clhls/design-method-study-population/design-method-data-collection-quality-control-procedures. [Last accessed on 2022 Jan 26]. https://doi. org/10.1007/978-1-4020-6752-5_2

[14]

Comtois D. (2021). summarytools: Tools to Quickly and Neatly Summarize Data. R package version 1.0.0. Available from: https:// CRAN.R-project.org/package=summarytools.[Last accessed on 2022 Jan 26].

[15]

Davey RJ and Jamieson S. (2004). The validity of using the mini-mental state examination in NICE dementia guidelines. Journal of Neurology Neurosurgery and Psychiatry, 75:343-344.

[16]

Deb S and Braganza J. (1999). Comparison of rating scales for the diagnosis of dementia in adults with Down’s syndrome. Journal of Intellectual Disability Research, 43(5):400-407. https://doi.org/10.1046/j.1365-2788.1999.043005400.x

[17]

Dinno A. (2009). Exploring the sensitivity of Horn’s parallel analysis to the distributional form of simulated data. Multivariate Behavioral Research, 44(3):362-388. https://doi.org/10.1080/00273170902938969

[18]

Fillenbaum GG, Heyman A, Wilkinson WE, et al. (1987). Comparison of two screening tests in Alzheimer’s disease. The correlation and reliability of the mini-mental state examination and the modified blessed test. Archives of Neurology, 44:924-927. https://doi. org/10.1001/archneur.1987.00520210026014

[19]

Finch WH. (2020). Using fit statistic differences to determine the optimal number of factors to retain in an exploratirt factor analysis. Educational and Psychological Measurement, 80(2):217-241. https://doi.org/10.1177/0013164419865769

[20]

Folstein MF, Folstein SE, and McHugh PR. (1975). “Mini-mental state”: A practical method for grading the cognitive state of patients for the clinician. Journal of Psychiatric Research, 12:189-198. https://doi.org/10.1016/0022-3956(75)90026-6

[21]

Fox, J. (2019). polycor: Polychoric and Polyserial Correlations. R package version 0.7-10. Available from: https://CRAN.R-project. org/package=polycor. [Last accessed on 2022 Jan 26].

[22]

Garrodp LE, Abad FJ, and Ponsoda V. (2013). A new look at Horn’s parallel analysis with ordinal variables. American Psychological Association, 18(4):454-474. https://doi.org/10.1037/a0030005

[23]

Glorfeld LW. (1995). An Improvement on Horn’s parallel analysis methodology for selecting the correct number of factors to retain. Educational and Psychological Measurement, 55(3):377-393. https://doi.org/10.1177/0013164495055003002

[24]

Gu D. (2005). Assessment of Data Quality of the Chinese Longitudinal Healthy Longevity Survey in 2002. The CLHLS Technical Report No.2005-1.

[25]

Gu D, Feng Q, Chen H, et al. (2021). Chinese longitudinal healthy longevity survey. In: D Gu and ME Dupre (eds.). Encyclopedia of Gerontology and Population Aging. Switzerland AG, Cham: Springer Nature. p.957-970.

[26]

Hayton JC, Allen DG, and Scarpello V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7(2):191-205. https://doi.org/10.1177/1094428104263675

[27]

Horn JL and McArdle JJ. (1992). A practical and theoretical guide to MI in aging research. Experimental Aging Research, 18:117-144. https://doi.org/10.1080/03610739208253916

[28]

Horn JL. (1965). A rationale and a test for the number of factors in factor analysis. Psychometrika, 30:179-185. https://doi.org/10.1007/ bf02289447

[29]

Hsieh SW, Wu DW, Wang CW, et al. (2021). Poor cognitive function is associated with obstructive lung diseases in Taiwanese adults. International Journal of Environmental Research and Public Health, 18:2344. https://doi.org/10.3390/ijerph18052344

[30]

Hu L and Bentler PM. (1999). Cutoff criteria for fit indices in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6:1-55. https://doi.org/10.1080/10705519909540118

[31]

Jackson DJ, Gillaspy JA, and Purc-Steogebsib R. (2009). Reporting practices in confirmatory factor analysis: An overview and some recommendations. Psychological Methods, 14(1):6-23. https://doi.org/10.1037/a0014694

[32]

Jöreskog KG. (1993). Testing structural equation models. In: KA Bollen and JS Long (eds.). Testing Structural Equation Models. Newbury Park, CA: Sage, p.294-316.

[33]

Kaiser HF and Rice J. (1974). Little jiffy, mark Iv. Educational and Psychological Measurement, 34(1):111-117. https://doi. org/10.1177/001316447403400115

[34]

Kaiser HF. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20:114- 151. http://dx.doi.org/10.1177/001316446002000116

[35]

Kaiser HF. (1970). A second generation little jiffy. Psychometrika, 35(4):401-415. https://doi.org/10.1007/BF02291817

[36]

Lane FC, Anderson B, Ponce HF, et al. (2012). Factorial invariance of LibQUAL as a measure of library service quality over time. Library and Information Science Research, 34:22-30. https://doi.org/10.1016/j.lisr.2011.07.004

[37]

Langa KM, Llewellyn DJ, Lang IA, et al. (2009). Cognitive health among older adults in the United States and in England. BMC Geriatrics, 9:23. https://doi.org10.1186/1471-2318-9-23

[38]

Lezak MD, Howieson DB, and Loring DW. (2004). Neuropsychological Assessment. 4th ed. New York: Oxford University Press.

[39]

Liau AK, Chow D, Tan TK, et al. (2010). Development and validation of the Personal strengths inventory using exploratory and confirmatory factor analyses. Journal of Psychoeducational Assessment, 29:14-26. https://doi.org/10.1177/0734282910365648

[40]

Lim M, Li Z, Xie H, et al. (2019). An Asian study on clinical and psychological factors associated with personal recovery in people with psychosis. BMC Psychiatry, 19:256. https://doi.org/10.1186/s12888-019-2238-9

[41]

Meredith W. (1993). Measurement invariance, factor analysis, and factorial invariance. Psychometrika, 58:525-543. https://doi. org/10.1007/bf02294825

[42]

Mitchell AJ. (2009). A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. Journal of Psychiatric Research, 43(4):411-431. https://doi.org/10.1016/j.jpsychires.2008.04.014

[43]

Mullen M. (1995). Diagnosing measurement equivalence in cross-national research. Journal of International Business Studies, 3:573- 596. https://doi.org/10.1057/palgrave.jibs.8490187

[44]

Osterweil D, Mulford P, Syndulko K, et al. (1994). Cognitive function in old and very old residents of a residential facility: Relationship to age, education, and dementia. Journal of the American Geriatric Society, 42(7):766-773. https://doi.org/10.1111/j.1532-5415.1994. tb06539.x

[45]

Park MH, Kwon DY, Jung JM, et al. (2012). Mini-mental status examination as predictors of mortality in the elderly. Acta Psychiatrica Scandinavica, 127:298-304. https://doi.org/10.1111/j.1600-0447.2012.01918.x

[46]

Pett MA, Lackey NR, and Sullivan JJ. (2003). Making Sense of Factor Analysis: The Use of Factor Analysis for Instrument Development in Health Care Research. Thousand Oaks, CA: Sage. https://doi.org/10.4135/9781412984898

[47]

Pomplun M and Omar MH. (2001). The factorial invariance of a test of reading comprehension across groups of limited English proficient students. Applied Measurement in Education, 14:261-283. https://doi.org/10.1207/s15324818ame1403_4

[48]

Putnick DL and Bornstein MH. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Development Review, 41:71-90. https://doi.org/10.1016/j.dr.2016.06.004

[49]

Reilly S, Challis D, Burns A, et al. (2004). The use of assessment scales in old age psychiatry services in England and Northern Ireland. Aging and Mental Health, 8(3):249-55. https://doi.org/10.1080/13607860410001669787

[50]

Revelle W and Rocklin T. (1979). Very simple structure: An alternative procedure for estimating the optimal number of interpretable factors. Multivariate Behavioral Research, 14:403-414. https://doi.org/10.1207/s15327906mbr1404_2

[51]

Revelle W. (2021). psych: Procedures for Personality and Psychological Research. Evanston, Illinois, USA: Northwestern University. Available from: https://CRAN.R-project.org/package=psych Version = 2.1.9. [Last accessed on 2022 Jan 26].

[52]

Revuelta J, Franco-Martinez A, and Ximénez C. (2021). Nominal factor analysis of situational judgment tests: Evaluation of latent dimensionality and factorial invariance. Educational and Psychological Measurement, 81(6):1054-1088. https://doi. org/10.1177/0013164421994321

[53]

Rosseel Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2):1-36. https://doi. org/10.18637/jss.v048.i02

[54]

Schürer S, van Ophuysen, S, and Behrmann, L. (2021). A new instrument for assessing cohesion in primary and grammar school classes factorial structure and measurement invariance of the GruKo4. Journal of Psychoeducational Assessment, 39(3):271-285. https:// doi.org/10.1177/0734282920966825

[55]

Schwartz G. (1978). Estimating the dimension of a model. The Annals of Statistics, 6:461-464.

[56]

Sclove LS. (1987). Application of model-selection criteria to some problems in multivariate analysis. Psychometrika, 52:333-343. https://doi.org/10.1007/bf02294360

[57]

Shigemori K, Ohgi S, Okuyama E, et al. (2010). The factorial structure of the mini-mental state examination (MMSE) in Japanese dementia patients. BMC Geriatrics, 10:36. https://doi.org/10.1186/1471-2318-10-36

[58]

Shulman KI, Herrmann N, Brodaty H, et al. (2006). IPA survey of brief cognitive screening instruments. International Psychogeriatrics, 18:281-294. https://doi.org/10.1017/s1041610205002693

[59]

Tinklenberg J, Brooks JO, Tanke ED, et al. (1990). Factor analysis and preliminary validation of the mini-mental state examination from a longitudinal perspective. International Psychogeriatrics, 2(2):123-134. https://doi.org/10.1017/s1041610290000382

[60]

Tucker LR and Lewis C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38(1):1-10. https:// doi.org/10.1007/BF02291170

[61]

van der Meulen M, Dirven L, Bakunina K, et al. (2021). MMSE is an independent prognostic factor for survival in primary central nervous system lymphoma. Journal of Neurooncology, 152:357-362. https://doi.org/10.1007/s11060-021-03708-8

[62]

Vandenberg RJ and Lance CE. (2000). A review and synthesis of the MI literature: Suggestions, practices, and recommendations for organizational research. Organizational Research Methods, 3:4-69. https://doi.org/10.1177/109442810031002

[63]

Velicer WF and Jackson DN. (1990). Component analysis versus common factor analysis: Some issues in selecting an appropriate procedure. Multivariate Behavioral Research, 25:1-28. https://doi.org/10.1207/s15327906mbr2501_1

[64]

Velicer WF. (1976). Determining the number of components from the matrix of partial correlations. Psychometrika, 41:321-327. https://doi.org/10.1007/bf02293557

[65]

Wong SS and Fong NK. (2009). Reliability and validity of the telephone version of the cantonese mini-mental state examination (T-SMMSE) when used with elderly patients with and without dementia in Hong Kong. International Psychogeriatrics, 1(2):345- 353. https://doi.org/10.1017/s1041610209008588

[66]

Yi Z and Vaupel JW. (2002). Functional capacity and self-evaluation of health and life of oldest old in China. Journal of Social Issue, 58:733-748. https://doi.org/10.1111/1540-4560.00287

[67]

Yoon M and Millsap RE. (2007). Detecting violations of factorial invariance using data-based specification searches: A monte carlo study. Structural Equation Modeling, 14(3):435-463. https://doi.org/10.1080/10705510701301677

[68]

Zumbo BD, Gadermann AM, and Zeisser C. (2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods, 6(1):21-29. https://doi.org/10.22237/jmasm/1177992180

Previous article in this issue

Next article in this issue

International Journal of Population Studies, Electronic ISSN: 2424-8606 Print ISSN: 2424-8150, Published by AccScience Publishing