Adaptation, Validation, and Reliability of the Indonesian Version of the Sports Mental Toughness Questionnaire (SMTQ)

Authors

DOI: https://doi.org/10.6018/cpd.626491
Keywords: confirmation factor analysis, SMTQ, mental toughness, reliability, validation

Supporting Agencies

  • Directorate of Research, Technology, and Community Service, Directorate General of Higher Education, Research, and Technology, Ministry of Education and Culture (Grant No. 544/UN20.2.1/PG/2024).

Abstract

The concept of mental toughness (MT) is increasingly recognized as a key factor in athletic performance. The Sport Mental Toughness Questionnaire (SMTQ) is an MT measuring instrument developed in a sports context and in English. However, few studies test psychometric structures across different languages and cultural contexts. Therefore, this research aims to adapt and test the SMTQ in the Indonesian context and analyze invariance based on the comparison between athletes and non-athletes. A total of 856 people participated in this study, but the final data were analyzed for 724 participants (Mage = 21.56 years, SD = 7.63). The number of athletes was 385 people (Mage = 20.79 years, SD = 5.05), while the number of non-athletes was 339 people (Mage = 22.42 years, SD = 9.70). Confirmatory factor analysis (CFA) was used to analyze the psychometric structure of the SMTQ. The research results showed that the three models tested (single-factor model, three-factor model, and higher-order model) did not meet the model fit. The results of the revised model show that the revised three-factor model is a model that fits the data (CFI = .983, TLI = .977, RMSEA = .054, SRMR = .049). The invariance results based on status (athlete vs. non-athlete) found that there was no significant decrease in model fit and the SMTQid invariance achieved strict invariance. The validity of SMTQid shows very good factor loading values ​​and falls within the good to excellent criteria (λ = .57 to .86), as well as convergent validity, which shows a significant correlation with MTI (r = .38, p < .001). The results of the reliability test show CR values ​​= .82, .79, and .81 and α values ​​= .73, .60,and  .83 for each of the confidence, constancy, and control scales in the SMTQ.

Downloads

Download data is not yet available.
Metrics
Views/Downloads
  • Abstract
    70
  • (263-277) Adaptation, Val...
    50

References

Ato, M., López, J. J., & Benavente, A. (2013). A classification system for research designs in psychology. Anales de Psicologia, 29(3), 1038–1059. https://doi.org/10.6018/analesps.29.3.178511

Bagozzi, R. P. (2010). Structural equation models are modelling tools with many ambiguities: Comments acknowledging the need for caution and humility in their use. Journal of Consumer Psychology, 20(2), 208–214. https://doi.org/10.1016/j.jcps.2010.03.001

Beaton, A. A., Funk, D. C., Ridinger, L., & Jordan, J. (2011). Sport involvement: A conceptual and empirical analysis. Sport Management Review, 14(2), 126–140. https://doi.org/10.1016/j.smr.2010.07.002

Beauducel, A., & Herzberg, P. Y. (2006). On the performance of maximum likelihood versus means and variance adjusted weighted least squares estimation in CFA. Structural Equation Modeling: A Multidisciplinary Journal, 13(2), 186–203. https://doi.org/10.1207/s15328007sem1302_2

Borualogo, I. S., & Jefferies, P. (2019). Adapting the child and youth resilience measure-revised for indonesian contexts. Journal of Educational, Health and Community Psychology, 8(4), 480. https://doi.org/10.12928/jehcp.v8i4.12962

Browne, M. W., & Cudeck, R. (1992). Alternative ways of assessing model fit. Sociological Methods & Research, 21(2), 230–258. https://doi.org/10.1177/0049124192021002005

Bush Durand, N., Salmela, J., & Demesrs Green, I. (2001). The ottawa mental skills assessment tool (OMSAT-3*). Sport Psychologist, 15(1), 1–19. https://doi.org/10.1123/tsp.15.1.1

Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling: A Multidisciplinary Journal, 14(3), 464–504. https://doi.org/10.1080/10705510701301834

Chu Kequn, Z. F. (2023). Impact of cultural intelligence on the cross-cultural adaptation of international students in China: The mediating effect of psychological resilience. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1077424

Comrey, A. L., & Lee, H. B. (1992). A first course in factor analysis. Lawrence Erlbaum Associates, Inc.

Crust, L. (2007). Mental toughness in sport : A review. International Journal of Sport and Exercise Physiology, 5(3), 270–290. https://doi.org/10.1080/1612197X.2007.9671836

Crust, L., & Clough, P. J. (2005). Relationship between mental toughness and physical endurance. Perceptual and Motor Skills, 100(1), 192–194. https://doi.org/10.2466/pms.100.1.192–194

Field, A. (2013). Discovering statistic using IBM SPSS statistic (5th ed.). Sage Publications, Inc.

Gambashidze, N., Hammer, A., Brösterhaus, M., & Manser, T. (2017). Evaluation of psychometric properties of the valuation of psychometric properties of the German Hospital Survey on Patient Safety Culture and its potential for cross-cultural comparisons: A cross-sectional study. BMJ Open, 7(11), 1–12. https://doi.org/10.1136/bmjopen-2017-018366

Gatt, I., West, L. M., Calleja, N., Briffa, C., & Cordina, M. (2017). Psychometric properties of the belief about medicines questionnaire (BMQ) in the Maltese language. Pharmacy Practice, 15(1), 1–9. https://doi.org/10.18549/PharmPract.2017.01.886

Giandra, S. N., & Setyawan, I. (2014). Hubungan antara efektivitas komunikasi interpersonal pelatih dengan ketangguhan mental atlet. Empati, 3(4), 558–569.

Gould, D., Dieffenbach, K., & Moffett, A. (2002). Psychological characteristics and their development in Olympic champions. Journal of Applied Sport Psychology, 14(3), 172–204. https://doi.org/10.1080/10413200290103482

Gucciardi, D. F. (2017). Mental toughness: progress and prospects. Current Opinion in Psychology, 16(16), 17–23. https://doi.org/10.1016/j.copsyc.2017.03.010

Gucciardi, D. F., Gordon, S., & Dimmock, J. A. (2009). Development and preliminary validation of a mental toughness inventory for Australian football. Psychology of Sport and Exercise, 10(1), 201–209. https://doi.org/10.1016/j.psychsport.2008.07.011

Gucciardi, D. F., Hanton, S., Gordon, S., Mallett, C. J., & Temby, P. (2014). The concept of mental toughness: tests of dimensionality, nomological network, and traitness. Journal of Personality, 83(1), 26–44. https://doi.org/10.1111/jopy.12079

Gucciardi, D. F., Zhang, C. Q., Ponnusamy, V., Si, G., & Stenling, A. (2016). Cross-cultural invariance of the mental toughness inventory among Australian, Chinese, and Malaysian athletes: A Bayesian estimation approach. Journal of Sport and Exercise Psychology, 38(2), 187–202. https://doi.org/10.1123/jsep.2015-0320

Guntoro, T. S., & Putra, M. F. P. (2022). Athletes’ religiosity: How it plays a role in athletes’ anxiety and life satisfaction. HTS Teologiese Studies/Theological Studies, 78(1), a7802. https://doi.org/10.4102/hts.v78i1.7802

Guntoro, T. S., Sutoro, Putra, M. F. P., Kurdi, Németh, Z., & Setiawan, E. (2023). The role of anthropometry, physical, psychological and personality for elite athletes in competitive sports. Pedagogy of Physical Culture and Sports, 27(4), 331–339. https://doi.org/10.15561/26649837.2023.0409

Hein, S., Reich, J., Masarks, S., Thuma, P. E., & Grigorenko, E. L. (2019). Getting something out of nothing: Analyzing patterns of null responses to improve data collection methods in sub-Saharan Africa. Physiology & Behavior, 46(2), 248–256. https://doi.org/10.1016/j.lindif.2014.11.024.Getting

Igono, J. (2019). Mental toughness in english and spanish speaking professional baseball players. In ProQuest LLC. https://doi.org/10.1503/cmaj.180710

Liew, G. C., Kuan, G., Chin, N. S., & Hashim, H. A. (2019). Mental toughness in sport: Systematic review and future. German Journal of Exercise and Sport Research, 49(4), 381–394. https://doi.org/10.1007/s12662-019-00603-3

Maksum, A. (2007). Kualitas pribadi atlet: Kunci keberhasilan meraih prestasi tinggi. Anima, Indonesian Psychological Journal, 22(2), 108–115.

Maksum, A. (2022). Mental juara: Interrelasi antara komitmen, persisten, dan ambisi prestatif. Jurnal Olahraga Papua, 4(1), 34–46. https://doi.org/10.31957/jop.v4i1.1359

Miçooğulları, B. O. (2017). The Sports mental toughness questionnaire (SMTQ): A psychometric evaluation of the Turkish version. Studia Sportiva, 11(2), 90–98.

Montero, I., & León, O. G. (2007). A guide for naming research studies in Psychology. International Journal of Clinical and Health Psychology, 7(3), 847–862.

Mostajeran, M. H., Badami, R., & Behnke, M. (2022). Psychometric properties of the persian version of the sport mental training questionnaire. Iranian Journal of Psychiatry and Behavioral Sciences, 16(2). https://doi.org/10.5812/ijpbs-118789

Nunnally, J. C., & Bernstein, I. H. (1994). Psychometric theory. McGraw-Hill.

Perry, J. M., Modesti, C., Talamo, A., & Nicolais, G. (2019). Culturally sensitive PTSD screening in non-western youth: reflections and indications for mental health practitioners. Journal of Refugee Studies, 32(SpecialIssie1), I151–I161. https://doi.org/10.1093/jrs/fez053

Putra, M. F. P., Kurdi, Sutoro, S., Syahruddin, S., Hasibuan, S., Sinulingga, A., Kamaruddin, I., Kristiyandaru, A., Mashud, Hariadi, I., Guntoro, T. S., Sinaga, E., Ibrahim, Setiawan, E., Ridwan, M., Wanena, T., Hidayat, R. R., & Hariadi, I. (2024). An indonesian version of mental toughness index: testing psychometric properties in athletes and non-athletes. Retos, 55, 816–824. https://doi.org/10.47197/retos.v55.106086

Putra, M. F. P., Sutoro, Guntoro, T. S., Sinaga, E., Wanena, T., Rahayuni, K., Jannah, M., Warni, W. E., Juriana, Priambodo, A., Tahki, K., Hariadi, I., Hidayat, R. R., & Wandik, Y. (2024). Cross-cultural adaptation of the psychological performance inventory-alternative (PPI-A) for the Indonesian context. Retos, 56, 990–997. https://doi.org/10.47197/retos.v56.103765

Putra, M. F. P., Sutoro, Wanena, T., Wandik, Y., Womsiwor, D., Dike, I. M., Mulait, C., Pattinussa, V., & Pahabol, N. (2024). Mental toughness: are there differences between athletes and non-athletes, education levels, and gender? Retos, 58, 516–521. https://doi.org/10.47197/retos.v58.107330

Quirin, M., Wróbel, M., Pala, A. N., Stieger, S., Brosschot, J., Kazén, M., Hicks, J. A., Mitina, O., Shanchuan, D., Lasauskaite, R., Silvestrini, N., Steca, P., Padun, M. A., & Kuhl, J. (2018). A cross-cultural validation of the implicit positive and negative affect test (IPANAT). European Journal of Psychological Assessment, 34(1), 52–63. https://doi.org/10.1027/1015-5759/a000315

R Core Team. (2016). A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.r-project.org

Raynadi, F. B., Rachmah, D. N., & Akbar, S. N. (2017). Hubungan ketangguhan mental dengan kecemasan bertanding pada atlet pencak silat di Banjarbaru. Jurnal Ecopsy, 3(3), 149–154. https://doi.org/10.20527/ecopsy.v3i3.2665

Rintaugu, E., Mwangi, F., Andanje, N., Tian, X., Fuku, N., & Kidokoro, T. (2022). Mental toughness characteristics of male university athletes in relation to contextual factors. Journal of Human Kinetics, 81(1), 243–251. https://doi.org/10.2478/hukin-2022-0019

Rosseel, Y. (2012). lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02

Rukmini, E., Nugraha, A. S., Angelina, H., & Christianty, D. A. (2022). The validity and reliability of the online cooperative learning attitude scales in the indonesian language. Sisforma, 8(2), 72–79. https://doi.org/10.24167/sisforma.v8i2.4153

Seligman, M. E., & Csikszentmihalyi, M. (2000). Positive psychology: An introduction. The American Psychologist, 55(1), 5–14. https://doi.org/10.1037/0003-066X.55.1.5

Sheard, M., Golby, J., & Van Wersch, A. (2009). Progress toward construct validation of the Sports Mental Toughness Questionnaire (SMTQ). European Journal of Psychological Assessment, 25(3), 186–193. https://doi.org/10.1027/1015-5759.25.3.186

Sorensen, S., Jarden, A., & Schofield, G. (2016). Lay perceptions of mental toughness: Understanding conceptual similarities and differences between lay and sporting contexts. International Journal of Wellbeing, 6(3), 71–95. https://doi.org/10.5502/ijw.v6i3.551

Stamatis, A., Grandjean, P., Morgan, G., Padgett, R. N., Cowden, R., & Koutakis, P. (2020). Developing and training mental toughness in sport: A systematic review and meta-analysis of observational studies and pre-test and post-test experiments. BMJ Open Sport and Exercise Medicine, 6(1), 1–9. https://doi.org/10.1136/bmjsem-2020-000747

Stamatis, A., Morgan, G. B., Papadakis, Z., Mougios, V., Bogdanis, G., & Spinou, A. (2019). Cross-cross-cultural invariance of the mental toughness index among american and greek athletes. Current Psychology, 40(12), 5793–5800. https://doi.org/10.1007/s12144-019-00532-2

Sutoro, Guntoro, T. S., & Putra, M. F. P. (2023). Development and validation mental training model: Mental toughness training circle (MTTC). F1000Reserach, 12(169), 1–36. https://doi.org/10.12688/f1000research.129010.1

Taber, K. S. (2018). The use of cronbach’s alpha when developing and reporting research instruments in science education. Research in Science Education, 48(6), 1273–1296. https://doi.org/10.1007/s11165-016-9602-2

Turana, Y., Kristian, K., Suswanti, I., Sani, T. P., Handajani, Y. S., Tran, K., & Nguyen, T. A. (2023). Adapting the world health organization support dementia program to the indonesian socio-cultural context. Frontiers in Public Health, 16(11), 1050760. https://doi.org/10.3389/fpubh.2023.1050760

Tylén, K., Weed, E., Wallentin, M., Roepstorff, A., & Frith, C. D. (2010). Language as a tool for interacting minds. Mind and Language, 25(1), 3–29. https://doi.org/10.1111/j.1468-0017.2009.01379.x

Wandik, Y., Sutoro, Putra, M. F. P., Dina, Guntoro, T. S., Wambrauw, O. O. O., Abidjulu, C. F., Irab, S. P., Jembise, T. L., Wanena, T., Kmurawak, R. M. B., Rahayu, A. S., Manalu, J., Yektiningtyas, W., Gultom, M., Zainuri, A., J., N. J., Sinaga, E., Hidayat, R. R., … Hariadi, I. (2024). Interrelation of mental toughness, religiosity, and happiness of elite adolescent athletes based on gender, type of sport, and level of education. Retos, 56, 981–989. https://doi.org/10.47197/retos.v56.103469

Yantes, R., & Wilhelm, F. (2023). Careless: Procedures for computing indices of careless responding. https://github.com/ryentes/careless

Published
10-10-2025
How to Cite
Sutoro, S., Guntoro, T. S., Tandipayung, R., Candra, O., Numberi, G. K. I., Zainuri, A., … Putra, M. F. P. (2025). Adaptation, Validation, and Reliability of the Indonesian Version of the Sports Mental Toughness Questionnaire (SMTQ). Sport Psychology Notebooks, 25(3), 263–277. https://doi.org/10.6018/cpd.626491
Issue
Section
Psicología del Deporte

Similar Articles

1 2 3 4 5 6 7 8 9 10 > >> 

You may also start an advanced similarity search for this article.