Psychometric properties of the Academic Perceptions Questionnaire for the assessment of first-year university students´ expectations
Abstract
This paper aims to test the psychometric validity and reliability of a measure of first-year university students’ expectations, based on a multidimensional conception of expectations. The sample consisted of 759 first-year students, attending various academic degrees at the Universities of Vigo - Ourense and University of Minho. The value Mdn age was 19, with only 5.3% with ages above 23 years. Participants answered a set of 56 items based on seven different dimensions of expectations. Results of confirmatory factor analysis, were carried out with LISREL. Factorial validity, and factors’ convergent and discriminant validity were assured. These results, along with evidences reliability, suggest that the Academic Perceptions Questionnaire presents a final structure composed of seven expectation dimensions, including 42 items: Training for employment/career, Personal and social development, Student mobility, Political and citizenship involvement, Social pressure, Quality of education, and Social interaction. The equivalence of measurement model in the two languages and in two groups randomly derived from the full sample was also verified. The results of this structural validity study support the assessment of the expectations of first-year students in Higher Education with the questionnaire.
Downloads
References
Almeida, L. S. (2007). Transição, adaptação académica e êxito escolar no ensino superior. Revista Galego-Portuguesa de Psicoloxía e Educación, 14(2), 203-215.
Almeida, L. S., Costa, A. R., Alves, F., Gonçalves, P. y Araújo, A. (2012). Expetativas académicas dos alunos do ensino superior: construção e validação de uma escala de avaliação. Psicologia, Educação e Cultura, XVI(I), 70-85.
Almeida, L. S., Guisande, M. A. y Paisana, J. (2012). Participación extracurricu-lar, ajuste y rendimiento académico en la Enseñanza Superior: Un estudio con estudiantes portugueses. Anales de Psicología, 28(3), 860-865.
Almeida, L. S., Guisande, M. A., Soares, A. P. y Saavedra, L. (2006). Acesso e sucesso no Ensino Superior em Portugal: Questões de género, origem só-cio-cultural e percurso académico dos alunos. Psicologia: Reflexão e Crítica, 19(3), 507-514.
Almeida, L., Vasconcelos, R. y Mendes, T. (2008). O abandono dos estudantes no Ensino Superior: um estudo na Universidade do Minho. Revista Galego-Portuguesa de Psicoloxía e Educación, 16(1,2), 111-119.
Anderson, J. C. y Gerbing, D. W. (1988). Structural equation modeling in prac-tice: A review and recommended two step approach. Psychological Bulletin, 103(3), 411-423.
Bagozzi, R. P. y Yi, I. (1998). On the evaluation of structural equation models. Journal of the Academy of Marketing Science, 16(1), 74-94.
Baker, R. W., McNeil, O. V. y Siryk, B. (1985). Expectations and reality in freshman adjustment to college. Journal of Counselling Psychology, 32(1), 94-103.
Baker, R. W. y Schultz, K. L. (1992). Measuring expectations about college ad-justment. NACADA Journal, 12(2), 23-32.
Bentler, P. M. y Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606.
Bentler, P. M. y Dudgeon, P. (1996). Covariance structure analysis: Statistical practice, theory, and directions. Annual Review of Psychology, 47, 563-592.
Bradley, C., Kish, K. A., Krudwig, A. M., Williams, T. y Wooden, O. S. (2002). Predicting faculty-student interaction: An analysis of new student expecta-tions. Journal of Indiana University Student Personnel Association, 2, 72-85.
Braxton, J. M., Vesper, N. y Hossler, D. (1995). Expectations for college and student persistence. Research in Higher Education, 36(5), 595-611.
Browne, M. W. y Cudeck, R. (1993). Alternative ways of assessing model fit. En K. A. Bollen y J. S. Long (Eds.), Testing structural equation models (pp. 136-162). London: SAGE.
Byrne, M. y Flood, B. (2005). A study of accounting students' motives, expecta-tions and preparedness for Higher Education. Journal of Further and Higher Education, 29(2), 111-124.
Cole, J. S., Kennedy, M. y Ben-Avie, M. (2009). The role of precollege data in assessing and understanding student engagement in college. New Directions for Institutional Research, 141, 55-69.
Cook, A. y Leckey, J. (1999). Do expectations meet reality? A survey of changes in first year student opinion. Journal of Further and Higher Education, 23(2), 157-171.
Cronbach, L. J. y Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281-302.
Curran, P. J., West, S. G. y Finch, J. F. (1996). The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis. Psychological Methods, 1(1), 16-29.
Cheung, G.W. y Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9(2), 233-255.
Darlaston-Jones, D., Pike, L., Cohen, L., Young, A., Haunold, S. y Drew, N. (2003). Are they being served? Student expectations of higher education. Issues In Educational Research, 13(1), 31-52.
Deaño, M., García-Señorán, M. y Sepúlveda, J. (1997). Factores de éxito en alumnos de último curso de carrera en la Universidad de Vigo. Caderno de Innovación i Educación (CIE), 1, 203-238.
Deaño, M., Gómez, J. y García-Señorán, M. (1997). Perfil del alumnado de la Universidad de Vigo a partir de la evaluación docente del profesorado. Caderno de Innovación i Educación (CIE), 1, 253-264.
Fernández-Ortiz, R., González, L., Fernández-Losa, N. y Segura, M. J. (2010). Calidad universitaria: expectativas de los estudiantes recién incorporados. Revista Nacional de Administración, 1(2), 17-30.
Flora, D. B. y Curran, P. J. (2004). An empirical evaluation of alternative meth-ods of estimation for confirmatory factor analysis with ordinal data. Psycho-logical Methods, 9(4), 466-491.
Fornell, C. y Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50.
Goldfinch, J. y Hughes, M. (2007). Skills, learning styles and success of first-year undergraduates. Active Learning in Higher Education, 8(3), 259-273.
Hernández, F., Sancho, J. M., Montané, A. y Sánchez de Serdio, A. (2011). ¿Cómo los académicos españoles se enfrentan con el cambio? Respuesta desde una investigación de historias de vida profesionales. Barcelona: Universidad de Barcelona. Recuperado de http://hdl.handle.net/2445/20983.
Howard, J. A. (2005). Why should we care about student expectations? En T. E. Miller, B. E. Bender, J. H. Schuh y Associates (Eds.), Promoting reasonable expectations: Aligning student and institutional views of the college experience (pp. 10-33). San Francisco, CA: Jossey-Bass.
Hu, L. y Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparametrized model misspecification. Psychological Methods, 3(4), 424-453.
Igue, E. A., Bariani, I. C. y Milanesi, P. V. (2008). Vivência acadêmica e expectativas de universitários igressantes e concluintes. Psico-USF, 13(2), 155-164.
Infante-Díaz, J. (2010). La reforma de los planes de estudio universitarios de la España democrática. Revista de Educación, 351, 259-282.
Jackson, L. M., Pancer, S. M. y Pratt, M. W. (2000). Great expectations: The relation between expectancies and adjustment during the transition to university. Journal of Applied Social Psychology, 30(10), 2100-2025.
Jöreskog, K. G. (2005). Structural equation modeling with ordinal variables using LIS-REL. Recuperado de http://www.ssicentral.com/lisrel/techdocs/ordinal.pdf
Jöreskog, K. G. y Mustaky, I. (2001). Factor analysis of ordinal variables: A comparison of three approaches. Multivariate Behavioral Research, 36, 347-387.
Jöreskog, K. G. y Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language. Chicago, IL: Scientific Software International.
Jöreskog, K. G. y Sörbom, D. (1996a). PRELIS 2: User’s reference guide. Chicago, IL: Scientific Software International.
Jöreskog, K. G. y Sörbom, D. (1996b). LISREL 8: User’s reference guide. Chicago, IL: Scientific Software International.
Jöreskog, K. G. y Sörbom, D. (2002). LISREL 8.53 for Windows [Computer software]. Chicago, IL: Scientific Software International.
Kline, R. B. (2011). Principles and practice of structural equation modeling (3ª ed.). New York, NY: Guilford Press.
Kuh, G. D., Gonyea, R. M. y Williams, J. M. (2005). What students expect from college and what they get. En T. E. Miller, B. E. Bender, J. H. Schuch y Associates (Eds.), Promoting reasonable expectations: Aligning student and institutional views of the college experience (pp. 34-64). San Francisco, CA: Jossey-Bass.
Magalhães, A., Amaral, A. y Tavares, O. (2009). Equity, access and institutional competition. Tertiary Education and Management, 15(1), 35-48.
Meredith, W. (1993). Measurement invariance, factor analysis and factorial invariance. Psychometrika, 58(4), 525-543.
Millsap, R. E. y Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39(3), 479-515.
Nunnally, J. C. y Bernstein, I. H. (1994). Psychometric theory (3ª ed.). New York, NY: McGraw-Hill.
OECD (2011a). Education at a Glance 2011: Highlights. OECD Publishing. Recuperado de http://www.oecd.org/edu/highereducationandadultlearning/48631550.pdf
OECD (2011b). Education at a Glance 2011: OECD indicators. OECD Publis-hing. Recuperado de http://www.oecd.org/education/highereducationandadultlearning/48631582.pdf
Olsen, D., Kuh, G. D., Schilling, K. M., Schilling, K., Connolly, M., Simmons, A. y Vesper, N. (November, 1998). Great Expectations: What First-Year Students Say They Will Do and What They Actually Do. Paper presented at the Annual Meeting of the Association for the Study of Higher Education, Miami, FL.
Pancer, S. M., Hunsberger, B., Pratt, M. W. y Alisat, S. (2000). Cognitive com-plexity of expectations and adjustment to university in first year. Journal of Adolescent Research, 15(1), 38-57.
Pascarella, E .T. y Terenzini, P. T. (2005). How College Affects Students: A Third Decade of Research. San Francisco: Jossey-Bass.
Pichardo, M. C., Berbén, A. B. G., De la Fuente, J. y Justicia, F. (2007). El estudio de las expectativas en la universidad: análisis de trabajos empíricos y futuras líneas de investigación. Revista Electrónica de Investigación Educativa, 9(1). Recuperado de http://redie.uabc.mx/vol9no1/contenido-pichardo.html
Saavedra, L., Almeida, L. S., Gonçalves, A. y Soares, A. P. (2004). Pontos de partida, pontos de chegada: Impacto de variáveis sócio-culturais no ingresso ao Ensino Superior. Sociedade e Cultura 6, Cadernos do Noroeste, 22(1-2), 63-84.
Salanova, M., Martínez, I. M., Bresó, E., LLorens, S. y Grau, R. (2005). Bienestar psicológico en estudiantes universitarios: facilitadores y obstaculizadores del desempeño académico. Anales de Psicología, 21(1), 170-180.
Satorra, A. y Bentler, P. M. (1994). Corrections to test statistics and standard errors in covariance structure analysis. En A. Von Eye y C. C. Clogg (Eds.), Latent variable analysis (pp. 399-419). Thousand Oaks, CA: SAGE.
Smith, J. S. y Wertlieb, E. C. (2005). Do first-year college students’ expectations align with their first-year experiences? NASPA Journal, 42(2), 153-174.
Soares, A. P. (2003). Transição e adaptação ao Ensino Superior: Construção e validação de um modelo multidimensional de ajustamento de jovens ao contexto universitário. Unpublished doctoral thesis. Braga: Universidade do Minho.
Soares, A. P. C. y Almeida, L. S. (2005). Questionário de Envolvimento Acadé-mico (QEA): Novos elementos para a sua validação. Psicología: Teoria, Investigação e Prática, 10(2), 139-158.
Soares, A. P., Almeida, L. S. y Guisande, M. A. (2011). Ambiente académico y adaptación a la universidad: Un estudio con estudiantes de 1º año de la Universidad do Minho. Revista Iberoamericana de Psicología y Salud, 2(1), 99-121.
Soares, A. P., Guisande, M. A. y Almeida, L. S. (2007). Autonomía y ajuste académico: Un estudio con estudiantes portugueses de primer año. International Journal of Clinical and Health Psychology, 7(3), 753-765.
Soares, A. P., Guisande, M. A., Almeida, L. S. y Páramo, M. F. (2009). Academic achievement in first-year Portuguese college students: The role of academic preparation and learning strategies. International Journal of Psychology, 44(3), 204-212.
Tavares, D., Tavares, O., Justino. E. y Amaral, A. (2008). Students’ preferences and needs in Portuguese Higher Education. European Journal of Education, 43(1), 107-122.
Tinto, V. (1993). Leaving college: Rethinking the causes and cures of student attrition (2ª ed.). Chicago, IL: University of Chicago Press.
The works published in this journal are subject to the following terms:
1. The Publications Service of the University of Murcia (the publisher) retains the property rights (copyright) of published works, and encourages and enables the reuse of the same under the license specified in paragraph 2.
© Servicio de Publicaciones, Universidad de Murcia, 2022
2. The works are published in the online edition of the journal under a Creative Commons Reconocimiento-CompartirIgual 4.0 (legal text). You can copy, use, distribute, transmit and publicly display, provided that: i) you cite the author and the original source of publication (journal, editorial and URL of the work), ii) are not used for commercial purposes, iii ) mentions the existence and specifications of this license.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
3. Conditions of self-archiving. Is allowed and encouraged the authors to disseminate electronically pre-print versions (version before being evaluated and sent to the journal) and / or post-print (version reviewed and accepted for publication) of their works before publication, as it encourages its earliest circulation and diffusion and thus a possible increase in its citation and scope between the academic community. RoMEO Color: Green.
