Psychometric validation of the Environmental Reward Observation Scale (EROS) in breast cancer survivors

  • Concepcion Fernández-Rodríguez Universidad de Oviedo.Dpto de Psicología
  • Sonia González-Fernández Universidad de Oviedo
  • Ignacio Pedrosa Universidad de Oviedo
Keywords: cancer survivors, Environmental Reward Observation Scale (EROS), depression, anxiety.


The loss of rewards resulting from oncological disease has been associated with emotional problems in cancer survivors. The Environmental Reward Observation Scale (EROS) evaluates environmental reinforcement and is based on behavioral models which show the relationship between environmental reinforcement and emotional state. The aim of this study is to analyze the psychometrical properties of this scale in breast cancer survivors and its usefulness in discriminating between survivors with and without emotional disorders. A total of 219 women survivors (Mage= 52.97; SDag= 7.50) completed measures of environmental reinforcement, behavioral activation and avoidance, and emotional state. Data fit an essentially unidimensional structure, showing high internal consistency and correlations, varying from moderate to high, with all the measures used. In the EROS scores, statistically significant differences were found between participants with and without emotional disorders. Optimum cut-off point to discriminate between anxiety and depression was established via Receiver Operating Characteristic curve. Using the framework of the Item Response Theory model, all the items were found to have a power of discrimination for measuring environmental reinforcement ranging from moderate to high. The EROS is a psychometrically sound instrument, which can be used to improve assessment of emotional state in breast cancer survivors. 


Download data is not yet available.

Author Biographies

Concepcion Fernández-Rodríguez, Universidad de Oviedo.Dpto de Psicología

Concepción Fernández-Rodríguez is a Full Professor of Behavior Therapy  at the University of  Oviedo (Spain).  Director of the Clinical and Health Psychology Unit, University of Oviedo.  Her research interests cover the following areas:  Contextual Therapies, Treatment Outcome and Psycho-oncology.  She has served as PI  on several related research and services grants funded by Spanish Government  to assess the efficacy  of contextual therapy. She is authored/co-authored and edited  seven books and  over  a hundred refereed articles in peer reviewed professional journals.  


Sonia González-Fernández, Universidad de Oviedo

Sonia González-Fernández is a licensed clinical psychologist and a pre-doctoral student of the University of Oviedo (Spain). Her research subject is the efficacy of contextual therapy implemented on a group basis for the treatment of depression in cancer patients. She has specialized in Psycho-oncology. She has authored/co-authored several refereed articles in peer-reviewed professional journals.

Ignacio Pedrosa, Universidad de Oviedo

Ignacio Pedrosa, is a research expert on the area of methodology of Behavioral Science. His main areas of research are in relation to robust statistical procedures for repeated measures and for incomplete data, in both experimental and quasi-experimental designs, and analysis of research quality. He has authored/co-authored several refereed articles in peer-reviewed professional journals.


Armento, M.E., & Hopko, D.R. (2007). The environmental reward ob-servation scale (EROS), development, validity, and reliability. Behavior Therapy, 38, 107-119. doi: 10.1016/j.beth.2006.05.003.

Asparouhov, T., & Muthén, B. (2009). Exploratory Structural Equation Mod-eling. Structural Equation Modeling: A Multidisciplinary Journal, 16, 397-438. doi:10.1080/10705510903008204.

Barraca, J., Pérez-Álvarez, M., & Lozano-Bleda, J. (2011). Avoidance and Acti-vation as Keys to Depression: Adaptation of the Behavioral Activation for Depression Scale in a Spanish Sample. The Spanish Journal of Psychology, 14, 998-1009. Available in:

Barraca, J., & Pérez-Álvarez, M. (2010). Spanish adaptation of the Envi-ronmental Reward Observation Scale (EROS). Ansiedad y Estrés, 16, 95-107.

Bardeen, J. R. (2015). Short-term pain for long-term gain: The role of expe-riential avoidance in the relation between anxiety sensitivity and emotion-al distress. Journal of Anxiety Disorders, 30, 113-119. doi: 10.1016/j.janxdis.2014.12.013.

Baker, F. (2001). The basics of item response theory. College Park: ERIC Clear-inghouse on Assessment and Evaluation, University of Maryland.

Beck, A.T., & Steer, R.A., (1993). Beck Depression Inventory Manual. San Anto-nio, TX: The Psychological Corporation.

Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck Depression Inventory-II. San Antonio, TX: The Psychological Corporation.

Becoña, E., Martínez-Vispo, C., Senra, C., López-Durán, A., Rodríguez-Cano, R., & Fernández del Río, E. (2017). Cognitive-behavioral treatment with behavioral activation for smokers with depressive symptomatolo-gy: study protocol of a randomized controlled trial. BMC Psychiatry, 17, 134. doi:10.1186/s12888-017-1301-7.

Bevilacqua, L.A., Dulak, D., Schofield, E., … & Alici, Y. (2018). Prevalence and Predictors of Depression, Pain, and Fatigue in Older- versus Young-er-Adult Cancer Survivors. Psycho-Oncology. doi: 10.1002/pon.4605.

Bombardier, Ch., Fann, J., Ludman, E., Vannoy, S., Dyer, J., Barber, J., & Temkin, N. (2017). The Relations of Cognitive, Behavioral, and Physi-cal Activity Variables to Depression Severity in Traumatic Brain Injury: Reanalysis of Data from a Randomized Controlled Trial. The Journal of Head Trauma Rehabilitation, 32, 343-53 doi: 10.1097/HTR.0000000000000288.

Bond, F.W., Hayes, S.C., Baer, R.A., Carpenter, K.M., Guenole, N., Orcutt, H.K., & Zettle, R.D. (2011). Preliminary psychometric properties of the Acceptance and Action Questionnaire - II: a revised measure of psycho-logical inflexibility and experiential avoidance. Behavior Therapy, 42, 676-688. doi: 10.1016/j.beth.2011.03.007.

Brem, M.J., Shorey, R.C., Anderson, S., & Stuart, G.L. (2017). Depression, anxiety, and compulsive sexual behaviour among men in residential treatment for substance use disorders: The role of experiential avoid-ance. Clinical Psychology and Psychotherapy, 24, 1246-1253. doi: 10.1002/cpp.2085.

Burns, A., Hofer, S., Curry, P., Sexton, E., & Doyle F. (2014). Revisiting the dimensionality of the Hospital Anxiety and Depression Scale in an in-ternational sample of patients with ischemic heart disease. Journal of Psy-chosomatic Research, 77, 116-121. doi: 10.1016/j.jpsychores.2014.05.005.

Cataldo, J., & Brodsky, J.L. (2013). Lung cancer stigma, anxiety, depression and symptom severity. Oncology, 85, 33-40. doi:10.1159/000350834.

Cuijpers, P., van Straten, A., & Warmerdam, L. (2007). Behavioral acti-vation treatments of depression: A meta-analysis. Clinical Psychology Review, 27, 318–326. doi: 10.1016/j.cpr.2006.11.001.

Derogatis, L.R. (2001). Brief Symptom Inventory (BSI)-18. Administration, Scor-ing and Procedures Manual. Minneapolis: NCS Pearson.

Fernández, C., Padierna, C., Villoria, E., Amigo, I., Fernández, R., & Peláez, I. 2011. Impact of anxiety and depression on the physical status and daily of cancer patients during chemotherapy. Psicothema, 23, 374-381. Retrieved from

Fernández, C., Villoria, E., Fernández, P., González, S., & Pérez M. (2017). Effects of Behavioral Activation on the quality of life & emotional state of lung cancer and breast cancer patients during chemotherapy treatment. Behavior Modification, 1-30 doi:10.1177/0145445517746915.

Ferrando, P. J., & Lorenzo-Seva, U. (2014). El análisis factorial exploratorio de los ítems: algunas consideraciones adicionales. Anales de Psicología, 30(3), 1170-1175. doi: 10.6018/analesps.30.3.199991

Folke, F., & Kanter, J. W. (2016). A learning theory account of de-pression. Personality and Social Psychology, 57, 3–82. doi: 10.1111/sjop.12233.

Galdón, M.J., Dura, E., Andreu, Y., Ferrando, M., Murgui, S., Pérez, S., & Ibañez, E. (2008). Psychometric properties of the Brief Symptom In-ventory-18 in a Spanish breast cancer sample. Journal of Psychosomatic Re-search, 65, 533-539. doi:10.1016/j.jpsychores.2008.05.009.

González-Fernández, S., Fernández-Rodríguez, C., Mota-Alonso, M.J., Gar-cía-Teijido, P., Pedrosa, I., & Pérez-Álvarez, M. (2017). Emotional state and psychological flexibility in breast cancer survivors. European Journal of Oncology Nursing, 30, 75-83. doi: 10.1016/j.ejon.2017.08.006.

González-Fernández, S., Fernández-Rodríguez, C., Paz-Caballero, D., & Pé-rez-Álvarez. M. (2018). Treating anxiety and depression of cancer survi-vors: Behavioral activation versus acceptance and commitment therapy. Psicothema, 30, 14-20. doi: 10.7334/psicothema2017.396

Halpern, E., Albert, M., Krieger, A., Metz, Ch., & Maidment, A. (1996). Comparison of receiver operating characteristic curves on the basis of op-timal operating points. Academic Radiology, 3, 245-253.

Hill, R.M., Buitron, V., & Pettit, J.W. (2017). Unpacking Response Con-tingent Positive Reinforcement: Reward Probability, but Not Environ-mental Suppressors, Prospectively Predicts Depressive Symptoms via Behavioral Activation. Journal of Psychopathology and Behavioral Assessment, 39, 498. doi:10.1007/s10862-017-9600-3.

Hopko, D.R., Funderburk, J.S., Shorey, R.C., McIndoo, C.C., Ryba, M.M., File, A.A., … & Vitulano, M. (2013). Behavioral Activation and Prob-lem-Solving Therapy for Depressed Breast Cancer Patients: Preliminary Support for Decreased Suicidal Ideation. Behavior Modification, 37, 747-767. doi: 10.1177/0145445513501512.

Hopko, D. R., Lejuez, C. W., Ruggiero, K. J., & Eifert, G. H. (2003). Con-temporary behavioral activation treatments for depression: Proce-dures, principles, and progress. Clinical Psychology Review, 23, 699-717. doi.10.1016/S0272-73580300070-9.

Hopko, D.R., & Mullane, C.M. (2008). Exploring the relation of depression and overt behavior with daily diaries. Behaviour Research and Therapy, 46, 1085-89. doi. 10.1016/j.brat.2008.05.002.

Kanter, J.W., Mulick, P.S., Busch, A.M., Berlin, K.S., & Martell, C.R. (2007). The behavioral activation for depression scale (BADS): psychometric properties and factor structure. Journal of Psychopathology and Behavioral As-sessment, 29, 191-202. doi:10.1007/s10862-006-9038-5.

Koch-Gallenkamp, L., Bertram, H., Eberle, A., Holleczek, B., Schmid-Höpfner, S., Waldmann, A., . . . & Arndt, V. (2016). Fear of recurrence in long-term cancer survivors. Do cancer type, sex, time since diagno-sis, and social support matter? Health Psychology, 35(12), 1329-1333. doi:10.1037/hea0000374.

Kuehner, C. (2017). Why is depression more common among women than among men? The Lancet Psychiatry, 4(2), 146-158. doi. 10.1016/S2215-0366(16)30263-2.

Lejuez, C., Hopko, D., Acierno, R., Daugh¬ters, S., & Pagoto, S. (2011). Ten Year Revision of the Brief Behavioral Activation Treatment for De-pression (BATD): Revised Treatment Manual (BATD-R). Behavior Modifi-cation, 35, 111-161. doi: 10.1177/0145445510390929.

Lejuez, C., Hopko, D., & Hopko, S. (2001). A Brief Behavioral Activation Treatment for Depression. Behavior Modification, 25, 255-286. doi: 10.1177/0145445501252005.

Lewinsohn, P. (1974). A behavioral approach to depression. In R. Friedman & M. Katz (Eds.), The psychology of depression: Con¬temporary Theory and Re-search (pp. 157-178). Hoboken, USA: Wiley.

Lewinsohn, P., Sullivan, J., & Grosscup, S. (1980). Changing reinforcing events: An approach to the treatment of depression. Psychotherapy: Theo-ry, Research and Prac¬tice, 17, 322–334. doi: 10.1037/h0085929.

Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014). Exploratory Item Factor Analysis: A practical guide revised and up-dated. Anales de Psicología/Annals of Psychology, 30(3), 1151-1169. doi: 10.6018/analesps.30.3.199361

Lorenzo-Seva, U., & Ferrando, P.J. (2017). Factor. Manual of the Program. Tarra-gona: Universitat Rovira i Virgili.

McGinty, H. L., Small, B. J., Laronga, C., & Jacobsen, P. B. (2016). Predic-tors and patterns of fear of cancer recurrence in breast cancer survi-vors. Health Psychology, 35, 1-9. doi: 10.1037/hea0000238.

MacPherson, L., Tull, M. T., Matusiewicz, A. K., Rodman, S., Strong, D. R., Kahler, C. W., ... & Lejuez, C. W. (2010). Randomized controlled trial of behavioral activation smoking cessation treatment for smokers with ele-vated depressive symptoms. Journal of Consulting and Clinical Psychology, 78(1), 55-61. doi: 10.1037/a0017939.

Manos, R., Kanter, J., & Busch, A. (2010). A critical review of assessment strate¬gies to measure the behavioral activation model of depression. Clini-cal Psychology Review, 30, 547-561. doi: 10.1016/j.cpr.2010.03.008.

Martell, C., Addis, M., & Jacobson, N. (2001). Depression in Context: Strate¬gies for Guided Action. New York: W. W. Norton and Company, Inc.

McHorney, C.A., & Tarlov, A.R. (1995). Individual-patient monitoring in clinical practice: are available health status surveys adequate? Qual Life Res., 4(4), 293-307

Mosewich, A. D., Hadd, V., Crocker, P. R. E., & Zumbo, B. D. (2013). In-variance testing of the SF-36 health survey in women breast cancer survi-vors: Do personal and cancer-related variables influence the meaning of quality of life items? Social Indicators Research, 110, 559-557. doi:10.1007/s11205-011-9944-0.

Muthén, L.K., & Muthén, B.O. (2012). Mplus User’s Guide. Seventh Edition. Los Angeles, CA: Muthén and Muthén.

Radloff, L.S. (1997). The CES-D Scale: A Self-Report Depression Scale for Re-search in the General Population. Applied Psychological Measurement, 1 (3), 387-415.

Ryba, M., & Hopko, D. (2012). Gender Differences in Depression: As-sessing Mediational Effects of Overt Behaviors and Environmental Re-ward through Daily Diary Monitoring. Depression Research and Treatment, 865679. doi 10.1155/2012/865679.

Ruiz, F.J., Langer-Herrera, A.I., Luciano, C., Cangas, A.J., & Beltrán, I. (2013). Measuring experiential avoidance and psychological inflexibility: The Spanish version of the Acceptance and Action Questionnaire - II. Psico-thema, 25, 123-129. doi: 10.7334/psicothema2011.239

Samejima, F. (1970). Estimation of latent ability using a response pattern of graded scores. Psychometrika, 17, 1. doi:10.1007/BF03372160.

Sanz, J., & García-Vera, M.P. (2007). A psychometric analysis of the short forms of the 1978 version of the Beck Depression Inventory. Psicología Conductual, 15, 191-214.

Smarr, K. L., & Keefer, A. L. (2011). Measures of depression and de-pressive symptoms: Beck Depression Inventory‐II (BDI‐II), Center for Epidemiologic Studies Depression Scale (CES‐D), Geriatric Depres-sion Scale (GDS), Hospital Anxiety and Depression Scale (HADS), and Patient Health Questionnaire‐9 (PHQ‐9). Arthritis Care & Re-search, 63(S11), S454-S466. doi:10.1002/acr.20556

Spielberger, C. D. (1983). Manual for the State-Trait Anxiety Inventory (STAI). Pa-lo Alto, CA: Consulting Psychologists Press.

Trindade, I., Ferreira, C., & Pinto-Gouveia, J. (2017). Roles of body im-age-related experiential avoidance and uncommitted living in the link be-tween body image and women’s quality of life, Women and Health, 58 (1), 38-50, doi: 10.1080/03630242.2016.1267688

Tull, M., Gratz, K., Latzman, R., Kimbrel, N., & Lejuez, C. (2010). Rein-forcement sen¬sitivity theory and emotion regulation difficulties: A multi-modal investigation. Personality and Individual Difference, 49, 989–994. doi: 10.1016/j.paid.2010.08.010.

Valderrama-Díaz, M. A., Bianchi-Salguero, J. M., & Villalba-Garzón, A. A. (2016). Validation of the Environmental Reward Observation Scale (EROS) in Colombian population. Universitas Psychologica, 15. doi: 10.11144/javeriana.upsy15-4.vero.

Wagener, A., & Blairy, S. (2015). Validation and Psychometric Properties of the French Versions of the Environmental Reward Observation Scale and of the Reward Probability Index. Psychologica Belgica, 55, 71-86, doi: 10.5334/

Walker, J., Postma, K., McHugh, G.S., Rush, R., Coyle, B., Strong, V., & Sharpe, M. (2007). Performance of the Hospital Anxiety and De-pression Scale as a screening tool for major depressive disorder in cancer patients. Journal of Psychosomatic Research, 63, 83-91. doi: 10.1016/j.jpsychores.2007.01.009.

West, S.G., Taylor A.B., & Wu W. (2012). Model fit and model selection in structural equation modelling. In Handbook of Structural Equation Mod-eling, Hoyle, R.H., (Ed.). New York, NY: Guilford. pp. 209-231.

Yi J.C., & Syrjala K.L. (2017). Anxiety and Depression in Cancer Survivors. Medical Clinics of North America, 101, 1099-1113. doi: 10.1016/j.mcna.2017.06.005.

Zigmond, A.S., & Snaith, R.P. (1983). The hospital anxiety and depression scale. Acta Psychiatrica Scandinavica, 67, 361-370. doi: 10.1111/j.1600-0447. 1983.tb09716. x.

How to Cite
Fernández-Rodríguez, C., González-Fernández, S., & Pedrosa, I. (2020). Psychometric validation of the Environmental Reward Observation Scale (EROS) in breast cancer survivors. Anales De Psicología / Annals of Psychology, 36(1), 74-83.
Clinical and Health Psychology