The COVID Stress Scale in a Malaysian population: Psychometric properties
Abstract
The COVID Stress Scales (CSS) were used to assess distress related to Coronavirus Disease 2019 (COVID-19). In line with Malaysia's epidemic prevention and control policies during the pandemic, a Malay version of the CSS was developed. This study validated the psychometric properties and factorial structure of the CSS in a Malaysian sample of 686 adults (431 females, 255 males; aged 18–65 years), addressing the lack of culturally specific tools to measure pandemic-related distress in Malaysia. Using rigorous translation and confirmatory factor analysis, the CSS demonstrated strong internal consistency. The results showed that a six-factor model encompassing danger, socioeconomic impact, xenophobia, contamination, traumatic stress, and compulsive checking for the Malay adaptation of the CSS was a good fit with the data. Concurrent validity was confirmed through significant correlations with established measures of COVID-19 fear, PTSD symptoms, and depression. The novelty of this research lies in providing the first comprehensive validation of the Malay CSS, ensuring its cultural relevance and accuracy for assessing COVID-19 stress within the Malaysian sociocultural context. These findings position the CSS as a reliable, multidimensional instrument with practical applications for mental health research and targeted public health interventions to address pandemic-related psychological distress in Malaysia.
References
Adamczyk, K., Clark, D. A., & Pradelok, J. (2021). The Polish COVID Stress Scales: Considerations of psychometric functioning, measurement invariance, and validity. PloS One, 16(12). https://doi.org/10.1371/journal.pone.0260459
Ahorsu, D. K., Lin, C. Y., Imani, V., Saffari, M., Griffiths, M. D., & Pakpour, A. H. (2020). The fear of COVID-19 scale: Development and initial validation. International Journal of Mental Health and Addiction, 20, 1537–1545. https://doi.org/10.1007/s11469-020-00270-8
American Psychiatric Association. (2022). American Psychiatric Association Diagnostic and Statistical Manual of Mental Disorders (DSM-5-TR). American Psychiatric Association Publishing (2022) https://doi. org/10.1176/appi. books. 9780890425787.
Arora, T., Grey, I., Östlundh, L., Lam, K. B. H., Omar, O. M., & Arnone, D. (2022). The prevalence of psychological consequences of COVID-19: A systematic review and meta-analysis of observational studies. Journal of Health Psychology, 27(4), 805-824.
Toseeb, U., & Asbury, K. (2023). A longitudinal study of the mental health of autistic children and adolescents and their parents during COVID-19: Part 1, quantitative findings. Autism, 27(1), 105-116.
Bitan, D. T., Grossman-Giron, A., Bloch, Y., Mayer, Y., Shiffman, N., & Mendlovic, S. (2020). Fear of COVID-19 scale: Psychometric characteristics, reliability and validity in the Israeli population. Psychiatry Research, 289, 113100. https://doi.org/10.1016/j.psychres.2020.113100
Blanchard, E. B., Jones-Alexander, J., Buckley, T. C., & Forneris, C. A. (1996). Psychometric properties of the PTSD Checklist (PCL). Behaviour Research and Therapy, 34(8), 669-673.
Bonilla, J., Bernal, G., Santos, A., & Santos, D. (2004). A revised Spanish version of the Beck Depression Inventory: Psychometric properties with a Puerto Rican sample of college students. Journal of Clinical Psychology, 60(1), 119-130.
Bracken, B. A., & Barona, A. (1991). State of the art procedures for translating, validating and using psychoeducational tests in cross-cultural assessment. School Psychology International, 12(1-2), 119-132.
Bueno-Notivol, J., Gracia-García, P., Olaya, B., Lasheras, I., López-Antón, R., & Santabárbara, J. (2021). Prevalence of depression during the COVID-19 outbreak: A meta-analysis of community-based studies. International Journal of Clinical and Health Psychology, 21(1), 100196. https://doi.org/10.1016/j.ijchp.2020.07.007
Boehme, B. A. E., Kinsman, L., Taylor, S., & Asmundson, G. J. G. (2024). Is there evidence for factorial invariance of the COVID Stress Scales? An analysis of North American and cross-cultural populations. Frontiers in Psychiatry, 15, 1381124. https://doi.org/10.3389/fpsyt.2024.1381124
Byrne, B. M., Baron, P., & Balev, J. (1998). The Beck Depression Inventory: A cross-validated test of second-order factorial structure for Bulgarian adolescents. Educational and Psychological Measurement, 58(2), 241-251.
Byrne, B. M., Baron, P., Larsson, B., & Melin, L. (1995). The Beck Depression Inventory: Testing and cross-validating a second-order factorial structure for Swedish nonclinical adolescents. Behaviour Research and Therapy, 33(3), 345-356.
Campo-Arias, A., Pedrozo-Cortés, M. J., & Pedrozo-Pupo, J. C. (2020). Pandemic-Related Perceived Stress Scale of COVID-19: An exploration of online psychometric performance, 49(4), 229-230.
Campos, R. C., & Gonçalves, B. (2011). The Portuguese version of the beck depression inventory-II (BDI-II). European Journal of Psychological Assessment. https://doi.org/10.1027/1015-5759/a000072
Carlander, A., Lekander, M., Asmundson, G. J., Taylor, S., Olofsson Bagge, R., & Lindqvist Bagge, A. S. (2022). COVID-19 related distress in the Swedish population: Validation of the Swedish version of the COVID Stress Scales (CSS). Plos One, 17(2), e0263888. https://doi.org/10.1371/journal.pone.0263888
Cavalheiro, F. R. S., & Sticca, M. G. (2022). Adaptation and Validation of the Brazilian Version of the Fear of COVID-19 Scale. International Journal of Mental Health and Addiction, 20(2), 921-929.
Chandu, V., Pachava, S., Vadapalli, V., & Marella, Y. (2020). Development and initial validation of the COVID-19 anxiety scale. Indian Journal of Public Health, 64, 201-204.
Chen, B., Sun, J., & Feng, Y. (2020). How have COVID-19 isolation policies affected young people’s mental health?–Evidence from Chinese college students. Frontiers in Psychology, 11, 1529. https://doi.org/10.3389/fpsyg.2020.01529
COVID-19 Malaysia. (n.d.). COVID-19 Malaysia. Retrieved May 17, 2022 from https://covid-19.moh.gov.my/
Dell'Acqua, C., Moretta, T., Dal Bò, E., Benvenuti, S. M., & Palomba, D. (2022). Emotional processing prospectively modulates the impact of anxiety on COVID-19 pandemic-related post-traumatic stress symptoms: An ERP study. Journal of Affective Disorders, 303, 245-254.
DeVon, H. A., Block, M. E., Moyle‐Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., ... & Kostas‐Polston, E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39(2), 155-164.
Dong, F., Liu, H. L., Dai, N., Yang, M., & Liu, J. P. (2021). A living systematic review of the psychological problems in people suffering from COVID-19. Journal of Affective Disorders, 292, 172-188.
Estrada, S., Kennedy, B., Sass, S., Barena, E., O’Brian, K., Ihionkhan, P., & Thomas, C. (2025). Factor structure and Rasch analysis of the COVID Stress Scale: Evaluating competing factor models. SAGE Open, 1–16. https://doi.org/10.1177/21582440251363683
Ginting, H., Näring, G., Van Der Veld, W. M., Srisayekti, W., & Becker, E. S. (2013). Validating the Beck Depression Inventory-II in Indonesia's general population and coronary heart disease patients. International Journal of Clinical and Health Psychology, 13(3), 235-242.
Green, Z. A., Noor, U., Ahmed, F., & Himayat, L. (2022). Validation of the Fear of COVID-19 Scale in a sample of Pakistan’s university students and future directions. Psychological Reports, 125(5), 2709-2732.
Guillen-Burgos, H. F., Gomez-Ureche, J., Acosta, N., Acevedo-Vergara, K., Perez-Florez, M., Villalba, E., ... & Galvez-Florez, J. F. (2022). Post-traumatic stress disorder, anxiety, and depression symptoms in healthcare workers during COVID-19 pandemic in Colombia. European Journal of Trauma & Dissociation, 6(4), 100293. https://doi.org/10.1016/j.ejtd.2022.100293
Hamidi, R., Fekrizadeh, Z., Azadbakht, M., Garmaroudi, G., Taheri Tanjani, P., Fathizadeh, S., & Ghisvandi, E. (2015). Validity and reliability Beck depression inventory-II among the Iranian elderly population. Journal of Sabzevar University of Medical Sciences, 22(1), 189-198.
Heale, R., & Twycross, A. (2015). Validity and reliability in quantitative studies. Evidence-based Nursing, 18(3), 66-67.
Holmes, T. H., & Rahe, R. H. (1967). The Social Readjustment Rating Scale. Journal of Psychosomatic Research, 11(2), 213–218.
Hynes, K. C., Tambling, R. R., Russell, B. S., Park, C. L., & Fendrich, M. (2022). A latent profile analysis of the COVID-19 Stressors Scale. Psychological Trauma: Theory, Research, Practice, and Policy, 14(4), 705-713.
Jaapar, S. Z. S., Abidin, Z. Z., & Othman, Z. (2014). Validation of Malay Trauma Screening Questionnaire. International Medical Journal, 21(6), 536-538.
Kapci, E. G., Uslu, R., Turkcapar, H., & Karaoglan, A. (2008). Beck Depression Inventory II: evaluation of the psychometric properties and cut‐off points in a Turkish adult population. Depression and Anxiety, 25(10), E104-E110.
Khosravani, V., Asmundson, G. J., Taylor, S., Bastan, F. S., & Ardestani, S. M. S. (2021). The Persian COVID stress scales (Persian-CSS) and COVID-19-related stress reactions in patients with obsessive-compulsive and anxiety disorders. Journal of Obsessive-Compulsive and Related Disorders, 28, 100615. https://doi.org/10.1016/j.jocrd.2020.100615
Kojima, M., Furukawa, T. A., Takahashi, H., Kawai, M., Nagaya, T., & Tokudome, S. (2002). Cross-cultural validation of the Beck Depression Inventory-II in Japan. Psychiatry Research, 110(3), 291-299.
Kshirsagar, M. V., Vaidya, S. R., & Ashturkar, M. D. (2022). Impact of COVID-19 on mental health of health-care providers in Maharashtra: A cross-sectional study. Annals of Indian Psychiatry, 6(4), 362-365.
Kühner, C., Bürger, C., Keller, F., & Hautzinger, M. (2007). Reliability and validity of the revised Beck Depression Inventory (BDI-II). Results from German samples. Der Nervenarzt, 78(6), 651-656.
Lim, S. Y., Lee, E. J., Jeong, S. W., Kim, H. C., Jeong, C. H., Jeon, T. Y., ... & Kim, J. B. (2011). The validation study of Beck Depression Scale 2 in Korean version. Anxiety and Mood, 7(1), 48-53.
Lin W.L., Yao, G. (2014). Concurrent validity. In Michalos A.C. (ed.) Encyclopaedia of Quality of Life and Well-Being Research. Springer, Dordrecht. https://doi.org/10.1007/978-94-007-0753-5_
Lovik, A., González-Hijón, J., Kähler, A. K., Valdimarsdóttir, U. A., Frans, E. M., Magnusson, P. K., ... & Fang, F. (2023). Mental health indicators in Sweden over a 12-month period during the COVID-19 pandemic–Baseline data of the Omtanke2020 Study. Journal of Affective Disorders, 322, 108-117.
Mahamid, F. A., Veronese, G., Bdier, D., & Pancake, R. (2022). Psychometric properties of the COVID stress scales (CSS) within Arabic language in a Palestinian context. Current Psychology, 41(10), 7431-7440.
Martínez-Lorca, M., Martínez-Lorca, A., Criado-Álvarez, J. J., Armesilla, M. D. C., & Latorre, J. M. (2020). The fear of COVID-19 scale: Validation in Spanish university students. Psychiatry Research, 293, 113350. https://doi.org/10.1016/j.psychres.2020.113350
Masuyama, A., Shinkawa, H., & Kubo, T. (2022). Validation and psychometric properties of the Japanese version of the fear of COVID-19 scale among adolescents. International Journal of Mental Health and Addiction, 20, 387–397.
Miclea, B., Nicoara, R. D., & Coman, H. G. (2022). Psychometric properties of the Questionnaire COVID-19 Stress on the Romanian community sample. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 13(4), 122-140.
Mohamad, F. F. (2022). Impak Perintah Kawalan Pergerakan (PKP) terhadap kesihatan mental wanita: Satu tinjauan awal di kalangan wanita di Selangor. e-Bangi: Journal of Social Sciences & Humanities, 19(1), 81-93.
Miclea, B., Nicoara, R. D., & Coman, H. G. (2022). Psychometric Properties of the Questionnaire COVID-19 Stress on the Romanian Community Sample. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 13(4). https://doi.org/10.70594/
Milic, M., Dotlic, J., Rachor, G. S., Asmundson, G. J., Joksimovic, B., Stevanovic, J., ... & Gazibara, T. (2021). Validity and reliability of the Serbian COVID Stress Scales. PLoS One, 16(10). https://doi.org/10.1371/journal.pone.0259062
Nikčević, A. V., & Spada, M. M. (2020). The COVID-19 anxiety syndrome scale: Development and psychometric properties. Psychiatry Research, 292, 113322. https://doi.org/10.1016/j.psychres.2020.113322
Noe-Grijalva, M., Polo-Ambrocio, A., Gómez-Bedia, K., & Caycho-Rodríguez, T. (2022). Spanish Translation and Validation of the COVID Stress Scales in Peru. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.840302
Novović, Z., Mihić, L., Tovilović, S., Jovanović, V., & Biro, M. (2011). Psychometric characteristics of the Beck depression inventory on a Serbian student sample. Psihologija, 44(3), 225-243.
Nunnally, J. (1978). Psychometric theory. McGraw Hill.
Pang, N. T. P., Kamu, A., Hambali, N. L. B., Mun, H. C., Kassim, M. A., Mohamed, N. H., ... & Jeffree, M. S. (2022). Malay version of the fear of COVID-19 scale: Validity and reliability. International Journal of Mental Health and Addiction, 20, pages263–272.
Pieh, C., Budimir, S., Delgadillo, J., Barkham, M., Fontaine, J. R., & Probst, T. (2021). Mental health during COVID-19 lockdown in the United Kingdom. Psychosomatic Medicine, 83(4), 328-337.
Pilch, I., Kurasz, Z., & Turska-Kawa, A. (2021). Experiencing fear during the pandemic: Validation of the fear of COVID-19 scale in Polish. PeerJ, 9, e11263. https://doi.org/10.7717/peerj.11263
Psychology of Pandemics Network. (n.d.). Resources for Professionals. Retrieved from https://coronaphobia.org/
Ransing, R., Ramalho, R., Orsolini, L., Adiukwu, F., Gonzalez-Diaz, J. M., Larnaout, A., ... & Kilic, O. (2020). Can COVID-19 related mental health issues be measured?. Brain, Behavior, and Immunity, 88, 32-34.
Robinson, J. P., Shaver, P. R., & Wrightsman, L. S. (1991). Criteria for scale selection and evaluation. Measures of Personality and Social Psychological Attitudes, 1(3), 1-16.
Ruggiero, K. J., Ben, K. D., Scotti, J. R., & Rabalais, A. E. (2003). Psychometric properties of the PTSD Checklist—Civilian version. Journal of traumatic stress, 16(5), 495-502.
Sakib, N., Akter, T., Zohra, F., Bhuiyan, A. I., Mamun, M. A., & Griffiths, M. D. (2023). Fear of COVID-19 and depression: a comparative study among the general population and healthcare professionals during COVID-19 pandemic crisis in Bangladesh. International Journal of Mental Health and Addiction, 21(2), 976-992.
Satici, B., Gocet-Tekin, E., Deniz, M. E., & Satici, S. A. (2021). Adaptation of the Fear of COVID-19 Scale: Its association with psychological distress and life satisfaction in Turkey. International Journal of Mental Health and Addiction, 19(6), 1980-1988.
Sica, C., & Ghisi, M. (2007). The Italian versions of the Beck Anxiety Inventory and the Beck Depression Inventory-II: Psychometric properties and discriminant power. In M. A. Lange (Ed.), Leading-edge psychological tests and testing research (pp. 27–50). Nova Science Publishers.
Soares, F. R., Afonso, R. M., Martins, A. P., Pakpour, A. H., & Rosa, C. P. (2022). The fear of the COVID-19 Scale: Validation in the Portuguese general population. Death Studies, 46(9), 2093-2099. https://doi.org/10.1080/07481187.2021.1889722
Soraci, P., Ferrari, A., Abbiati, F. A., Del Fante, E., De Pace, R., Urso, A., & Griffiths, M. D. (2022). Validation and psychometric evaluation of the Italian version of the Fear of COVID-19 Scale. International Journal of Mental Health and Addiction, 20(4), 1913-1922.
Stănculescu, E. (2022). Fear of COVID-19 in Romania: Validation of the Romanian version of the fear of COVID-19 scale using graded response model analysis. International Journal of Mental Health and Addiction, 20(2), 1094-1109.
Tambling, R. R., Russell, B. S., Park, C. L., Fendrich, M., Hutchinson, M., Horton, A. L., & Tomkunas, A. J. (2021). Measuring cumulative stressfulness: Psychometric properties of the COVID-19 Stressors Scale. Health Education & Behavior, 48(1), 20-28.
Taylor, S., Landry, C. A., Paluszek, M. M., Fergus, T. A., McKay, D., & Asmundson, G. J. (2020). Development and initial validation of the COVID Stress Scales. Journal of Anxiety Disorders, 72, 102232. https://doi.org/10.1016/j.janxdis.2020.102232
Voitsidis, P., Kerasidou, M. D., Nikopoulou, A. V., Tsalikidis, P., Parlapani, E., Holeva, V., & Diakogiannis, I. (2021). A systematic review of questionnaires assessing the psychological impact of COVID-19. Psychiatry Research, 305, 114183. https://doi.org/10.1016/j.psychres.2021.114183
Weathers, F. W., Litz, B. T., Herman, D. S., Huska, J. A., & Keane, T. M. (1993, October). The PTSD Checklist (PCL): Reliability, validity, and diagnostic utility. In Annual Convention of the International Society for Traumatic Stress Studies, San Antonio, TX (Vol. 462).
Winkler, P., Formanek, T., Mlada, K., Kagstrom, A., Mohrova, Z., Mohr, P., & Csemy, L. (2020). Increase in prevalence of current mental disorders in the context of COVID-19: Analysis of repeated nationwide cross-sectional surveys. Epidemiology and Psychiatric Sciences, 29, E173. doi:10.1017/S2045796020000888
Xia, L., Lian, Q., Yang, H., & Wu, D. (2022). The adaption of the Chinese version of the COVID Stress Scales as a screening instrument of stress: Psychometric properties during the COVID-19 pandemic. Frontiers in Public Health, 10. https://doi.org/10.3389/fpubh.2022.962304
Yang, X., & Stewart, S. M. (2020). The Beck Depression Inventory-II as a screening tool of depression in the Chinese adolescent population in Hong Kong: A validation study using the Composite International Diagnostic Interview as the gold standard. Asian Journal of Psychiatry, 52, 102125. https://doi.org/10.1016/j.ajp.2020.102125
Keywords
Full Text:
PDFDOI: http://dx.doi.org/10.17576/ebangi.2025.2204.04
Refbacks
- There are currently no refbacks.
-
_________________________________________________
eISSN 1823-884x
Faculty of Social Sciences & Humanities
Universiti Kebangsaan Malaysia
43600 UKM Bangi, Selangor Darul Ehsan
MALAYSIA
© Copyright UKM Press, Universiti Kebangsaan Malaysia