Hungarian Validation of the Calgary Charter on Health Literacy Scale: An Instrument Measuring the Effectiveness of Interventions
Abstract
Summary
Background: Significant part of the Hungarian adult population’s health literacy needs to be improved. Although there is a couple of translated and validated health literacy questionnaires, none of them is specifically suitable for measuring the effectiveness of health literacy interventions. Therefore, the aim of our study was to validate in Hungarian a health literacy instrument used to assess the change in the level of health literacy. Based on the literature, we chose the Calgary Charter on Health Literacy Scale, available in English and Spanish.
Methodology: We carried out a cross-sectional study on a nationally representative sample. Our voluntary respondents were aged 18 years or over. Due to the COVID-19 pandemic, the data were collected by computer-assisted telephone survey in December 2020. Descriptive analysis, as well as the instrument’s reliability and validity were evaluated using Cronbach's alpha, Spearman-Brown and corrected item-total correlation coefficients and exploratory factor analysis.
Results: Our sample consisted of 1,152 people (47.5% of the respondents were male, 52.5% were female). Most of the respondents (52.7%) were aged 35 to 64, 18.5% were aged 18 and 34, and 28.8% were aged 65 years or older. The Cronbach's alpha measuring the internal consistency of the instrument (0.64) is at the limit of acceptability, the value of the Spearman-Brown correlation coefficient (0.66) can be described as average. The results of the item-total correlation test for our entire sample were higher than 0.3 considered acceptable. The results of the exploratory factor analysis showed a one-factor structure.
Conclusions: The Cronbach's alpha obtained in our survey has been lower than reliability of the original measuring tool (0.80), which can be explained by the different method of data collection. For this reason, we consider it worthwhile to supplement our research in conjunction with personal data collection, for which experiences of this research could be used as well.
References
Berkman, N. D., Sheridan, S. L., Donahue, K. E., Halpern, D. J. és Crotty, K. (2011). Low health literacy and health outcomes: An updated systematic review. Annals of Internal Medicine, 155(2), 97–107. https://doi. org/10.7326/0003-4819-155-2-201107190-00005
Bíró, É., Szabó, P. és Kósa, K. (2022). A magyar felnőtt lakosság egészségműveltsége. Egészségfejlesztés, 63(3), 3–11. https://doi.org/10.24365/EF.8496
Chew, L. D., Bradley, K. A. és Boyko, E. J. (2004). Brief questions to identify patients with inadequate health literacy. Family Medicine, 36(8), 588–594.
Child, D. (2006). Essential factor analysis. (3rd ed.), Continuum.
Coleman, C., Kurtz-Rossi, S., McKinney, J., Pleasant, A., Rootman, I. és Shohet, L. (2009). The Calgary Charter on health literacy: Rationale and core principles for the development of health literacy curricula. The Center for Literacy of Quebec. http://www.centreforliteracy.qc.ca/sites/default/files/CFL_Calgary_Charter_2011.pdf
Csizmadia, P. (2016). Az egészségműveltség definíciói. Egészségfejlesztés, 57(3), 41−44. http://dx.doi. org/10.24365/ef.v57i3.68
Eichler, K., Wieser, S. és Brügger, U. (2009). The costs of limited health literacy: A systematic review. International Journal of Public Health, 54(5), 313–324. https://doi.org/10.1007/s00038-009-0058-2
Elbashir, M., ElHajj, M. S., Rainkie, D., Kheir, N., Hamou, F., Abdulrhim, S., Mahfouz, A., Alyafei, S. és Awaisu, A. (2023). Evaluation of health literacy levels and associated factors among patients with acute coronary syndrome and heart failure in Qatar. Patient Preference and Adherence, 17, 89–105. https://doi.org/10.2147/PPA.S385246
Haun, J., Noland Dodd, V., Varnes, J., Graham-Pole, J., Rienzo, B. és Donaldson, P. (2009). Testing a health literacy screening tool: Implications for utilization of a BRIEF health literacy indicator. Federal Practitioner, 26(12), 24–31. https://www.mdedge.com/fedprac/article/74355/testing-brief-health-literacy-screening-tool
Haun, J., Luther, S., Dodd, V. és Donaldson, P. (2012) Measurement variation across health literacy assessments: Implications for assessment selection in research and practice, Journal of Health Communication, 17(sup3), 141–159, https://doi.org/10.1080/10810730.2012.712615
Haun, J. N., Valerio, M. A., McCormack, L. A., Sørensen, K. és Paasche-Orlow, M. K. (2014). Health literacy measurement: An inventory and descriptive summary of 51 instruments. Journal of Health Communication, 19(sup2), 302–333. https://doi.org/10.1080/10810730.2014.936571
Hinkle, D. E., Wiersma, W. és Jurs, S. G. (2003). Applied statistics for the behavioral sciences. (5th ed.). Houghton Mifflin.
Koltai, J. és Kun, E. (2016). A magyarországi egészségértés nemzetközi összehasonlításban. Egészségfejlesztés, 57(3), 3–20. https://doi.org/10.24365/EF.V57I3.62
Koltai, J. és Kun, E. (2016). Az egészségértés gyakorlati mérése Magyarországon és nemzetközi összehasonlításban. Orvosi Hetilap, 157(50), 2002–2006. https://doi.org/10.1556/650.2016.30563
Liu, C., Wang, D., Liu, C., Jiang, J., Wang, X., Chen, H., Ju, X. és Zhang, X. (2020). What is the meaning of health literacy? A systematic review and qualitative synthesis. Family Medicine and Community Health, 8(2), 351. https://doi.org/10.1136/FMCH-2020-000351
Mátyás, G., Vincze, F. és Bíró, É. (2021). Egészségműveltséget mérő kérdőívek validálása hazai felnőttmintán. Orvosi Hetilap, 162(39), 1579–1588. https://doi.org/10.1556/650.2021.32212
Morris, N. S., MacLean, C. D., Chew, L. D. és Littenberg, B. (2006). The Single Item Literacy Screener: Evaluation of a brief instrument to identify limited reading ability. BMC Family Practice, 7, 21. https://doi. org/10.1186/1471-2296-7-21
Náfrádi, L., Papp-Zipernovszky, O., Schulz, P. J. és Csabai, M. (2019). Measuring functional health literacy in hungary: Validation of S-TOFHLA and Chew screening questions. Central European Journal of Public Health, 27(4), 320–325. https://doi.org/10.21101/cejph.a4885
Nunnally, J. C. és Bernstein, I. H. (1994). Psychometric theory. (3rd ed.). McGraw-Hill.
Papp-Zipernovszky, O., Náfrádi, L., Schulz, P. J. és Csabai, M. (2016). „Hogy minden beteg megértse!” – Az egészségműveltség (health literacy) mérése Magyarországon. Orvosi Hetilap, 157(23), 905–915. https:// doi.org/10.1556/650.2016.30498
Pleasant, A., Maish, C., O’Leary, C. és Carmona, R. H. (2018). A theory-based self-report measure of health literacy: The Calgary Charter on Health Literacy scale. Methodological Innovations, 11(3). https://doi. org/10.1177/2059799118814394
Pleasant, A., Maish, C., O’Leary, C. és Carmona, R. H. (2019). Measuring health literacy in adults: An overview and discussion of current tools. International Handbook of Health Literacy: Research, practice and policy across the life-span. (p. 67.), Policy Press.
Pleasant, A., O’Leary, C. és Carmona, R. H. (2020). Using formative research to tailor a community intervention focused on the prevention of chronic disease. Evaluation and Program Planning, 78, 101716. https:// doi.org/10.1016/j.evalprogplan.2019.101716
Simonds, S. K. (1974). Health education as social policy. Health Education Monographs, 2(1_suppl), 1–10. https://doi.org/10.1177/10901981740020S102
Sørensen, K., van den Broucke, S., Fullam, J., Doyle, G., Pelikan, J., Slonska, Z. és Brand, H. (2012). Health literacy and public health: A systematic review and integration of definitions and models. BMC Public Health, 12(1), 1–13. https://doi.org/10.1186/1471-2458-12-80
Sørensen, K., Van den Broucke, S., Pelikan, J. M., Fullam, J., Doyle, G., Slonska, Z., Kondilis, B., Stoffels, V., Osborne, R. H., Brand, H., & HLS-EU Consortium (2013). Measuring health literacy in populations: illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLSEU-Q). BMC Public Health, 13, 948. https://doi.org/10.1186/1471-2458-13-948
Tavousi, M., Mohammadi, S., Sadighi, J., Zarei, F., Kermani, R. M., Rostami, R. és Montazeriid, A. (2022). Measuring health literacy: A systematic review and bibliometric analysis of instruments from 1993 to 2021. PLoS ONE, 17(7):e0271524. https://doi.org/10.1371/journal.pone.0271524
Terwee, C. B., Bot, S. D. M., de Boer, M. R., van der Windt, D. A. W. M., Knol, D. L., Dekker, J., Bouter, L. M. és de Vet, H. C. W. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60(1), 34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012
Thorndike, R. L. (1971). Reliability. In Lindquist, E. F. (Ed.), Educational measurement. (2nd ed.), (pp. 560–620.), American Council on Education.
U. S. Department of Health and Human Services. (2023). Health Literacy Tool Shed. https://healthliteracy. bu.edu/all
Weiss, B. D., Mays, M. Z., Martz, W., Castro, K. M., DeWalt, D. A., Pignone, M. P., Mockbee, J. és Hale, F. A. (2005). Quick assessment of literacy in primary care: The Newest Vital Sign. Annals of Family Medicine, 3(6), 514–522. https://doi.org/10.1370/afm.405
Copyright (c) 2023 Gabriella Mátyás, , Ferenc Vincze, , Éva Bíró,
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
.png)
