Introduction: Critical appraisal skills are presumed to perform a principal part in evidence-based health education and practice methods. This study aimed to design an educational intervention around critical appraisal in this context, evaluate the efficacy of the teaching methods, and investigate critical appraisal skills training to undergraduate medical students.
Methods: In this prospective Randomized Control Trial (RCT), 256 sixth-year undergraduate medical students from Shiraz University of Medical Science, Shiraz, Iran, participated. 124 of the students were not taught critical thinking methods as a control group, and 132 participants were taught critical thinking methods by multimedia and attended an online Critical Appraisal Skills (CAS) training workshop as an intervention group. We used the Critical Appraisal Skills Programme (CASP) questionnaire to evaluate students’ knowledge, attitude, confidence, and appraisal skills. This questionnaire was translated into Persian for the first time in Iran by Shokooh Varai, et al. They investigated its validity and reliability,
the reliability of the questionnaire being obtained by the Richardson Index (0.75), and the validity being confirmed by some faculty members of Tehran Nursing and Midwifery School. To compare both control and intervention groups, we used an independent t-test and a Chi-Square test at a significance level of 5%, and to analyze the demographic information, we applied some descriptive statistics: frequency, frequency percentage, mean and standard deviation. All
of the statistical approaches were analyzed, using SPSS 22.
Results: In all dimensions of the critical appraisal skills, medical students who completed the critical appraisal multi-media training and workshop performed better than those who did not (control group), and this difference was statistically significant (P<0.05). Moreover, the Chi-Square test results showed no statistical relationship between the groups regarding the demographic variables (P>0.05). Also, the Cohen’s D effect size values in the knowledge and confidence
dimensions were greater than 0.5; this meant a large effect. Regarding the attitude and appraises Skill dimensions, the effect size was between 0.2 and 0.5, which meant a medium effect.
Conclusion: Teaching critical appraisal skills through multi-media and CAS online workshops to medical students effectively improves the students’ knowledge and confidence in appraising articles. This teaching also indicated a medium effect on students’ attitudes and behavior. Our findings can justify implementing critical appraisal skills teaching modules in the undergraduate medical education curriculum. |
- Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet (London, England). 2017;390(10092):415-23.
- Al-Jundi A, Sakka S. Critical appraisal of clinical research. Journal of clinical and diagnostic research: JCDR. 2017;11(5):JE01-05.
- Horsley T, Hyde C, Santesso N, Parkes J, Milne R, Stewart R. Teaching critical appraisal skills in healthcare settings. Cochrane Database of Systematic Reviews. 2011;2011(11):CD001270.
- Taylor RS, Reeves BC, Ewings PE, Taylor RJ. Critical appraisal skills training for health care professionals: a randomized controlled trial [ISRCTN46272378]. BMC medical education. 2004;4(1):1-10.
- Sagheb MM, Amini M, Saber M, Moghadami M, Nabiei P, Khalili R, et al. Teaching evidence-based medicine (EBM) to undergraduate medical students through flipped classroom approach. Shiraz E-Medical Journal. 2018;19(2).
- Kong LN, Qin B, Zhou YQ, Mou SY, Gao HM. The effectiveness of problem-based learning on development of nursing students’ critical thinking: A systematic review and meta-analysis. International journal of nursing studies. 2014;51(3):458-69.
- Jaunoo S, Adams HL. A survey showing the need to incorporate the teaching of critical appraisal skills in the undergraduate medical curriculum. British Journal of Medicine & Medical Research. 2016;14(12):1-8.
- Halalau A, Holmes B, Rogers-Snyr A, Donisan T, Nielsen E, Cerqueira TL, et al. Evidence-based medicine curricula and barriers for physicians in training: a scoping review. International journal of medical education. 2021;12:101-24.
- McCall MC, Fanshawe TR, McCartney D, Young D, Nunan D, Heneghan C. Online supplementation for teaching evidence-based medicine: feasibility of a randomised-controlled trial. BMJ evidence-based medicine. 2021;26(5):254.
- Basheer A, Iqbal N, Prabakaran S, Simiyon M, Anandan V. Simulated Randomized Controlled Trial to Learn Critical Appraisal (SiRCA): A Randomized Controlled Study of Effectiveness Among Undergraduate Medical Students. Cureus. 2021;13(11):e19946.
- Gardeshi Z, Amini M, Nabeiei P. The perception of hidden curriculum among undergraduate medical students: a qualitative study. BMC research notes. 2018;11(1):1-4.
- Tabari P, Amini M, Arya N, Moghadami M, Khoshnood K, Shokripour M, et al. The role of educating health-care personnel in prevention, diagnosis, or treatment of COVID-19: A narrative mini review. Journal of Education and Health Promotion. 2021;10(1):476.
- Moghadami M, Amini M, Moghadami M, Dalal B, Charlin B. Teaching clinical reasoning to undergraduate medical students by illness script method: a randomized controlled trial. BMC medical education. 2021;21(1):1-7.
- Moher D, Schulz KF, Altman DG. The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Clinical oral investigations. 2003;7(1):2-7.
- Varai S, Dehghan Nayeri N, Hosseiny SF, Ahmadi Chenari H. Critique and evaluation of published articles quality of Health Sciences qualitative Researches Journal based on CASP scale. Journal of Qualitative Research in Health Sciences. 2020;8(4):9-15.
- Cohen J. Statistical power analysis for the behavioural sciences. New York: Routledge. 1988.
- Maden‐Jenkins M. Healthcare librarians and the delivery of critical appraisal training: attitudes, level of involvement and support. Health Information & Libraries Journal. 2010;27(4):304-15.
- Hyde C, Parkes J, Deeks J, Milne R. Systematic review of effectiveness of teaching critical appraisal. Database of Abstracts of Reviews of Effects (DARE): Quality-assessed Reviews [Internet]. York (UK): Centre for Reviews and Dissemination (UK). 2000.
- Thomas JD, Cardinal BJ. Health science knowledge translation: Critical appraisal of online physical activity promotion material. Nursing & Health Sciences. 2021;23(3):742-53.
- Ellaway R, Masters K. AMEE Guide 32: e-Learning in medical education Part 1; Learning, teaching and assessment. Med Teach. 2008;30(5):455-73.
- Coomarasamy A, Taylor R, Khan K. A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal. Med Teach. 2003;25(1):77-81.
- Bero LA, Grilli R, Grimshaw JM, Harvey E, Oxman AD, Thomson MA. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. BMJ. 1998;317(7156):465-8.
- Larsen CM, Terkelsen AS, Carlsen AF, Kristensen HK. Methods for teaching evidence-based practice: a scoping review. BMC medical education. 2019;19(1):259.
- Flynn MF. Developing critical appraisal and evidence synthesis skills in future microbiologists. FEMS microbiology letters. 2021;368(18):1-3.
- Omidifar N, Bafti AH, Shokripour M, Amini M, Erana-Rojas IE, Moghimizadeh M. Pathologists' professional lifestyle: Excellence in practice, ethics, education, health promotion, and personal life. Journal of Education and Health Promotion. 2022;11(1):97.
- Taylor R, Reeves B, Ewings P, Binns S, Keast J, Mears R. A systematic review of the effectiveness of critical appraisal skills training for clinicians. Med Educ. 2000;34(2):120-5.
- Coomarasamy A, Taylor R, Khan KS. A systematic review of postgraduate teaching in evidence-based medicine and critical appraisal. Med Teach. 2003;25(1):77-81.
- Parkes J, Hyde C, Deeks JJ, Milne R. Teaching critical appraisal skills in health care settings. Cochrane Database of Systematic Reviews. 2001;(3):CD001270.
- Milne R, Donald A, Chambers L. Piloting short workshops on the critical appraisal of reviews. Health Trends. 1995;27(4):120-3.
- Dimitrov DM, Rumrill JrPD. Pretest-posttest designs and measurement of change. Work. 2003;20:159–65.
|
