The Role of Qualitative and Quantitative Feedback on Faculties’ Quality of Writing Multiple Choice Questions

AuthorAmir Shianien
AuthorSeyed Mojtaba Ahmadien
AuthorGhobad Ramezanien
AuthorFatemeh Darabien
AuthorForough Zanganehen
AuthorFarhad Salarien
OrcidSeyed Mojtaba Ahmadi [0000-0002-5925-6727]en
OrcidGhobad Ramezani [0000-0002-8192-5587]en
OrcidFarhad Salari [0000-0003-3211-0354]en
Issued Date2022-12-31en
AbstractBackground: Multiple choice questions (MCQs) are the most common questions in clinical tests. Content validity and appropriate structure of the questions are always outstanding issues for each education system. This study aimed to evaluate the role of providing quantitative and qualitative feedback on the quality of faculty members’ MCQs. Methods: This analytical study was conducted on Kermanshah University of Medical Sciences faculty members using the total MCQs test at least two times from 2018 to 2021. The quantitative data, including the validity of the tests, difficulty, and discrimination indices, were collected using a computer algorithm by experts. Results: The second analysis revealed that 14 (27.5%) faculty members had credit scores below 0.4, which was within the acceptable range for the overall validity of the test. The results showed a higher difficulty index in the second feedback than the first (0.46 ± 0.21 vs 0.55 ± 0.21, P = 0.30). No significant difference was found in the discrimination index (0.24 ± 0.1.25 vs 0.24 ± 0.10, P = 0.006). Furthermore, there were no significant differences in terms of taxonomy I (61.29 ± 20.84 vs 59.32 ± 22.11, P = 0.54), II (29.71 ± 17.84 vs 32.76 ± 18.82 P = 0.39), and III (8.50 ± 16.60 vs 7.36 ± 14.48, P = 0 .44) before and after feedback. Conclusions: Based on the results, the questions were not ideal regarding Bloom’s taxonomy standards and the difficulty and discrimination indexes. Furthermore, providing feedback alone is not enough, and proper planning by the educational and medical development centers’ authorities is required to empower the faculty members in this area.en
DOIhttps://doi.org/10.5812/erms-119114en
KeywordMultiple Choice Questionsen
KeywordBloom’s Taxonomyen
KeywordQualitative and Quantitative Analysisen
PublisherBrieflandsen
TitleThe Role of Qualitative and Quantitative Feedback on Faculties’ Quality of Writing Multiple Choice Questionsen
TypeResearch Articleen

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
erms-11-2-119114.pdf
Size:
97.98 KB
Format:
Adobe Portable Document Format
Description:
Article/s PDF