Show simple item record

dc.contributor.authorYeates, P.en
dc.contributor.authorMaluf, A.en
dc.contributor.authorMcCray, G.en
dc.contributor.authorKinston, R.en
dc.contributor.authorCope, N.en
dc.contributor.authorCullen, K.en
dc.contributor.authorO'Neill, V.en
dc.contributor.authorCole, A.en
dc.contributor.authorChung, C. W.en
dc.contributor.authorGoodfellow, R.en
dc.contributor.authorVallender, R.en
dc.contributor.authorEnsaff, S.en
dc.contributor.authorGoddard-Fuller, Rikkien
dc.contributor.authorMcKinley, R.en
dc.date.accessioned2024-10-07T07:25:06Z
dc.date.available2024-10-07T07:25:06Z
dc.date.issued2024en
dc.identifier.citationYeates P, Maluf A, McCray G, Kinston R, Cope N, Cullen K, et al. Inter-school variations in the standard of examiners' graduation-level OSCE judgements. Medical teacher. 2024 2024 JUL 6. PubMed PMID: WOS:001264647700001. English.en
dc.identifier.pmid38976711en
dc.identifier.urihttp://hdl.handle.net/10541/627174
dc.description.abstractIntroductionEnsuring equivalence in high-stakes performance exams is important for patient safety and candidate fairness. We compared inter-school examiner differences within a shared OSCE and resulting impact on students' pass/fail categorisation.MethodsThe same 6 station formative OSCE ran asynchronously in 4 medical schools, with 2 parallel circuits/school. We compared examiners' judgements using Video-based Examiner Score Comparison and Adjustment (VESCA): examiners scored station-specific comparator videos in addition to 'live' student performances, enabling 1/controlled score comparisons by a/examiner-cohorts and b/schools and 2/data linkage to adjust for the influence of examiner-cohorts. We calculated score impact and change in pass/fail categorisation by school.ResultsOn controlled video-based comparisons, inter-school variations in examiners' scoring (16.3%) were nearly double within-school variations (8.8%). Students' scores received a median adjustment of 5.26% (IQR 2.87-7.17%). The impact of adjusting for examiner differences on students' pass/fail categorisation varied by school, with adjustment reducing failure rate from 39.13% to 8.70% (school 2) whilst increasing failure from 0.00% to 21.74% (school 4).DiscussionWhilst the formative context may partly account for differences, these findings query whether variations may exist between medical schools in examiners' judgements. This may benefit from systematic appraisal to safeguard equivalence. VESCA provided a viable method for comparisons.en
dc.language.isoenen
dc.titleInter-school variations in the standard of examiners' graduation-level OSCE judgementsen
dc.contributor.departmentChristie Education, Christie Hospitals NHS Foundation Trust, Manchester, United Kingdomen
dc.identifier.journalMedical Teacheren
dc.description.noteen]
refterms.dateFOA2024-10-08T15:58:55Z


Files in this item

Thumbnail
Name:
Inter-school variations in the ...
Size:
2.180Mb
Format:
PDF
Description:
Found with Open Access Button

This item appears in the following Collection(s)

Show simple item record