Authors: Gonnella J.S.¹; Erdmann J.B.²; Hojat M.¹

Source: Medical Education, Volume 38, Number 4, April 2004 , pp. 425-434(10)

Publisher: Wiley-Blackwell

Abstract:

Context

It is important to establish the predictive validity of medical school grades. The strength of predictive validity and the ability to identify at-risk students in medical schools depends upon assessment systems such as number grades, pass/fail (P/F) or honours/pass/fail (H/P/F) systems. Objective

This study was designed to examine the predictive validity of number grades in medical school, and to determine whether any important information is lost in a shift from number to P/F and H/P/F grading systems. Subjects

The participants in this prospective, longitudinal study were 6656 medical students who studied at Jefferson Medical College over 3 decades. They were grouped into 10 deciles based on their number grades in Year 1 of medical school. Methods

Participants were compared on academic accomplishments in Years 2 and 3 of medical school, medical school class rank, delayed graduation and attrition, performance on medical licensing examinations and clinical competence ratings in the first postgraduate year. Results

Results supported the short- and longterm predictive validity of the number grades. Ratings of clinical competence beyond medical school were predicted by number grades in medical school. We demonstrated that small differences in number grades are statistically meaningful, and that important information for identifying students in need of remedial education is lost when students who narrowly meet faculty's expectations are included with the rest of the class in a broad ‘pass’ category. Conclusions

The findings refute the argument that knowledge of sciences basic to medicine is not critical to subsequent performance in medical school and beyond if an appropriate evaluation system is used. Furthermore, the results of this study raise questions about abandoning number grades in favour of a pass/fail system. Consideration of these findings in policy decisions regarding assessment systems of medical students is recommended.

Keywords: education, medical/*standards; predictive value of tests; *educational measurement; clinical competence/*standards; prospective study; longitudinal study

Document Type: Research article

DOI: http://dx.doi.org/10.1111/j.1365-2923.2004.01774.x

Affiliations: 1: Center for Research in Medical Education and Health Care, Jefferson Medical College, Thomas Jefferson University, Philadelphia, Pennsylvania, USA 2: Office of the Dean, Jefferson College of Health Professions, Thomas Jefferson University, Philadelphia, Pennsylvania, USA

Publication date: 2004-04-01

Related content

• In this: publication
• By this: publisher
• In this Subject: Medicine (General)
• By this author: Gonnella J.S. ;  Erdmann J.B. ;  Hojat M.

Website © Publishing Technology. Article copyright remains with the publisher, society or author(s) as specified within the article.

• Terms and conditions
• Privacy policy
• Information for advertisers