Review and opinion piece on the CASPer test publication titled “Extending the interview to all medical school candidates--Computer-Based Multiple Sample Evaluation of Noncognitive Skills (CMSENS)”.
Note: The following represent the opinions of the authors and additional independent research is required to validate or refute the findings in the original CASPer test publication.
Reviewed CASPer test publication: Extending the interview to all medical school candidates--Computer-Based Multiple Sample Evaluation of Noncognitive Skills (CMSENS). Acad Med. 2009 Oct;84(10 Suppl):S9-12. doi: 10.1097/ACM.0b013e3181b3705a.
“To avoid criticism say nothing, do nothing, be nothing.” – Aristotle
Summary of the Overall Findings
1. The original article on CMSENS (later renamed to CASPer), is a small-scale, pilot study that includes one case site: McMaster University. The positive results showing correlations between CASPer and MMI are at best, predictive for future studies that are larger and geographically diverse.
2. The authors have attempted to generalize the findings to various populations such as domestic and international medical graduates, and undergraduate medical school applicants in the Netherlands, without adequate scientific evidence and sufficient sample size.
3. Statistical issues – the small sample size in the publication suffers from “the law of small numbers” and “a bias of confidence over doubt”. Read more...