Does the situational judgement test (SJT), CASPer, REALLY work as an admissions screening tool?

CASPer, CASPer Test, CMSENS, CASPer test publication review, situational judgement test, sjt, McMaster CASPer, casper test reliability and validity

Review and opinion piece on the CASPer test publication titled “Extending the interview to all medical school candidates--Computer-Based Multiple Sample Evaluation of Noncognitive Skills (CMSENS)”.

Note: The following represent the opinions of the authors and additional independent research is required to validate or refute the findings in the original CASPer test publication.

Reviewed CASPer test publication: Extending the interview to all medical school candidates--Computer-Based Multiple Sample Evaluation of Noncognitive Skills (CMSENS). Acad Med. 2009 Oct;84(10 Suppl):S9-12. doi: 10.1097/ACM.0b013e3181b3705a.

“To avoid criticism say nothing, do nothing, be nothing.” – Aristotle


Summary of the Overall Findings

1. This study (nor any other study to date) have proven that CASPer is valid predictor of future behavior. At best, the test has shown a mild correlation with future tests. In essence this test is merely a predictor of future tests. For a test to be valid it must be able to measure the constructs it is designed to measure. For example, a ruler is a good tool for measuring distance but it's not good for measuring the temperature of a room. Similarly, CASPer has been "validated" to measure future test performances such as performance on the objective structured clinical examinations (OSCE) or other examinations. This means that by design such tests are only valid measures of future tests and are not necessarily able to predict future on-the-job behavior. The best predictor of future performance is intrinsic motivation because motivation directs behavior. 

2. The original article on CMSENS (later renamed to CASPer), is a small-scale, pilot study that includes one case site: McMaster University. The positive results showing correlations between CASPer and MMI are at best, predictive for future studies that are larger and geographically diverse.

3. The authors have attempted to generalize the findings to various populations such as domestic and international medical graduates, and undergraduate medical school applicants in the Netherlands, without adequate scientific evidence and sufficient sample size.

5. Statistical issues – the small sample size in the publication suffers from “the law of small numbers” and “a bias of confidence over doubt”.  Read more...

CASPer, CASPer Prep, CASPer Test, How To Ace CASPer

How to Ace the CASPer Test Using the Punnett Square Approach (aka "if then, then that" approach)

We have discussed CASPer a lot in these blog posts:  (Top Five Tips For Acing Your CASPer Test & Former CASPer Test Evaluator Reveals Her Top CASPer Prep Tips). We have talked about which kinds of questions you should prepare for and how to think about this weird exam. But we haven’t drilled down into detail how to approach decision making in an ethical conundrum.

On CASPer, you will be asked to explain your thoughts and behaviors around a particular matter of ethics. You will have to share your thought process around situations that reflect a lack of professionalism, crossing professional boundaries and displays of cultural incompetence.

Some of these are really complicated. So how do you make the best decision possible? Sometimes, when you place your hands on the keyboard to start writing as the clock feels like it races to 00:00, you aren’t sure what you should do. It’s not clear what the right answer may be. For CASPer, there are some contexts for which there is no perfect answer but you MUST report to authorities when public safety or vulnerable individuals may be in harm’s way. As long as you report when you know you should, and take the high road (which is usually the safest road), then you won’t fail the question. But, not failing is different than excelling at CASPer. Read more...

  • End of posts.
Schedule Your FREE Initial Consultation Today!
Contact Us