Top Episode Takeaways: ✂️ Cut scores are important decision points in criterion-referenced tests that categorize test takers as passing or failing. They should be set thoughtfully using a defensible process, not arbitrarily (e.g. always using 70%). Setting the cut score too high or low can have significant consequences.

📏 The Angoff method is a common way to set cut scores. It involves having subject matter experts review test questions and estimate what percentage of minimally competent test takers would answer each question correctly. This provides a way to link the cut score to the test content and the minimum performance standard for the job or domain being tested.

⚖️ Cut scores may need to be revisited and adjusted over time if the test content changes substantially. Small tweaks may not require changing the cut score, but replacing many items with ones that perform differently in terms of difficulty may necessitate an adjustment to keep the cut score fair and aligned with the intended minimum competency standard. Ongoing evaluation is important.

Episode Keywords:Validity, Reliability, Construct, Cut score, Angoff method, Item analysis, Fairness, Rubric, Feedback, Blueprint.

Connect with us:⁠⁠⁠

Amanda Dainis, PhD, MPA⁠⁠⁠ https://www.linkedin.com/in/amanda-dainis-phd-mpa-012b94119/⁠⁠⁠

Tim Burnett⁠⁠⁠ https://www.linkedin.com/in/tburnett/

A proud supporter of the ⁠⁠⁠https://www.testcommunity.network