Scale Validation Procedure Template

A scale-validation tutorial states the actual decision rule in one row of one table. A corrected item-total correlation under .30, or a rising Cronbach's alpha, is reason enough to flag an item, a rule a 2018 protocol in Health Psychology and Behavioral Medicine states inside one study's results narrative. A 2024 best-practice review adds a second test: whether an item's factor loading lands on a different construct once every item runs against every factor together. Neither names a place to log an item that clears the first test and fails the second.

This space fixes those checks as three standing thresholds before a single pilot number is read, then logs every item's fate to the exact statistic that decided it. Item-total and reliability are both computed against an item's own subscale in isolation, so an item can clear both while still measuring the wrong construct; only the factor-structure check tests it against everything else in the pool at once. It does not draft the item pool itself. A dedicated instrument-design pack does that, tracing every item to a construct before a single response exists.

In the worked example, Highmark Logistics pilots an 18-item Change Readiness Scale on 238 employees ahead of a warehouse system changeover. C4 fails every sheet: an item-total correlation of .20, an alpha that rises to .84 without it, and a factor loading of just .34 on its own construct. E5 clears item-total and reliability cleanly but loads .54 on the wrong factor against .42 on its own, the pattern only the third check catches, so it is reworded and held for revalidation rather than treated as finished.