Measuring Beneficiary Knowledge of the Medicare Program: A Psychometric Analysis

Reliable measures of Medicare beneficiaries' program knowledge are necessary for credible program monitoring, evaluation, and public accountability. This study developed and evaluated the psychometric properties of two possible measures of beneficiary knowledge. One measure was based on self-reported knowledge, the other was a true/false quiz which requires beneficiaries to demonstrate their knowledge. We used data from the 1998 and 1999 Medicare Current Beneficiary Survey (MCBS) to evaluate the reliability and construct validity of the indices. Overall, based on both content considerations and the psychometric analyses, the true/false quiz proved to be the more accurate and useful measure of beneficiaries' knowledge.