A New Questionnaire to Assess Respiratory Symptoms (The Respiratory Symptom Experience Scale): Quantitative Psychometric Assessment and Validation Study

BACKGROUND: Smokers often experience respiratory symptoms (eg, morning cough), and those who stop smoking, including those who do so by switching completely to electronic nicotine delivery systems (ENDS), may experience reductions in symptoms. Existing respiratory symptom questionnaires may not be suitable for studying these changes, as they are intended for patient populations, such as those with chronic obstructive pulmonary disease (COPD). OBJECTIVE: This study aimed to develop a respiratory symptom questionnaire appropriate for current smokers and for assessing changes when smokers stop smoking. METHODS: The Respiratory Symptom Experience Scale (RSES) was derived from existing instruments and subject matter expert input and refined through cognitive debriefing interviews (n=49). Next, for purposes of the quantitative psychometric evaluation, the RSES was administered to smokers (n=202), former smokers (no tobacco use in >6 months; n=200), and switchers (n=208, smokers who switched to ENDS for >6 months), all of whom had smoked for at least 10 years (mean age 33 years). Participants, who averaged 62 (SD 12) years of age, included 28% (173/610) with respiratory allergy symptoms and 17% (104/610) with COPD. Test-retest reliability was assessed by repeat assessment after 1 week in 128 participants. RESULTS: A generalized partial credit model confirmed that the response options were ordered, and a parallel analysis using principal components confirmed that the scale was unidimensional. With allowance for 2 sets of correlated errors between pairs of items, a 1-factor graded response model fit the data. Discrimination parameters were approximately 1 or greater for all items. Scale reliability was 0.80 or higher across a broad range of severity (standardized scores −0.40 to 3.00). Test-retest reliability (absolute intraclass correlation) was good, at 0.89. RSES convergent validity was supported by substantial differences (Cohen d=0.74) between those with and without a diagnosis of respiratory disease (averaging 0.57 points, indicating that differences of this size or smaller represent meaningful differences). RSES scores also strongly differentiated those with and without COPD (d=1.52). Smokers’ RSES scores were significantly higher than former smokers’ scores (P<.001). Switchers’ RSES scores were significantly lower than smokers’ scores (P<.001) and no different from former smokers’ scores (P=.34). CONCLUSIONS: The RSES fills an important gap in the existing toolkit of respiratory symptom questionnaires; it is a reliable and valid tool to assess respiratory symptoms in adult current and former smokers, including those who have switched to noncombusted nicotine products. This suggests that the scale is sensitive to respiratory symptoms that develop in smokers and to their remission when smokers quit or switch to noncombusted nicotine products intended to reduce the harm of smoking. The findings also suggest that switching from cigarettes to ENDS may improve respiratory health.