Web-Based Survey Piloting Process as a Model for Developing and Testing Past Contraceptive Use and Pregnancy History: Cystic Fibrosis Case Study

BACKGROUND: Individuals with complex, chronic diseases are now living longer, making reproductive health an important topic to address in the health care setting. Self-respondent surveys are a feasible way to collect past contraceptive use and pregnancy history to assess contraceptive safety and effectiveness. Because sensitive topics, such as contraception and pregnancy outcomes, can vary across social groups or cultures, piloting questions and evaluating survey administration procedures in the target population are necessary for precise and reliable responses before wide distribution. OBJECTIVE: This study aimed to develop a precise and reliable survey instrument and related procedures among individuals with cystic fibrosis regarding contraceptive use and obstetrical history. METHODS: We piloted and tested web-based questions related to contraceptive use and pregnancy history among 50 participants with and those without cystic fibrosis aged 18 to 45 years using a 3-tier process. Findings from each tier informed changes to the questionnaire before testing in the subsequent tier. Tier 1 used cognitive pretesting to assess question understanding and the need for memory prompts. In tier 2, we used test-retest self- and interviewer-administered approaches to assess question reliability, evaluate response missingness, and determine confidence between 2 types of survey administration approaches. In tier 3, we tested the questionnaire for clarity, time to complete, and whether additional prompts were necessary. RESULTS: In tier 1, respondents suggested improvements to the web-based survey questions and to the written and visual prompts for better recall regarding past contraceptive use. In tier 2, the test-retest reliability between self- and interviewer-administrative procedures of “ever use” contraceptive method questions was similar, with percent absolute agreement ranging between 84% and 100%. When the survey was self-administered, the percentage of missing responses was higher and respondent confidence about month and year when contraceptive methods were used was lower. Most respondents reported that they preferred the self-administered survey because it was more convenient and faster to complete. CONCLUSIONS: Our 3-tier process to pilot web-based survey questions related to contraceptive and obstetrical history in our complex disease population helped us tailor content and format questions before wide dissemination to our target population. Results from this pilot study informed the subsequent larger study design to include a 10% respondent test-retest self- and interviewer-administered quality control component to better inform imputation procedures of missing data.