Efficiencies of Internet-Based Digital and Paper-Based Scientific Surveys and the Estimated Costs and Time for Different-Sized Cohorts

AIMS: To evaluate the relative efficiencies of five Internet-based digital and three paper-based scientific surveys and to estimate the costs for different-sized cohorts. METHODS: Invitations to participate in a survey were distributed via e-mail to employees of two university hospitals (E(1) and E(2)) and to members of a medical association (E(3)), as a link placed in a special text on the municipal homepage regularly read by the administrative employees of two cities (H(1) and H(2)), and paper-based to workers at an automobile enterprise (P(1)) and college (P(2)) and senior (P(3)) students. The main parameters analyzed included the numbers of invited and actual participants, and the time and cost to complete the survey. Statistical analysis was descriptive, except for the Kruskal-Wallis-H-test, which was used to compare the three recruitment methods. Cost efficiencies were compared and extrapolated to different-sized cohorts. RESULTS: The ratios of completely answered questionnaires to distributed questionnaires were between 81.5% (E(1)) and 97.4% (P(2)). Between 6.4% (P(1)) and 57.0% (P(2)) of the invited participants completely answered the questionnaires. The costs per completely answered questionnaire were $0.57–$1.41 (E(1–3)), $1.70 and $0.80 for H(1) and H(2), respectively, and $3.36–$4.21 (P(1–3)). Based on our results, electronic surveys with 10, 20, 30, or 42 questions would be estimated to be most cost (and time) efficient if more than 101.6–225.9 (128.2–391.7), 139.8–229.2 (93.8–193.6), 165.8–230.6 (68.7–115.7), or 188.2–231.5 (44.4–72.7) participants were required, respectively. CONCLUSIONS: The study efficiency depended on the technical modalities of the survey methods and engagement of the participants. Depending on our study design, our results suggest that in similar projects that will certainly have more than two to three hundred required participants, the most efficient way of conducting a questionnaire-based survey is likely via the Internet with a digital questionnaire, specifically via a centralized e-mail.