Using the Patient Portal Sexual Health Instrument in Surveys and Patient Questionnaires Among Sexual Minority Men in the United States: Cross-sectional Psychometric Validation Study

BACKGROUND: Patient portal modules, including electronic personal health records, health education, and prescription refill ordering, may be leveraged to address the sexually transmitted infection (STI) burden, including HIV, among gay, bisexual, and other sexual minority men (SMM). Theoretical frameworks in the implementation sciences highlight examining constructs of innovation attributes and performance expectations as key determinants of behavioral intentions and the use of new web-based health technologies. However, behavioral intentions to use patient portals for HIV and other STI prevention and care among SMM is understudied. OBJECTIVE: The aim of this study is to develop a brief instrument for measuring attitudes focused on using patient portals for STI prevention and care among a nationwide sample of SMM. METHODS: A total of 12 items of the American Men’s Internet Survey-Patient Portal Sexual Health Instrument (AMIS-PPSHI) were adapted from a previous study. Psychometric analyses of the AMIS-PPSHI items were conducted among a randomized subset of 2018 AMIS participants reporting web-based access to their health records (N=1375). Parallel analysis and inspection of eigenvalues in a principal component analysis (PCA) informed factor retention in exploratory factor analysis (EFA). After EFA, Cronbach α was used to examine the internal consistency of the scale and its subscales. Confirmatory factor analysis (CFA) was used to assess the goodness of fit of the final factor structure. We calculated the total AMIS-PPSHI scale scores for comparisons within group categories, including age, STI diagnosis history, recency of testing, serious mental illness, and anticipated health care stigma. RESULTS: The AMIS-PPSHI scale resulting from EFA consisted of 12 items and had good internal consistency (α=.84). The EFA suggested 3 subscales: sexual health engagement and awareness (α=.87), enhancing dyadic communication (α=.87), and managing sexual health care (α=.79). CFA demonstrated good fit in the 3-factor PPSHI structure: root mean square error of approximation=0.061, comparative fit index=0.964, Tucker-Lewis index=0.953, and standardized root mean square residual=0.041. The most notable differences were lower scores on the enhanced dyadic communication subscale among people living with HIV. CONCLUSIONS: PPSHI is a brief instrument with strong psychometric properties that may be adapted for use in large surveys and patient questionnaires in other settings. Scores demonstrate that patient portals are favorable web-based solutions to deliver health services focused on STI prevention and care among SMM in the United States. More attention is needed to address the privacy implications of interpersonal use of patient portals outside of traditional health settings among persons with HIV.