Development and validation of an instrument to assess the knowledge and perceptions of predatory journals

OBJECTIVE: The main aim of this study is to develop a valid and reliable instrument to assess levels of knowledge and perceptions of predatory journals. METHODS: The current study employed successive methods framework including (1) item generation through a literature review and theoretical framework development, (2) validity testing in terms of face, content, and construct validity for perceptions construct as well as item analysis for knowledge scale, and (3) reliability testing in terms of Cronbach's alpha, Kuder-Richardson (KR-20), item-to-total correlations, corrected item-to-total correlations, Cronbach's alpha if item deleted, and test-retest reliability. A total of 304 participants were recruited from King Fahad Medical City (KFMC) in Riyadh, Saudi Arabia to evaluate its construct validity and reliability. This was established using exploratory factor analysis (EFA) with principal axis factoring (PFA) and varimax rotation as well as confirmatory factor analysis (CFA) for perception construct. RESULTS: An instrument was developed from this study called the “Predatory Journals KP Assessment Questionnaire”. The results of EFA and CFA confirmed the construct validity of the perception construct. Item analysis confirmed the construct validity of the knowledge scale. The internal consistency and test-retest reliability were achieved for the knowledge scale items, consisting of 13 items. The results of EFA confirmed the measured constructs of perceptions toward predatory journals. The results of EFA and CFA for perception construct resulted in only one factor with 9 items. CONCLUSION: This study has successfully developed a valid and reliable questionnaire to measure knowledge and perceptions of predatory journals among researchers in the clinical and health disciplines. This instrument serves as a valuable guide for future studies that aim to assess researcher's knowledge and perceptions about predatory journals and examine the differences in these measured constructs according to their demographic and professional characteristics.