Quantitative Framework for Model Evaluation in Microbiology Research Using Pseudomonas aeruginosa and Cystic Fibrosis Infection as a Test Case

Laboratory models are a cornerstone of modern microbiology, but the accuracy of these models has not been systematically evaluated. As a result, researchers often choose models based on intuition or incomplete data. We propose a general quantitative framework to assess model accuracy from RNA sequencing data and use this framework to evaluate models of Pseudomonas aeruginosa cystic fibrosis (CF) lung infection. We found that an in vitro synthetic CF sputum medium model and a CF airway epithelial cell model had the highest genome-wide accuracy but underperformed on distinct functional categories, including porins and polyamine biosynthesis for the synthetic sputum medium and protein synthesis for the epithelial cell model. We identified 211 “elusive” genes that were not mimicked in a reference strain grown in any laboratory model but found that many were captured by using a clinical isolate. These methods provide researchers with an evidence-based foundation to select and improve laboratory models.