Multilevel IRT models for the analysis of satisfaction for distance learning during the Covid-19 pandemic

The Covid-19 pandemic played a relevant role in the diffusion of distance learning alternatives to “traditional” learning based on classroom activities, to allow university students to continue attending lessons during the most severe phases of the pandemic. In such a context, investigating the students' perspective on distance learning provides useful information to stakeholders to improve effective educational strategies, which could be useful also after the end of the emergency to favor the digital transformation in the higher educational setting. Here we focus on the satisfaction in distance learning for Italian university students. We rely on data comprising students enrolled in various Italian universities, which were inquired about several aspects related to learning distance. We explicitly take into account the hierarchical nature of data (i.e., students nested in universities) and the latent nature of the variable of interest (i.e., students' learning satisfaction) through a multilevel Item Response Theory model with students' and universities' covariates. As the main results of our study, we find out that distance learning satisfaction of students: (i) depends on the University where they study; (ii) is affected by some students' socio-demographic characteristics, among which psychological factors related to Covid-19; (iii) is affected by some observable university characteristics.