Trends in the ability of socioeconomic position to predict individual body mass index: an analysis of repeated cross-sectional data, 1991–2019

BACKGROUND: The widening of group-level socioeconomic differences in body mass index (BMI) has received considerable research attention. However, the predictive power of socioeconomic position (SEP) indicators at the individual level remains uncertain, as does the potential temporal variation in their predictive value. Examining this is important given the increasing incorporation of SEP indicators into predictive algorithms and calls to reduce social inequality to tackle the obesity epidemic. We thus investigated SEP differences in BMI over three decades of the obesity epidemic in England, comparing population-wide (SEP group differences in mean BMI) and individual-level (out-of-sample prediction of individuals’ BMI) approaches to understanding social inequalities. METHODS: We used repeated cross-sectional data from the Health Survey for England, 1991–2019. BMI (kg/m(2)) was measured objectively, and SEP was measured via educational attainment, occupational class, and neighbourhood index of deprivation. We ran random forest models for each survey year and measure of SEP adjusting for age and sex. RESULTS: The mean and variance of BMI increased within each SEP group over the study period. Mean differences in BMI by SEP group also increased: differences between lowest and highest education groups were 1.0 kg/m(2) (0.4, 1.6) in 1991 and 1.3 kg/m(2) (0.7, 1.8) in 2019. At the individual level, the predictive capacity of SEP was low, though increased in later years: including education in models improved predictive accuracy (mean absolute error) by 0.14% (− 0.9, 1.08) in 1991 and 1.05% (0.18, 1.82) in 2019. Similar patterns were obtained for occupational class and neighbourhood deprivation and when analysing obesity as an outcome. CONCLUSIONS: SEP has become increasingly important at the population (group difference) and individual (prediction) levels. However, predictive ability remains low, suggesting limited utility of including SEP in prediction algorithms. Assuming links are causal, abolishing SEP differences in BMI could have a large effect on population health but would neither reverse the obesity epidemic nor reduce much of the variation in BMI. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12916-023-03103-2.