Constitutive depletion of brain serotonin differentially affects rats’ social and cognitive abilities

Central serotonin appears a promising transdiagnostic marker of psychiatric disorders and a modulator of some of their key behavioral symptoms. In adult male Tph2(−/−) rats, constitutively lacking central serotonin, we tested individual’s cognitive, social and non-social abilities and characterized group’s social organization under classical and ethological testing conditions. Using unsupervised machine learning, we identified the functions most dependent on serotonin. Although serotonin depletion did not affect cognitive performances in classical testing, in the home-cage it induced compulsive aggression and sexual behavior, hyperactive and hypervigilant stereotyped behavior, reduced self-care and exacerbated corticosterone levels. This profile recalled symptoms of impulse control and anxiety disorders. Serotonin appeared essential for behavioral adaptation to dynamic social environments. Our animal model challenges the essential role of serotonin in decision-making, flexibility, impulsivity, and risk-taking. These findings highlight the importance of studying everyday life functions within the dynamic social living environment to model complexity in animal models.