Multiple Losses of MSH1, Gain of mtMutS, and Other Changes in the MutS Family of DNA Repair Proteins in Animals

MutS is a key component of the mismatch repair (MMR) pathway. Members of the MutS protein family are present in prokaryotes, eukaryotes, and viruses. Six MutS homologs (MSH1–6) have been identified in yeast, of which three function in nuclear MMR, while MSH1 functions in mitochondrial DNA repair. MSH proteins are believed to be well conserved in animals, except for MSH1—which is thought to be lost. Two intriguing exceptions to this general picture have been found, both in the class Anthozoa within the phylum Cnidaria. First, an ortholog of the yeast-MSH1 was reported in one hexacoral species. Second, a MutS homolog (mtMutS) has been found in the mitochondrial genome of all octocorals. To understand the origin and potential functional implications of these exceptions, we investigated the evolution of the MutS family both in Cnidaria and in animals in general. Our study confirmed the acquisition of octocoral mtMutS by horizontal gene transfer from a giant virus. Surprisingly, we identified MSH1 in all hexacorals and several sponges and placozoans. By contrast, MSH1 orthologs were lacking in other cnidarians, ctenophores, and bilaterian animals. Furthermore, while we identified MSH2 and MSH6 in nearly all animals, MSH4, MSH5, and, especially, MSH3 were missing in multiple species. Overall, our analysis revealed a dynamic evolution of the MutS family in animals, with multiple losses of MSH1, MSH3, some losses of MSH4 and MSH5, and a gain of the octocoral mtMutS. We propose that octocoral mtMutS functionally replaced MSH1 that was present in the common ancestor of Anthozoa.