A next generation approach to species delimitation reveals the role of hybridization in a cryptic species complex of corals

BACKGROUND: Our ability to investigate processes shaping the evolutionary diversification of corals (Cnidaria: Anthozoa) is limited by a lack of understanding of species boundaries. Discerning species of corals has been challenging due to a multitude of factors, including homoplasious and plastic morphological characters and the use of molecular markers that are either not informative or have not completely sorted. Hybridization can also blur species boundaries by leading to incongruence between morphology and genetics. We used traditional DNA barcoding and restriction-site associated DNA sequencing combined with coalescence-based and allele-frequency methods to elucidate species boundaries and simultaneously examine the potential role of hybridization in a speciose genus of octocoral, Sinularia. RESULTS: Species delimitations using two widely used DNA barcode markers, mtMutS and 28S rDNA, were incongruent with one another and with the morphospecies identifications. When mtMutS and 28S were concatenated, a 0.3% genetic distance threshold delimited the majority of morphospecies. In contrast, 12 of the 15 examined morphospecies formed well-supported monophyletic clades in both concatenated RAxML phylogenies and SNAPP species trees of > 6000 RADSeq loci. DAPC and Structure analyses also supported morphospecies assignments, but indicated the potential for two additional cryptic species. Three morphologically distinct species pairs could not, however, be distinguished genetically. ABBA-BABA tests demonstrated significant admixture between some of those species, suggesting that hybridization may confound species delimitation in Sinularia. CONCLUSIONS: A genomic approach can help to guide species delimitation while simultaneously elucidating the processes generating coral diversity. Results support the hypothesis that hybridization is an important mechanism in the evolution of Anthozoa, including octocorals, and future research should examine the contribution of this mechanism in generating diversity across the coral tree of life. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1186/s12862-019-1427-y) contains supplementary material, which is available to authorized users.