Analysis of breast cancer subtypes by AP-ISA biclustering

BACKGROUND: Gene expression profiling has led to the definition of breast cancer molecular subtypes: Basal-like, HER2-enriched, LuminalA, LuminalB and Normal-like. Different subtypes exhibit diverse responses to treatment. In the past years, several traditional clustering algorithms have been applied to analyze gene expression profiling. However, accurate identification of breast cancer subtypes, especially within highly variable LuminalA subtype, remains a challenge. Furthermore, the relationship between DNA methylation and expression level in different breast cancer subtypes is not clear. RESULTS: In this study, a modified ISA biclustering algorithm, termed AP-ISA, was proposed to identify breast cancer subtypes. Comparing with ISA, AP-ISA provides the optimized strategy to select seeds and thresholds in the circumstance that prior knowledge is absent. Experimental results on 574 breast cancer samples were evaluated using clinical ER/PR information, PAM50 subtypes and the results of five peer to peer methods. One remarkable point in the experiment is that, AP-ISA divided the expression profiles of the luminal samples into four distinct classes. Enrichment analysis and methylation analysis showed obvious distinction among the four subgroups. Tumor variability within the Luminal subtype is observed in the experiments, which could contribute to the development of novel directed therapies. CONCLUSIONS: Aiming at breast cancer subtype classification, a novel biclustering algorithm AP-ISA is proposed in this paper. AP-ISA classifies breast cancer into seven subtypes and we argue that there are four subtypes in luminal samples. Comparison with other methods validates the effectiveness of AP-ISA. New genes that would be useful for targeted treatment of breast cancer were also obtained in this study. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (doi:10.1186/s12859-017-1926-z) contains supplementary material, which is available to authorized users.