Transformer models for heavy flavor jet identification

During Run2 of the Large Hadron Collider (LHC), deep-learning-based algorithms were established and led to a significantly improved heavy flavor (b and c) jet tagging performance. In the scope of large-radius boosted jets like top-quark jets, Graph Neural Network (GNN) based models, e.g., ParticleNet, have reached state-of-the-art performance. As a step further, we present ParticleTransformerAK4, a new algorithm that incorporates physics-inspired interactions in an augmented attention mechanism. We show that ParticleTransformerAK4 substantially improves the heavy flavor jet tagging performance compared to the state-of-the-art DeepJet algorithm. ParticleTransformerAK4 is therefore a promising algorithm to be used for heavy flavor jet identification during Run3 of LHC.