Neural correlates of text‐based emoticons: a preliminary fMRI study

INTRODUCTION: Like nonverbal cues in oral interactions, text‐based emoticons, which are textual portrayals of a writer's facial expressions, are commonly used in electronic device–mediated communication. Little is known, however, about how text‐based emoticons are processed in the human brain. With this study, we investigated whether the text‐based emoticons are processed as face expressions using fMRI. METHODS: During fMRI scan, subjects were asked to respond by pressing a button, indicating whether text‐based emoticons represented positive or negative emotions. Voxel‐wise analyses were performed to compare the responses and contrasted with emotional versus scrambled emoticons and among emoticons with different emotions. To explore processing strategies for text‐based emoticons, brain activity in the bilateral occipital and fusiform face areas were compared. RESULTS: In the voxel‐wise analysis, both emotional and scrambled emoticons were processed mainly in the bilateral fusiform gyri, inferior division of lateral occipital cortex, inferior frontal gyri, dorsolateral prefrontal cortex (DLPFC), dorsal anterior cingulate cortex (dACC), and parietal cortex. In a percent signal change analysis, the right occipital and fusiform face areas showed significantly higher activation than left ones. In comparisons among emoticons, sad one showed significant BOLD signal decrease in the dACC, the left AIC, the bilateral thalamus, and the precuneus as compared with other conditions. CONCLUSION: The results of this study imply that people recognize text‐based emoticons as pictures representing face expressions. Even though text‐based emoticons contain emotional meaning, they are not associated with the amygdala while previous studies using emotional stimuli documented amygdala activation.