Cargando…

“Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction

The fields of neural prosthetic technologies and Brain-Computer Interfaces (BCIs) have witnessed in the past 15 years an unprecedented development, bringing together theories and methods from different scientific fields, digital media, and the arts. More in particular, artists have been amongst the...

Descripción completa

Detalles Bibliográficos
Autores principales: Zioga, Polina, Pollick, Frank, Ma, Minhua, Chapman, Paul, Stefanov, Kristian
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5891608/
https://www.ncbi.nlm.nih.gov/pubmed/29666566
http://dx.doi.org/10.3389/fnins.2018.00191
_version_ 1783313030350635008
author Zioga, Polina
Pollick, Frank
Ma, Minhua
Chapman, Paul
Stefanov, Kristian
author_facet Zioga, Polina
Pollick, Frank
Ma, Minhua
Chapman, Paul
Stefanov, Kristian
author_sort Zioga, Polina
collection PubMed
description The fields of neural prosthetic technologies and Brain-Computer Interfaces (BCIs) have witnessed in the past 15 years an unprecedented development, bringing together theories and methods from different scientific fields, digital media, and the arts. More in particular, artists have been amongst the pioneers of the design of relevant applications since their emergence in the 1960s, pushing the boundaries of applications in real-life contexts. With the new research, advancements, and since 2007, the new low-cost commercial-grade wireless devices, there is a new increasing number of computer games, interactive installations, and performances that involve the use of these interfaces, combining scientific, and creative methodologies. The vast majority of these works use the brain-activity of a single participant. However, earlier, as well as recent examples, involve the simultaneous interaction of more than one participants or performers with the use of Electroencephalography (EEG)-based multi-brain BCIs. In this frame, we discuss and evaluate “Enheduanna—A Manifesto of Falling,” a live brain-computer cinema performance that enables for the first time the simultaneous real-time multi-brain interaction of more than two participants, including a performer and members of the audience, using a passive EEG-based BCI system in the context of a mixed-media performance. The performance was realised as a neuroscientific study conducted in a real-life setting. The raw EEG data of seven participants, one performer and two different members of the audience for each performance, were simultaneously recorded during three live events. The results reveal that the majority of the participants were able to successfully identify whether their brain-activity was interacting with the live video projections or not. A correlation has been found between their answers to the questionnaires, the elements of the performance that they identified as most special, and the audience's indicators of attention and emotional engagement. Also, the results obtained from the performer's data analysis are consistent with the recall of working memory representations and the increase of cognitive load. Thus, these results prove the efficiency of the interaction design, as well as the importance of the directing strategy, dramaturgy and narrative structure on the audience's perception, cognitive state, and engagement.
format Online
Article
Text
id pubmed-5891608
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-58916082018-04-17 “Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction Zioga, Polina Pollick, Frank Ma, Minhua Chapman, Paul Stefanov, Kristian Front Neurosci Neuroscience The fields of neural prosthetic technologies and Brain-Computer Interfaces (BCIs) have witnessed in the past 15 years an unprecedented development, bringing together theories and methods from different scientific fields, digital media, and the arts. More in particular, artists have been amongst the pioneers of the design of relevant applications since their emergence in the 1960s, pushing the boundaries of applications in real-life contexts. With the new research, advancements, and since 2007, the new low-cost commercial-grade wireless devices, there is a new increasing number of computer games, interactive installations, and performances that involve the use of these interfaces, combining scientific, and creative methodologies. The vast majority of these works use the brain-activity of a single participant. However, earlier, as well as recent examples, involve the simultaneous interaction of more than one participants or performers with the use of Electroencephalography (EEG)-based multi-brain BCIs. In this frame, we discuss and evaluate “Enheduanna—A Manifesto of Falling,” a live brain-computer cinema performance that enables for the first time the simultaneous real-time multi-brain interaction of more than two participants, including a performer and members of the audience, using a passive EEG-based BCI system in the context of a mixed-media performance. The performance was realised as a neuroscientific study conducted in a real-life setting. The raw EEG data of seven participants, one performer and two different members of the audience for each performance, were simultaneously recorded during three live events. The results reveal that the majority of the participants were able to successfully identify whether their brain-activity was interacting with the live video projections or not. A correlation has been found between their answers to the questionnaires, the elements of the performance that they identified as most special, and the audience's indicators of attention and emotional engagement. Also, the results obtained from the performer's data analysis are consistent with the recall of working memory representations and the increase of cognitive load. Thus, these results prove the efficiency of the interaction design, as well as the importance of the directing strategy, dramaturgy and narrative structure on the audience's perception, cognitive state, and engagement. Frontiers Media S.A. 2018-04-03 /pmc/articles/PMC5891608/ /pubmed/29666566 http://dx.doi.org/10.3389/fnins.2018.00191 Text en Copyright © 2018 Zioga, Pollick, Ma, Chapman and Stefanov. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Zioga, Polina
Pollick, Frank
Ma, Minhua
Chapman, Paul
Stefanov, Kristian
“Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction
title “Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction
title_full “Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction
title_fullStr “Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction
title_full_unstemmed “Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction
title_short “Enheduanna—A Manifesto of Falling” Live Brain-Computer Cinema Performance: Performer and Audience Participation, Cognition and Emotional Engagement Using Multi-Brain BCI Interaction
title_sort “enheduanna—a manifesto of falling” live brain-computer cinema performance: performer and audience participation, cognition and emotional engagement using multi-brain bci interaction
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5891608/
https://www.ncbi.nlm.nih.gov/pubmed/29666566
http://dx.doi.org/10.3389/fnins.2018.00191
work_keys_str_mv AT ziogapolina enheduannaamanifestooffallinglivebraincomputercinemaperformanceperformerandaudienceparticipationcognitionandemotionalengagementusingmultibrainbciinteraction
AT pollickfrank enheduannaamanifestooffallinglivebraincomputercinemaperformanceperformerandaudienceparticipationcognitionandemotionalengagementusingmultibrainbciinteraction
AT maminhua enheduannaamanifestooffallinglivebraincomputercinemaperformanceperformerandaudienceparticipationcognitionandemotionalengagementusingmultibrainbciinteraction
AT chapmanpaul enheduannaamanifestooffallinglivebraincomputercinemaperformanceperformerandaudienceparticipationcognitionandemotionalengagementusingmultibrainbciinteraction
AT stefanovkristian enheduannaamanifestooffallinglivebraincomputercinemaperformanceperformerandaudienceparticipationcognitionandemotionalengagementusingmultibrainbciinteraction