基于相位同步的无标度合奏脑音乐

Dan WU; Chao-yi LI; Jie LIU; Jing LU; De-zhong YAO

doi:10.1631/jzus.C1400199

Your Location：

Home >

Browse articles >

基于相位同步的无标度合奏脑音乐

脑机接口与半机器人智能专题 | Updated：2022-05-19

- 基于相位同步的无标度合奏脑音乐
- Scale-free brain ensemble modulated by phase synchronization
- 信息与电子工程前沿（英文） 2014年15卷第10期页码：821-831
- Affiliations：
  
  1.Department of Biomedical Engineering, School of Computer and Information Technology, Beijing Jiaotong University, Beijing 100044, China
  2.NeuroInformation of Ministry of Education, University of Electronic Science and Technology of China, Chengdu 610054, China
- Author bio：
  
  [ "Dan WU, E-mail: wudan@bjtu.edu.cn" ]
  De-zhong YAO, dyao@uestc.edu.cn
- Funds：
  
  Project supported by the National Natural Science Foundation of China (Nos. 81201159, 91232725, and 81330032) and the China Postdoctoral Science Foundation (No. 2014M550607)
- DOI：10.1631/jzus.C1400199
  中图分类号： TP274;R318
- 收稿：2014-06-06，
  
  修回：2014-;9-17，
  
  纸质出版：2014-10
- Accepted：
Scan QR Code
基于相位同步的无标度合奏脑音乐[J]. 信息与电子工程前沿（英文）, 2014,15(10):821-831.

Dan WU, Chao-yi LI, Jie LIU, et al. Scale-free brain ensemble modulated by phase synchronization[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(10): 821-831.
基于相位同步的无标度合奏脑音乐[J]. 信息与电子工程前沿（英文）, 2014,15(10):821-831. DOI： 10.1631/jzus.C1400199.

Dan WU, Chao-yi LI, Jie LIU, et al. Scale-free brain ensemble modulated by phase synchronization[J]. Frontiers of Information Technology & Electronic Engineering, 2014, 15(10): 821-831. DOI： 10.1631/jzus.C1400199.

摘要

研究目的

将不同状态下的脑电信号转换为音乐进行聆听和分析，该音乐能反映大脑活动本身的无标度性，同时反映不同电极位置信号的相位同步情况。

创新要点

无标度性是脑电信号和音乐都遵循的规律。我们使用了一种满足无标度特征的脑音乐生成方法，将相位同步信息用于调整音乐的协和性，使得到的音乐可以表达不同电极位置信号之间的同步关系。

研究方法

首先，将来自两个不同电极位置的脑电信号分别转换为两段音乐旋律，其中脑电信号的振幅等参数映射为音乐中音符的音高、音长和音量。然后，将这两段音乐合成为一段合奏，为其设定调式。通过计算两道脑电信号之间的相位同步指数，得到音乐的协和性序列。对每个时间点而言，均有两个音同时发出。根据音乐的调式，可确定一个固定的音符，再根据协和性序列，调整另一个音符，从而使音乐的协和性可以表达相位同步指数的变化（图1）。最后，将静息状态下的睁眼和闭眼的EEG数据用于产生音乐（图2，3），显示出在音域、标度指数等方面的差异（图4）。

重要结论

基于相位同步的无标度合奏脑音乐生成方法可以将来自不同电极的脑电信号的特征用音乐的形式进行表达，得到的音乐保留了原始脑电信号的无标度特征（图6，7）。该方法在脑电监测和生物反馈方面有一定的应用潜力。

Abstract

To listen to brain activity as a piece of music

we proposed the scale-free brainwave music (SFBM) technology

which could translate the scalp electroencephalogram (EEG) into music notes according to the power law of both EEG and music. In the current study

this methodology was further extended to a musical ensemble of two channels. First

EEG data from two selected channels are translated into musical instrument digital interface (MIDI) sequences

where the EEG parameters modulate the pitch

duration

and volume of each musical note. The phase synchronization index of the two channels is computed by a Hilbert transform. Then the two MIDI sequences are integrated into a chorus according to the phase synchronization index. The EEG with a high synchronization index is represented by more consonant musical intervals

while the low index is expressed by inconsonant musical intervals. The brain ensemble derived from real EEG segments illustrates differences in harmony and pitch distribution during the eyes-closed and eyes-open states. Furthermore

the scale-free phenomena exist in the brainwave ensemble. Therefore

the scale-free brain ensemble modulated by phase synchronization is a new attempt to express the EEG through an auditory and musical way

and it can be used for EEG monitoring and bio-feedback.

关键词

Keywords

references

E.D. Adrian , , , B.H.C. Matthews . . The Berger rhythm: potential changes from the occipital lobes in man . . Brain , , 1934 . . 57 ( ( 4 ): ): 355 - - 385 . . DOI: 10.1093/brain/57.4.355 http://doi.org/10.1093/brain/57.4.355 . .

G. Baier , , , T. Hermann , , , U. Stephani . . Event-based sonification of EEG rhythms in real time . . Clin. Neurophysiol. , , 2007 . . 118 ( ( 6 ): ): 1377 - - 1386 . . DOI: 10.1016/j.clinph.2007.01.025 http://doi.org/10.1016/j.clinph.2007.01.025 . .

M.T. Banich , , , R.J. Compton . . Cognitive Neuroscience (3rd Ed.) , , : : Wadsworth, USA Cengage Learning , , 2010 . . .

J.M. Beggs , , , D. Plenz . . Neuronal avalanches in neocortical circuits . . J. Neurosci. , , 2003 . . 23 ( ( 35 ): ): 11167 - - 11177 . . . .

Y. Chen , , , M. Ding , , , J.A.S. Kelso . . Long memory processes (1/ f α type) in human coordination . . Phys. Rev. Lett. , , 1997 . . 79 ( ( 22 ): ): 4501 - - 4504 . . DOI: 10.1103/PhysRevLett.79.4501 http://doi.org/10.1103/PhysRevLett.79.4501 . .

P. Ciuciu , , , G. Varoquaux , , , P. Abry , , , 等 . . Scale-free and multifractal time dynamics of fMRI signals during rest and task . . Front. Physiol. , , 2012 . . 3 186 DOI: 10.3389/fphys.2012.00186 http://doi.org/10.3389/fphys.2012.00186 . .

G. Fechner , , , H.E. Adler , , , D.H. Howes , , , 等 . . Elements of Psychophysics , , : : New York, USA Rinehart and Winston , , 1966 . . .

W.J. Freeman , , , M.D. Holmes , , , G.A. West , , , 等 . . Fine spatiotemporal structure of phase in human intracranial EEG . . Clin. Neurophysiol. , , 2006 . . 117 ( ( 6 ): ): 1228 - - 1243 . . DOI: 10.1016/j.clinph.2006.03.012 http://doi.org/10.1016/j.clinph.2006.03.012 . .

P. Gong , , , A.R. Nikolaev , , , C. van Leeuwen . . Scale- invariant fluctuations of the dynamical synchronization in human brain electrical activity . . Neurosci. Lett. , , 2003 . . 336 ( ( 1 ): ): 33 - - 36 . . DOI: 10.1016/S0304-3940(02)01247-8 http://doi.org/10.1016/S0304-3940(02)01247-8 . .

P. Grigolini , , , G. Aquino , , , M. Bologna , , , 等 . . A theory of 1/ f noise in human cognition . . Phys. A , , 2009 . . 388 ( ( 19 ): ): 4192 - - 4204 . . DOI: 10.1016/j.physa.2009.06.024 http://doi.org/10.1016/j.physa.2009.06.024 . .

B.J. He , , , J.M. Zempel , , , A.Z. Snyder , , , 等 . . The temporal structures and functional significance of scale-free brain activity . . Neuron , , 2010 . . 66 ( ( 3 ): ): 353 - - 369 . . DOI: 10.1016/j.neuron.2010.04.020 http://doi.org/10.1016/j.neuron.2010.04.020 . .

H. Hennig , , , R. Fleischmann , , , A. Fredebohm , , , 等 . . The nature and perception of fluctuations in human musical rhythms . . PLoS ONE , , 2011 . . 6 ( ( 10 ): ): e26457 DOI: 10.1371/journal.pone.0026457 http://doi.org/10.1371/journal.pone.0026457 . .

T. Hermann , , , G. Baier . . Sonification of the human EEG. In : Franinović K., Serafin, S. (Eds.), Sonic Interaction Design . . MIT Press, Cambridge , , 2013 . . p.285 - - 297 . . . .

T. Hinterberger , , , G. Baier . . Parametric orchestral sonification of EEG in real time . . IEEE Multim. , , 2005 . . 12 ( ( 2 ): ): 70 - - 79 . . DOI: 10.1109/MMUL.2005.36 http://doi.org/10.1109/MMUL.2005.36 . .

sü H , , , J. K. , , , A. Hsü . . Fractal geometry of music . . Proc. Nat. Acad. Sci. USA , , 1990 . . 87 ( ( 3 ): ): 938 - - 941 . . DOI: 10.1073/pnas.87.3.938 http://doi.org/10.1073/pnas.87.3.938 . .

sü H , , , J. K. , , , A. Hsü . . Self-similarity of the "1/f noise" called music . . Proc. Nat. Acad. Sci. USA , , 1991 . . 88 ( ( 8 ): ): 3507 - - 3509 . . DOI: 10.1073/pnas.88.8.3507 http://doi.org/10.1073/pnas.88.8.3507 . .

R.C. Hwa , , , T.C. Ferree . . Scaling properties of fluctuations in the human electroencephalogram . . Phys. Rev. E , , 2002 . . 66 ( ( 2 ): ): 021901 DOI: 10.1103/PhysRevE.66.021901 http://doi.org/10.1103/PhysRevE.66.021901 . .

W. Klonowski , , , W. Duch , , , A. Perovic , , , 等 . . Some computational aspects of the brain computer interfaces based on inner music . . Comput. Intell. Neurosci. , , 2009 . . 2009 950403 DOI: 10.1155/2009/950403 http://doi.org/10.1155/2009/950403 . .

D.J. Levitin , , , P. Chordia , , , V. Menon . . Musical rhythm spectra from Bach to Joplin obey a 1/f power law . . Proc. Nat. Acad. Sci. USA , , 2012 . . 109 ( ( 10 ): ): 3716 - - 3720 . . DOI: 10.1073/pnas.1113828109 http://doi.org/10.1073/pnas.1113828109 . .

L. Liu , , , J. Wei , , , H. Zhang , , , 等 . . A statistical physics view of pitch fluctuations in the classical music from Bach to Chopin: evidence for scaling . . PLoS ONE , , 2013 . . 8 ( ( 3 ): ): e58710 DOI: 10.1371/journal.pone.0058710 http://doi.org/10.1371/journal.pone.0058710 . .

X.F. Liu , , , C.K. Tse , , , M. Small . . Complex network structure of musical compositions: algorithmic generation of appealing music . . Phys. A , , 2010 . . 389 ( ( 1 ): ): 126 - - 132 . . DOI: 10.1016/j.physa.2009.08.035 http://doi.org/10.1016/j.physa.2009.08.035 . .

S.B. Lowen , , , L.S. Liebovitch , , , J.A. White . . Fractal ion-channel behavior generates fractal firing patterns in neuronal models . . Phys. Rev. E , , 1999 . . 59 ( ( 5 ): ): 5970 - - 5980 . . DOI: 10.1103/PhysRevE.59.5970 http://doi.org/10.1103/PhysRevE.59.5970 . .

J. Lu , , , D. Wu , , , H. Yang , , , 等 . . Scale-free brain-wave music from simultaneously EEG and fMRI recordings . . PLoS ONE , , 2012 . . 7 ( ( 11 ): ): e49773 DOI: 10.1371/journal.pone.0049773 http://doi.org/10.1371/journal.pone.0049773 . .

B. Manaris , , , J. Romero , , , P. Machado , , , 等 . . Zipf's law, music classification, and aesthetics . . Comput. Music J. , , 2005 . . 29 ( ( 1 ): ): 55 - - 69 . . DOI: 10.1162/comj.2005.29.1.55 http://doi.org/10.1162/comj.2005.29.1.55 . .

E.R. Miranda . . Plymouth brain-computer music interfacing project: from EEG audio mixers to composition informed by cognitive neuroscience . . Int. J. Arts Technol. , , 2010 . . 3 ( ( 2-3 ): ): 154 - - 176 . . DOI: 10.1504/IJART.2010.032562 http://doi.org/10.1504/IJART.2010.032562 . .

J.M. Palva , , , A. Zhigalov , , , J. Hirvonen , , , 等 . . Neuronal long-range temporal correlations and avalanche dynamics are correlated with behavioral scaling laws . . Proc. Nat. Acad. Sci. USA , , 2013 . . 110 ( ( 9 ): ): 3585 - - 3590 . . DOI: 10.1073/pnas.1216855110 http://doi.org/10.1073/pnas.1216855110 . .

R.Q. Quiroga , , , A. Kraskov , , , T. Kreuz , , , 等 . . Performance of different synchronization measures in real data: a case study on electroencephalographic signals . . Phys. Rev. E , , 2002 . . 65 ( ( 4 ): ): 041903 DOI: 10.1103/PhysRevE.65.041903 http://doi.org/10.1103/PhysRevE.65.041903 . .

J.G. Roederer . . The Physics and Psychophysics of Music: an Introduction (4th Ed.) , , : : New York, USA Springer , , 2008 . . .

D. Rosenboom . . Biofeedback and the Arts, Results of Early Experiments (2nd Ed.) , , : : Vancouve Aesthetic Research Centre of Canada , , 1976 . . .

D. Rosenboom . . Extended musical interface with the human nervous system: assessment and prospectus . . Leonardo , , 1999 . . 32 ( ( 4 ): ): 257 DOI: 10.1162/002409499553398 http://doi.org/10.1162/002409499553398 . .

M. Schroeder . . Fractals, Chaos, Power Laws: Minutes from an Infinite Paradise , , : : New York, USA Dover Publications , , 2009 . . .

I. Sposobin . . Harmony Textbook. Chen M., translator. 2000 , , : : Beijing People's Music Publishing House , , 1959 . . .

M.C. Teich , , , C. Heneghan , , , S.B. Lowen , , , 等 . . Fractal character of the neural spike train in the visual system of the cat . . J. Opt. Soc. Am. A , , 1997 . . 14 ( ( 3 ): ): 529 - - 546 . . DOI: 10.1364/JOSAA.14.000529 http://doi.org/10.1364/JOSAA.14.000529 . .

Y. Tian , , , D. Yao . . Why do we need to use a zero reference. Reference influences on the ERPs of audiovisual effects . . Psychophysiology , , 2013 . . 50 ( ( 12 ): ): 1282 - - 1290 . . DOI: 10.1111/psyp.12130 http://doi.org/10.1111/psyp.12130 . .

K. Torre , , , E.J. Wagenmakers . . Theories and models for 1/ f β noise in human movement science . . Hum. Movement Sci. , , 2009 . . 28 ( ( 3 ): ): 297 - - 318 . . DOI: 10.1016/j.humov.2009.01.001 http://doi.org/10.1016/j.humov.2009.01.001 . .

A. Vljame , , , T. Steffert , , , S. Holland , , , 等 . . A review of real-time EEG sonification research . . Int. Conf. on Auditory Display , , 2013 . . p.85 - - 93 . . . .

F.B. Vialatte , , , A. Cichocki . . Sparse bump sonification: a new tool for multichannel EEG diagnosis of mental disorders; application to the detection of the early stage of Alzheimer's disease . . Proc. 13th Int. Conf. on Neural Information Processing , , 2006 . . p.92 - - 101 . . DOI: 10.1007/11893295_11 http://doi.org/10.1007/11893295_11 . .

R.F. Voss , , , J. Clarke . . "1/ f noise" in music: music from 1/ f noise . . J. Acoust. Soc. Am. , , 1978 . . 63 258 - - 263 . . DOI: 10.1121/1.381721 http://doi.org/10.1121/1.381721 . .

MA W . . WMA Declaration of Helsinki-Ethical Principles for Medical Research Involving Human Subjects . . Available from http://www.wma.net/en/30publications/10policies/b3/index.html http://www.wma.net/en/30publications/10policies/b3/index.html , , 1964 . . .

D. Wu , , , C. Li , , , D. Yao . . Scale-free music of the brain . . PLoS ONE , , 2009 . . 4 ( ( 6 ): ): DOI: 10.1371/journal.pone.0005915 http://doi.org/10.1371/journal.pone.0005915 . .

D. Wu , , , C. Li , , , Y. Yin , , , 等 . . Music composition from the brain signal: representing the mental state by music . . Comput. Intell. Neurosci. , , 2010 . . 2010 267671 DOI: 10.1155/2010/267671 http://doi.org/10.1155/2010/267671 . .

D. Wu , , , X. Shi , , , J. Hu , , , 等 . . Listen to the song of the brain in real time: the Chengdu brainwave music. Proc 8th Int. Symp. on Noninvasive Functional Source Imaging of the Brain and Heart & 8th Int . . Conf. on Bioelectromagnetism , , 2011 . . p.135 - - 138 . . DOI: 10.1109/NFSI.2011.5936836 http://doi.org/10.1109/NFSI.2011.5936836 . .

D. Wu , , , C. Li , , , D. Yao . . An ensemble with the Chinese pentatonic scale using electroencephalogram from both hemispheres . . Neurosci. Bull. , , 2013a . . 29 ( ( 5 ): ): 581 - - 587 . . DOI: 10.1007/s12264-013-1334-y http://doi.org/10.1007/s12264-013-1334-y . .

D. Wu , , , C. Li , , , D. Yao . . Scale-free brain quartet: artistic filtering of multi-channel brainwave music . . PLoS ONE , , 2013b . . 8 ( ( 5 ): ): e64046 DOI: 10.1371/journal.pone.0064046 http://doi.org/10.1371/journal.pone.0064046 . .

D. Yao . . A method to standardize a reference of scalp EEG recordings to a point at infinity . . Physiol. Meas. , , 2001 . . 22 693 DOI: 10.1088/0967-3334/22/4/305 http://doi.org/10.1088/0967-3334/22/4/305 . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据