Detection of time varying pitch in tonal languages: an approach based on ensemble empirical mode decomposition

Hong HONG; Xiao-hua ZHU; Wei-min SU; Run-tong GENG; Xin-long WANG

doi:10.1631/jzus.C1100092

Your Location：

Home >

Browse articles >

Detection of time varying pitch in tonal languages: an approach based on ensemble empirical mode decomposition

Electronic Engineering | Updated：2022-12-09

- Detection of time varying pitch in tonal languages: an approach based on ensemble empirical mode decomposition
- Detection of time varying pitch in tonal languages: an approach based on ensemble empirical mode decomposition
- Frontiers of Information Technology & Electronic Engineering Vol. 13, Issue 2, Pages: 139-145(2012)
- Affiliations：
  
  1.School of Electronic Engineering and Optoelectronic Techniques, Nanjing University of Science and Technology, Nanjing 210094, China
  2.State Key Laboratory of Modern Acoustics, Institute of Acoustics, Nanjing University, Nanjing 210093, China
- Author bio：
  
  [ "Hong HONG, E-mail: hongnju@gmail.com" ]
- Funds：
- DOI：10.1631/jzus.C1100092
  CLC： TN912.3
- Received：13 April 2011，
  
  Revised：2011-12-29，
  
  Published：2012-02
- Accepted：
Scan QR Code
Hong HONG, Xiao-hua ZHU, Wei-min SU, et al. Detection of time varying pitch in tonal languages: an approach based on ensemble empirical mode decomposition[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(2): 139-145.
DOI：

Hong HONG, Xiao-hua ZHU, Wei-min SU, et al. Detection of time varying pitch in tonal languages: an approach based on ensemble empirical mode decomposition[J]. Frontiers of Information Technology & Electronic Engineering, 2012, 13(2): 139-145. DOI： 10.1631/jzus.C1100092.

摘要

Abstract

A method based on ensemble empirical mode decomposition (EEMD) is proposed for accurately detecting the time varying pitch of speech in tonal languages. Unlike frame-

event-

or subspace-based pitch detectors

the time varying information of pitch within the short duration

which is of crucial importance in speech processing of tonal languages

can be accurately extracted. The Chinese Linguistic Data Consortium (CLDC) database for Mandarin Chinese was employed as standard speech data for the evaluation of the effectiveness of the method. It is shown that the proposed method provides more accurate and reliable results

particularly in estimating the tones of non-monotonically varying pitches like the third one in Mandarin Chinese. Also

it is shown that the new method has strong resistance to noise disturbance.

关键词

Keywords

references

T. Ananthapadmanabha , , , B. Yegnanarayana . . Epoch extraction of voiced speech . . IEEE Trans. Acoust. Speech Signal Process. , , 1975 . . 23 ( ( 6 ): ): 562 - - 570 . . DOI: 10.1109/TASSP.1975.1162745 http://doi.org/10.1109/TASSP.1975.1162745 . .

M. Bekara , , , M.V.D. Baan . . Random and coherent noise attenuation by empirical mode decomposition . . Geophysics , , 2009 . . 74 ( ( 5 ): ): 89 - - 98 . . DOI: 10.1190/1.3157244 http://doi.org/10.1190/1.3157244 . .

P. Boersma . . Praat, a system for doing phonetics by computer . . Glot Int. , , 2002 . . 5 341 - - 345 . . . .

K.W. Chan , , , H.C. So . . Accurate frequency estimation for real harmonic sinusoids . . IEEE Signal Process. Lett. , , 2004 . . 11 ( ( 7 ): ): 609 - - 612 . . DOI: 10.1109/LSP.2004.830115 http://doi.org/10.1109/LSP.2004.830115 . .

E. Chang , , , J. Zhou , , , S. Di , , , C. Huang , , , K. Lee . . Large Vocabulary Mandarin Speech Recognition with Different Approaches in Modeling Tones . . Proc. Int. Conf. on Spoken Language Processing , , 2000 . . p.983 - - 986 . . . .

Y.M. Cheng , , , D. O'Shaughnessy . . Automatic and reliable estimation of glottal closure instant and period . . IEEE Trans. Acoust. Speech Signal Process. , , 1989 . . 37 ( ( 12 ): ): 1805 - - 1815 . . DOI: 10.1109/29.45529 http://doi.org/10.1109/29.45529 . .

M.G. Christensen , , , A. Jakobsson , , , S.H. Jensen . . Joint high-resolution fundamental frequency and order estimation . . IEEE Trans. Audio Speech Lang. Process. , , 2007 . . 15 ( ( 5 ): ): 1635 - - 1644 . . DOI: 10.1109/TASL.2007.899267 http://doi.org/10.1109/TASL.2007.899267 . .

M.G. Christensen , , , P. Stoica , , , A. Jakobsson , , , S.H. Jensen . . Multi-pitch estimation . . Signal Process. , , 2008 . . 88 ( ( 4 ): ): 972 - - 983 . . DOI: 10.1016/j.sigpro.2007.10.014 http://doi.org/10.1016/j.sigpro.2007.10.014 . .

A. de Cheveigne , , , H. Kawahara . . YIN, a fundamental frequency estimator for speech and music . . J. Acoust. Soc. Am. , , 2002 . . 111 ( ( 4 ): ): 1917 - - 1930 . . DOI: 10.1121/1.1458024 http://doi.org/10.1121/1.1458024 . .

J. Deller , , , J. Proakis , , , J. Hanson . . Discrete-Time Processing of Speech Signals . . Prentice Hall, Englewood Cliffs, NJ, USA , , 1993 . . .

A. Goska , , , A. Krawiecki . . Analysis of phase synchronization of coupled chaotic oscillators with empirical mode decomposition . . Phys. Rev. E , , 2006 . . 74 ( ( 4 ): ): 046217 DOI: 10.1103/PhysRevE.74.046217 http://doi.org/10.1103/PhysRevE.74.046217 . .

H. Hong , , , X.L. Wang , , , Z.Y. Tao . . Local integral mean-based sifting for empirical mode decomposition . . IEEE Signal Process. Lett. , , 2009 . . 16 ( ( 10 ): ): 841 - - 844 . . DOI: 10.1109/LSP.2009.2025925 http://doi.org/10.1109/LSP.2009.2025925 . .

H. Huang , , , J. Pan . . Speech pitch determination based on Hilbert-Huang transform . . Signal Process. , , 2006 . . 86 ( ( 4 ): ): 792 - - 803 . . DOI: 10.1016/j.sigpro.2005.06.011 http://doi.org/10.1016/j.sigpro.2005.06.011 . .

N.E. Huang , , , Z. Wu . . An adaptive data analysis method for nonlinear and nonstationary time series: the empirical mode decomposition and Hilbert spectral analysis . . Wavel. Anal. Appl. , , 2007 . . 1 ( ( 4 ): ): 363 - - 376 . . DOI: 10.1007/978-3-7643-7778-6_25 http://doi.org/10.1007/978-3-7643-7778-6_25 . .

N.E. Huang , , , Z. Shen , , , S.R. Long , , , M.C. Wu , , , H.H. Shih , , , Q. Zheng , , , N.C. Yen , , , C.C. Tung , , , H.H. Liu . . The empirical mode decomposition and the Hilbert spectrum for nonlinear non-stationary time series analysis . . Proc. R. Soc. Lond. A , , 1998 . . 454 903 - - 995 . . DOI: 10.1098/rspa.1998.0193 http://doi.org/10.1098/rspa.1998.0193 . .

N.E. Huang , , , Z. Shen , , , S. Long . . A new view of nonlinear water waves: the Hilbert spectrum . . Ann. Rev. Fluid Mech. , , 1999 . . 31 ( ( 1 ): ): 417 - - 459 . . DOI: 10.1146/annurev.fluid.31.1.417 http://doi.org/10.1146/annurev.fluid.31.1.417 . .

N.E. Huang , , , C.C. Chern , , , K. Huang , , , L.W. Salvino , , , S.R. Long , , , K.L. Fan . . A new spectral representation of earthquake data: Hilbert spectral analysis of Station TCU129, Chi-Chi, Taiwan, 21 September 1999 . . Bull. Seismol. Soc. Am. , , 2001 . . 91 ( ( 5 ): ): 1310 - - 1338 . . DOI: 10.1785/0120000735 http://doi.org/10.1785/0120000735 . .

I.M. Jnosi , , , R. Mller . . Empirical mode decomposition and correlation properties of long daily ozone records . . Phys. Rev. E , , 2005 . . 71 ( ( 5 ): ): 056126 DOI: 10.1103/PhysRevE.71.056126 http://doi.org/10.1103/PhysRevE.71.056126 . .

S. Kadambe , , , G.F. Boudreaux-Bartels . . Application of the wavelet transform for pitch detection of speech signals . . IEEE Trans. Inf. Theory , , 1992 . . 38 ( ( 2 ): ): 917 - - 924 . . DOI: 10.1109/18.119752 http://doi.org/10.1109/18.119752 . .

Y.G. Lei , , , Z.J. He , , , Y.Y. Zi . . Application of the EEMD method to rotor fault diagnosis of rotating machinery . . Mech. Syst. Signal Process. , , 2009 . . 23 ( ( 4 ): ): 1327 - - 1338 . . DOI: 10.1016/j.ymssp.2008.11.005 http://doi.org/10.1016/j.ymssp.2008.11.005 . .

H.B. Li , , , P. Stoica , , , J. Li . . Computationally efficient parameter estimation for harmonic sinusoidal signals . . Signal Process. , , 2000 . . 80 ( ( 9 ): ): 1937 - - 1944 . . DOI: 10.1016/S0165-1684(00)00103-1 http://doi.org/10.1016/S0165-1684(00)00103-1 . .

H. Liang , , , Z. Lin , , , R.W. McCallum . . Artifact reduction in electrogastrograms based on the empirical mode decomposition . . Med. Biol. Eng. Comput. , , 2000 . . 38 ( ( 1 ): ): 35 - - 41 . . DOI: 10.1007/BF02344686 http://doi.org/10.1007/BF02344686 . .

S.L. Lin , , , P.C. Tung , , , N.E. Huang . . Data analysis using a combination of independent component analysis and empirical mode decomposition . . Phys. Rev. E , , 2009 . . 79 ( ( 6 ): ): 066705 DOI: 10.1103/PhysRevE.79.066705 http://doi.org/10.1103/PhysRevE.79.066705 . .

A.M. Noll . . Cepstrum pitch determination . . J. Acoust. Soc. Am. , , 1967 . . 41 ( ( 2 ): ): 293 - - 309 . . DOI: 10.1121/1.1910339 http://doi.org/10.1121/1.1910339 . .

P.F. Pai , , , A.N. Palazotto . . Detection and identification of nonlinearities by amplitude and frequency modulation analysis . . Mech. Syst. Signal Process. , , 2008 . . 22 ( ( 5 ): ): 1107 - - 1132 . . DOI: 10.1016/j.ymssp.2007.11.006 http://doi.org/10.1016/j.ymssp.2007.11.006 . .

K. Qi , , , Z.J. He , , , Y.Y. Zi . . Cosine window-based boundary processing method for EMD and its application in rubbing fault diagnosis application in rubbing fault diagnosis . . Mech. Syst. Signal Process. , , 2007 . . 21 ( ( 7 ): ): 2750 - - 2760 . . DOI: 10.1016/j.ymssp.2007.04.007 http://doi.org/10.1016/j.ymssp.2007.04.007 . .

B. Resch , , , M. Nilsson , , , A. Ekman , , , W.B. Kleijn . . Estimation of the instantaneous pitch of speech . . IEEE Trans. Audio Speech Lang. Process. , , 2007 . . 15 ( ( 3 ): ): 813 - - 822 . . DOI: 10.1109/TASL.2006.885242 http://doi.org/10.1109/TASL.2006.885242 . .

T. Schlurmann , , , T. Dose , , , S. Schimmels . . Characteristic Modes of the 'Adreanov Tsunami' Based on the Hilbert-Huang Transformation . . Proc. 4th Int. Symp. on Ocean Wave Measurement and Analysis , , 2001 . . 2 1525 - - 1534 . . DOI: 10.1061/40604(273)154 http://doi.org/10.1061/40604(273)154 . .

D. Talkin . . A robust algorithm for pitch tracking (RAPT) . . Speech Cod. Synth. , , 1995 . . 14 495 - - 518 . . . .

C. Wang , , , S. Seneff . . A Study of Tones and Tempo in Continuous Mandarin Digit Strings and Their Application in Telephone Quality Speech Recognition . . Proc. Int. Conf. on Spoken Language Processing , , 1998 . . p.635 - - 638 . . . .

Z. Wu , , , N.E. Huang . . Ensemble empirical mode decomposition: a noise-assisted data analysis method . . Adv. Adapt. Data Anal. , , 2009 . . 1 ( ( 1 ): ): 1 - - 41 . . DOI: 10.1142/S1793536909000047 http://doi.org/10.1142/S1793536909000047 . .

G.L. Xu , , , X.T. Wang , , , X.G. Xu . . Time-varying frequency-shifting signal-assisted empirical mode decomposition method for AM-FM signals . . Mech. Syst. Signal Process. , , 2009 . . 23 ( ( 8 ): ): 2458 - - 2469 . . DOI: 10.1016/j.ymssp.2009.06.006 http://doi.org/10.1016/j.ymssp.2009.06.006 . .

J.X. Zhang , , , M.G. Christensen , , , S.H. Jensen , , , M. Moonen . . A robust and computationally efficient subspace-based fundamental frequency estimator . . IEEE Trans. Audio Speech Lang. Process. , , 2010 . . 18 ( ( 3 ): ): 487 - - 497 . . DOI: 10.1109/TASL.2010.2040786 http://doi.org/10.1109/TASL.2010.2040786 . .

Views

Downloads

CSCD

Alert me when the article has been cited

Submit

Tools

Publicity Resources

No data

Related Author

No data

Related Institution

No data

Chat

Address：Zhejiang University Press, 148 Tianmushan Road, Hangzhou, China Postal code：310028
Tel：+86-571-88273162 Email：fitee@zju.edu.cn
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.

⁰