Exploiting articulatory features for pitch accent detection

Junhong ZHAO; Ji XU; Wei-qiang ZHANG; Hua YUAN; Jia LIU; Shanhong XIA

doi:10.1631/jzus.C1300104

Your Location：

Home >

Browse articles >

Exploiting articulatory features for pitch accent detection

计算机与自动化 | Updated：2022-12-09

- Exploiting articulatory features for pitch accent detection
- Exploiting articulatory features for pitch accent detection
- 信息与电子工程前沿（英文） 2013年14卷第11期页码：835-844
- Affiliations：
  
  1.State Key Laboratory of Transducer Technology, Institute of Electronics, Chinese Academy of Sciences, Beijing 100190, China
  2.University of Chinese Academy of Sciences, Beijing 100190, China
  3.National Laboratory for Information Science and Technology, Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
- Author bio：
  
  [ "Junhong ZHAO, E-mail: junhong.iecas@gmail.com" ]
- Funds：
  
  Project (Nos. 61370034, 61273268, and 61005019) supported by the National Natural Science Foundation of China
- DOI：10.1631/jzus.C1300104
  中图分类号： TP391;TN912.34
- 收稿：2013-04-22，
  
  修回：2013-10-15，
  
  纸质出版：2013-11
- Accepted：
Scan QR Code
Exploiting articulatory features for pitch accent detection[J]. 信息与电子工程前沿（英文）, 2013,14(11):835-844.

Junhong ZHAO, Ji XU, Wei-qiang ZHANG, et al. Exploiting articulatory features for pitch accent detection[J]. Frontiers of Information Technology & Electronic Engineering, 2013, 14(11): 835-844.
Exploiting articulatory features for pitch accent detection[J]. 信息与电子工程前沿（英文）, 2013,14(11):835-844. DOI： 10.1631/jzus.C1300104.

Junhong ZHAO, Ji XU, Wei-qiang ZHANG, et al. Exploiting articulatory features for pitch accent detection[J]. Frontiers of Information Technology & Electronic Engineering, 2013, 14(11): 835-844. DOI： 10.1631/jzus.C1300104.

摘要

Abstract

Articulatory features describe how articulators are involved in making sounds. Speakers often use a more exaggerated way to pronounce accented phonemes

so articulatory features can be helpful in pitch accent detection. Instead of using the actual articulatory features obtained by direct measurement of articulators

we use the posterior probabilities produced by multi-layer perceptrons (MLPs) as articulatory features. The inputs of MLPs are frame-level acoustic features pre-processed using the split temporal context-2 (STC-2) approach. The outputs are the posterior probabilities of a set of articulatory attributes. These posterior probabilities are averaged piecewise within the range of syllables and eventually act as syllable-level articulatory features. This work is the first to introduce articulatory features into pitch accent detection. Using the articulatory features extracted in this way

together with other traditional acoustic features

can improve the accuracy of pitch accent detection by about 2%.

关键词

Keywords

references

S. Ananthakrishnan , , , S. Narayanan . . Automatic prosodic event detection using acoustic, lexical and syntactic evidence . . IEEE Trans. Audio Speech Lang. Process. , , 2008 . . 16 ( ( 1 ): ): 216 - - 228 . . DOI: 10.1109/TASL.2007.907570 http://doi.org/10.1109/TASL.2007.907570 . .

A.W. Black , , , H.T. Bunnell , , , Y. Dou , , , P.K. Muthukumar , , , F. Metze , , , D. Perry , , , T. Polzehl , , , K. Prahallad , , , S. Steidl , , , C. Vaughn . . Articulatory Features for Expressive Speech Synthesis . . Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , , 2012 . . p.4005 - - 4008 . . DOI: 10.1109/ICASSP.2012.6288796 http://doi.org/10.1109/ICASSP.2012.6288796 . .

H. Chao , , , Z.L. Yang , , , W.J. Liu . . Improved Tone Modeling by Exploiting Articulatory Features for Mandarin Speech Recognition . . Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , , 2012 . . p.4741 - - 4744 . . DOI: 10.1109/ICASSP.2012.6288978 http://doi.org/10.1109/ICASSP.2012.6288978 . .

T. Cho . . Manifestation of prosodic structure in articulatory variation: evidence from lip kinematics in English . . Lab. Phonol. , , 2006 . . 8 519 - - 548 . . . .

D. Erickson . . Articulation of extreme formant patterns for emphasized vowels . . Phonetica , , 2002 . . 59 ( ( 2-3 ): ): 134 - - 149 . . DOI: 10.1159/000066067 http://doi.org/10.1159/000066067 . .

R.E. Fan , , , P.H. Chen , , , C.J. Lin . . Working set selection using second order information for training support vector machines . . J. Mach. Learn. Res. , , 2005 . . 6 1889 - - 1918 . . . .

C. Fougeron . . Prosodically Conditioned Articulatory Variations: a Review . . UCLA Working Papers in Phonetics , , 1999 . . p.1 - - 74 . . . .

M.A. Hall . . Correlation-Based Feature Selection for Machine Learning . . PhD Thesis, The University of Waikato, New Zealand , , 1999 . . .

M.A. Hall , , , L.A. Smith . . Feature Selection for Machine Learning: Comparing a Correlation-Based Filter Approach to the Wrapper . . Proc. 12th Int. Florida Artificial Intelligence Research Society Conf. , , 1999 . . p.235 - - 239 . . . .

Y. Iribe , , , T. Mori , , , K. Katsurada , , , T. Nitta . . Pronunciation Instruction Using CG Animation Based on Articulatory Features . . Proc. Int. Conf. on Computers in Education , , 2010 . . p.501 - - 508 . . . .

Y. Iribe , , , T. Mori , , , K. Katsurada , , , G. Kawai , , , T. Nitta . . Real-Time Visualization of English Pronunciation on an IPA Chart Based on Articulatory Feature Extraction . . Proc. Interspeech , , 2012 . . p.1271 - - 1274 . . . .

J.H. Jeon , , , Y. Liu . . Automatic Prosodic Events Detection Using Syllable-Based Acoustic and Syntactic Features . . Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , , 2009a . . p.4565 - - 4568 . . DOI: 10.1109/ICASSP.2009.4960646 http://doi.org/10.1109/ICASSP.2009.4960646 . .

J.H. Jeon , , , Y. Liu . . Semi-supervised Learning for Automatic Prosodic Event Detection Using Co-training Algorithm . . Proc. ACL-IJCNLP , , 2009b . . p.540 - - 548 . . DOI: 10.3115/1690219.1690222 http://doi.org/10.3115/1690219.1690222 . .

J.H. Jeon , , , Y. Liu . . Syllable-Level Prominence Detection with Acoustic Evidence . . Proc. Interspeech , , 2010 . . p.1772 - - 1775 . . . .

J.H. Jeon , , , Y. Liu . . Automatic prosodic event detection using a novel labeling and selection method in co-training . . Speech Commun. , , 2012 . . 54 ( ( 3 ): ): 445 - - 458 . . DOI: 10.1016/j.specom.2011.10.008 http://doi.org/10.1016/j.specom.2011.10.008 . .

K. Kirchhoff , , , G.A. Fink , , , G. Sagerer . . Combining acoustic and articulatory feature information for robust speech recognition . . Speech Commun. , , 2002 . . 37 ( ( 3-4 ): ): 303 - - 319 . . DOI: 10.1016/S0167-6393(01)00020-6 http://doi.org/10.1016/S0167-6393(01)00020-6 . .

S. Krstulovic . . LPC-Based Inversion of the DRM Articulatory Model . . Proc. European Conf. on Speech Communication and Technology , , 1999 . . p.125 - - 128 . . . .

H. Meng , , , C.Y. Tseng , , , M. Kondo , , , A. Harrison , , , T. Viscelgia . . Studying L2 Suprasegmental Features in Asian Enlishes: a Position Paper . . Proc. Interspeech , , 2009 . . p.1715 - - 1718 . . . .

M. Ostendorf , , , P.J. Price , , , S. Shattuck-Hufnagel . . The Boston University Radio News Corpus . . Linguistic Data Consortium , , 1995 . . .

J. Papcun , , , T.R. Hochberg , , , F. Thomas , , , J. Larouche , , , J. Zacks , , , S. Levy . . Inferring articulation and recognizing gestures from acoustics with a neural network trained on X-ray microbeam data . . J. Acoust. Soc. Am. , , 1992 . . 92 ( ( 2 ): ): 688 - - 700 . . DOI: 10.1121/1.403994 http://doi.org/10.1121/1.403994 . .

Y.M. Qian , , , J. Liu . . Articulatory Feature Based Multilingual MLPs for Low-Resource Speech Recognition . . Proc. Interspeech , , 2012a . . p.2602 - - 2605 . . . .

Y.M. Qian , , , J. Liu . . Cross-Lingualand Ensemble MLPs Strategies for Low-Resource Speech Recognition . . Proc. Interspeech , , 2012b . . p.2582 - - 2585 . . . .

Y.M. Qian , , , D. Povey , , , J. Liu . . State-Level Data Borrowing for Low-Resource Speech Recognition Based on Subspace GMMs . . Proc. Interspeech , , 2011 . . p.553 - - 560 . . . .

Y.M. Qian , , , J. Xu , , , J. Liu . . Multi-stream posterior features and combining subspace GMMs for low resource LVCSR . . Chin. J. Electron. , , 2013 . . 22 ( ( 2 ): ): 291 - - 295 . . . .

H.B. Richards , , , J.S. Mason , , , M. Hunt , , , J. Bridle . . Deriving Articulatory Representations of Speech with Various Excitation Modes . . Proc. 4th Int. Conf. on Spoken Language , , 1996 . . p.1233 - - 1236 . . DOI: 10.1109/ICSLP.1996.607831 http://doi.org/10.1109/ICSLP.1996.607831 . .

H.B. Richards , , , J. Bridle , , , M. Hunt , , , J.S. Mason . . Vocal Tract Shape Trajectory Estimation Using MLP Analysis-by-Synthesis . . Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , , 1997 . . p.1287 - - 1290 . . DOI: 10.1109/ICASSP.1997.596181 http://doi.org/10.1109/ICASSP.1997.596181 . .

A. Sangwan , , , J.H.L. Hansen . . Automatic analysis of Mandarin accented English using phonological features . . Speech Commun. , , 2012 . . 54 ( ( 1 ): ): 40 - - 54 . . DOI: 10.1016/j.specom.2011.06.003 http://doi.org/10.1016/j.specom.2011.06.003 . .

A. Sangwan , , , M. Mehrabani , , , J.H.L. Hansen . . Automatic Language Analysis and Identification Based on Speech Production Knowledge . . Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , , 2010 . . p.5006 - - 5010 . . DOI: 10.1109/ICASSP.2010.5495066 http://doi.org/10.1109/ICASSP.2010.5495066 . .

J. Schroeter , , , M.M. Sondhi . . Techniques for estimating vocal-tract shapes from the speech signal . . IEEE Trans. Speech Audio Process. , , 1994 . . 2 ( ( 1 ): ): 133 - - 150 . . DOI: 10.1109/89.260356 http://doi.org/10.1109/89.260356 . .

P. Schwarz , , , P. Matejka , , , J. Cernocky . . Hierarchical Structure of Neural Networks for Phoneme Recognition . . Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , , 2006 . . p.325 - - 328 . . DOI: 10.1109/ICASSP.2006.1660023 http://doi.org/10.1109/ICASSP.2006.1660023 . .

S.M. Siniscalchi , , , T. Svendsen , , , C.H. Lee . . Toward a Detector-Based Universal Phone Recognizer . . Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing , , 2008 . . p.4261 - - 4264 . . DOI: 10.1109/ICASSP.2008.4518596 http://doi.org/10.1109/ICASSP.2008.4518596 . .

A.M.C. Sluijter , , , V.J. van Heuven . . Acoustic Correlates of Linguistic Stress and Accent in Dutch and American English . . Proc. 4th Int. Conf. on Spoken Language , , 1996 . . p.630 - - 633 . . DOI: 10.1109/ICSLP.1996.607440 http://doi.org/10.1109/ICSLP.1996.607440 . .

X.J. Sun . . Pitch Accent Prediction Using Ensemble Machine Learning . . Proc. ICSLP , , 2002 . . p.953 - - 956 . . . .

P. Taylor . . The rise/fall/connection model of intonation . . Speech Commun. , , 1994 . . 15 ( ( 1-2 ): ): 169 - - 186 . . DOI: 10.1016/0167-6393(94)90050-7 http://doi.org/10.1016/0167-6393(94)90050-7 . .

P. Taylor . . The Tilt Intonation Model . . Proc. ICSLP , , 1998 . . p.1383 - - 1386 . . . .

I.H. Witten , , , E. Frank . . Data Mining: Practical Machine Learning Tools and Techniques . . Morgan Kaufmann, Burlington, Massachusetts , , 2005 . . .

J. Zhao , , , H. Yuan , , , J. Liu , , , S. Xia . . Automatic Lexical Stress Detection Using Acoustic Features for Computer Assisted Language Learning . . Proc. APSIPA ASC , , 2011 . . p.247 - - 251 . . . .

浏览量

Downloads

CSCD

文章被引用时，请邮件提醒。

Submit

工具集

关联资源

暂无数据