Are you an EPFL student looking for a semester project?
Work with us on data science and visualisation projects, and deploy your project as an app on top of Graph Search.
In this paper, we propose a platform based on phonological speech vocoding for examining relations between phonology and speech processing, and in broader terms, between the abstract and physical structures of speech signal. The goal of this paper is to go a step further towards bridging both fields and contributing to the program of Laboratory Phonology. We show two application examples for the laboratory phonology: a comparison of the phonological systems and an experimental phonological parametric text-to-speech (TTS) system. The following three phonological systems are considered in this work: (i) Government Phonology (GP) features, (ii) the Sound Pattern of English (SPE) features, and (iii) the extended SPE (eSPE) features. Comparing GP- and eSPE-based vocoded speech, we con- clude that eSPE achieves slightly better results than the other two systems. However, GP – the most compact phonological speech representation – performs comparably to the systems with higher number of phonological classes. The parametric TTS based on phonological speech representation, and trained from an unlabelled audio book in an unsupervised manner, achieves promising results. We envision that the presented approach paves the way for researchers in both fields to form mean- ingful hypotheses that are explicitly testable using the concepts developed and exemplified in this paper. Laboratory phonologists might test the applied concepts of their theoretical models and speech pro- cessing community may be suggesting tests for the potential of advancing the performance of current state-of-the-art applications using the concepts developed for the theoretical phonological models.
Mathew Magimai Doss, Zohreh Mostaani