Publication Details
On the Usage of Phonetic Information for Text-independent Speaker Embedding Extraction
Rohdin Johan A., Dr. (DCGM FIT BUT)
Burget Lukáš, doc. Ing., Ph.D. (DCGM FIT BUT)
Plchot Oldřich, Ing., Ph.D. (DCGM FIT BUT)
Qian Yanmin (SJTU)
Yu Kai (SJTU)
Černocký Jan, prof. Dr. Ing. (DCGM FIT BUT)
phonetic information, text-independent speaker verification, adversarial training
Embeddings extracted by deep neural networks have become the state-of-the-art utterance representation in speaker recognition systems. It has recently been shown that incorporating frame-level phonetic information in the embedding extractor can improve the speaker recognition performance. On the other hand, in the final embedding, phonetic information is just an additional source of session variability which may be harmful to the text-independent speaker recognition task. This suggests that at the embedding level phonetic information should be suppressed rather than encouraged. To verify this hypothesis, we perform several experiments that encourage or/and suppress phonetic information at various stages in the network. Our experiments confirm that multitask learning is beneficial if it is applied at the frame-level stage of the network, whereas adversarial training is beneficial if it is used at the segment-level stage of the network. Additionally, the combination of these two approaches improves the performance further, resulting in an equal error rate of 3.17% on the VoxCeleb dataset.
@INPROCEEDINGS{FITPUB12087, author = "Shuai Wang and A. Johan Rohdin and Luk\'{a}\v{s} Burget and Old\v{r}ich Plchot and Yanmin Qian and Kai Yu and Jan \v{C}ernock\'{y}", title = "On the Usage of Phonetic Information for Text-independent Speaker Embedding Extraction", pages = "1148--1152", booktitle = "Proceedings of Interspeech", journal = "Proceedings of Interspeech - on-line", volume = 2019, number = 9, year = 2019, location = "Graz, AT", publisher = "International Speech Communication Association", ISSN = "1990-9772", doi = "10.21437/Interspeech.2019-3036", language = "english", url = "https://www.fit.vut.cz/research/publication/12087" }