Publication Details
Comparison of methods for language-dependent and language-independent query-by-example spoken term detection
Fapšo Michal, Ing. (DCGM FIT BUT)
Szőke Igor, Ing., Ph.D. (DCGM FIT BUT)
Černocký Jan, prof. Dr. Ing. (DCGM FIT BUT)
Grézl František, Ing., Ph.D. (DCGM FIT BUT)
- http://dl.acm.org/citation.cfm?id=2328971&CFID=187707319&CFTOKEN=67886685
- http://www.fit.vutbr.cz/research/groups/speech/publi/2012/tejedor_ACM_TOIS_2012_journal_a18-tejedor.pdf PDF
- http://delivery.acm.org/10.1145/2330000/2328971/a18-tejedor.pdf?ip=147.229.14.237&acc=ACTIVE%20SERVICE&CFID=187707319&CFTOKEN=67886685&__acm__=1351519701_709658fb38d893d2359ca49d4537939f PDF
Experimentation, Query-by-example, DTW-based query-by-example, GMM/HMM-based query-by-example, WFST-based query-by-example, bottleneck features, keyword spotting
This article investigates query-by-example (QbE) spoken term detection (STD), in which the query is not entered as text, but selected in speech data or spoken. Two feature extractors based on neural networks (NN) are introduced: the first producing phone-state posteriors and the second making use of a compressive NN layer. They are combined with three different QbE detectors: while the Gaussian mixture model/hidden Markov model (GMM/HMM) and dynamic time warping (DTW) both work on continuous feature vectors, the third one, based on weighted finite-state transducers (WFST), processes phone lattices.
This article investigates query-by-example (QbE) spoken term detection (STD), in which the query is not entered as text, but selected in speech data or spoken. Two feature extractors based on neural networks (NN) are introduced: the first producing phone-state posteriors and the second making use of a compressive NN layer. They are combined with three different QbE detectors: while the Gaussian mixture model/hidden Markov model (GMM/HMM) and dynamic time warping (DTW) both work on continuous feature vectors, the third one, based on weighted finite-state transducers (WFST), processes phone lattices. QbE STD is compared to two standard STD systems with text queries: acoustic keyword spotting and WFST-based search of phone strings in phone lattices. The results are reported on four languages (Czech, English, Hungarian, and Levantine Arabic) using standard metrics: equal error rate (EER) and two versions of popular figureof- merit (FOM). Language-dependent and language-independent cases are investigated; the latter being particularly interesting for scenarios lacking standard resources to train speech recognition systems. While the DTW and GMM/HMM approaches produce the best results for a language-dependent setup depending on the target language, the GMM/HMM approach performs the best dealing with a language-independent setup. As far as WFSTs are concerned, they are promising as they allow for indexing and fast search.
@ARTICLE{FITPUB10179, author = "Javier Tejedor and Michal Fap\v{s}o and Igor Sz\H{o}ke and Jan \v{C}ernock\'{y} and Franti\v{s}ek Gr\'{e}zl", title = "Comparison of methods for language-dependent and language-independent query-by-example spoken term detection", pages = "1--34", booktitle = "ACM Transactions on Information Systems (TOIS)", journal = "ACM Transactions on Information Systems (TOIS)", volume = 2012, number = 30, year = 2012, location = "New York, US", publisher = "Association for Computing Machinery", ISSN = "1046-8188", doi = "10.1145/2328967.2328971", language = "english", url = "https://www.fit.vut.cz/research/publication/10179" }