Publication Details

Comparison of methods for language-dependent and language-independent query-by-example spoken term detection

TEJEDOR Javier, FAPŠO Michal, SZŐKE Igor, ČERNOCKÝ Jan and GRÉZL František. Comparison of methods for language-dependent and language-independent query-by-example spoken term detection. ACM Transactions on Information Systems (TOIS), vol. 2012, no. 30, pp. 1-34. ISSN 1046-8188. Available from: http://dl.acm.org/citation.cfm?id=2328971&CFID=187707319&CFTOKEN=67886685
Czech title
Porovnání metod pro jazykově závislou a nezávislou detekci klíčových slov zadaných vzorem
Type
journal article
Language
english
Authors
Tejedor Javier (UAM)
Fapšo Michal, Ing. (DCGM FIT BUT)
Szőke Igor, Ing., Ph.D. (DCGM FIT BUT)
Černocký Jan, prof. Dr. Ing. (DCGM FIT BUT)
Grézl František, Ing., Ph.D. (DCGM FIT BUT)
URL
Keywords

Experimentation, Query-by-example, DTW-based query-by-example, GMM/HMM-based query-by-example, WFST-based query-by-example, bottleneck features, keyword spotting

Abstract

This article investigates query-by-example (QbE) spoken term detection (STD), in which the query is not entered as text, but selected in speech data or spoken. Two feature extractors based on neural networks (NN) are introduced: the first producing phone-state posteriors and the second making use of a compressive NN layer. They are combined with three different QbE detectors: while the Gaussian mixture model/hidden Markov model (GMM/HMM) and dynamic time warping (DTW) both work on continuous feature vectors, the third one, based on weighted finite-state transducers (WFST), processes phone lattices.

Annotation

This article investigates query-by-example (QbE) spoken term detection (STD), in which the query is not entered as text, but selected in speech data or spoken. Two feature extractors based on neural networks (NN) are introduced: the first producing phone-state posteriors and the second making use of a compressive NN layer. They are combined with three different QbE detectors: while the Gaussian mixture model/hidden Markov model (GMM/HMM) and dynamic time warping (DTW) both work on continuous feature vectors, the third one, based on weighted finite-state transducers (WFST), processes phone lattices. QbE STD is compared to two standard STD systems with text queries: acoustic keyword spotting and WFST-based search of phone strings in phone lattices. The results are reported on four languages (Czech, English, Hungarian, and Levantine Arabic) using standard metrics: equal error rate (EER) and two versions of popular figureof- merit (FOM). Language-dependent and language-independent cases are investigated; the latter being particularly interesting for scenarios lacking standard resources to train speech recognition systems. While the DTW and GMM/HMM approaches produce the best results for a language-dependent setup depending on the target language, the GMM/HMM approach performs the best dealing with a language-independent setup. As far as WFSTs are concerned, they are promising as they allow for indexing and fast search.

Published
2012
Pages
1-34
Journal
ACM Transactions on Information Systems (TOIS), vol. 2012, no. 30, ISSN 1046-8188
Book
ACM Transactions on Information Systems (TOIS)
Publisher
Association for Computing Machinery
Place
New York, US
DOI
BibTeX
@ARTICLE{FITPUB10179,
   author = "Javier Tejedor and Michal Fap\v{s}o and Igor Sz\H{o}ke and Jan \v{C}ernock\'{y} and Franti\v{s}ek Gr\'{e}zl",
   title = "Comparison of methods for language-dependent and language-independent query-by-example spoken term detection",
   pages = "1--34",
   booktitle = "ACM Transactions on Information Systems (TOIS)",
   journal = "ACM Transactions on Information Systems (TOIS)",
   volume = 2012,
   number = 30,
   year = 2012,
   location = "New York, US",
   publisher = "Association for Computing Machinery",
   ISSN = "1046-8188",
   doi = "10.1145/2328967.2328971",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/10179"
}
Back to top