Publication Details

Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results

MALANDRAKIS Nikolaos, GLEMBEK Ondřej and NARAYANAN Shrikanth. Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results. In: Proceedings of Interspeech 2017. Stockholm: International Speech Communication Association, 2017, pp. 2123-2127. ISSN 1990-9772. Available from: https://www.semanticscholar.org/paper/Extracting-Situation-Frames-from-Non-English-and-Malandrakis-Glembek/047ebaf46d648fea9e5c2c64873c629f7fd53a00
Czech title
Extrakce situačních rámců z ne-anglické řeči: evaluační metodika a pilotní výsledky
Type
conference paper
Language
english
Authors
Malandrakis Nikolaos (USC)
Glembek Ondřej, Ing., Ph.D. (DCGM FIT BUT)
Narayanan Shrikanth (USC)
URL
Keywords

speech recognition, speech analysis, performance evaluation, natural language processing

Abstract

This paper describes the first evaluation framework for the extraction of Situation Frames - structures describing humanitarian assistance needs - from non-English speech audio, conducted for the DARPA LORELEI (Low Resource Languages for Emergent Incidents) program. Participants in LORELEI had to process audio from a variety of sources, in non-English languages, and extract the information required to populate Situation Frames describing whether any need is mentioned, the type of need present and where the need exists. The evaluation was conducted over a period of 10 days and attracted submissions from 6 teams, each team spanning multiple organizations. Performance was evaluated using precision-recall curves. The results are encouraging, with most teams showing some capability to detect the type of situation discussed, but more work will be required to connect needs to specific locations.

Published
2017
Pages
2123-2127
Journal
Proceedings of Interspeech - on-line, vol. 2017, no. 8, ISSN 1990-9772
Proceedings
Proceedings of Interspeech 2017
Conference
Interspeech Conference, Stockholm, SE
Publisher
International Speech Communication Association
Place
Stockholm, SE
DOI
10.21437/Interspeech.2017-226
UT WoS
000457505000444
EID Scopus
2-s2.0-85039170544
BibTeX 
@INPROCEEDINGS{FITPUB12238,
   author = "Nikolaos Malandrakis and Ond\v{r}ej Glembek and Shrikanth Narayanan",
   title = "Extracting Situation Frames from non-English Speech: Evaluation Framework and Pilot Results",
   pages = "2123--2127",
   booktitle = "Proceedings of Interspeech 2017",
   journal = "Proceedings of Interspeech - on-line",
   volume = 2017,
   number = 8,
   year = 2017,
   location = "Stockholm, SE",
   publisher = "International Speech Communication Association",
   ISSN = "1990-9772",
   doi = "10.21437/Interspeech.2017-226",
   language = "english",
   url = "https://www.fit.vut.cz/research/publication/12238"
}
Back to top