RT Journal Article
T1 ALBAYZIN 2016 spoken term detection evaluation: an international open competitive evaluation in Spanish
A1 Tejedor Noguerales, Javier
A1 Toledano, Doroteo T
A1 López Otero, Paula
A1 Docío Fernández, Laura
A1 Serrano, Luis
A1 Hernáez, Inma
A1 Coucheiro Limeres, Alejandro
A1 Ferreirós, Javier
A1 Olcoz, Julia
A1 Llombart, Jorge
K1 1203.04 Inteligencia Artificial
K1 2405 Biometría
K1 5701.09 Traducción Automática
AB Within search-on-speech, Spoken Term Detection (STD) aims to retrieve data from a speech repository given a textual representation of a search term. This paper presents an international open evaluation for search-on-speech based on STD in Spanish and an analysis of the results. The evaluation has been designed carefully so that several analyses of the main results can be carried out. The evaluation consists in retrieving the speech files that contain the search terms, providing their start and end times, and a score value that reflects the confidence given to the detection. Two different Spanish speech databases have been employed in the evaluation: MAVIR database, which comprises a set of talks from workshops, and EPIC database, which comprises a set of European Parliament sessions in Spanish. We present the evaluation itself, both databases, the evaluation metric, the systems submitted to the evaluation, the results, and a detailed discussion. Five different research groups took part in the evaluation, and ten different systems were submitted in total. We compare the systems submitted to the evaluation and make a deep analysis based on some search term properties (term length, within-vocabulary/out-of-vocabulary terms, single-word/multi-word terms, and native (Spanish)/foreign terms)
PB EURASIP Journal on Audio Speech and Music Processing
SN 16874722
YR 2017
FD 2017-09-29
LK http://hdl.handle.net/11093/3230
UL http://hdl.handle.net/11093/3230
LA eng
NO EURASIP Journal on Audio Speech and Music Processing, 2017, 22 (2017)
NO Xunta de Galicia | Ref. ED431G/01
DS Investigo
RD 14-sep-2024