Please use this identifier to cite or link to this item:
|Title:||Theoretical analysis of diversity in an ensemble of automatic speech recognition systems||Authors:||Audhkhasi, Kartik
Zavou, Andreas M.
Georgiou, Panayiotis G.
Narayanan, Shrikanth S.
|Keywords:||Ambiguity decomposition;Automatic speech recognition;Discriminative training;Diversity;Ensemble methods;ROVER;System combination||Category:||Electrical Engineering - Electronic Engineering - Information Engineering||Field:||Engineering and Technology||Issue Date:||1-Mar-2014||Publisher:||Institute of Electrical and Electronics Engineers Inc.||Source:||IEEE Transactions on Audio, Speech and Language Processing, 2014, Volume 22, Issue 3, Pages 711-726||metadata.dc.doi:||10.1109/TASLP.2014.2303295||Abstract:||Diversity or complementarity of automatic speech recognition (ASR) systems is crucial for achieving a reduction in word error rate (WER) upon fusion using the ROVER algorithm. We present a theoretical proof explaining this often-observed link between ASR system diversity and ROVER performance. This is in contrast to many previous works that have only presented empirical evidence for this link or have focused on designing diverse ASR systems using intuitive algorithmic modifications. We prove that the WER of the ROVER output approximately decomposes into a difference of the average WER of the individual ASR systems and the average WER of the ASR systems with respect to the ROVER output. We refer to the latter quantity as the diversity of the ASR system ensemble because it measures the spread of the ASR hypotheses about the ROVER hypothesis. This result explains the trade-off between the WER of the individual systems and the diversity of the ensemble. We support this result through ROVER experiments using multiple ASR systems trained on standard data sets with the Kaldi toolkit. We use the proposed theorem to explain the lower WERs obtained by ASR confidence-weighted ROVER as compared to word frequency-based ROVER. We also quantify the reduction in ROVER WER with increasing diversity of the N-best list. We finally present a simple discriminative framework for jointly training multiple diverse acoustic models (AMs) based on the proposed theorem. Our framework generalizes and provides a theoretical basis for some recent intuitive modifications to well-known discriminative training criterion for training diverse AMs.||URI:||http://ktisis.cut.ac.cy/handle/10488/9622||ISSN:||15587916||Rights:||© 2014 IEEE.||Type:||Article|
|Appears in Collections:||Άρθρα/Articles|
Show full item record
Page view(s) 5031
checked on Nov 24, 2017
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.