Deterministic Annealing (DA) approach to Speech Recognizer Design
Signal Compression Laboratory Research Project
| Researchers: | Liang Gu, Jayanth Nayak |
| Faculty: | Prof. Kenneth Rose |
| Research Focus: | The deterministic annealing (DA) algorithm is applied to design classifiers based on SCHMM. The algorithm belongs to the class of minimum classification error (MCE) techniques that are known to outperform maximum likelihood (ML) design. Most MCE methods smooth the piecewise constant classification error cost to facilitate the use of local descent optimization methods, but are susceptible to the numerous shallow local minimum traps that riddle the cost surface. The DA approach employs randomization of the classification rule followed by minimization of the corresponding expected misclassification rate, while controlling the level of randomness via a constraint on the Shannon entropy. The effective cost function is smooth and converges to the MCE cost at the limit of zero entropy. The proposed algorithm is supposed to outperform both standard ML and standard MCE design methods on the E-set database. |
| Presentation | Disriminative Training of Tied-Mixture Hidden Markov Models using Deterministic Annealing |