Please use this identifier to cite or link to this item: http://ktisis.cut.ac.cy/handle/10488/8584
Title: Maximum-Margin Classification of Sequential Data with Infinitely-Long Temporal Dependencies
Authors: Chatzis, Sotirios P. 
Keywords: Sequential data modeling;Sequence memoizer;Mean-field principle;Margin maximization
Category: Electrical Engineering - Electronic Engineering - Information Engineering
Field: Engineering and Technology
Issue Date: 2013
Publisher: Elsevier Science Limited
Source: Expert systems with applications, 2013, Volume 40, Issue 11, pages 4519–4527
Abstract: Generative models for sequential data are usually based on the assumption of temporal dependencies described by a first-order Markov chain. To ameliorate this shallow modeling assumption, several authors have proposed models with higher-order dependencies. However, the practical applicability of these approaches is hindered by their prohibitive computational costs in most cases. In addition, most existing approaches give rise to model training algorithms with objective functions that entail multiple spurious local optima, thus requiring application of tedious countermeasures to avoid getting trapped to bad model estimates. In this paper, we devise a novel margin-maximizing model with convex objective func- tion that allows for capturing infinitely-long temporal dependencies in sequential datasets. This is effected by utilizing a recently proposed nonparametric Bayesian model of label sequences with infinitely-long temporal dependencies, namely the sequence memoizer, and training our model using mar- gin maximization and a versatile mean-field-like approximation to allow for increased computational efficiency. As we experimentally demonstrate, the devised margin-maximizing construction of our model, which leads to a convex optimization scheme, without any spurious local optima, combined with the capacity of our model to capture long and complex temporal dependencies, allow for obtaining exceptional pattern recognition performance in several applications.
URI: http://ktisis.cut.ac.cy/handle/10488/8584
ISSN: 0957-4174
1873-6793 (online)
DOI: http://dx.doi.org/10.1016/j.eswa.2013.01.051
Rights: Elsevier Ltd. All rights reserved.
Type: Article
Appears in Collections:Άρθρα/Articles

Show full item record

SCOPUSTM   
Citations 50

4
checked on Nov 16, 2017

WEB OF SCIENCETM
Citations 20

4
checked on Oct 17, 2017

Page view(s)

22
Last Week
1
Last month
2
checked on Nov 22, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.