Please use this identifier to cite or link to this item:
|Title:||Asymmetric deep generative models||Authors:||Partaourides, Harris
Chatzis, Sotirios P.
|Keywords:||Deep generative model;Restricted multivariate skew-Normal distribution;Semi-supervised learning;Variational inference||Category:||Electrical Engineering - Electronic Engineering - Information Engineering||Field:||Engineering and Technology||Issue Date:||7-Jun-2017||Publisher:||Elsevier B.V.||Source:||Neurocomputing, 2017, Volume 241, Pages 90-96||metadata.dc.doi:||http://dx.doi.org/10.1016/j.neucom.2017.02.028||Abstract:||Amortized variational inference, whereby the inferred latent variable posterior distributions are parameterized by means of neural network functions, has invigorated a new wave of innovation in the field of generative latent variable modeling, giving rise to the family of deep generative models (DGMs). Existing DGM formulations are based on the assumption of a symmetric Gaussian posterior over the model latent variables. This assumption, although mathematically convenient, can be well-expected to undermine the eventually obtained representation power, as it imposes apparent expressiveness limitations. Indeed, it has been recently shown that even some moderate increase in the latent variable posterior expressiveness, obtained by introducing an additional level of dependencies upon auxiliary (Gaussian) latent variables, can result in significant performance improvements in the context of semi-supervised learning tasks. Inspired from these advances, in this paper we examine whether a more potent increase in the expressiveness and representation power of modern DGMs can be achieved by completely relaxing their typical symmetric (Gaussian) latent variable posterior assumptions: Specifically, we consider DGMs with asymmetric posteriors, formulated as restricted multivariate skew-Normal (rMSN) distributions. We derive an efficient amortized variational inference algorithm for the proposed model, and exhibit its superiority over the current state-of-the-art in several semi-supervised learning benchmarks.||URI:||http://ktisis.cut.ac.cy/handle/10488/10037||ISSN:||09252312||Rights:||© 2017 Elsevier B.V.||Type:||Article|
|Appears in Collections:||Άρθρα/Articles|
Show full item record
Page view(s) 5063
checked on Dec 16, 2018
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.