Please use this identifier to cite or link to this item: http://ktisis.cut.ac.cy/handle/10488/10037
Title: Asymmetric deep generative models
Authors: Partaourides, Harris 
Chatzis, Sotirios P. 
Keywords: Deep generative model;Restricted multivariate skew-Normal distribution;Semi-supervised learning;Variational inference
Category: Electrical Engineering - Electronic Engineering - Information Engineering
Field: Engineering and Technology
Issue Date: 7-Jun-2017
Publisher: Elsevier B.V.
Source: Neurocomputing, 2017, Volume 241, Pages 90-96
metadata.dc.doi: http://dx.doi.org/10.1016/j.neucom.2017.02.028
Abstract: Amortized variational inference, whereby the inferred latent variable posterior distributions are parameterized by means of neural network functions, has invigorated a new wave of innovation in the field of generative latent variable modeling, giving rise to the family of deep generative models (DGMs). Existing DGM formulations are based on the assumption of a symmetric Gaussian posterior over the model latent variables. This assumption, although mathematically convenient, can be well-expected to undermine the eventually obtained representation power, as it imposes apparent expressiveness limitations. Indeed, it has been recently shown that even some moderate increase in the latent variable posterior expressiveness, obtained by introducing an additional level of dependencies upon auxiliary (Gaussian) latent variables, can result in significant performance improvements in the context of semi-supervised learning tasks. Inspired from these advances, in this paper we examine whether a more potent increase in the expressiveness and representation power of modern DGMs can be achieved by completely relaxing their typical symmetric (Gaussian) latent variable posterior assumptions: Specifically, we consider DGMs with asymmetric posteriors, formulated as restricted multivariate skew-Normal (rMSN) distributions. We derive an efficient amortized variational inference algorithm for the proposed model, and exhibit its superiority over the current state-of-the-art in several semi-supervised learning benchmarks.
URI: http://ktisis.cut.ac.cy/handle/10488/10037
ISSN: 09252312
Rights: © 2017 Elsevier B.V.
Type: Article
Appears in Collections:Άρθρα/Articles

Show full item record

Page view(s) 50

37
Last Week
1
Last month
6
checked on Nov 22, 2017

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.