Deep Convolutional Sum-Product Networks

Authors

  • Cory J. Butz University of Regina
  • Jhonatan S. Oliveira University of Regina
  • André E. dos Santos University of Regina
  • André L. Teixeira University of Regina

DOI:

https://doi.org/10.1609/aaai.v33i01.33013248

Abstract

We give conditions under which convolutional neural networks (CNNs) define valid sum-product networks (SPNs). One subclass, called convolutional SPNs (CSPNs), can be implemented using tensors, but also can suffer from being too shallow. Fortunately, tensors can be augmented while maintaining valid SPNs. This yields a larger subclass of CNNs, which we call deep convolutional SPNs (DCSPNs), where the convolutional and sum-pooling layers form rich directed acyclic graph structures. One salient feature of DCSPNs is that they are a rigorous probabilistic model. As such, they can exploit multiple kinds of probabilistic reasoning, including marginal inference and most probable explanation (MPE) inference. This allows an alternative method for learning DCSPNs using vectorized differentiable MPE, which plays a similar role to the generator in generative adversarial networks (GANs). Image sampling is yet another application demonstrating the robustness of DCSPNs. Our preliminary results on image sampling are encouraging, since the DCSPN sampled images exhibit variability. Experiments on image completion show that DCSPNs significantly outperform competing methods by achieving several state-of-the-art mean squared error (MSE) scores in both left-completion and bottom-completion in benchmark datasets.

Downloads

Published

2019-07-17

How to Cite

Butz, C. J., Oliveira, J. S., dos Santos, A. E., & Teixeira, A. L. (2019). Deep Convolutional Sum-Product Networks. Proceedings of the AAAI Conference on Artificial Intelligence, 33(01), 3248-3255. https://doi.org/10.1609/aaai.v33i01.33013248

Issue

Section

AAAI Technical Track: Machine Learning