Efficient Verification of ReLU-Based Neural Networks via Dependency Analysis

  • Elena Botoeva Imperial College London
  • Panagiotis Kouvaros Imperial College London
  • Jan Kronqvist Imperial College London
  • Alessio Lomuscio Imperial College London
  • Ruth Misener Imperial College London

Abstract

We introduce an efficient method for the verification of ReLU-based feed-forward neural networks. We derive an automated procedure that exploits dependency relations between the ReLU nodes, thereby pruning the search tree that needs to be considered by MILP-based formulations of the verification problem. We augment the resulting algorithm with methods for input domain splitting and symbolic interval propagation. We present Venus, the resulting verification toolkit, and evaluate it on the ACAS collision avoidance networks and models trained on the MNIST and CIFAR-10 datasets. The experimental results obtained indicate considerable gains over the present state-of-the-art tools.

Published
2020-04-03
Section
AAAI Technical Track: Machine Learning