Exploring the Benefits of Depth Information in Object Pixel Masking (Student Abstract)

Authors

  • Anish Kachinthaya University of California, Santa Barbara
  • Yi Ding University of California, Santa Barbara
  • Tobias Hollerer University of California, Santa Barbara

DOI:

https://doi.org/10.1609/aaai.v34i10.7189

Abstract

In this paper, we look at how depth data can benefit existing object masking methods applied in occluded scenes. Masking the pixel locations of objects within scenes helps computers get a spatial awareness of where objects are within images. The current state-of-the-art algorithm for masking objects in images is Mask R-CNN, which builds on the Faster R-CNN network to mask object pixels rather than just detecting their bounding boxes. This paper examines the weaknesses Mask R-CNN has in masking people when they are occluded in a frame. It then looks at how depth data gathered from an RGB-D sensor can be used. We provide a case study to show how simply applying thresholding methods on the depth information can aid in distinguishing occluded persons. The intention of our research is to examine how features from depth data can benefit object pixel masking methods in an explainable manner, especially in complex scenes with multiple objects.

Downloads

Published

2020-04-03

How to Cite

Kachinthaya, A., Ding, Y., & Hollerer, T. (2020). Exploring the Benefits of Depth Information in Object Pixel Masking (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 34(10), 13833-13834. https://doi.org/10.1609/aaai.v34i10.7189

Issue

Section

Student Abstract Track