All You Need Is Boundary: Toward Arbitrary-Shaped Text Spotting

  • Hao Wang Huazhong University of Science and Technology
  • Pu Lu Huazhong University of Science and Technology
  • Hui Zhang Huazhong University of Science and Technology
  • Mingkun Yang Huazhong University of Science and Technology
  • Xiang Bai Huazhong University of Science and Technology
  • Yongchao Xu Huazhong University of Science and Technology
  • Mengchao He Alibaba Group
  • Yongpan Wang Alibaba Group
  • Wenyu Liu Huazhong University of Science and Technology

Abstract

Recently, end-to-end text spotting that aims to detect and recognize text from cluttered images simultaneously has received particularly growing interest in computer vision. Different from the existing approaches that formulate text detection as bounding box extraction or instance segmentation, we localize a set of points on the boundary of each text instance. With the representation of such boundary points, we establish a simple yet effective scheme for end-to-end text spotting, which can read the text of arbitrary shapes. Experiments on three challenging datasets, including ICDAR2015, TotalText and COCO-Text demonstrate that the proposed method consistently surpasses the state-of-the-art in both scene text detection and end-to-end text recognition tasks.

Published
2020-04-03
Section
AAAI Technical Track: Vision