H2RBox (ICLR 2023)

H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detection

Abstract

Oriented object detection emerges in many applications from aerial images to autonomous driving, while many existing detection benchmarks are annotated with horizontal bounding box only which is also less costive than fine-grained rotated box, leading to a gap between the readily available training corpus and the rising demand for oriented object detection. This paper proposes a simple yet effective oriented object detection approach called H2RBox merely using horizontal box annotation for weakly-supervised training, which closes the above gap and shows competitive performance even against those trained with rotated boxes. The cores of our method are weakly- and self-supervised learning, which predicts the angle of the object by learning the consistency of two different views. To our best knowledge, H2RBox is the first horizontal box annotation-based oriented object detector. Compared to an alternative i.e. horizontal box-supervised instance segmentation with our post adaption to oriented object detection, our approach is not susceptible to the prediction quality of mask and can perform more robustly in complex scenes containing a large number of dense objects and outliers. Experimental results show that H2RBox has significant performance and speed advantages over horizontal box-supervised instance segmentation methods, as well as lower memory requirements. While compared to rotated box-supervised oriented object detectors, our method shows very close performance and speed, and even surpasses them in some cases.

Results and models

DOTA1.0

| Backbone | mAP | Angle | lr schd | Mem (GB) | Inf Time (fps) | MS | Batch Size | Configs | Download | |:------------------------:|:-----:|:-----:|:-------:|:--------:|:--------------:|:---:|:----------:|:-----------------------------------------------------------------------------------------------------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| | ResNet50 (1024,1024,200) | 67.24 | le135 | 1x | 5.50 | 25.7 | - | 2 | h2rboxatssr50adamwfpn1xdota_le135 | - | | ResNet50 (1024,1024,200) | 67.45 | le90 | 1x | 7.02 | 28.5 | - | 2 | h2rboxr50adamwfpn1xdotale90 | model | log | | ResNet50 (1024,1024,200) | 70.77 | le90 | 3x | 7.02 | 28.5 | - | 2 | h2rboxr50adamwfpn3xdotale90 | model | log | | ResNet50 (1024,1024,200) | 74.53 | le90 | 1x | 8.58 | - | √ | 2 | h2rboxr50adamwfpn1xdotams_le90 | model | log |

DOTA1.5

| Backbone | mAP | Angle | lr schd | Mem (GB) | Inf Time (fps) | MS | Batch Size | Configs | Download | |:------------------------:|:-----:|:-----:|:-------:|:--------:|:--------------:|:---:|:----------:|:-------------------------------------------------------------------------------------------------:|:--------:| | ResNet50 (1024,1024,200) | 59.02 | le135 | 1x | 6.29 | 24.8 | - | 2 | h2rboxatssr50adamwfpn1xdotav15_le135 | - | | ResNet50 (1024,1024,200) | 60.19 | le90 | 1x | 10.68 | 25.8 | - | 2 | h2rboxr50adamwfpn1xdotav15le90 | - | | ResNet50 (1024,1024,200) | 62.60 | le90 | 1x | 10.68 | 25.8 | - | 2 | h2rboxr50adamwfpn3xdotav15le90 | - |

DOTA2.0

| Backbone | mAP | Angle | lr schd | Mem (GB) | Inf Time (fps) | MS | Batch Size | Configs | Download | |:------------------------:|:-----:|:-----:|:-------:|:--------:|:--------------:|:---:|:----------:|:----------------------------------------------------------------------------------------------:|:--------:| | ResNet50 (1024,1024,200) | 45.35 | le135 | 1x | 6.43 | 24.7 | - | 2 | h2rboxatssr50adamwfpn1xdotav2_le135 | - | | ResNet50 (1024,1024,200) | 45.87 | le90 | 1x | 11.57 | 25.0 | - | 2 | h2rboxr50adamwfpn1xdotav2le90 | - | | ResNet50 (1024,1024,200) | 47.86 | le90 | 1x | 11.57 | 25.0 | - | 2 | h2rboxr50adamwfpn3xdotav2le90 | - |

Notes:

• MS means multiple scale image split.
• Inf time was tested on a single RTX3090.
• MMRotate 1.x Implementation for H2RBox
• Jittor Implementation for H2RBox
• JDet Implementation for H2RBox

Get Started

Please refer to the official guide of MMRotate 0.x or here.

Citation

``` @inproceedings{yang2023h2rbox, title={H2RBox: Horizontal Box Annotation is All You Need for Oriented Object Detection}, author={Yang, Xue and Zhang, Gefan and Li, Wentong and Wang, Xuehui and Zhou, Yue and Yan, Junchi}, booktitle={International Conference on Learning Representations}, year={2023} }

```