DOTA: A Large-scale Dataset for Object Detection in Aerial Images

Gui-Song Xia, Xiang Bai, Jian Ding, Zhen Zhu, Serge Belongie,
Jiebo Luo, Mihai Datcu, Marcello Pelillo, Liangpei Zhang.

Overview

We propose two detection tasks. Task1 uses the initial annotation as ground truth. Task2 uses the generated axis-aligned bounding boxes as ground truth. The results from task2 are of great practical value. We recommond you to test your algorithms by way of Task1.

Task1 - Detection with oriented bounding boxes (Recommended)

The aim of this task is to locate the ground object instances with an oriented bounding box. The oriented bounding box follows the same format with the original annotation

Submission Format

You will be asked to submit a zip file containing results for all test images to evaluate your results. The results are stored in 15 files, "Task1_plane.txt, Task1_storage-tank.txt, ...", each file contains all the results for a specific category. Each file is in the following format:

					
imgname score x1 y1 x2 y2 x3 y3 x4 y4
imgname score x1 y1 x2 y2 x3 y3 x4 y4
... 
					
				
An example submission of task1

Evaluation Protocol

The evaluation protocol for oriented bounding box is a little different from the protocol in the original PASCAL VOC. We use the intersection over the union area of two polygons(ground truth and prediction) to calculate the IoU. The rest follows the PASCAL VOC.

Task2 - Detection with horizontal bounding boxes

Detecting object with horizontal bounding boxes is usual in many previous contests for object detection. The aim of this task is to accurately localize the instance in terms of horizontal bounding box with (xmin, ymin, xmax, ymax) format. In the task, the ground truths for training and testing are generated by calculating the axis-aligned bounding boxes over original annotated bounding boxes.

Submission Format

You will be asked to submit a zip file containing results for all test images to evaluate your results. The results are stored in 15 files, "Task2_plane.txt, Task2_storage-tank.txt, ...", each file contains all the results for a specific category.

					
imgname score xmin ymin xmax ymax
imgname score xmin ymin xmax ymax
... 
					
				
An example submission of task2

Evaluation Protocol

The evaluation protocol for horizontal bounding boxes follows the PASCAL VOC benchmark, which uses mean Average Precision(mAP) as the primary metric.