Journal Article
Computer Vision

A Comprehensive Review for Typical Applications Based Upon Unmanned Aerial Vehicle Platform

Yuqi Han(Tsinghua University), Huaping Liu(Tsinghua University), Yufeng Wang(Beihang University), Chunlei Liu(Beihang University)
January 1, 2022IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing88 citations

88

Citations

2

Influential Citations

IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing

Venue

2022

Year

Abstract

Unmanned Aerial Vehicles (UAVs) have been widely applied in military and civilian fields due to their flexibility and effectiveness. As a vital component of UAVs, the vision system has taken on great significance in different applications (e.g., autonomous landing, traffic surveillance, and disaster rescue) to attract widespread attention in recent years. Therefore, the automatic understanding of visual data collected from these air platforms becomes urgently needed in UAV systems. In this review, we revisit and summarize the recent techniques and developments for several typical UAV applications, including object detection, object tracking, and semantic segmentation. In addition, we also highlight the difficulties and subsequent orientations from different perspectives, which may stimulate future research and applications in the UAV vision era.

Analysis

Why This Paper Matters

Unmanned Aerial Vehicles (UAVs) have become indispensable in both military and civilian domains, offering flexibility and effectiveness for tasks like surveillance, mapping, and rescue. The vision system is a critical component, enabling autonomous operation through visual data understanding. This review paper is significant because it consolidates the rapidly growing body of work on UAV-based computer vision, focusing on three fundamental tasks: object detection, object tracking, and semantic segmentation. By providing a structured overview of recent techniques, datasets, and challenges, it serves as a timely resource for researchers entering the field or seeking to benchmark their work. The paper also highlights domain-specific difficulties such as small object scales, severe occlusion, and viewpoint variations, which are often overlooked in generic vision surveys.

Technical Contributions

The paper's main contribution is its comprehensive categorization and analysis of UAV vision methods:

  • Object Detection: Reviews anchor-based and anchor-free detectors, including adaptations for small objects and real-time performance on embedded platforms.
  • Object Tracking: Covers correlation filter-based and deep learning trackers, with emphasis on handling fast motion, scale changes, and background clutter.
  • Semantic Segmentation: Discusses fully convolutional networks, encoder-decoder architectures, and attention mechanisms tailored for aerial imagery.
  • Datasets and Benchmarks: Lists key datasets (e.g., VisDrone, UAVDT, DOTA) and evaluation metrics for each task.
  • Challenges and Future Directions: Identifies open problems such as domain adaptation, multi-modal fusion, and energy-efficient inference.

Results

As a survey, the paper does not present original experimental results. Instead, it summarizes performance trends from the literature. For example, it notes that state-of-the-art object detectors on UAV datasets achieve around 70-80% mAP on standard benchmarks, while tracking methods report success rates of 60-70% on challenging sequences. Semantic segmentation models reach 70-80% mIoU on urban aerial datasets. The paper does not provide a direct comparison table but references key works and their reported metrics.

Significance

This review has broad impact by providing a clear roadmap for UAV vision research. It helps practitioners select appropriate methods for their applications and highlights underexplored areas like real-time processing on resource-constrained UAVs and robust performance under adverse conditions. The paper also encourages cross-pollination between UAV vision and general computer vision, potentially driving innovations in small object detection and viewpoint-invariant representations. As UAVs become more autonomous, such surveys will be crucial for accelerating progress in the field.