Title

Intelligent Edge-Enabled Efficient Multi-Source Data Fusion for Autonomous Surface Vehicles in Maritime Internet of Things

Document Type

Article

Publication Title

IEEE Transactions on Green Communications and Networking

Abstract

With the rapid development of low-end Internet of Things (IoT) devices and shipborne sensors, efficient multi-source data fusion methods for autonomous surface vehicles (ASVs) have recently attracted significant research interest in intelligent edge-enabled maritime applications. The data fusion capacity can enhance the situation awareness of ASVs, leading to improved efficacy and safety in ASV-empowered maritime IoT (MIoT). Both cameras and automatic identification system (AIS) equipment, which provide visual and positioning information, respectively, have become the commonly adopted cost-effective sensors. In this work, we first introduce a lightweight YOLOX-s network with transfer learning to accurately and robustly detect the moving vessels at different scales in real time. A data augmentation method is then proposed to promote its generalization ability. The detected vessels and synchronous AIS messages are finally fused to make full use of the multi-source sensing data, contributing to an augmented reality (AR)-based maritime navigation system at the shipborne intelligent edges. The AR system is able to superimpose both static and dynamic information from the collected AIS messages onto the video-captured images. It has the capacity of providing auxiliary information for early warning of navigation risks for ASVs in MIoT networks. Compared with traditional single-sensor-based navigation methods, our data fusion framework exhibits more reliable and robust results, and appears to have substantial practical potential applications. Extensive experiments have been conducted to demonstrate the superior performance of our framework under different navigational conditions.

First Page

1

Last Page

1

DOI

10.1109/TGCN.2022.3158004

Publication Date

3-9-2022

Keywords

Artificial intelligence, Autonomous surface vehicles (ASVs), Cameras, Data integration, deep neural network., edge computing, Intelligent sensors, Laser radar, maritime Internet of Things (MIoT), multi-source data fusion, Radar, Safety

Comments

IR Deposit conditions:

OA version (pathway a) Accepted version

No embargo

When accepted for publication, set statement to accompany deposit (see policy)

Must link to publisher version with DOI

Publisher copyright and source must be acknowledged

Share

COinS