Versatile Tasks on Integrated Aerial Platforms Using Only Onboard Sensors: Control, Estimation, and Validation

Kaidi Wang, Ganghua Lai, Yushu Yu*, Jianrui Du, Jiali Sun, Bin Xu, Antonio Franchi, Fuchun Sun

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Connecting multiple aerial vehicles to a rigid central platform through passive spherical joints holds the potential to construct a fully-actuated aerial platform. The integration of multiple vehicles enhances efficiency in tasks like mapping and object reconnaissance. This paper proposes a control and state estimation framework for the Integrated Aerial Platform (IAP), enabling it to perform versatile tasks like object reconnaissance and physical interactive tasks with only onboard sensors. In the framework, the 6D motion control serves as the low-level controller, while the high-level controller comprises a 6D admittance filter and a perception-aware attitude correction module. The 6D admittance filter, serving as the interaction controller, is adaptable for aerial interaction tasks. The perception-aware attitude correction algorithm is carefully designed by adopting a geometric Model Predictive Controller (MPC). This algorithm, incorporating both offline and online calculations, proves to be well-suited for the intricate dynamics of an IAP. A 6D direct wrench controller is also developed for the IAP. Notably, both the interaction controller and the direct wrench controller operate without reliance on force/torque sensors. Instead, a wrench observer algorithm is devised, considering external disturbances. Additionally, based on the kinematics constraints of the multiple aerials in the platform, a fusion algorithm for multiple Visual-Inertial Odometry (VIO) and kinematics constraints is developed, providing more accurate localization. A prototype of the IAP is constructed, and its capabilities are demonstrated through experiments including perception-aware object reconnaissance, aerial mapping, aerial peg-in-hole task, and 6D contact wrench generation. All experiments are conducted exclusively with onboard sensors. These tasks exemplify the merits of the proposed IAP and validate the effectiveness of the proposed control framework and fusion algorithm.

Original languageEnglish
JournalIEEE Transactions on Robotics
DOIs
Publication statusAccepted/In press - 2025
Externally publishedYes

Keywords

  • Integrated Aerial Platform
  • Interaction Task
  • Loose Fusion
  • Perception-aware Control
  • Visual-Inertial Localization

Fingerprint

Dive into the research topics of 'Versatile Tasks on Integrated Aerial Platforms Using Only Onboard Sensors: Control, Estimation, and Validation'. Together they form a unique fingerprint.

Cite this