TY - JOUR
T1 - Scenarios Engineering for Trustworthy AI
T2 - Domain Adaptation Approach for Reidentification with Synthetic Data
AU - Li, Xuan
AU - Wang, Xiao
AU - Deng, Fang
AU - Wang, Fei Yue
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Reidentification (Re-ID) is a crucial computer vision application with a variety of potential uses in many maritime scenarios, including search, rescue, and surveillance. However, the development of advanced boat reidentification (Boat Re-ID) algorithms necessitates the availability of large-scale Re-ID datasets for model training and evaluation. Inspired by scenarios engineering, this study proposes a new framework for automatically generating a realistic synthetic dataset for boat Re-ID investigation. The synthetic dataset contains 107 boat models and various visual conditions in 36 real backgrounds. The use of synthetic datasets enables the learning-based Re-ID algorithm's performance to be quantitatively verificated under varying imaging conditions. Nonetheless, our experiments prove that synthetic datasets are inadequate to handle real-world challenges. Therefore, we present a domain adaptation approach that integrates both real and synthetic data to create trustworthy models. This approach employs a multistep training strategy, gradient reversal layer and novel loss functions to preserve the features from two distribution dataset domains. The results of the experiments demonstrate that 1) synthetic datasets can be employed to train boat Re-ID algorithms and quantitatively test the performance of these algorithms under diverse imaging conditions and 2) our approach utilizes the attributes of the two data domains (real and synthetic) to achieve exceptional performance in real-world applications.
AB - Reidentification (Re-ID) is a crucial computer vision application with a variety of potential uses in many maritime scenarios, including search, rescue, and surveillance. However, the development of advanced boat reidentification (Boat Re-ID) algorithms necessitates the availability of large-scale Re-ID datasets for model training and evaluation. Inspired by scenarios engineering, this study proposes a new framework for automatically generating a realistic synthetic dataset for boat Re-ID investigation. The synthetic dataset contains 107 boat models and various visual conditions in 36 real backgrounds. The use of synthetic datasets enables the learning-based Re-ID algorithm's performance to be quantitatively verificated under varying imaging conditions. Nonetheless, our experiments prove that synthetic datasets are inadequate to handle real-world challenges. Therefore, we present a domain adaptation approach that integrates both real and synthetic data to create trustworthy models. This approach employs a multistep training strategy, gradient reversal layer and novel loss functions to preserve the features from two distribution dataset domains. The results of the experiments demonstrate that 1) synthetic datasets can be employed to train boat Re-ID algorithms and quantitatively test the performance of these algorithms under diverse imaging conditions and 2) our approach utilizes the attributes of the two data domains (real and synthetic) to achieve exceptional performance in real-world applications.
KW - Boat reidentification (Boat Re-ID)
KW - domain adaptation (DA)
KW - scenarios engineering (SE)
KW - synthetic dataset
KW - unmanned aerial vehicles (UAVs)
UR - http://www.scopus.com/inward/record.url?scp=85206984278&partnerID=8YFLogxK
U2 - 10.1109/TSMC.2024.3445117
DO - 10.1109/TSMC.2024.3445117
M3 - Article
AN - SCOPUS:85206984278
SN - 2168-2216
VL - 54
SP - 6901
EP - 6910
JO - IEEE Transactions on Systems, Man, and Cybernetics: Systems
JF - IEEE Transactions on Systems, Man, and Cybernetics: Systems
IS - 11
ER -