IPES: Improved Pre-trained Encoder Stealing Attack in Contrastive Learning

Chuan Zhang, Zhuopeng Li, Haotian Liang, Jinwen Liang*, Ximeng Liu, Liehuang Zhu

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Recent studies have shed light on security vulnerabilities in Encoder-as-a-Service (EaaS) systems that enable the theft of valuable encoder attributes such as functionality. However, many of these attacks often either simply used the data augmentation method, or solely explored the idea of contrastive learning to improve the performance, lacking analysis and a combination of both two aspects. Furthermore, they also ignored the potential of harnessing the inner characteristics of the encoder, specifically its robustness. Thus, we introduce Improved Pretrained Encoder Stealing (IPES), a novel approach that capitalizes on augmented and perturbed samples to enhance the surrogate encoder's ability to replicate the aim encoder. Additionally, we place emphasis on optimizing the query budget by leveraging the inherent robustness of well-trained encoders. By combining the idea of contrastive learning and the inherent robustness of the encoder, IPES improves the performance by more than 14% in downstream accuracy compared to conventional methods.

Original languageEnglish
Title of host publicationProceedings - IEEE Congress on Cybermatics
Subtitle of host publication2023 IEEE International Conferences on Internet of Things, iThings 2023, IEEE Green Computing and Communications, GreenCom 2023, IEEE Cyber, Physical and Social Computing, CPSCom 2023 and IEEE Smart Data, SmartData 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages354-361
Number of pages8
ISBN (Electronic)9798350309461
DOIs
Publication statusPublished - 2023
Event2023 IEEE Congress on Cybermatics: 16th IEEE International Conferences on Internet of Things, iThings 2023, 19th IEEE International Conference on Green Computing and Communications, GreenCom 2023, 16th IEEE International Conference on Cyber, Physical and Social Computing, CPSCom 2023 and 9th IEEE International Conference on Smart Data, SmartData 2023 - Danzhou, China
Duration: 17 Dec 202321 Dec 2023

Publication series

NameProceedings - IEEE Congress on Cybermatics: 2023 IEEE International Conferences on Internet of Things, iThings 2023, IEEE Green Computing and Communications, GreenCom 2023, IEEE Cyber, Physical and Social Computing, CPSCom 2023 and IEEE Smart Data, SmartData 2023

Conference

Conference2023 IEEE Congress on Cybermatics: 16th IEEE International Conferences on Internet of Things, iThings 2023, 19th IEEE International Conference on Green Computing and Communications, GreenCom 2023, 16th IEEE International Conference on Cyber, Physical and Social Computing, CPSCom 2023 and 9th IEEE International Conference on Smart Data, SmartData 2023
Country/TerritoryChina
CityDanzhou
Period17/12/2321/12/23

Fingerprint

Dive into the research topics of 'IPES: Improved Pre-trained Encoder Stealing Attack in Contrastive Learning'. Together they form a unique fingerprint.

Cite this