TY - GEN
T1 - Flexible Semantic Watermarking for Robust Diffusion Model Detection and Tracing
AU - Zhu, Zhitong
AU - Yu, Jing
AU - Gai, Keke
AU - Zhuang, Jiamin
AU - Gou, Gaopeng
AU - Xiong, Gang
N1 - Publisher Copyright:
© 2024 Copyright held by the owner/author(s).
PY - 2024/12/28
Y1 - 2024/12/28
N2 - The excellent capability and wide application of Diffusion Models have lead to great concerns about malicious usage.Watermarking is regarded as a promising solution to identify the model authenticity and trace the origin of the image, thus alleviating the potential misuse risks.However, existing works fall short in properties such as fidelity and watermark capacity, thus decreasing the robustness and flexibility of watermarking methods.In response to the limitations of existing methods, this paper proposes a multi-bit latent space watermarking scheme for watermark detection and identification.We design the watermark scheme based on the principle of the diffusion sampling process, which enables watermarking generated content without modifying the original workflow or adjusting the pretrained weights of the diffusion model.Experiments have demonstrated that the proposed method achieves a good balance in terms of watermark effectiveness, fidelity and robustness.Additionally, our method can be adapted for different sampling settings of diffusion model, indicating great flexibility and versatility in practical applications.
AB - The excellent capability and wide application of Diffusion Models have lead to great concerns about malicious usage.Watermarking is regarded as a promising solution to identify the model authenticity and trace the origin of the image, thus alleviating the potential misuse risks.However, existing works fall short in properties such as fidelity and watermark capacity, thus decreasing the robustness and flexibility of watermarking methods.In response to the limitations of existing methods, this paper proposes a multi-bit latent space watermarking scheme for watermark detection and identification.We design the watermark scheme based on the principle of the diffusion sampling process, which enables watermarking generated content without modifying the original workflow or adjusting the pretrained weights of the diffusion model.Experiments have demonstrated that the proposed method achieves a good balance in terms of watermark effectiveness, fidelity and robustness.Additionally, our method can be adapted for different sampling settings of diffusion model, indicating great flexibility and versatility in practical applications.
KW - Diffusion Model
KW - Model Watermark
UR - https://www.scopus.com/pages/publications/85216206896
U2 - 10.1145/3696409.3700282
DO - 10.1145/3696409.3700282
M3 - Conference contribution
AN - SCOPUS:85216206896
T3 - Proceedings of the 6th ACM International Conference on Multimedia in Asia, MMAsia 2024
BT - Proceedings of the 6th ACM International Conference on Multimedia in Asia, MMAsia 2024
PB - Association for Computing Machinery, Inc
T2 - 6th ACM International Conference on Multimedia in Asia, MMAsia 2024
Y2 - 3 December 2024 through 6 December 2024
ER -