TY - JOUR
T1 - A semantics-maintained differential privacy protection for high-utility text
AU - Wu, Zhouting
AU - Luo, Senlin
AU - Pan, Limin
N1 - Publisher Copyright:
© 2026
PY - 2026/4/8
Y1 - 2026/4/8
N2 - Preserving utility is essential for downstream applications of privatized text data. While widely adopted differentially private mechanisms offer formal privacy guarantees, they often compromise utility. This degradation primarily stems from two issues: treating all tokens equally regardless of token's privacy-criticality, and allowing semantically irrelevant candidates to replace input tokens, leading to unnecessary semantic distortion. To address the above problems, a Utility-oriented Truncated Exponential Mechanism (UTEM) is proposed, which employs a two-stage utility enhancement strategy. First, UTEM distinguishes between sensitive and non-sensitive tokens, reducing unnecessary perturbations on non-sensitive tokens and thereby preserving the original semantics. Second, it leverages distance truncation and tail penalty mechanism to optimize the candidate set by pruning semantically irrelevant tokens, thereby further improving utility. Theoretical derivations of privacy and utility are presented, establishing formal guarantees for UTEM. Experiments on SST-2, QNLI, and ChnSentiCorp demonstrate accuracy scores of 85.09 %, 87.04 %, and 87.64 %, respectively, with corresponding defense success rates of 75.51 %, 78.40 %, and 51.09 %. On the IMDB dataset, UTEM achieves an accuracy of 85.80 %, while reducing the attack AUC to 51.22 %. Extensive Experiments on four public benchmark datasets under ten evaluation settings demonstrate that UTEM consistently outperforms state-of-the-art baselines in terms of utility while maintaining comparable privacy protection.
AB - Preserving utility is essential for downstream applications of privatized text data. While widely adopted differentially private mechanisms offer formal privacy guarantees, they often compromise utility. This degradation primarily stems from two issues: treating all tokens equally regardless of token's privacy-criticality, and allowing semantically irrelevant candidates to replace input tokens, leading to unnecessary semantic distortion. To address the above problems, a Utility-oriented Truncated Exponential Mechanism (UTEM) is proposed, which employs a two-stage utility enhancement strategy. First, UTEM distinguishes between sensitive and non-sensitive tokens, reducing unnecessary perturbations on non-sensitive tokens and thereby preserving the original semantics. Second, it leverages distance truncation and tail penalty mechanism to optimize the candidate set by pruning semantically irrelevant tokens, thereby further improving utility. Theoretical derivations of privacy and utility are presented, establishing formal guarantees for UTEM. Experiments on SST-2, QNLI, and ChnSentiCorp demonstrate accuracy scores of 85.09 %, 87.04 %, and 87.64 %, respectively, with corresponding defense success rates of 75.51 %, 78.40 %, and 51.09 %. On the IMDB dataset, UTEM achieves an accuracy of 85.80 %, while reducing the attack AUC to 51.22 %. Extensive Experiments on four public benchmark datasets under ten evaluation settings demonstrate that UTEM consistently outperforms state-of-the-art baselines in terms of utility while maintaining comparable privacy protection.
KW - Differential privacy
KW - Privacy protection
KW - Semantics-maintaining
KW - Text data
UR - https://www.scopus.com/pages/publications/105030227912
U2 - 10.1016/j.knosys.2026.115478
DO - 10.1016/j.knosys.2026.115478
M3 - Article
AN - SCOPUS:105030227912
SN - 0950-7051
VL - 338
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 115478
ER -