TY - GEN
T1 - SCOPE
T2 - 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1, KDD 2026
AU - Yang, Yizhe
AU - Jiang, Xuanming
AU - Dang, Jisheng
AU - Wang, Aoying
AU - An, Baoyi
AU - Wu, Hao
AU - Wang, Bimei
AU - Peng, Hong
AU - Zhao, Guoshuai
AU - Hu, Bin
AU - Yang, Zhongyu
N1 - Publisher Copyright:
© 2026 Owner/Author.
PY - 2026/8/8
Y1 - 2026/8/8
N2 - Deployed large language models (LLMs) require continual post-hoc safety updates to counter evolving threats, yet current methods often entangle refusal behaviors with capability-critical representations, causing cumulative utility drift in sequential edits. We propose SCOPE, a streaming post-hoc editing framework for capability-invariant LLM safety governance. SCOPE derives layer-wise capability subspaces via online activation covariance and constrains safety updates to their orthogonal spaces, decoupling capability preservation from safety-specific edits. Within the derived null space, it extracts low-rank refusal directions from contrastive harmful activations to steer refusal behaviors without interfering with core capabilities. Its online covariance maintenance enables efficient, adaptive expansion of the protected capability subspace against open-ended threat evolution. Our experiments validate that SCOPE delivers significant safety robustness gains by substantially reducing attack success rates, while keeping general capabilities within natural run-to-run variance under repeated edits, supporting long-term safety maintenance for deployed LLMs.
AB - Deployed large language models (LLMs) require continual post-hoc safety updates to counter evolving threats, yet current methods often entangle refusal behaviors with capability-critical representations, causing cumulative utility drift in sequential edits. We propose SCOPE, a streaming post-hoc editing framework for capability-invariant LLM safety governance. SCOPE derives layer-wise capability subspaces via online activation covariance and constrains safety updates to their orthogonal spaces, decoupling capability preservation from safety-specific edits. Within the derived null space, it extracts low-rank refusal directions from contrastive harmful activations to steer refusal behaviors without interfering with core capabilities. Its online covariance maintenance enables efficient, adaptive expansion of the protected capability subspace against open-ended threat evolution. Our experiments validate that SCOPE delivers significant safety robustness gains by substantially reducing attack success rates, while keeping general capabilities within natural run-to-run variance under repeated edits, supporting long-term safety maintenance for deployed LLMs.
KW - alignment tax
KW - large language models
KW - post-hoc safety governance
KW - streaming patching
UR - https://www.scopus.com/pages/publications/105051039399
U2 - 10.1145/3770855.3817993
DO - 10.1145/3770855.3817993
M3 - Conference contribution
AN - SCOPUS:105051039399
T3 - Proceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
SP - 6056
EP - 6067
BT - KDD 2026 - Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2
PB - Association for Computing Machinery
Y2 - 9 August 2026 through 13 August 2026
ER -