Skip to main navigation Skip to search Skip to main content

SCOPE: Streaming Covariance-Orthogonal Post-Hoc Editing for Continual LLM Safety Governance

  • Yizhe Yang*
  • , Xuanming Jiang
  • , Jisheng Dang*
  • , Aoying Wang
  • , Baoyi An
  • , Hao Wu
  • , Bimei Wang
  • , Hong Peng
  • , Guoshuai Zhao
  • , Bin Hu*
  • , Zhongyu Yang*
  • *Corresponding author for this work
  • Lanzhou University
  • Ltd.
  • Xi'an Jiaotong University
  • National University of Singapore
  • Peking University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Deployed large language models (LLMs) require continual post-hoc safety updates to counter evolving threats, yet current methods often entangle refusal behaviors with capability-critical representations, causing cumulative utility drift in sequential edits. We propose SCOPE, a streaming post-hoc editing framework for capability-invariant LLM safety governance. SCOPE derives layer-wise capability subspaces via online activation covariance and constrains safety updates to their orthogonal spaces, decoupling capability preservation from safety-specific edits. Within the derived null space, it extracts low-rank refusal directions from contrastive harmful activations to steer refusal behaviors without interfering with core capabilities. Its online covariance maintenance enables efficient, adaptive expansion of the protected capability subspace against open-ended threat evolution. Our experiments validate that SCOPE delivers significant safety robustness gains by substantially reducing attack success rates, while keeping general capabilities within natural run-to-run variance under repeated edits, supporting long-term safety maintenance for deployed LLMs.

Original languageEnglish
Title of host publicationKDD 2026 - Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2
PublisherAssociation for Computing Machinery
Pages6056-6067
Number of pages12
ISBN (Electronic)9798400722592
DOIs
Publication statusPublished - 8 Aug 2026
Externally publishedYes
Event32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1, KDD 2026 - Jeju Island, Korea, Republic of
Duration: 9 Aug 2026 → 13 Aug 2026

Publication series

NameProceedings of the ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
Volume2-B
ISSN (Print)2154-817X

Conference

Conference32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1, KDD 2026
Country/TerritoryKorea, Republic of
CityJeju Island
Period9/08/26 → 13/08/26

Keywords

  • alignment tax
  • large language models
  • post-hoc safety governance
  • streaming patching

Fingerprint

Dive into the research topics of 'SCOPE: Streaming Covariance-Orthogonal Post-Hoc Editing for Continual LLM Safety Governance'. Together they form a unique fingerprint.

Cite this