TY - GEN
T1 - An Intelligent AIOps Framework Based on Multi-Agent Collaboration and Dual-Context Retrieval
AU - Jia, Zhiyang
AU - Wu, Shengfeng
N1 - Publisher Copyright:
© 2026 IEEE.
PY - 2026
Y1 - 2026
N2 - Enterprise operations and maintenance knowledge and runtime evidence are often scattered across manuals, incident reports, monitoring records, and emergency plans. Conventional keyword retrieval is weak in semantic matching and evidence localization, while a single question-Answering model often struggles to integrate heterogeneous operational signals for fault-Assisted diagnosis. To address these issues, this paper proposes an intelligent AIOps framework based on multi-Agent collaboration and dual-context retrieval. The framework first performs document-level global recall to preserve scenario background and then chunk-level local ranking to identify actionable evidence. A unified orchestrator coordinates knowledge, monitoring, decision, notification, and host-management agents to interpret tasks, invoke bounded skills, aggregate cross-source evidence, and return traceable results. A FastAPI and React prototype is implemented and evaluated on a reproducible benchmark built from the open-source Rootly logs dataset and project runbooks. On 85 retrieval cases, dual-context retrieval reaches Recall@5 of 0.98, improves MRR from 0.90 to 0.92, and reduces average retrieval latency among hybrid methods. On 94 fault-diagnosis cases, the full workflow improves Top-1 accuracy from 0.57 to 0.79, action correctness from 0.68 to 0.86 and evidence completeness from 0.47 to 0.91. These results provide preliminary, reproducible evidence that the proposed framework improves evidence grounding and traceable diagnosis in a practical prototype setting.
AB - Enterprise operations and maintenance knowledge and runtime evidence are often scattered across manuals, incident reports, monitoring records, and emergency plans. Conventional keyword retrieval is weak in semantic matching and evidence localization, while a single question-Answering model often struggles to integrate heterogeneous operational signals for fault-Assisted diagnosis. To address these issues, this paper proposes an intelligent AIOps framework based on multi-Agent collaboration and dual-context retrieval. The framework first performs document-level global recall to preserve scenario background and then chunk-level local ranking to identify actionable evidence. A unified orchestrator coordinates knowledge, monitoring, decision, notification, and host-management agents to interpret tasks, invoke bounded skills, aggregate cross-source evidence, and return traceable results. A FastAPI and React prototype is implemented and evaluated on a reproducible benchmark built from the open-source Rootly logs dataset and project runbooks. On 85 retrieval cases, dual-context retrieval reaches Recall@5 of 0.98, improves MRR from 0.90 to 0.92, and reduces average retrieval latency among hybrid methods. On 94 fault-diagnosis cases, the full workflow improves Top-1 accuracy from 0.57 to 0.79, action correctness from 0.68 to 0.86 and evidence completeness from 0.47 to 0.91. These results provide preliminary, reproducible evidence that the proposed framework improves evidence grounding and traceable diagnosis in a practical prototype setting.
KW - AIOps
KW - dual-context retrieval
KW - fault diagnosis
KW - large language model
KW - multi-Agent collaboration
KW - retrieval-Augmented generation
UR - https://www.scopus.com/pages/publications/105048894792
U2 - 10.1109/EITCE70137.2026.11634570
DO - 10.1109/EITCE70137.2026.11634570
M3 - Conference contribution
AN - SCOPUS:105048894792
T3 - 2026 10th International Conference on Electronic Information Technology and Computer Engineering, EITCE 2026
SP - 635
EP - 640
BT - 2026 10th International Conference on Electronic Information Technology and Computer Engineering, EITCE 2026
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 10th International Conference on Electronic Information Technology and Computer Engineering, EITCE 2026
Y2 - 12 June 2026 through 14 June 2026
ER -