AnomalyLLM: Few-Shot Anomaly Edge Detection for Dynamic Graphs Using Large Language Models

Shuo Liu, Di Yao, Lanting Fang, Zhetao Li, Wenbin Li, Kaiyu Feng, Xiaowen Ji, Jingping Bi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Detecting anomaly edges for dynamic graphs aims to identify edges significantly deviating from the normal pattern and can be applied in various domains, such as cybersecurity, financial transactions and AIOps. With the evolving of time, the types of anomaly edges are emerging and the labeled anomaly samples are few for each type. Current methods are either designed to detect randomly inserted edges or require sufficient labeled data for model training, which harms their applicability for real-world applications. In this paper, we study this problem by cooperating with the rich knowledge encoded in large language models(LLMs) and propose a method, namely AnomalyLLM. To align the dynamic graph with LLMs, AnomalyLLM pretrains a dynamic-aware encoder to generate the representations of edges and reprograms the edges using the prototypes of word embeddings. Along with the encoder, we design an in-context learning framework that integrates the information of a few labeled samples to achieve few-shot anomaly detection. Experiments on four datasets reveal that AnomalyLlmcan not only significantly improve the performance of few-shot anomaly detection, but also achieve superior results on new anomalies without any update of model parameters.

Original languageEnglish
Title of host publicationProceedings - 24th IEEE International Conference on Data Mining, ICDM 2024
EditorsElena Baralis, Kun Zhang, Ernesto Damiani, Merouane Debbah, Panos Kalnis, Xindong Wu
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages785-790
Number of pages6
ISBN (Electronic)9798331506681
DOIs
Publication statusPublished - 2024
Event24th IEEE International Conference on Data Mining, ICDM 2024 - Abu Dhabi, United Arab Emirates
Duration: 9 Dec 202412 Dec 2024

Publication series

NameProceedings - IEEE International Conference on Data Mining, ICDM
ISSN (Print)1550-4786

Conference

Conference24th IEEE International Conference on Data Mining, ICDM 2024
Country/TerritoryUnited Arab Emirates
CityAbu Dhabi
Period9/12/2412/12/24

Keywords

  • Anomaly Detection
  • Dynamic Graphs
  • Few-Shot Learning
  • Large Language Models

Fingerprint

Dive into the research topics of 'AnomalyLLM: Few-Shot Anomaly Edge Detection for Dynamic Graphs Using Large Language Models'. Together they form a unique fingerprint.

Cite this