TY - JOUR
T1 - ANNProof
T2 - Building a verifiable and efficient outsourced approximate nearest neighbor search system on blockchain
AU - Lu, Lingling
AU - Wen, Zhenyu
AU - Yuan, Ye
AU - He, Qinming
AU - Chen, Jianhai
AU - Liu, Zhenguang
N1 - Publisher Copyright:
© 2024
PY - 2024/7
Y1 - 2024/7
N2 - Data-as-a-service is increasingly prevalent, with outsourced K-approximate nearest neighbors search (K-ANNS) gaining popularity in applications like similar image retrieval and anti-money laundering. However, malicious search service providers and dataset providers in current outsourced query systems cause incorrect user query results. To address this, we propose ANNProof, a novel framework supporting verifiable outsourced K-ANNS on the blockchain. ANNProof utilizes two innovative authenticated data structures (ADS), the Merkle HNSW node tree, and the Merkle vector identifier tree, for efficient K-ANNS query verification. Additionally, we employ the Merkle sharding tree as an ADS optimization technique, reducing the overhead of delivering verifiable queries. We implement the ADS construction protocol based on blockchain smart contracts to ensure tamper-evident datasets and enhance execution efficiency via a contract state consistency checking scheme. Extensive evaluations show that ANNProof reduces VO generation time, result verification time, and VO size by 160, 120, and 28×, respectively, compared to the state-of-the-art systems. Moreover, ADS construction using ANNProof takes at most 2% of the index construction time, resulting in a negligible overhead for implementing verifiable queries. Meanwhile, the sharding optimization accelerates ADS updates by 53×.
AB - Data-as-a-service is increasingly prevalent, with outsourced K-approximate nearest neighbors search (K-ANNS) gaining popularity in applications like similar image retrieval and anti-money laundering. However, malicious search service providers and dataset providers in current outsourced query systems cause incorrect user query results. To address this, we propose ANNProof, a novel framework supporting verifiable outsourced K-ANNS on the blockchain. ANNProof utilizes two innovative authenticated data structures (ADS), the Merkle HNSW node tree, and the Merkle vector identifier tree, for efficient K-ANNS query verification. Additionally, we employ the Merkle sharding tree as an ADS optimization technique, reducing the overhead of delivering verifiable queries. We implement the ADS construction protocol based on blockchain smart contracts to ensure tamper-evident datasets and enhance execution efficiency via a contract state consistency checking scheme. Extensive evaluations show that ANNProof reduces VO generation time, result verification time, and VO size by 160, 120, and 28×, respectively, compared to the state-of-the-art systems. Moreover, ADS construction using ANNProof takes at most 2% of the index construction time, resulting in a negligible overhead for implementing verifiable queries. Meanwhile, the sharding optimization accelerates ADS updates by 53×.
KW - Blockchain
KW - Cloud computing
KW - K-ANN search
KW - Merkle tree
KW - Verifiable outsourced query
UR - http://www.scopus.com/inward/record.url?scp=85187955843&partnerID=8YFLogxK
U2 - 10.1016/j.future.2024.03.002
DO - 10.1016/j.future.2024.03.002
M3 - Article
AN - SCOPUS:85187955843
SN - 0167-739X
VL - 156
SP - 206
EP - 220
JO - Future Generation Computer Systems
JF - Future Generation Computer Systems
ER -