TY - JOUR
T1 - Coordinate-based efficient indexing mechanism for intelligent IoT systems in heterogeneous edge computing
AU - Tang, Songtao
AU - Du, Xin
AU - Lu, Zhihui
AU - Gai, Keke
AU - Wu, Jie
AU - Hung, Patrick C.K.
AU - Choo, Kim Kwang Raymond
N1 - Publisher Copyright:
© 2022 Elsevier Inc.
PY - 2022/8
Y1 - 2022/8
N2 - Powered by edge servers (also called as edge nodes) which are close to the data source, distributed edge AI processes the huge amounts of data generated by Internet of Things (IoT) devices, extracting value for users. In edge computing, massive data are stored in several distributed edge nodes with heterogeneous capabilities. Intelligent applications running on one edge node may need data from other edge nodes. An efficient data indexing mechanism can rapidly locate the edge node where the data is kept, supporting latency-sensitive intelligent applications. The existing indexing methods in edge computing assume that all edge nodes are the same in capability and the number of edge nodes is constant. This paper proposes CREIM, a coordinate-based efficient indexing mechanism for intelligent IoT systems in heterogeneous edge computing. CREIM achieves fair load balancing on edge nodes with heterogeneous capabilities. The indexing mechanism deals well with the horizontal scaling of edge nodes. Besides, CREIM addresses a fast lookup with one overlay hop, providing low latency data retrieval for edge intelligent applications. In the experiments, CREIM is applied in a realistic network simulated by the mininet and the routing forwarding is supported by the P4 switch. The experiments are constructed by combining real location datasets of Shanghai Telecoms base stations with the real-collected requests of end-devices. The experimental results demonstrate that CREIM achieves a near-optimal latency of index-lookup, adapts the heterogeneous capabilities among edge nodes and reduces the cost of increasing/decreasing edge nodes by 56.36% compared with the state-of-the-art method.
AB - Powered by edge servers (also called as edge nodes) which are close to the data source, distributed edge AI processes the huge amounts of data generated by Internet of Things (IoT) devices, extracting value for users. In edge computing, massive data are stored in several distributed edge nodes with heterogeneous capabilities. Intelligent applications running on one edge node may need data from other edge nodes. An efficient data indexing mechanism can rapidly locate the edge node where the data is kept, supporting latency-sensitive intelligent applications. The existing indexing methods in edge computing assume that all edge nodes are the same in capability and the number of edge nodes is constant. This paper proposes CREIM, a coordinate-based efficient indexing mechanism for intelligent IoT systems in heterogeneous edge computing. CREIM achieves fair load balancing on edge nodes with heterogeneous capabilities. The indexing mechanism deals well with the horizontal scaling of edge nodes. Besides, CREIM addresses a fast lookup with one overlay hop, providing low latency data retrieval for edge intelligent applications. In the experiments, CREIM is applied in a realistic network simulated by the mininet and the routing forwarding is supported by the P4 switch. The experiments are constructed by combining real location datasets of Shanghai Telecoms base stations with the real-collected requests of end-devices. The experimental results demonstrate that CREIM achieves a near-optimal latency of index-lookup, adapts the heterogeneous capabilities among edge nodes and reduces the cost of increasing/decreasing edge nodes by 56.36% compared with the state-of-the-art method.
KW - Distributed storage
KW - Heterogeneous edge computing
KW - Indexing mechanism
KW - Internet of Things system
UR - http://www.scopus.com/inward/record.url?scp=85129334813&partnerID=8YFLogxK
U2 - 10.1016/j.jpdc.2022.04.012
DO - 10.1016/j.jpdc.2022.04.012
M3 - Article
AN - SCOPUS:85129334813
SN - 0743-7315
VL - 166
SP - 45
EP - 56
JO - Journal of Parallel and Distributed Computing
JF - Journal of Parallel and Distributed Computing
ER -