MDP-Based Task Offloading for Vehicular Edge Computing under Certain and Uncertain Transition Probabilities

Xuefei Zhang*, Jian Zhang, Zhitong Liu, Qimei Cui, Xiaofeng Tao, Shuo Wang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

94 Citations (Scopus)

Abstract

Low latency/delay is one of the most critical requirements for the application of vehicular networks. However, frequent real-time information update caused by vehicles high mobility is liable to aggravate the delay. Meanwhile, the task migration between different vehicular edge computing (VEC) servers results in an amount of delay if the computing cannot be completed before the vehicle moves out of the coverage of the current VEC server. In this paper, the problem is concluded as when and to whom to offload the task for VEC, which is formulated as a finite horizon Markov decision process (MDP) to minimize the delay with respect to the communication, computing, handover and migration. Through characterizing the time-space correlation of vehicles mobility, the curse of dimensionality problem in MDP is resolved. Meanwhile, a general expression of the transition probabilities is derived. On this basis, the specific results of highway, 2-D street and real-data scenarios are provided as well. For practical implementation considerations, the transition probabilities are commonly uncertain primarily due to random driver behavior, inaccurate sample data and complex path environment. Under this uncertain environment,a robust time-aware MDP-based task offloading algorithm (RTMDP) is proposed, which has been proved to perform well even under the high uncertain transition probabilities by simulation results.

Original languageEnglish
Article number8954797
Pages (from-to)3296-3309
Number of pages14
JournalIEEE Transactions on Vehicular Technology
Volume69
Issue number3
DOIs
Publication statusPublished - Mar 2020

Keywords

  • Markov decision process
  • time-space correlation
  • uncertain transition probabilities
  • vehicular edge computing

Fingerprint

Dive into the research topics of 'MDP-Based Task Offloading for Vehicular Edge Computing under Certain and Uncertain Transition Probabilities'. Together they form a unique fingerprint.

Cite this