AccuracyTrader: Accuracy-Aware Approximate Processing for Low Tail Latency and High Result Accuracy in Cloud Online Services

Rui Han, Siguang Huang, Fei Tang, Fugui Chang, Jianfeng Zhan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

6 Citations (Scopus)

Abstract

Modern latency-critical online services such as search engines often process requests by consulting large input data spanning massive parallel components. Hence the tail latency of these components determines the service latency. To trade off result accuracy for tail latency reduction, existing techniques use the components responding before a specified deadline to produce approximate results. However, they may skip a large proportion of components when load gets heavier, thus incurring large accuracy losses. This paper presents AccuracyTrader that produces approximate results with small accuracy losses while maintaining low tail latency. AccuracyTrader aggregates information of input data on each component to create a small synopsis, thus enabling all components producing initial results quickly using their synopses. AccuracyTrader also uses synopses to identify the parts of input data most related to arbitrary requests' result accuracy, thus first using these parts to improve the produced results in order to minimize accuracy losses. We evaluated AccuracyTrader using workloads in real services. The results show: (i) AccuracyTrader reduces tail latency by over 40 times with accuracy losses of less than 7% compared to existing exact processing techniques, (ii) when using the same latency, AccuracyTrader reduces accuracy losses by over 13 times comparing to existing approximate processing techniques.

Original languageEnglish
Title of host publicationProceedings - 45th International Conference on Parallel Processing, ICPP 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages278-287
Number of pages10
ISBN (Electronic)9781509028238
DOIs
Publication statusPublished - 21 Sept 2016
Externally publishedYes
Event45th International Conference on Parallel Processing, ICPP 2016 - Philadelphia, United States
Duration: 16 Aug 201619 Aug 2016

Publication series

NameProceedings of the International Conference on Parallel Processing
Volume2016-September
ISSN (Print)0190-3918

Conference

Conference45th International Conference on Parallel Processing, ICPP 2016
Country/TerritoryUnited States
CityPhiladelphia
Period16/08/1619/08/16

Keywords

  • Cloud online services
  • Result accuracy
  • Synopsis
  • Tail latency

Fingerprint

Dive into the research topics of 'AccuracyTrader: Accuracy-Aware Approximate Processing for Low Tail Latency and High Result Accuracy in Cloud Online Services'. Together they form a unique fingerprint.

Cite this