SmartFilter: An Edge System for Real-Time Application-Guided Video Frames Filtering

Given the limited bandwidth available in distributed camera systems, it is nearly impossible for cameras to transmit their entire feed to the server in real time. Furthermore, as the number of camera units increases, the processing overheads on the server also increase, resulting in excessive latencies. This article introduces SmartFilter, a new Edge-to-Cloud filtering solution for video analytics. SmartFilter exploits the feedbacks from the running server-side application to filter directly on the camera, frames that are likely to produce the same application result as the previously offloaded ones. Because of its unique filtering mechanism, SmartFilter improves the system's throughput, latency, and network usage and reduces the server's processing overhead while maintaining the overall accuracy. SmartFilter is typically a fast and lightweight binary classifier that examines changes within frames to decide when these changes are significant enough to alter the application output. Experiments with various video data sets and in a real-world scenario demonstrate that our solution can achieve 40 FPS on a commodity camera while delivering a filtering efficiency of more than 90%.