File(s) under embargo

Reason: We are applying for patents and have publications pending that are related to the content of the thesis.

10

month(s)

14

day(s)

until file(s) become available

Approximation for streaming video analytics on mobile devices

thesis
posted on 09.12.2021, 06:20 by Ran XuRan Xu
Approximate algorithms have shown great success to reduce the computation latency with minor accuracy loss. Such algorithms are especially useful on resource-constrained devices like mobile phones and embedded boards. However, current approximate algorithms for streaming video analytics cannot provide accuracy and latency guarantees. This happens in the face of changing content characteristics in the video stream and changing resource availability on the target devices.

In this dissertation, we propose the analytic foundation on how to characterize the accuracy and latency of approximate algorithms in a content and contention aware manner. We use this to enable an approximate algorithm to probabilistically meet a user-provided latency constraint or an accuracy target. We use video processing pipelines, a video object classification system, and a video object detection system as examples to demonstrate how our solution can improve the performance of streaming video analytic systems on the resource-constrained mobile and embedded devices. Our evaluation shows that our technique can be overlaid seamlessly on top of standard vision algorithms and provides superior accuracy-latency tradeoff over the start-of-the-art approaches.

History

Degree Type

Doctor of Philosophy

Department

Electrical and Computer Engineering

Campus location

West Lafayette

Advisor/Supervisor/Committee Chair

Saurabh Bagchi

Additional Committee Member 2

Somali Chaterji

Additional Committee Member 3

Yin Li

Additional Committee Member 4

Fengqing Maggie Zhu

Additional Committee Member 5

Yexiang Xue