Blind Spots of Objective Measures

Blind Spots of Objective Measures: Exploiting Imperceivable Errors for Immersive Tactile Internet

Kroep, H. J.C. (Student TU Delft)
Gokhale, V. (TU Delft Embedded Systems)
Venkatesha Prasad, Ranga Rao (TU Delft Embedded Systems)

2022

Tactile Internet (TI) enables the transfer of human skills over the Internet, enabling teleoperation with force feed-back. Advancements are being made rapidly at several fronts to realize a functional TI soon. Generally, TI is expected to faithfully reproduce operator's actions at the other end, where a robotic arm emulates it while providing force feedback to the operator. Performance of TI is usually characterized using objective metrics such as network delay, packet losses, and RMSE. Pari passu, subjective evaluations are used as additional validation, and performance evaluation itself is not primarily based on user experience. Hence objective evaluation, which generally minimizes error (signal mismatch), is oblivious to subjective experience. In this paper, we argue that user-centric designs of TI solutions are necessary. We first consider a few common TI errors and examine their perceivability, The idea is to reduce the impact of perceivable errors and exploit the imperceivable errors to our advantage, while the objective metrics may indicate that the errors are high. To harness the imperceivable errors, we design Adaptive Offset Framework (AOF) to improve the TI signal reconstruction under realistic network settings. We use AOF to highlight the contradictory inferences drawn by objective and subjective evaluations while realizing that subjective evaluations are closer to ground truth. This strongly suggests the existence of 'blind spots of objective measures'. Further, we show that AOF significantly improves the user grade, up to 3 points (on a scale of 10) compared to the standard reconstruction method.

QoS
Tactile internet
teleoperation
user experience

http://resolver.tudelft.nl/uuid:e8bbd923-c0e3-4e0b-98e5-6771946580e7

https://doi.org/10.1109/ICCPS54341.2022.00011

Institute of Electrical and Electronics Engineers (IEEE)

2023-07-01

978-1-6654-0967-4

Proceedings - 13th ACM/IEEE International Conference on Cyber-Physical Systems, ICCPS 2022

13th ACM/IEEE International Conference on Cyber-Physical Systems, 2022-05-04 → 2022-05-06, Virtual, Online, Italy

Proceedings - 13th ACM/IEEE International Conference on Cyber-Physical Systems, ICCPS 2022

Green Open Access added to TU Delft Institutional Repository 'You share, we take care!' - Taverne project https://www.openaccess.nl/en/you-share-we-take-care Otherwise as indicated in the copyright section: the publisher is the copyright holder of this work and the author uses the Dutch legislation to make this work public.

Institutional Repository

conference paper

© 2022 H. J.C. Kroep, V. Gokhale, Ranga Rao Venkatesha Prasad