Of MOS and men: Bridging the gap between objective and subjective quality measurements in mobile TV

Of MOS and men: Bridging the gap between objective and subjective quality measurements in mobile TV

De Koning, T.C.M.
Veldhoven, P.
Knoche, H.
Kooij, R.E.

Electrical Engineering, Mathematics and Computer Science

2007-02-27

In this paper we explore the relation between subjective and objective measures of video quality. We computed objective MOS values from video clips using the video quality measuring tool VQM and compared it to the clips’ subjective Acceptability scores. Using the ITU defined mapping (M2G) from MOS to binary Good or Better (GoB) values, we compared the M2G translated values to the clips’ subjective Acceptability scores at various encoding bitrates (32-224kbps) and sizes (120x90, 168x126, 208x156 and 240x180). The results show that in the domain of mobile TV the ITU mapping M2G represents a serious overestimation of Acceptability. The mapping M2A, between MOS and Acceptability, that we suggest provides a significant improvement of 76% in the root mean square error (RMSE) over M2G. We show that Acceptability depended on more than just the visual quality and that both content type and size are essential to provide accurate estimates of Acceptability in the field of mobile TV. We illustrate this gain in Acceptability predictions for the popular content type football (soccer). In terms of RMSE our content dependent mapping (M2Af) yielded an improvement of 39% over M2A. Future research will validate the predictive power of our suggested mapping on other video material.

mobile TV
acceptability
MOS
VQM
subjective quality
objective quality

http://resolver.tudelft.nl/uuid:4d2d66dc-44c9-49c1-ac9d-09d0ab0bb320

SPIE

0277-786X

Proceedings of SPIE, 2007 vol. 6507

Institutional Repository

conference paper

(c)2007 De Koning, T.C.M., Veldhoven, P., Knoche, H., Kooij, R.E.