QUALITY EVALUATION OF LONG DURATION AUDIOVISUAL CONTENT
Abstract
Subjective quality assessment of multi-modal services depends on a number of external
factors that affect the final judgment, e.g. user expectations, user fatigue,
room environment or methodology used in the evaluation process. In order to obtain
as accurate as possible measurement of the perceived quality, an experimenter
should carefully consider all factors contributing to the overall experience. Particulary
important is to choose the right measurement method for the purpose of a
specific task. In spite of the fact that a number of standardized test procedures for
the quality assessment exist it is not always possible to find the one which suits a
certain research purpose. In such case, the development of new assessment techniques
is usually necessary, which then needs to be followed by appropriate testing
and validation procedures. The lack of an appropriate methodology for instantaneous
measurement of user’s audio-visual quality expectations/preferences over
extended periods of time, as well as the scarce attention devoted to the topic of
temporal development of Quality of Experience, were the main driving factors for
this work.
This dissertation, composed of five papers, helps to understand the underlying
attributes of perceived quality and user cognitive processes used in evaluation of
long duration audiovisual content. The work described here is twofold: firstly,
a novel methodology for continuous quality evaluation is proposed, and secondly,
using the method, the effect of the time dimension on user’s behavioral reaction to
the experienced quality is investigated. The momentary-based approach described
in this work reflects instantaneous measures of users’ quality judgements. Such
measures allow capturing time varying changes of system characteristics and help to
contribute to the holistic vision of quality of experience. The results obtained from
several experiments described in this work reveal the importance of content duration
in the process of quality assessment and its impact on user’s quality requirements.
The knowledge gained from those studies can be directly applied to the quality
assurance models of multimedia content providers and may serve as a valuable
source of information for objective quality metrics development.
Has parts
Paper A: Borowiak, Adam Dominik; Reiter, Ulrich; Svensson, U. Peter. Quality Evaluation of Long Duration Audiovisual Content. I: 2012 IEEE Consumer Communications and Networking Conference (CCNC). IEEE conference proceedings 2012 http://dx.doi.org/10.1109/CCNC.2012.6181113 (c) 2012 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.Paper B: Borowiak, Adam Dominik; Reiter, Ulrich. Quality Evaluation of Long Duration AV Content — An Extended Analysis Using a Novel Assessment Methodology. Multimedia tools and applications 2014 ;Volum 74.(2) s. 367-380, The final publication is available at Springer via http://dx.doi.org/10.1007/s11042-014-1920-7
Paper C: Borowiak, Adam Dominik; Reiter, Ulrich; Svensson, U. Peter. Audio quality requirements and comparison of multimodal vs. unimodal perception of impairments for long duration content. Journal of Signal Processing Systems 2014 ;Volum 74.(1) s. 79-89, The final publication is available at Springer via http://dx.doi.org/10.1007/s11265-013-0777-8
Paper D: Borowiak, Adam Dominik; Reiter, Ulrich. Long Duration Audiovisual Content:Impact of Content Type and Impairment Appearance on User Quality Expectations Over Time. I: Fifth International Workshop on Quality of Multimedia Experience (QoMEX 2013). IEEE conference proceedings http://dx.doi.org/10.1109/QoMEX.2013.6603237 (c) 2013 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.
Paper E: Borowiak, Adam Dominik; Reiter, Ulrich; Svensson, U. Peter. Momentary Quality of Experience: Users’ Audio Quality Preferences Measured Under Different Presentation Conditions. Journal of The Audio Engineering Society 2014 ;Volum 62.(4) s. 235-243 - Is not included due to copyright