Evaluation Framework for the iTRACK Integrated System

Evaluation Framework for the iTRACK Integrated System

Abdelgawad, Ahmed (University of Agder)
Comes, M. (TU Delft Transport and Logistics)

Franco, Zeno (editor)
Gonzalez, Jose J. (editor)
Canos, Jose H. (editor)

2019

Evaluation and testing are major steps in the development of any information system, particularly if it is to be used in high-risk contexts such as conflicts. While thus far there are various approaches for testing against technology requirements; usability or usefulness, there is a lack of a comprehensive evaluation framework that combines the three elements. The lack of such a framework and commonly agreed standards constitutes a barrier for innovation, and at the same time imposes risks to responders if the technology is introduced without proper testing. This paper aims to close this gap. Based on a reviewing of evaluation methods and measurement metrics, we design a comprehensive evaluation framework including common code quality testing metrics, usability testing methods, subjective usefulness questionnaires, and performance indicators. We demonstrate our approach by using the example of an integrated system for the safety and security of humanitarian missions, and we highlight how our approach allows measuring the system’s quality and usefulness.

Evaluation Framework
Humanitarian Disaster
Software Testing
Software Usability
Software Usefulness

http://resolver.tudelft.nl/uuid:736384b2-b5ab-444a-ae9f-d5e1eb8aa4d2

ISCRAM, Valencia

978-84-09-10498-7

ISCRAM 2019 - Proceedings: 16th International Conference on Information Systems for Crisis Response and Management

Proceedings of the International ISCRAM Conference, 2411-3387, 2019-May

Institutional Repository

conference paper

© 2019 Ahmed Abdelgawad, M. Comes