This paper attempts an introduction in the field through two complementary perspectives, the normative and the empirical one. The first perspectives concerns definition of the term through various international standards and norms (ISO 9126, 9241 etc.), while the second concerns the established practice of the field in relation to software usability evaluation techniques. Finally an example of application of heuristicevaluation experiment is briefly introduced
This paper presents usability perspective through the most frequently used models of software quality, i.e. FCM, CSQ and ISO 9126. Furthermore, it discuses the requirements, in terms of usability, in ISO 9001 quality assurance international standard (using the ISO 9000-3 guidelines for software as well), in Malcolm Baldrige National Quality Awards and in Capability Maturity Model. The aim of the paper is to position usability in the overall framework of software quality and to underline the importance of usability into software quality models and standards.
This paper describes a structured approach for evaluation of software usability. This evaluation approach that is based on decision support methods, has been proposed in other software engineering areas but not extensively used for usability engineering. Some typical usability evaluation problem situations are described and their most important aspects are outlined in the paper: the evaluation context (target, scope, actors), the type of the evaluation, the definition and measurement of the usability attributes, the definition of the preferences of the evaluator and the preference aggregation procedure.
2nd part. Chairperson: S. Retalis, University of CyprusThis paper concentrates on evaluation of learning environments and the appropriateness of the established usability techniques in the particularly difficult case of educational software.
This paper suggests a heuristic approach for the evaluation of web-sites. The paper presents an experiment through which heuristic evaluation was adapted for web-based applications. Special emphasis is provided in the training of the evaluators, attempting to answer the question if their training has an effect on the evaluation itself. The results from the presented study confirm that adapted heuristic evaluation is applicable to web applications and that the prior evaluators' expertise is of great importance, while it was proven that it is possible to augment, under conditions, this expertise in a short way, in order to increase effectiveness of the evaluation process.
This paper is also concerned with usability evaluation of a web application, i.e. a web-based Modern Greek online course. A set of user-cantered evaluation methods have been used in this case. In the paper, an analysis of the design methodology employed in this specific case study is provided and then examples of how valuable usability information can be extracted from different user-centre evaluation methods is presented. Conclusions, related to the analysis of the information obtained through the different evaluation methods and about the usability of the course, are also provided in the paper.
In this paper, a stepwise evaluation study is presented applied in evaluation of educational software. This approach includes a specific summative evaluation method, involving specially developed pre-test and post-test questionnaires, which provide data for both quantitative and qualitative analysis. The focus of this evaluation is on the learning effectiveness of the course and its instructional model as well as the identification of extensions and revisions needed to be made.
This paper concerns the design of a speech and natural language understanding system, i.e. a generic platform for the development of natural and multi-modal interactive interfaces to a wide area of databases employed by information service providers. The presented platform utilizes generic dialogue components easily adaptable to new services and languages. Generation of multilingual and multimodal interfaces is then achieved by incorporating the lexical and semantic relations of the database contents, thus reducing the development time and facilitating the system's maintenance and transportability to different applications and languages. >
This paper describes the design of a distributed web-based multi-agent application that supports sharing of personal document collections of the members of a scientific group. The paper focuses on the system architecture and technology applied, functionality and especially typical patterns of use. Issues of control, task allocation, transparency and privacy protection are discussed with reference to interaction design of the system. The usability factors defining these last two innovative environments need to be redefined and are a matter of discussion in the frame of the workshop.