Test procedure for evaluating the human-machine interface of vehicles with automated driving systems

Objective: The human-machine interface (HMI) is a crucial part of every automated driving system (ADS). In the near future, it is likely that-depending on the operational design domain (ODD)-different levels of automation will be available within the same vehicle. The capabilities of a given automat...

Full description

Saved in:
Bibliographic Details
Published in:Traffic injury prevention 2019-06, Vol.20 (sup1), p.S146-S151
Main Authors: Naujoks, Frederik, Hergeth, Sebastian, Wiedemann, Katharina, Schömig, Nadja, Forster, Yannick, Keinath, Andreas
Format: Article
Language:English
Subjects:
Acceptance
Automated driving
Automation
Automobile Driving
Controllability
Design standards
Evaluation
Human factors
human-machine interface
Humans
Man-machine interfaces
Norms
Performance measurement
Product development
Test procedures
usability
User-Computer Interface
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Objective: The human-machine interface (HMI) is a crucial part of every automated driving system (ADS). In the near future, it is likely that-depending on the operational design domain (ODD)-different levels of automation will be available within the same vehicle. The capabilities of a given automation level as well as the operator's responsibilities must be communicated in an appropriate way. To date, however, there are no agreed-upon evaluation methods that can be used by human factors practitioners as well as researchers to test this. Methods: We developed an iterative test procedure that can be applied during the product development cycle of ADS. The test procedure is specifically designed to evaluate whether minimum requirements as proposed in NHTSA's automated vehicle policy are met. Results: The proposed evaluation protocol includes (a) a method to identify relevant use cases for testing on the basis of all theoretically possible steady states and mode transitions of a given ADS; (b) an expert-based heuristic assessment to evaluate whether the HMI complies with applicable norms, standards, and best practices; and (c) an empirical evaluation of ADS HMIs using a standardized design for user studies and performance metrics. Conclusions: Each can be used as a stand-alone method or in combination to generate objective, reliable, and valid evaluations of HMIs, focusing on whether they meet minimum requirements. However, we also emphasize that other evaluation aspects such as controllability, misuse, and acceptance are not within the scope of the evaluation protocol.
ISSN:1538-9588
1538-957X
DOI:10.1080/15389588.2019.1603374