Replication Kit - Automatically Detecting Usability Issues in Virtual Reality Applications

Main Author: Metje, Sören
Format: info software Journal
Bahasa: eng
Terbitan: , 2021
Subjects:
VR
Online Access: https://zenodo.org/record/4585921
Daftar Isi:
  • This replication kit aims at enabling the reproduction of the results that we described in my bachelor thesis `Automatically Detecting Usability Issues in Virtual Reality Applications`. In this thesis, we proposed concepts to detected three different usability issues. We extended the AutoQUEST framework to implement these concepts. For each issue detection concept, we added a separate smell rule. AutoQUEST traces events, such as user interactions and remote method invocations, on a software. Based on this, it supports usage and usability analysis as well as usage-based test case generation and execution. AutoQUEST is developed by Patrick Harms and Steffen Herbold. The website can be found here: https://autoquest.informatik.uni-goettingen.de/trac. In order to evaluate the detection concepts, we procedurally generated input data (user sessions). After that, we analyzed the user sessions with AutoQUEST, extracted the number of detected smells and compared it with our expectation. The kit contains following components: - Code of the user session generators specific for each smell detection methods - Code of the AutoQUEST framework including the implemented smell detection methods - Docker container image for the session generators - Docker container image for AutoQUEST - Bash scripts that automate the generation and analysis of multiple user session sets - Readme text files that describe how to use the software and how to replicate our results - All session sets we generated in the context of our detection method evaluations - All results of Autoquest’s usability analysis for each session set