User story

Level design

Work in process

Engineering design process

Game Developer

Software development

Video game development

Biology

Human–computer interaction

Operating system

Literature

Software engineering

Engineering

Pathos

Workflow

Paleontology

Fidelity

Programming language

User experience design

Operations management

Software

Context (archaeology)

Game development tool

Computer science

Design process

Game testing

Process (computing)

Game design

Game design document

Telecommunications

Database

Mechanical engineering

Iterative user-centred design has become a standard approach for developing interactive products. This process relies on prototyping and usertesting as early as possible to deliver a positive user experience and ensure that final products align with designers' intentions. The video game industry has benefited greatly from this design approach, with games user researchers adapting and introducing various evaluation techniques. However, repeatedly creating game builds suitable for usertesting (i.e., high-fidelity prototypes) is time-consuming and expensive. Moreover, recruiting users and conducting evaluation sessions are labour-intensive tasks. These challenges are especially pressing in the evaluation of game level and world design, where designers may wish to evaluate many alternatives or rapidly measure the impact of many small design changes on a game's ability to deliver the intended experience. To support developers grappling with these challenges, we have developed PathOS, a novel tool for simulating testing sessions with agents that model player navigation. This paper reports on our development objectives, implementation, and a user study with professional game developers to assess PathOS' application in a level design context. Our results demonstrate the ability of an automated testing tool to enhance the workflow of practicing developers.

Artificial Players in the Design Process: Developing an Automated Testing Tool for Game Level and World Design