Usability

Cognitive psychology

Psychoanalysis

Neuroscience

Low arousal theory

Social psychology

Frustration

Psychiatry

Computer science

Anxiety

Eye tracking

Pupil

Psychology

Arousal

Artificial intelligence

Pupillary response

Pupillometry

Gaze

Human–computer interaction

International Journal of Human-Computer Studies

Arousal detection has been used as a proxy to sense frustration, cognitive load, anxiety and stress, which are relevant to user experience. The mechanisms provide limited potential for widespread use beyond the lab. We used eye-tracking to capture pupillary response and gaze behaviour during user interaction. Pupillary response is used to sense changes in arousal while gaze analysis reveals the users’ focal attention during moments of increased arousal. A controlled study was run using our approach to detect arousal on the web. Participants (N=40) were presented with four tasks on the web. Each participant carried out each task in a normal and disruptive mode (modified to induce frustration). For ecological validity, we focused on frustration induced arousal, using common causes of frustration during user interaction. Results suggest that our approach is able to discriminate between frustrating tasks and normal tasks to a large effect (ηp2=0.690,p<.001). We discuss how arousal sensing opens up research avenues for usability and accessibility testing in the lab and the potential for use in naturalistic settings.

Unobtrusive arousal detection on the web using pupillary response