THEORETICAL FRAMEWORKS FOR UNDERSTANDING MULTIDISPLAY INTERACTION PATTERNS

Abstract

This study investigates interaction patterns within multidisplay environments using a mixed-methods approach that integrates empirical behavioral analysis with theoretical modeling. A controlled experimental setup involving wall displays, tablets, and mobile devices was used to collect quantitative data such as gesture frequencies, dwell times, cross-display transitions, modality co-occurrence, and error rates, complemented by qualitative observation of spatial coordination, gaze behavior, and user role dynamics. Results indicate that user interactions are highly adaptive and context-sensitive, shaped by spatial layout, task demands, and the affordances of each display. Cross-display transitions varied widely across users, and gesture–gaze synchronization emerged as a consistent multimodal strategy for coordination. Higher error rates were observed during rapid multitasking phases, while tri-display configurations yielded the most efficient task completion times and highest user satisfaction scores. Heatmaps and 3D interaction density plots revealed zones of concentrated collaborative activity, validating theories of spatial convergence. The observed interaction behaviors were mapped onto theoretical frameworks including Distributed Cognition, Activity Theory, and Embodied Interaction, revealing strong alignment between empirical findings and existing theoretical constructs. The study offers a novel synthesis of multidisplay interaction grounded in data and theory, emphasizing the need for fluid, responsive system designs that accommodate spatial cognition, embodied engagement, and collaborative dynamics. These insights inform the design of next-generation collaborative systems and enrich our theoretical understanding of complex interaction ecosystems.