Nintendo Wiimote and Experimental Psychology:
Blending Cognition and Action

 

Home | Summary of the experiments | Official press release | Download the paper | Details on using the Wiimote

Corresponding author: Rick Dale, Assistant Professor, University of Memphis

Website for the article:

Dale, R., Roche, J., Snyder, K., & McCall, R. (2008). Exploring action dynamics as an index of paired-associate learning. PLoS ONE, 3, e1728. doi:10.1371/journal.pone.0001728

Summary (from the paper): Much evidence exists supporting a richer interaction between cognition and action than commonly assumed. Such findings demonstrate that short-timescale processes, such as motor execution, may relate in systematic ways to longer-timescale cognitive processes, such as learning. We further substantiate one direction of this interaction: the flow of cognition into action systems. Two experiments explored match-to-sample paired-associate learning, in which participants learned randomized pairs of unfamiliar symbols. During the experiments, their hand movements were continuously tracked using the Nintendo Wiimote. Across learning, participant arm movements are initiated and completed more quickly, exhibit lower fluctuation, and exert more perturbation on the Wiimote during the button press. A second experiment demonstrated that action dynamics index novel learning scenarios, and not simply acclimatization to the Wiimote interface. Results support a graded and systematic covariation between cognition and action, and recommend ways in which this theoretical perspective may contribute to applied learning contexts.

 

Support: This work was supported in part by National Science Foundation grant BCS-0720322 to Rick Dale.