Günther Knoblich

Shaheed Azaad

Natalie Sebanz

Even the simplest social interactions require us to gather, integrate, and act upon, multiple streams of information about others and our surroundings. In this Element, we discuss how perceptual processes provide us with an accurate account of action-relevant information in social contexts. We overview contemporary theories and research that explores how: (1) individuals perceive others' mental states and actions, (2) individuals perceive affordances for themselves, others, and the dyad, and (3) how social contexts guide our attention to modulate what we perceive. Finally, we review work on the cognitive mechanisms that make joint action possible and discuss their links to perception.

Perception and Action in a Social Context

Ipke Wachsmuth

Manuela Lenzen

Communication is not just about the transfer of verbal information. Gestures, facial expressions, intonation and body language are all major sources of information during conversation. This book presents a new perspective on communication, one that will help us to better understand humans, and also to build machines that can communicate.

Embodied Communication in Humans and Machines

When people communicate face to face they don't just exchange verbal information. Rather, communication encompasses the whole body. Communication partners synchronize their body sway, and mimic or imitate each other's body postures and actions. They produce a multitude of manual and facial gestures that help to illustrate what is being said, show how communication partners feel, or or reveal verbal deception. Moreover, face-to-face communication takes place in shared contexts where partners jointly attend and refer to the same objects, often while working on joint tasks such as carrying a table or repairing a car together. Traditionally, communication research has neglected these parts of communication using the engineering model of signal transmission as the main theoretical metaphor. This book takes a new look at recent empirical findings in the cognitive and neurosciences, showing that the traditional approach is insufficient, and presenting a new interdisciplinary perspective, the Embodied Communication perspective. The core claim of the Embodied Communication perspective is that human communication involves parallel and highly interactive couplings between communication partners. These couplings range from low-level systems for performing and understanding instrumental actions, like the mirror system, to higher-systems that interpret symbols in a cultural context. The book can also serve as a guide for engineers who construct artificial agents and robots that should be able to interact with humans.

Embodied agents play an increasingly important role in cognitive interaction technology. The two main types of embodied agents are virtual humans inhabiting simulated environments and humanoid robots inhabiting the real world. So far research on embodied communicative agents has mainly explored their potential for practical applications. However, the design of communicative artificial agents can also be of great heuristic value for the scientific study of communication. It allows researchers to isolate, implement, and test essential properties of inter-agent communications in operational models. Modeling communication with robots and virtual humans thus involves the vision of using communicative machines as research tools. Artificial systems that reproduce certain aspects of natural, multimodal communication help to elucidate the internal mechanisms that give rise to different aspects of communication. In short, constructing embodied agents who are able to communicate may help us to understand the principles of human communication. As a comprehensive theme, “Embodied Communication in Humans and Machines” was taken up by an international research group hosted by Bielefeld University’s Center for Interdisciplinary Research (ZiF – Zentrum für interdisziplinäre Forschung) from October 2005 through September 2006. The overarching goal of this research year was to develop an integrated perspective of embodiment in communication, establishing bridges between lower-level, sensorimotor functions and a range of higher-level, communicative functions involving language and bodily action. The present volume grew out of a workshop that took place during April 5–8, 2006 at the ZiF as a part of the research year on embodied communication.

Second ZiF Research Group 2005/2006 International Workshop on Embodied Communication in Humans and Machines, Bielefeld, Germany, April 5-8, 2006, Revised Selected Papers

Günther Knoblich

Books

Your next favorite book is out there