Gandalf

Gandalf is a fully autonomous, humanoid agent that perceives a user's multimodal actsNspeech, prosody, manual gesture, body language, gazeNand generates appropriate multimodal responses to these in real-time (speech, gaze, facial & manual gesture & head movement). Gandalf has knowledge about the solar system and can travel to and tell users about the planets and moons with speech and gesture. Gandalf demonstrates a coherent framework for psychosoical dialogue skills which enables the production of concurrent reactive and reflective behaviors and planning of communicative acts, with response cycles analogous to those found in human face-to-face dialogue, from 1/6th of a second and up. Gandalf has been tested in interaction with humans and shown to be capable of supporting and sustaining multimodal, situated, real-time dialogue. Content Areas: Interaction between people and agents, face-to-face communication, action selection and planning, real-time performance, synthetic agents.