wiki:PublicationsAboutElckerlyc

Version 8 (modified by dennisr, 8 years ago) (diff)

--

Elckerlyc

Main article about the BML Realizer [1]

Abstract -- Elckerlyc is a BML Realizer for generating multimodal verbal and nonverbal behavior for Virtual Humans (VHs). The main characteristics of Elckerlyc are that (1) it is designed specifically for continuous interaction with tight temporal coordination between the behavior of a VH and its interaction partner; (2) it provides a mix between the precise temporal and spatial control offered by procedural animation and the physical realism of physical simulation; and (3) it is designed to be highly modular and extensible, implementing the architecture proposed in SAIBA.

Continuous Interaction with a Virtual Human

Article about Attentive Listening and Continuous Interaction [2]

Abstract -- This paper presents our progress in developing a Virtual Human capable of being an attentive speaker. Such a Virtual Human should be able to attend to its interaction partner while it is speaking -- and modify its communicative behavior on-the-fly based on what it observes in the behavior of its partner. We report new developments concerning a number of aspects, such as scheduling and interrupting multimodal behavior, automatic classification of listener responses, generation of response eliciting behavior, and strategies for generating appropriate reactions to listener responses. On the basis of this progress, a task-based setup for a responsive Virtual Human was implemented to carry out two user studies, the results of which are presented and discussed in this paper.

Multimodal Plan Representation for Adaptable BML Scheduling

Paper about the flexible scheduling setup [3]

Abstract -- In this paper we show how behavior scheduling for Virtual Humans can be viewed as a constraint optimization problem, and how Elckerlyc uses this view to maintain a extensible behavior plan representation that allows one to make micro-adjustments to behaviors while keeping constraints between them intact. These capabilities make it possible to implement tight mutual behavior coordination between a Virtual Human and a user, without requiring to re-schedule every time an adjustment needs to be made.

!BiBTeX

Bibtex references stored on: BibTexElckerlycPublications

References

  1. ^van Welbergen, Herwin and Reidsma, Dennis and Ruttkay, Zsófia M. and Zwiers, Job, Elckerlyc: A BML Realizer for continuous, multimodal interaction with a virtual human, 10.1007/s12193-010-0051-3, Journal on Multimodal User Interfaces, 3, 4, 2010, 3, article, 271--284,
  2. ^Reidsma, Dennis and de Kok, Iwan and Neiberg, Daniel and Pammi, Sathish and van Straalen, Bart and Truong, Khiet P and van Welbergen, Herwin, Continuous Interaction with a Virtual Human, Journal on Multimodal User Interfaces, 2011, article,
  3. ^Reidsma, Dennis and Welbergen, Herwin van and Zwiers, Job, Multimodal Plan Representation for Adaptable BML Scheduling, Proc. of IVA 2011, 2011, inproceedings,