wiki:AsapRealizer

AsapRealizer - A BML Realizer for incremental, fluent, multimodal interaction with a virtual human or robot

AsapRealizer is a novel realizer, developed as a jointly by the  Sociable Agents group in Bielefeld and the  Human Media Interaction group in Twente. It is a fusion of our state of the art behavior realizers ACE and Elckerlyc.

AsapRealizer is a  BML 1.0 compliant behavior realizer for generating multimodal verbal and nonverbal behavior for virtual humans and robots. It is designed specifically to allow very fluent interaction between the virtual human and its human interaction partner. To this end, AsapRealizer provides behavior generation elements that support incremental behavior construction (including emergent gesture co-articulation) and interactional coordination (e.g. behavior synchrony, fluent turn taking, active listening, attentive speaking). Animation in AsapRealizer is generated using a mix between the precise temporal and spatial control offered by procedural motion and the naturalness of physical simulation.

Citing AsapRealizer:

  1. van Welbergen, R. Yaghoubzadeh and S. Kopp. AsapRealizer 2.0: The Next Steps in Fluent Behavior Realization for ECAs in: Intelligent Virtual Agents, 14th International Conference, LNCS, volume 8637, Springer, pp 449–462, 2014  download paper


Getting Started

  • Licenses -- Explanation of the GPL3 license used for AsapRealizer, and the plans to move to more flexible licenses

Using AsapRealizer

Behavior Markup Language

  • BML -- Information about the BML standard in AsapRealizer
  • BMLA -- Documentation on AsapRealizer's BML extensions that provide top-down plan adaptability and incrementality
  • BMLT -- Documentation for the custom behavior types defined in BML-Twente
  • MURML -- AsapRealizer's MURML BML extension
  • BMLIPAACA -- Sending ipaaca messages with AsapRealizer
  • BMLP -- Documentation for the custom behavior types of the PictureEngine
  • BMLIS? -- Coming soon
  • LiveMocap -- Extensions to embed live motion capture performance of specific bodyparts in the realization

Behavior Modalities

Environments and Embodiments

Virtual characters

Configuration of AsapRealizer's default Engines

Tools

Develop

  • VirtualHumanLoader -- Specifying, configuring, and loading a Virtual Human and its behavior repertoire
  • RealizerPort -- Connecting AsapRealizer to your application: sending BML to the Virtual Human and receiving feedback about its performance
  •   Javadoc for AsapRealizer
  • UsingResources -- How to refer resources such as avatars and gesture repertoires on the classpath and in your code
  • AssetCreation -- Add new gesture repertoire, new avatar bodies and faces, etc.

Extend AsapRealizer

Support

  • FAQ/Troubleshooting -- Frequently Asked Questions and Frequently Occuring Problems
  • Forum -- Ask questions and help each other in the forums
  • ImproveDocumentation -- Your support in improving the documentation is highly appreciated
  • ReportBugs -- report bugs and request features using tickets
  • Contact -- Contact the main developers

Acknowledgements