Computer Science Department
Technical ReportNWU-CS-05-10June 20, 2005
Hierarchical Parallel Markov Modelsfor Interactive Social Agents
In this report I present hierarchical parallel Markov models for the creation of interactivesocial agents for video games and entertainment.The approach extends existing, popular character technologies for social, communicativeinteraction. First, adding the knowledge of temporal interaction structure enables naturallanguage interaction on a time scale much longer than current chatterbot technologies.Second, adding support for hierarchical interaction decomposition, where an interactionis represented as a collection of smaller, simpler elements, simplifies the authoring of complex engagement. Third, adding support for the concurrent engagement of theseelements enables engagement in interleaved, naturalistic communication.The resulting decomposition supports redundancy of representation, gracefulperformance degradation through the simultaneous engagement of behaviors on differentlevels of abstraction, and the stochastic approximation mechanism increases robustness inthe face of noise and ambiguity.In this report, I present the details of hierarchical parallel Markov models, I examine twoentertainment agents that use this technique, and explain the implementational details of how such an approach can be used in the development of future systems.
Games, characters, Markov models, social interaction.