Publications

Selected publications

2015

H. van Welbergen, Y. Ding, K. Sattler, C. Pelachaud, and S. Kopp, Real-Time Visual Prosody for Interactive Virtual Agents, in: Intelligent Virtual Agents, 15th International Conference, LNCS, volume 9238, Springer, pp 139–151. 2015
BiBTeX

N. Mattar, H. van Welbergen, P. Kulms, and S. Kopp Prototyping User Interfaces for Investigating the Role of Virtual Agents in Human-Machine Interaction , in: Intelligent Virtual Agents, 15th International Conference, LNCS, volume 9238, Springer, pp 356–360. 2015
BiBTeX

2014

S. Kopp, H. van Welbergen, R. Yaghoubzadeh, H. Buschmeier. An architecture for fluid real-time conversational agents: integrating incremental output generation and input processing. Journal on Multimodal User Interfaces 8, 97–108, 2014.
BiBTeX

H. van Welbergen, R. Yaghoubzadeh and S. Kopp. AsapRealizer 2.0: The Next Steps in Fluent Behavior Realization for ECAs in: Intelligent Virtual Agents, 14th International Conference, LNCS, volume 8637, Springer, pp 449–462, 2014
Nominated for best paper of IVA 2014.
BiBTeX

H. van Welbergen, K. Bergmann, H. Buschmeier, S. Kahl, I. de Kok, A. Sadeghipour, R. Yaghoubzadeh, and S. Kopp. Architectures and standards for IVAs at the Social Cognitive Systems Group In: Proceedings of the Workshop on Architectures and Standards for Intelligent Virtual Agents at IVA 2014. Boston, MA, USA, pp 8–11, 2014.
BiBTeX

A. Cafaro A, A. Hartholt, H. van Welbergen (Eds) Proceedings of the Workshop on Architectures and Standards for Intelligent Virtual Agents at IVA 2014 Boston, 2014.
BiBTeX

P. Kulms, H. van Welbergen, and S. Kopp Prototyping von intuitiven und interaktiven Benutzerschnittstellen: Schnelles und einfaches Design von Anwendungen mit virtuellen Agenten In: Erste Transdisziplinäre Konferenz "Technische Unterstützungssysteme, die die Menschen wirklich wollen", Hamburg: Helmut-Schmidt-Universität, pp. 30–38, 2014.
BiBTeX

2013

D. Reidsma, and H. van Welbergen. AsapRealizer in practice – A modular and extensible architecture for a BML Realizer. Entertainment Computing 4(3), 157–169, 2013.
BiBTeX

H. van Welbergen, D. Reidsma and J. Zwiers. Multimodal plan representation for adaptable BML scheduling. Autonomous Agents and Multi-Agent Systems, 1 - 23, Januari 2013.
BiBTeX

H. van Welbergen, T. Baumann, S. Kopp, D. Schlangen. Incremental, Adaptive and Interruptive Speech Realization for Fluent Conversation with ECAs in: Intelligent Virtual Agents, 13th International Conference, LNCS, volume 8108, Springer, pp 468--469, 2013
BiBTeX

H. van Welbergen. OpenBMLParser: An Open Source BML Parser/Analyzer in: Intelligent Virtual Agents, 13th International Conference, LNCS, volume 8108, Springer, pp 432--433, 2013
BiBTeX

2012

H. van Welbergen, D. Reidsma and S. Kopp. An Incremental Multimodal Realizer for Behavior Co-Articulation and Coordination in: Intelligent Virtual Agents, 12th International Conference, LNCS, volume 7502, Springer, pp 175--188, 2012
BiBTeX

M. Lohse, H. van Welbergen. Designing Appropriate Feedback for Virtual Agents and Robots. Position paper at RO-MAN Workshop Robot Feedback in Human-Robot Interaction: How to Make a Robot "Readable" for a Human Interaction Partner., 2012
BiBTeX

D. Reidsma and H. van Welbergen. Elckerlyc in practice - on the integration of a BML Realizer in real applications, in proceedings of the 4th international conference on INtelligent TEchnologies for interactive enterTAINment(INTETAIN 2011), A. Camurri, C. Costa and G. Volpe (eds), Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, volume 78, Springer Verlag, Berlin, pp. 83-92, 2012
Best paper of INTETAIN 2011
BiBTeX

2011

D. Reidsma, E. Dehling, H. van Welbergen, J. Zwiers and A. Nijholt. Leading and following with a virtual trainer, in Proceedings of the 4th International Workshop on Whole Body Interaction, 2011
BiBTeX

D. Reidsma, I.A. de Kok, D. Neiberg, S. Pammi, B. van Straalen, K.P. Truong and H. van Welbergen. Continuous Interaction with a Virtual Human, Journal on Multimodal User Interfaces, A.A. Salah and T. Gevers (eds), 4(2):97-118, ISSN 1783-7677, 2011
BiBTeX

Dennis Reidsma, Herwin van Welbergen, and Job Zwiers. Multimodal Plan Representation for adaptable BML Scheduling, in Intelligent Virtual Agents, 11th International Conference, LNCS, volume 6895, Springer, pp. 296-308, 2011.
BiBTeX

Herwin van Welbergen, Yuyu Xu, Marcus Thiebaux, Wei-Wen Feng, Jingqiao Fu, Dennis Reidsma, and Ari Shapiro. Demonstrating and Testing the BML Compliance of BML Realizers, in Intelligent Virtual Agents, 11th International Conference, LNCS, volume 6895, Springer, pp. 269-281, 2011.
BiBTeX

Job Zwiers, Herwin van Welbergen, and Dennis Reidsma. Continuous Interaction within the SAIBA framework, in Intelligent Virtual Agents, 11th International Conference, LNCS, volume 6895, Springer, pp. 324-330, 2011.
BiBTeX

H. van Welbergen Behavior Generation for Interpersonal Coordination with Virtual Humans: on Specifying, Scheduling and Realizing Multimodal Virtual Human Behavior. PhD Thesis, University of Twente, September 09 2011, University of Twente, Enschede, The Netherlands
BiBTeX

2010

H. van Welbergen, B.J.H. van Basten, A. Egges, Z.M. Ruttkay and M.H. Overmars. Real Time Animation of Virtual Humans: A Trade-off Between Naturalness and Control, Computer Graphics Forum, 29(8):2530-2554, ISSN 0167-7055, 2010
BiBTeX

H. van Welbergen, D. Reidsma, Z.M. Ruttkay and J. Zwiers. Elckerlyc - A BML Realizer for continuous, multimodal interaction with a Virtual Human, Journal on Multimodal User Interfaces, 3(4):271-284, ISSN 1783-7677, 2010
BiBTeX

D. Reidsma, K.P. Truong, H. van Welbergen, D. Neiberg, S. Pammi, I.A. de Kok and B. van Straalen. Continuous Interaction with a Virtual Human, in Proceedings of the 6th International Summer Workshop on Multimodal Interfaces (eNTERFACE'10), A.A. Salah and T. Gevers (eds), University of Amsterdam, Amsterdam, ISBN 978-90-5776-213-0, pp. 24-39, 2010
BiBTeX

D. Reidsma, H. van Welbergen, R.C. Paul, B.L.A. van de Laar and A. Nijholt. Developing Educational and Entertaining Virtual Humans using Elckerlyc, in Proceedings 9th International Conference on Entertainment Computing (ICEC 2010), H.S. Yang, R. Malaka, J. Hoshino and J.H. Han (eds), Lecture Notes in Computer Science, volume 6243, Springer Verlag, London, ISBN 3-642-15398-4, ISSN 0302-9743, pp. 514-517, 2010
BiBTeX

H. van Welbergen, D. Reidsma and J. Zwiers A Demonstration of Continuous Interaction with Elckerlyc, in Proceedings of the Third Workshop on Multimodal Output Generation, MOG 2010, I. van der Sluis, K. Bergmann, C.M.J. van Hooijdonk and M. Theune (eds), CTIT Workshop Proceeding, volume WP2010, CTIT, Enschede, pp. 51-57, 2010
Best student paper of MOG 2010
BiBTeX

2009

H. van Welbergen, J. Zwiers and Z.M. Ruttkay. Real-Time Animation Using a Mix of Physical Simulation and Kinematics, Journal of Graphics, GPU, & Game Tools, 14(4):1-21, ISSN 1086-7651, 2009.
BiBTeX

As editor:
Computer Animation and Virtual Worlds, Volume 20 Issue 2-3 (June 2009), CASA 2009 Special Issue, A. Nijholt, A. Egges and H. van Welbergen (eds), Wiley, ISSN: 1546-427X
doi: 10.1002/cav.295

As editor:
Short Paper and Poster Proceedings of the 22nd Annual Conference on Computer Animation and Social Agents, A. Nijholt, A. Egges, H. van Welbergen and G.H.W. Hondorp (eds), CTIT Workshop Proceedings, Centre for Telematics and Information Technology, University of Twente, Enschede, ISSN 0929-0672, pp. 114, 2009

H. van Welbergen, B. J. H. van Basten, A. Egges, Zs. Ruttkay and M. H. Overmars. Real Time Character Animation: A Trade-off Between Naturalness and Control, in State-of-the-Art-Report proceedings of Eurographics, Mark Pauly and Guenther Greiner (eds), Eurographics Association, Munich, Germany, ISSN 1017-4656, pp.45-72, 2009
BiBTeX

S.E.M. Jansen and H. van Welbergen. Methodologies for the User Evaluation of the Motion of Virtual Humans, in Intelligent Virtual Agents, 9th International Conference, Lecture Notes in Computer Science, volume 5773, Springer Berlin / Heidelberg, Berlin, ISBN 978-3-642-04379-6, pp. 125-131, 2009
BiBTeX

H. van Welbergen and S.E.M. Jansen. User Evaluation of the Movement of Virtual Humans, in Short Paper and Poster Proceedings of The Twenty-Second Annual Conference on Computer Animation and Social Agents, A. Nijholt, A. Egges, H. van Welbergen and G.H.W. Hondorp (eds), CTIT Workshop Proceedings Series, Centre for Telematics and Information Technology, University of Twente, Enschede, ISSN 0929-0672, pp. 109-111, 2009
BiBTeX

H. van Welbergen, D. Reidsma, J. Zwiers, Z.M. Ruttkay and M. ter Maat. An Animation Framework for Continuous Interaction with Reactive Virtual Humans, in Short Paper and Poster Proceedings of The Twenty-Second Annual Conference on Computer Animation and Social Agents, A. Nijholt, A. Egges, H. van Welbergen and G.H.W. Hondorp (eds), CTIT Workshop Proceedings Series, Centre for Telematics and Information Technology, University of Twente, Enschede, ISSN 0929-0672, pp. 69-72, 2009
BiBTeX

H. van Welbergen and Z.M. Ruttkay. On the parameterization of clapping, in Gesture-Based Human-Computer Interaction and Simulation 7th International Gesture Workshop, GW 2007, Lisbon, Portugal, May 23-25, 2007, Revised Selected Papers, M. Sales Dias, S. Gibet, M.M. Wanderley and R. Bastos (eds), Springer Berlin/Heidelberg, Berlin, ISBN 978-3-540-92864-5, pp. 36-47, 2009
BiBTeX

2008

A. Nijholt, D. Reidsma, H. van Welbergen, H.J.A. op den Akker and Z.M. Ruttkay. Mutually Coordinated Anticipatory Multimodal Interaction, in Nonverbal Features of Human-Human and Human-Machine Interaction, A. Esposito, N.G. Bourbakis, N. Avouris and I. Hatzilygeroudis (eds), Lecture Notes in Computer Science, volume 5042, Springer Verlag, Berlin, ISBN 978-3-540-70871-1, pp. 70-89, 2008
BiBTeX

H. van Welbergen. Using motion capture data to generate and evaluate motion models for real-time computer animation, in Proceedings of Measuring Behavior 2008, 6th International Conference on Methods and Techniques in Behavioral Research, A.J. Spink, M.R. Ballintijn, N.D. Bogers, F. Grieco, L.W.S. Loijens, L.P.J.J. Noldus, G. Smit and P.H. Zimmerman (eds), Noldus Information Technology bv, Maastricht, ISBN 978-90-74821-81-0, ISSN A.J. Spink, M.R. Ballintijn, N.D, pp. 26-27, 2008
BiBTeX

F.W. Fikkert, H. van der Kooij, Z.M. Ruttkay and H. van Welbergen. Measuring Behavior using Motion Capture, in Proceedings of Measuring Behavior 2008, 6th International Conference on Methods and Techniques in Behavioral Research, A.J. Spink, M.R. Ballintijn, N.D. Bogers, F. Grieco, L.W.S. Loijens, L.P.J.J. Noldus, G. Smit and P.H. Zimmerman (eds), Noldus, Maastricht, The Netherlands, ISBN 978-90-74821-81-0, pp. 13-13, 2008
BiBTeX

Z.M. Ruttkay and H. van Welbergen. Elbows higher! Performing, observing and correcting exercises by a Virtual Trainer, in Proceedings of the Eight International Conference on Intelligent Virtual Agents, Lecture Notes in Artificial Intelligence, volume 5208, Springer Verlag, London, ISBN 978-3-540-85482-1, ISSN 0302-9743, pp. 409-416, 2008
BiBTeX

H. van Welbergen, Z.M. Ruttkay and B. Varga. Informed Use of Motion Synthesis Methods, pp. 132-143. In Motion in Games, A. Egges, A. Kamphuis and M. Overmars (eds), Springer Verlag, Berlin, ISBN 978-3-540-89219-9, 2008
BiBTeX

2007

H. Vilhjalmsson, N. Cantelmo, J. Cassell, N.E. Chafai, M. Kipp, S. Kopp, M. Mancini, S. Marsella, A.N. Marshall, C. Pelachaud, Z.M. Ruttkay, K. Thórisson, H. van Welbergen and R.J. van der Werf. The Behavior Markup Language: Recent Developments and Challenges, in Proceedings of the 7th International Conference on Intelligent Virtual Agents, C. Pelachaud, J-C. Martin, E. André, G. Collet, K. Karpouzis and D. Pelé (eds), Electronic Notes in Artificial Intelligence, volume 4722, Springer, Berlin, ISSN 0302-9743, pp. 90-111, 2007
BiBTeX

A. Nijholt, D. Reidsma, Z.M. Ruttkay, H. van Welbergen and P. Bos. Non-verbal and Bodily Interaction in Ambient Entertainment, in Proceedings workshop on Fundamentals of Verbal and Non-verbal Communication and the Biometrical Issue, A. Esposito, M. Bratanic, E. Keller and M. Marinaro (eds), NATO Security through Science Series, E: Human and Societal Dynamics, volume 18, IOS Press, Amsterdam, pp. 343-348, 2007
BiBTeX

Z.M. Ruttkay and H. van Welbergen. Let's shake hands! On the coordination of gestures of humanoids, in Artificial and Ambient Intelligence, April 02 2007, Newcastle University, Newcastle upon Tyne, UK, pp. 164-168, 2007
BiBTeX

H. van Welbergen and Z.M. Ruttkay. On the parametrization of clapping, in Proceedings of the 7th International Workshop on Gesture in Human-Computer Interaction and Simulation, M.S. Dias and R. Jota (eds), ADETTI, Lisboa, Portugal, ISBN 978-972-8862-05-3, pp. 20-21, 2007
BiBTeX

2006

Z.M. Ruttkay and H. van Welbergen. On the timing of gestures of a Virtual Physiotherapist, in 3rd Central European Multimedia and Virtual Reality Conference, C.S. Lanyi (eds), Pannonian University Press, Hungary, ISBN 963 9495 89 1, pp. 219-224, 2006
BiBTeX

H. van Welbergen, A. Nijholt, D. Reidsma and J. Zwiers. Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter explaining 2D-Presented Information, IEEE Intelligent Systems, 21(5):47-99, ISSN 1541-1672, 2006
BiBTeX

A. Nijholt, D. Reidsma and H. van Welbergen. Establishing Rapport with a Virtual Dancer, in Proceedings (re)Actor. The First International Conference on Digital Live Art., September 12 2006, London, UK, pp. 2, 2006
BiBTeX

D. Reidsma, H. van Welbergen, R.W. Poppe, P. Bos and A. Nijholt. Towards Bi-directional Dancing Interaction, in 5th International Conference on Entertainment Computing, September 20 2006, R. Harper, M. Rautenberg and M. Combetto (eds), LNCS, volume 4161, Springer Verlag, Cambridge, UK, ISBN 3-540-45259-1, pp. 1-12, 2006
BiBTeX

Z.M. Ruttkay, J. Zwiers, H. van Welbergen and D. Reidsma. Towards a Reactive Virtual Trainer, in Proc. of the 6th International Conference on Intelligent Virtual Agents, IVA 2006, August 20 2006, LNAI, volume 4133, Springer, Marina del Rey, CA, USA, ISBN 3-540-37593-7, ISSN 0302-9743, pp. 292-303, 2006
BiBTeX

2005

H. van Welbergen, A. Nijholt, D. Reidsma and J. Zwiers. Presenting in Virtual Worlds: Towards an Architecture for a 3D Presenter explaining 2D-Presented Information, in Intetain: INtelligent TEchnologies for interactive enterTAINment, December 02 2005, M. Maybury, O. Stock and W. Wahlster (eds), LNAI, volume 3814, Springer, Madonna di Campiglio, Italy, ISBN 3-540-30509-2, pp. 203-212, 2005
BiBTeX

A. Nijholt, H. van Welbergen and J. Zwiers. Introducing an Embodied Virtual Presenter Agent in a Virtual Meeting Room, In: Proceedings of the IASTED International Conference on Artificial Intelligence and Applications (AIA 2005), M.H. Hamza (ed.), Innsbruck, Austria, Acta Press, Anaheim,ISBN 0-88986-459-4, ISSN 1027-2666, February 2005, 579-584.
BiBTeX

H. van Welbergen. A virtual human presenter in a 3D meeting environment. Master's thesis, University of Twente, August 2005.
BiBTeX

2004

W. Lewis Johnson, Paola Rizzo, Wauter Bosma, Sander Kole, Mattijs Ghijsen and Herwin van Welbergen, (2004). Generating socially appropriate tutorial dialog, ISCA Workshop on Affective Dialogue Systems, Kloster Irsee, Germany, June 2004, Lecture Notes in Computer Science 3068, E. André, L. Dybkjaer, W. Minker & P. Heisterkamp (Eds.), ISBN 3-540-22143-3, Springer-Verlag, Berlin Heidelberg New York, 254-264.
BiBTeX