The First IROS 2010 Workshop on Robots and Musical Expressions

- A workshop of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems  -

 (18 Oct, 2010, Taipei, Taiwan)

CFP: Special Issue on on Music Content Processing by and for Robots
(EURASIP Journal on Audio, Speech, and Music Processing) [pdf]
deadline for submission: April 1, 2011

Overview

Music is arguably the most popular form of sounds for humans, and a core occupation of our technological society. It is only natural to expect that robots should be our partners and interact with us in daily environments where musical sounds are present. Despite great improvements made in recent years in the field of Robot Audition, especially in speech and dialogue, much less attention has been devoted to robots dealing with non-speech sounds, especially music. Much work is still needed for robots to be able to analyze and synthesize musical sounds as we do, to understand and reason about music, and to adapt behaviors accordingly. For instance, most robots can't recognize/categorize musical sounds nor associate expression/emotion, and fall short in delivering real-time interactions according to this high-level of understanding (synchronizing movements, displaying emotions, adapting behavior, etc.).  The processing of high-level descriptions of music from audio signals is a focus of the Music Information Retrieval (MIR) community. This field is seeing recent progresses, however, they mostly focus on desktop software-based applications. So far in that field, the potential to use robots as a development platform has not been fully recognized.  On the other hand, developments in entertainment robotics have been increasing for the past few years, and fundamental issues for musical human-robot interactions are starting to be addressed.  

Producing computational models of such high-level behaviors, embedded in robotic platforms, calls for novel research at the frontier between Robotics and MIR.  This full-day workshop precisely aims at bringing "the best of two worlds" in fostering scientific exchanges of the highest scientific standard between researchers in Robotics, MIR and Cognitive Science.  

The objectives of this workshop are to:

Topics

This workshop includes the following topics related to musical robots:

Program

8:20-8:30 Opening Remark
8:30-10:00 Session 1: Dancing Robots (oral)
  • A Platform for Dance Performances with Multiple Quadrocopters  
    • Angela Schöllig, Federico Augugliaro, Raffaello D’Andrea
  • Towards a Dancing-to-music Humanoid Robot: Temporal Scaling Model of Whole Body Motion for a Dancing Humanoid Robot 
    • Shunsuke Kudoh, Takahiro Okamoto, Takaaki Shiratori, Shin’ichiro Nakaoka, Katsushi Ikeuchi
  • Synthesis of Dancing Motions Based on a Compact Topological Representation of Dance Styles
    • João Lobato Oliveira, Luiz Naveda, Fabien Gouyon, Marc Leman, Luis Paulo Reis
10:00-10:20 break (Posters should be hung.)
10:20-11:50 Session 2: Education and Interaction 1 (oral)
  • Building Musical Robots for the Machine Orchestra 
    • Ajay Kapur, Michael Darling
  • Orchestral Conducting for Non-Humans: its Impact in Interdisciplinary Education
    • Teresa M. Nakra, Yunfeng(Jennifer) Wang, Andrea Salgian, Christopher Ault
  • Developing Humanoids For Musical Interaction
    • Youngmoo Kim, Alyssa Batula, David Grunberg, Daniel M. Lofaro, JunHo Oh, Paul Y. Oh
11:50-13:40 Lunch
13:40-15:10 Session 3: Interaction 2 (oral)
  • Two-level Synchronization using Particle Filter for Co-player Music Robots 
    • Takuma Otsuka, Kazuhiro Nakadai, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno
  • Integration of flutist gesture recognition and beat tracking for human-robot ensemble
    • Takeshi Mizumoto, Angelica Lim, Takuma Otsuka, Kazuhiro Nakadai, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno
  • A Survey of Recent Interactive Compositions for Shimon – The Perceptual and Improvisational Robotic Marimba Player 
    • Gil Weinberg, Guy Hoffman, Ryan Nikolaidis, Trishul Mallikarjuna
15:10-15:30 break
15:30-17:00 Session 4: Poster Session
  • “playing robot”: An Investigation of Situated Cognition in the Context of (Artistic) Human Robot Interaction Design 
    • Jin Hyun Kim, Son-Hwa Chang, Lüder Schmidt
  • Integration of percussion robots “RobotMusic” with the Data-Suit “BodySuit”: Technological Aspects and Concepts 
    • Suguru Goto and Fuminori Yamasaki
  • Programming by Playing and Approaches for Expressive Robot Performances
    • Angelica Lim, Takeshi Mizumoto, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno
  • Humans and Machines Interacting in a Robotic Sonification Environment
    • Artemis Moroni, Josué Ramos, Eliane Guimarães, Jônatas Manzolli
  • Robotic applications in music research – a cognitive science perspective
    • Lüder Schmidt
  • Can a Robot Get Smarter by Listening to Itself? Musical Memory as an Extended Auditory-Neural-Motor Loop 
    • Assaf Talmudi, Aaron Albin, Parag Chordia
17:00-18:00 Session 5: Interaction 3 (oral)
  • Physical Human-Robot Cooperation using Musical Rhythm 
    • Kenta Yonekura, Chyon Hae Kim, Kazuhiro Nakadai, Hiroshi Tsujino, Shigeki Sugano
  • Research on Anthropomorphic Musical Robots and Their Application to Musical Interaction
    • Jorge Solis, Atsuo Takanisi

General information for presenters:

Organizers

Kazuhiro Nakadai
(Honda Research Institute Japan Co., Ltd./Tokyo Tech.)
Fabien Gouyon
(Telecommunications and Multimedia Unit, INESC Porto)
Hiroshi G. Okuno
(Department of Intelligence Science and Technology, Graduate School of Informatics, Kyoto University)
Jorge Solis
(Faculty of Sci. and Eng., Waseda University/Humanoid Robotics Institute, Waseda University)
Atsuo Takanishi
(Faculty of Sci. and Eng., Waseda University/Humanoid Robotics Institute, Waseda University)

Reviewers

Last update: Dec. 2, 2010 (16:43 AM JST)