日本語版

Takeshi Mizumoto logo of music robot group

Affiliation
Okuno and Ogata Lab., Graduate School of Informatics, Kyoto University
Ph.D Candidate, JSPS Fellowship for Young Scientists DC2
Phone
+81-75-753-5992
Email
"My family name in lower case"@kuis.kyoto-u.ac.jp
Research interests
Robot Thereminist: Human-robot ensemble using Thereminist Robot
Sound Imaging: visualization of acoustic communication of animals in their habitat.
Others
HARK development team, HARK documentation team

Demo Videos

Theremin player robot: Thereminist Robot Other demo videos are here

Publications

Papers written in Japanese are not translated yet.

First Author

Thesis
  1. Takeshi Mizumoto:
    Temporal Synchronization among Interacting In dividuals in Human-Robot Ensembles and Frog Choruses
    PhD Thesis, Feb. 2013. pdf
  2. Takeshi Mizumoto:
    Modeling of a Theremin's Pitch and Volume Characteristics and Feedforward Control for a Thereminist Robot
    Master Thesis, Feb. 2010.
  3. Takeshi Mizumoto:
    Studies of a Robot Capable of Counting the Beat Structure by Separating Music and Robot's Own Counting Voice,
    Graduation Thesis, Faculty of Engineering, Kyoto University, Feb. 2008.
Peer-reviewed Journals
  1. Takeshi Mizumoto, Ikkyu Aihara, Takuma Otsuka, Ryu Takeda, Kazuyuki Aihara, and Hiroshi G. Okuno,
    Sound Imaging of Nocturnal Animal Calls in Their Natural Habitat,
    Journal of Comparative Physiology A, Vol. 197, No. 9, pp. 915-921, 2011. DOI: 10.1007/s00359-011-0652-7 Cited by Anniversary Essay in Animal Behavior (Link)
  2. Takeshi Mizumoto, Hiroshi Tsujino, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata and Hiroshi G. Okuno:
    Development of a Theremin Player Robot Based on Arm-Position-to-Pitch and -Volume Models (in Japanese),
    Journal of Information Processing Society of Japan, Vol. 51, No.10, accepted, Jul. 2010.
Peer-reviewed International Conference Papers
  1. Takeshi Mizumoto, Kazuhiro Nakadai, Takami Yoshida, Ryu Takeda, Takuma Otsuka, Toru Takahashi, Hiroshi G. Okuno:
    Design and Implementation of Selectable Sound Separation on the Texai Telepresence System using HARK
    Proceedings of IEEE-RAS International Conference on Robotics and Automation (ICRA-2011), acepted (acceptance rate 49%), May 9-13, 2011, Shanghai, China.
  2. Takeshi Mizumoto, Angelica Lim, Takuma Otsuka, Kazuhiro Nakadai, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno:
    Integration of flutist gesture recognition and beat tracking for human-robot ensemble,
    Proceedings of IEEE/RSJ-2010 Workshop on Robots and Musical Expression, accepted, Oct. 18, 2010, Taipei, Taiwan.
  3. Takeshi Mizumoto, Takuma Otsuka, Kazuhiro Nakadai, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno
    Human-Robot Ensemble between Robot Thereminst and Human Percussionist using Coupled Oscillator Model
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2010), IEEE, RSJ, Taipei, Oct. 2010.
  4. Takeshi Mizumoto, Hiroshi Tsujino, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno
    Thereminist Robot: Development of a Robot Theremin Player with Feedforward and Feedback Arm Control based on a Theremin's Pitch Model (Invited paper),
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2009), IEEE, RSJ, St. Louis, 11-15 Oct. 2009.
  5. Takeshi Mizumoto, Ryu Takeda, Kazuyoshi Yoshii, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno:
    A Robot Listens to Music and Counts Its Beats Aloud by Separating Music from Counting Voice,
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2008), IEEE, RSJ, Nice, Sept. 2008.
    Travelling award from the Hara Research Foundation
    Award for Entertainment Robots and Systems (NTF Award) Nomination Finalist (4 of 649 papers).
Non-reviewed International Conferece Papers
  1. Takeshi Mizumoto, Ikkyu Aihara, Takuma Otsuka, Ryu Takeda, Kazuyuki Aihara, Hiroshi G. Okuno:
    Sound imaging system for visualizing spatio-temporal behavior of calling nocturnal animals,
    9th International Congress of Neuroethology, Aug., 2010, Salamanca, Spain. (poster)
Domestic Conference Papers
  1. 水本 武志, 尾形 哲也, 奥乃 博:
    テルミン演奏ロボットのためのUnscented Kalman Filter による適応的音高制御,
    日本ロボット学会第29回学術講演会,芝浦工業大学, Sep. 7-9, 2011.
  2. Takeshi Mizumoto, Kazuhiro Nakadai, Takuma Otsuka, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno
    打楽器とロボットの合奏のための結合振動子モデルに基づく打撃時刻予想手法
    The 28th annual conference of the Robotics Society of Japan, 1H3-2, 名古屋工業大学, Sep. 22, 2010.
  3. Takeshi Mizumoto, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno
    複数自由度を用いて音高特性モデルに基づく音高制御を行うテルミン演奏ロボットの開発
    72th Annual Conference of Information Processing Society Japan, 6T-8, Mar. 11, 2010.
    Session award for students
  4. Takeshi Mizumoto
    最古の電子楽器テルミンを演奏するロボットの開発,
    自然科学縦横無尽, 理学系異分野交流会, Jan. 2010. (oral)
  5. Takeshi Mizumoto:
    音声視覚化デバイス「カエルホタル」を用いた音源定位システム,
    自然科学縦横無尽, 理学系異分野交流会, Jan. 2010. (poster)
  6. Takeshi Mizumoto Hiroshi Tsujino, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno,
    Thereminist Robot: Development of a Robot Theremin Player based on a Theremin's Pitch Model,
    Special SIGMUS Symposium, Nov 2, 2009.
  7. Takeshi Mizumoto, Hiroshi Tsujino, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno
    テルミン演奏ロボットのための音高依存性を考慮した音量モデル,
    The 27th annual conference of the Robotics Society of Japan, 1I3-01, 横浜国立大学, Sep. 2009.
  8. Takeshi Mizumoto, Ikkyu Aihara, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno:
    フィールドにおける音源定位のための音声視覚化デバイス「カエルホタル」の設計,
    The 71st annual conference of the Information Processing Society of Japan, 6U-5, Mar. 2009
    Session award for students
  9. Takeshi Mizumoto, Hiroshi Tsujino, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno:
    内部モデルとフィードフォワード制御によるテルミン演奏ロボットの開発,
    The 71st annual conference of the Information Processing Society of Japan, 4ZC-2, Mar. 2009
  10. Takeshi Mizumoto, Ryu Takeda, Kazuyoshi Yoshii Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno:
    聴覚機能を持つ音楽ロボットのためのアーキテクチャの設計と ビートカウントロボットへの適用,
    The 26 the annual conference of the Robotics Society of Japan, 1A1-02, Sep. 2008.
  11. Takeshi Mizumoto, Ryu Takeda, Kazuyoshi Yoshii Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno:
    音楽と自分の声を聞き分けながらビートに合わせて発声するロボットの開発
    The 70 annual conference of the Information Processing Society of Japan, 2X-8, Mar. 2008.

Co-author

Peer-reviewed Journal Papers
  1. Tatsuhiko Itohara, Takuma Otsuka, Takeshi Muzumoto, Angelica Lim, Tetsuya Ogata, Hiroshi G. Okuno
    A multi-modal tempo and beat tracking system based on audio-visual information from live guitar performances
    EURASIP Journal on Audio, Speech, and Music Processing, accepted, Nov. 28, 2011.
  2. リム アンジェリカ, 水本 武志, 大塚 琢馬, 古谷 ルイ賢造, 尾形 哲也, 奥乃 博
    音楽共演ロボット: 開始・終了キューの画像認識による人間のフルート奏者との実時間同期
    情報処理学会論文誌, Vol.52, No.12 (Dec., 2011) 採録決定, Sep. 13, 2011.
  3. Angelica Lim, Takeshi Mizumoto, Tetsuya Ogata, Hiroshi G. Okuno:
    A musical robot that synchronizes with a co-player using non-verbal cues
    Advanced Robotics, Special Issue on Cutting Edge of Robotics in Japan, Sep. 16, 2012.
  4. リム アンジェリカ, 水本 武志, 大塚 琢馬, 古谷 ルイ賢造, 尾形 哲也, 奥乃 博:
    音楽共演ロボット: 開始・終了キューの画像認識による人間のフルート奏者との実時間同期
    情報処理学会論文誌, Vol. 52, No. 12, Sep 13, 2011.
  5. Ikkyu Aihara, Ryu Takeda, Takeshi Mizumoto, Takuma Otsuka, Hiroshi G. Okuno and Kazuyuki Aihara:
    Complex and transitive synchronization in a frustrated system of calling frogs,
    Physical Review E. Vol. 83, Issue 3, 031913(2011), 2011.
Peer-reviewed International Conference Papers
  1. Eui-Hyun Kim, Takeshi Muzumoto, Tetsuya Ogata, Hiroshi G. Okuno:
    Improvement of Speaker Localization by Considering Multipath Interference of Sound Wave for Binaural Robot Audition,
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011), accepted, (790/2459 =32.1%), IEEE, RSJ, San Francisco, 25-30 Sep. 2011.
  2. Tatsuhiko Itohara, Takeshi Muzumoto, Takuma Otsuka, Tetsuya Ogata, Hiroshi G. Okuno:
    Particle-filter Based Audio-visual Beat-tracking for Music Robot Ensemble with Human Guitarist,
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011), accepted, (790/2459 =32.1%), IEEE, RSJ, San Francisco, 25-30 Sep. 2011.
  3. Angelica Lim, Takeshi Muzumoto, Takuma Otsuka, Tatsuhiko Itohara, Kazuhiro Nakadai, Tetsuya Ogata, Hiroshi G. Okuno:
    More cowbell! A musical ensemble with the NAO thereminist,
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2011), IROS 2011 Standard Platform Demo, IEEE, RSJ, San Francisco, 25-30 Sep. 2011.
  4. Angelica Lim, Takeshi Mizumoto, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno:
    Programming by Playing and Approaches for Expressive Robot Performances,
    Proceedings of IEEE/RSJ-2010 Workshop on Robots and Musical Expression, accepted, Oct. 18, 2010, Taipei, Taiwan.
  5. Angelica Lim, Takeshi Mizumoto , Louis-Kenzo Cahier, Takuma Otsuka, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno:
    Robot Musical Accompaniment: Integrating Audio and Visual Cues for Real-time Synchronization with a Human Flutist
    Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-2010) , IEEE, RSJ, Taipei (accepted)
    NTF Award for Entertainment Robots and Systems (1 of 832 papers)
  6. Takuma Otsuka, Takeshi Mizumoto, Kazuhiro Nakadai, Toru Takahashi, Kazunori Komatani, Testuya Ogata, Hiroshi G. Okuno:
    Music-ensemble robot that is capable of playing the theremin while listening to the accompanied music,
    Proceedings of the 23rd International Conference on Industorial, Engineering and Other Applications of Applied Intelligent Systems (IEA/AIE-2010), Cordoba, Spain, Jun. 1-4, 2010.
    International Society for Applied Intelligence, Best Paper Award
  7. Ikkyu Aihara, Ryu Takeda, Takeshi Mizumoto, Takuma Ohtsuka, Toru Takahashi, Hiroshi G. Okuno:
    Synchronization in Frustrated Calling Behavior of Japanese Tree Frogs,
    Conference on Dynamics in Systems Biology, Aberdeen, UK, Sep. 2009. (oral)
Non peer-reviewed International Conference Papers
  1. Ikkyu Aihara, Takeshi Mizumoto, Ryu Takeda, Takuma Otsuka, Toru Takahashi, Kazuyuki Aihara, Hiroshi G. Okuno:
    Frustration in Synchronized Calling Behavior of Japanese Tree Frogs,
    International Conference on Neuroethology , Aug. 5-7 (6-7), 2010, Salamanca, Spain. (poster)
Reviews
  1. Ikkyu Aihara, Ryu Takeda, Takeshi Mizumoto, Toru Takahashi, Hiroshi G. Okuno:
    ニホンアマガエルの同期した発声行動に関する数理的研究および音響信号解析,
    数理解析講究録 1663, pp. 153--158, Jun. 2009.
Domestic Conference Papers
  1. 糸原 達彦, 大塚 琢馬, 水本 武志, 尾形 哲也, 奥乃 博:
    パーティクルフィルタを用いたギター演奏の視聴覚統合ビートトラッキング,
    日本ロボット学会第29回学術講演会, 芝浦工業大学, Sep. 7-9, 2011.
  2. Kazuhiro Nakadai, Hiroshi G. Okuno, Toru Takahashi, Keisuke Nakamura, Takeshi Mizumoto, Takami Yoshida, Takuma Otsuka, Gokhan Ince:
    Introduction to Open Source Robot Audition Software HARK,
    日本ロボット学会第29回学術講演会, 芝浦工業大学, Sep. 7-9, 2011.
  3. Tatsuhiko Itohara, Takuma Otsuka, Takeshi Mizumoto, Toru Takahashi, Tetsuya Ogata, Hiroshi G. Okuno:
    視聴覚統合ビートトラッキングを用いた音楽ロボットとギターとの合奏システム,
    The 73rd annual conference of the Information Processing Society of Japan, 1ZB-2, March 2, 2011.
    Session award for students
  4. Angelica Lim, Takeshi Mizumoto, Louis-Kenzo Cahier, Takuma Otsuka, Toru Takahashi, Tetsuya Ogata and Hiroshi G. Okuno:
    Multimodal gesture recognition for robot musical accompaniment,
    The 28th annual conference of the Robotics Society of Japan, 1H2-3, Nagoya Institute of Technology, Sep. 22, 2010.
  5. Angelica Lim, Takeshi Mizumoto, Takuma Otsuka, Toru Takahashi, Kazunori Komatani, Tetsuya Ogata, Hiroshi G. Okuno,
    Robot Musical Accompaniment: Real-time Synchronization using Visual Cue Recognition,
    The 72nd annual conference of the Information Processing Society of Japan, 6T-7, Mar. 11, 2010.
  6. Ikkyu Aihara, Takeshi Mizumoto, Ryu Takeda, Takuma Otsuka, Toru Takahashi, Hiroshi G. Okuno,
    アマガエルの多体系発声行動に潜む時空間ダイナミクス,
    Japanese Society for Quantitative Biology, Jan. 2010
  7. Ikkyu Aihara, Takeshi Mizumoto, Ryu Takeda, Takuma Otsuka, Toru Takahashi, Hiroshi G. Okuno,
    Time-delayed model on frogs' calling behavior and novel device for localizing calling animals,
    The 14th Auditory Research Forum, Mar. 2009.
  8. Ikkyu Aihara, Ryu Takeda, Takeshi Mizumoto, Toru Takahashi, Kazuyuki Aihara, Hiroshi G. Okuno:
    ニホンアマガエルの同期した発声行動に関する実験的研究およびその数理モデル解析,
    IEICE technical report. Neurocomputing., Mar. 2009
  9. Ikkyu Aihara, Ryu Takeda, Takeshi Mizumoto, Toru Takahashi, Hiroshi G. Okuno:
    ニホンアマガエル3 匹の同期した発声行動に関する数理的・実験的研究,
    第5回「生物数学の理論とその応用」, Jan. 2009.
  10. Ikkyu Aihara, Ryu Takeda, Takeshi Mizumoto, Toru Takahashi, Hiroshi G. Okuno:
    アマガエルの同期した発声行動に関する実験的・数理的研究,
    (社)音響学会関西支部 第11回若手研究者交流研究発表会, Dec. 2008.
    第11回若手研究者交流研究発表会 最優秀賞
  11. Ikkyu Aihara, Takeshi Mizumoto, Toru Takahashi, Ryu Takeda, Hiroshi G. Okuno:
    Complex Synchronization in Calling Behavior of Three Japanese Tree Frogs,
    The 13th Auditory Research Forum, Dec. 2008.
  12. Ikkyu Aihara, Ryu Takeda, Toru Takahashi, Takeshi Mizumoto, Hiroshi G. Okuno:
    Experimental and Theoretical Studies on Synchronized Calling Behavior of Three Japanese Tree Frogs,
    Japan-Slovenia Seminar on Nonlinear Science, Nov. 2008.

Others

Patents
  1. テルミン演奏ロボット (Theremin playing robot, Japan)
    発明者： 辻野 広司, 奥乃 博, 水本 武志.
    特開2011-81380号, 2011年4月21日. 特願2010-226106号, 2010年10月5日.
  2. Audio Source Detection System (United States),
    Inventors: Hiroshi Tsujino, Kazuhiro Nakadai, Hiroshi Okuno, Takeshi Mizumoto, and Ikkyu Aihara.
    Publication No: 20100189271, Publication Date: 2010-07-29. Application No: 12/631434, Application Date: 2009-12-04.
  3. 音源位置推定システム (Audio source detection system, Japan)
    発明者： 辻野 広司, 中臺 一博, 奥乃 博, 水本 武志, 合原 一究,
    特開2010-133964号, 2010年6月17日. 特願2009-277075号, 2009年12月4日.
Research grant
  1. Global COE Young Leader Fostering Program, Jul., 2010.
    Human-robot ensemble that synchronizes with a co-player's score position
Awards
  1. A total exemption from repayment for achievement of particularly outstanding results,
    Scholarship Loan Programs for Japanese Students, Japan Student Services Organization(JASSO), June, 2011.
  2. JSPS Research Fellowship for Young Scientists (DC2)
  3. A total exemption from repayment for achievement of particularly outstanding results,
    Scholarship Loan Programs for Japanese Students, Japan Student Services Organization(JASSO), June, 2010.
  4. Travelling award from the Hara Research Foundation,
    IROS-2008, Nice, France, Sep. 2007.
Media
  1. (TV) 世の中進歩堂, BS Japan, 2011/02/04 Link to the program
  2. (TV) 平成教育学院☆放課後, BS Fuji, 2008/8/2
  3. (Radio) 中川翔子のGサイエンス, Nippon Broadcasting System, Inc., 2008/7/25 Link
  4. (TV) 偉大なる未来図鑑, Prince Shotoku Robot, Fuji Television Network, Inc. 2008/3/27
Works related to a robot audition software HARK
  1. BINAAHR: Binaural Active Audition for Humanoid Robots
    Visiting researcher at LAAS-CNRS, Toulouse, France, for 5 weeks from Nov. to Dec.
  2. Implementation of selectable sound separation using the HARK System on Texai, Willow Garage, Inc
  3. (the 4th) Tutorial on Robot Audition HARK (instructor), IEEE Humanoids2009, Paris, France, Dec., 2009
  4. The 3rd HARK Tutorial (instructor), Keio University, Japan, 2009.
  5. The 2nd Robot Audition Software HARK Tutorial (instructor), KIST, Korea, 2008.
  6. The 1st HARK Tutorial, Kyoto University (instructor), Japan, 2008.

Photos and Movies


Frogs

Foreign Countries

Japan

Internal Only

Python: Python know-hows

Others

Back to member page Back to home page