日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

ヒューマノイド/音楽生成動作arXiv:2611.13370

AHEADance:ストリーミング音声に合わせて先読みするヒューマノイドダンス

AHEADance: Anticipatory Humanoid Dance from Streaming Audio

シェア:XThreadsFacebookLINEはてブBluesky

聴いた音楽と凍結音楽モデルによる近未来予測を組み合わせ、コミット済み動作から継続するヒューマノイド向けストリーミングダンス生成手法を提案し、Unitree G1上で実機動作を実現した。

著者: Tianhu Peng, Yukun Wang, Lingfan Bao, Yiyang Jia, Chengxu Zhou

分類: cs.RO, eess.SY

原文アブストラクト

A humanoid that dances to streamed music must commit each motion chunk before it has heard the music that chunk accompanies, and must continue from motion it has already committed. We present AHEADance, a robot-native streaming dance generator executed on a humanoid robot by a whole-body tracker. ListenAhead conditions each chunk on heard music and a frozen music model's forecasts of the coming music, aligned to their target times and weighted by reliability. The forecasts carry the timing of upcoming beats almost as well as the actual future; with them, the generator is better synchronized with the music and concentrates more motion energy at its song's beat frequency. Commit Forcing trains continuation from the model's own committed chunks, updating both the latent history and the decoded boundary of the next chunk; it reduces low activity from 83.5% to 10.3%, the level of real dance. Three music evaluators, each validated on real G1 dance, test synchronization, song and style. On a physical Unitree G1, it dances while the music plays and comes to rest when it stops, without a fall. Project page: https://ihcr.github.io/AHEADance

  1. 1パナソニックHDら、ロボット操作AI「T-Rex」を共同開発 12タスクで平均成功率65%研究・技術
  2. 2Hugging Face、ロボット学習基盤「LeRobot v0.7.0」を公開 対話操作と大規模データ学習に対応新製品・発表
  3. 3NVIDIA、Vera CPUのエージェント処理性能を公表 x86比で速度・電力効率を比較半導体・GPU
  4. 4Agility、SPAC合併でナスダック上場資金調達
  5. 5AgiBot、基盤モデル「GO-3 Preview」を発表 身体性AIの3ベンチマークで首位新製品・発表
PR本紙発行元 EmplifAI