自由エネルギー最小化による人間フィードバックからのインタラクション制御
Towards Interaction Regulation from Human Feedback via Free Energy Minimization
計算神経科学の自由エネルギー原理に着想を得て、人間の選好をオンラインでエージェント方策に統合する制御理論的枠組みを提案し、VR経由でジェスチャー指示を行う人間参加型ローバー実験で有効性を検証した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Maria Paula Diaz Monfort, Cinzia Tomaselli, Michael Richardson, Giovanni Russo
分類: eess.SY, cs.RO
原文アブストラクト
A central challenge across control and learning is the design of mechanisms regulating the interactions between humans and autonomous agents. Inspired by the free energy principle from computational neuroscience, we introduce a control-theoretical framework to integrate human preferences online into an agent policy. We turn the framework into an open control architecture and validate our approach using a human-in-the-loop experimental testbed involving a rover navigating via onboard sensing. The human, remotely located and equipped with virtual reality headsets, shares the same sensory information as the rover. Human preferences are provided to the rover via gestures which introduce both cooperative and competitive interactions between the agent goal and the preferences. The experiments show that interactions are regulated, validating the proposed approach.