グラフ構造世界モデルによるアドホックネットワーク動的学習
Learning Ad Hoc Network Dynamics via Graph-Structured World Models
ノードごとの潜在状態とクロスノード注意機構を持つグラフ構造のリカレント状態空間モデルを提案し、オフライン軌跡からネットワーク動態を学習してクラスタヘッド選択ポリシーを想像上のロールアウトで訓練する。
著者: Can Karacelebi, Yusuf Talha Sahin, Elif Surer, Ertan Onur
分類: cs.LG, cs.MA, cs.NI
原文アブストラクト
Ad hoc wireless networks exhibit complex, innate and coupled dynamics: node mobility, energy depletion and topology change that are difficult to model analytically. Model-free deep reinforcement learning requires sustained online interaction whereas existing model based approaches use flat state representations that lose per node structure. Therefore we propose G-RSSM, a graph structured recurrent state space model that maintains per node latent states with cross node multi head attention to learn the dynamics jointly from offline trajectories. We apply the proposed method to the downstream task clustering where a cluster head selection policy trains entirely through imagined rollouts in the learned world model. Across 27 evaluation scenarios spanning MANET, VANET, FANET, WSN and tactical networks with N=30 to 1000 nodes, the learned policy maintains high connectivity with only trained for N=50. Herein, we propose the first multi physics graph structured world model applied to combinatorial per node decision making in size agnostic wireless ad hoc networks.