日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
推論/エージェントarXiv:2607.15439v2

コーディングエージェントはARC-AGI-3を解くために実行可能な世界モデル、単純化、検証を必要とするか?

Do Coding Agents Need Executable World Models, Simplification, and Verification to Solve ARC-AGI-3?

シェア:XThreadsFacebookLINEはてブBluesky

ARC-AGI-3課題を解くコーディングエージェントにおいて、実行可能な世界モデル、単純化プロンプト、検証の各要素の貢献を比較し、検証が最も効果的であることを示した。

著者: Sergey Rodionov

分類: cs.AI

原文アブストラクト

Our previous ARC-AGI-3 agent bundled executable world modeling, prompted simplification, and exact replay verification, leaving their individual contributions unclear. An executable world model is a persistent, agent-authored environment hypothesis embodied in runnable code. We compare four Codex-based variants: textual; flexible-interface executable; executable with simplification prompts; and a fixed-interface variant with simplification and exact replay verification against recorded observations. The main study evaluates them with gpt-5.4 and gpt-5.5 at high and xhigh reasoning effort on 25 public games; exploratory follow-ups compare textual and verification with gpt-5.6-sol. In the main study, every variant scores higher as model capability and reasoning effort increase. These gains often exceed variant differences, which are smaller than anticipated and vary across settings. Requiring an executable deliverable is not universally beneficial: textual outperforms flexible-interface executable in both gpt-5.5 conditions. The simplification variant scores higher than its executable-only counterpart in three of four settings; the weakest is the exception. The complete verification treatment ranks first throughout, sometimes narrowly, but uses substantially more resources. With gpt-5.6-sol, the verification variant completes every public level at xhigh and max with about 99% human-relative action efficiency while using fewer than half the human baseline's total actions. At max, however, the textual variant completes every level with 41% fewer actions than the human baseline. Thus, at max, the three imposed mechanisms are not required for action-efficient public-set completion; verification nevertheless scores higher and succeeds at lower effort. Because gpt-5.6-sol postdates the games and held-out performance is untested, results indicate public-set saturation only.