Lao Siji:ニューラル再構成環境での閉ループ自動運転に向けたopenpilotの適応
Lao Siji: Adapting openpilot to Closed-Loop End-to-End Driving in Neural Reconstruction
市販L2モデルopenpilotの視覚エンコーダを凍結し、自己状態アダプタと経路メモリで方策層を微調整することで、ニューラル再構成シーンでの閉ループ運転を実現した研究。
著者: Chengzhi Gao, Yongzhi Liu, Jinchang Xu, Weichao Zhuang, Guodong Yin
分類: cs.RO, cs.CV
原文アブストラクト
We present Lao Siji, an end-to-end driving policy that ranks third in the 2026 NVIDIA AlpaSim E2E Driving Challenge, ahead of most entries built on foundation models. Instead of training from scratch on a general-purpose vision backbone, we adapt openpilot, an open-source L2 production model. We freeze its vision encoder and fine-tune the policy layers with an ego-state adapter and a route memory. On closed-loop rollouts in neural-reconstructed scenes, we supervise the policy with a privileged map teacher for lateral self-correction and a body-extent loss for road and obstacle clearance, while distilling the base model's remaining outputs to retain car following. Ablations show that self-correction samples carry the gain, while the clearance loss substitutes for them where no teacher exists. Longitudinal safety instead rests on the base model's lead-vehicle estimate behind a rule-based speed layer. Longer training, imitating human logs, and human-log speed targets yield either no measurable gain or adverse effects. Without further training, Lao Siji also places among the leaders on HUGSIM and Odyssey. The final training takes only one GPU-hour and shifts the weights by 3.9% from the shipped model. Code will be released after review.
関連論文
- RiSE-Drive: 不確実性下の長期リスクを考慮した自動運転候補評価自動運転/End-to-End
- OPTED: レンダリング不要な教師によるEnd-to-End自動運転のオンポリシー微調整自動運転/End-to-End
- GMF-Drive: 空間認識BEV表現とゲート付きMamba融合によるエンドツーエンド自動運転自動運転/End-to-End
- GEMINUS:エンドツーエンド自動運転のためのデュアル認識型グローバル・シーン適応型Mixture-of-Experts自動運転/End-to-End
- DriveCoT: 連鎖的思考推論を統合したエンドツーエンド自動運転自動運転/End-to-End
- NEAT: エンドツーエンド自動運転のためのニューラルアテンションフィールド自動運転/End-to-End
