スパース表現編集による制御可能な分子生成:解釈可能性駆動のアプローチ
Controllable Molecule Generation via Sparse Representation Editing: An Interpretability-Driven Perspective
大規模言語モデルの分子生成において、表現をスパースな特徴空間に分解し編集することで、原子や官能基の局所配置や物性の全体制御を可能にする解釈可能性駆動フレームワークSpaREを提案した。
著者: Zhuoran Li, Xu Sun, Chang Wen Chen, Wanyu Lin
分類: cs.LG
原文アブストラクト
Controllable molecule generation is crucial for diverse scientific applications, such as drug discovery and materials design. While large language models (LLMs) show great promise, their dense and entangled representations impede precise control over the generation of molecules with bespoke substructures or properties. To address this, we propose Sparse Representation Editing (SpaRE), an interpretability-driven framework for fine-grained and precise control in LLM-based molecule generation. The crux of SpaRE is to learn an overcomplete sparse feature space that disentangles LLM representations into a compact set of latent features corresponding to chemically meaningful concepts. Within this space, we can directly manipulate these concept-aligned latent features to achieve (1) local control, by generating target atoms and functional groups at specified positions; and (2) global control, by customizing the overall structural and physicochemical properties within defined ranges. In this way, our framework advances interpretability from post-hoc analysis to actionable generative control. Experiments show that SpaRE can generate chemically desirable molecules under complex constraints in real-world scenarios, while offering mechanistic insights for quantitative structure-property analysis. The code and demo are available at https://github.com/WanyuGroup/ICML2026_SpaRE.