日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

週刊ニュースレター購読
群制御arXiv:2607.01824v1

ゲーミングコンセンサス:クラウドソース型ファクトチェックにおける協調操作

Gaming Consensus: Coordinated Manipulation in Crowdsourced Fact-Checking

シェア:XThreadsFacebookLINEはてブBluesky

クラウドソース型ファクトチェックのマトリックス分解アルゴリズムが、少数の協調的なユーザーによる戦略的投票で操作され得ることを理論的・実証的に示し、実際のデータで最大10.7%の低品質ノートが操作可能であることを明らかにした。

著者: Nikil Roashan Selvam, Jay Baxter, Sophie Hilgard, Brad Miller, Keith Coleman, Ellen Vitercik, Sanmi Koyejo

分類: cs.LG

原文アブストラクト

Crowdsourced fact-checking systems have been adopted by major social media companies such as X, Meta, TikTok and Google with the aim of combating misleading information at scale without relying on centralized editorial control. These systems have been developed around a common underlying concept: a bridging mechanism that identifies notes flagging misleading information when they receive support from people with different perspectives rather than simple majority support. To our knowledge the only publicly disclosed bridging algorithms deployed for fact-checking are based on matrix factorization, as deployed by both X and Meta, augmented with additional components addressing abuse, targeted manipulation, and contributor brigades. This work examines the core matrix factorization portion of these systems, presenting theoretical and empirical evaluations of the degree to which coordinated users could vote strategically by leveraging the latent representations to fabricate the appearance of synthetic consensus within the bridging mechanism. Using historic production data, we find that up to 10.7% of lower quality notes could be manipulated above consensus thresholds using less than 10 ratings. We complement these findings with a theoretical analysis, revealing counterintuitively that rating a note as "Not Helpful" can increase its helpfulness score, as well as a cost model quantifying manipulation effort. We have developed and deployed mitigations within X's Community Notes algorithm to address synthetic consensus.

関連論文