The Structure Gap: When More Data Cannot Replace Structured Reasoning 待解读

下载

新用户看这篇论文该怎么开始

  1. 先点「赞助解读」,AI 会把论文转成可直接执行的行动清单。
  2. 看完“可执行改进行动”后,可快速决定是否值得立项。
  3. 用上面的卡片内容直接发给团队,减少重复阅读。
先订阅关键词,后续不再手工筛论文

摘要

A persistent belief in modern AI is that sufficiently large learners trained on sufficiently much data can make explicit domain knowledge optional. This paper examines a limitation of that belief. We define structure-encoded problems: tasks whose input-output map is determined, or sharply constrained, by known structure such as a solver, symmetry group, graph, physical law, measurement operator, grammar, combinatorial search space, or optimization objective. For such tasks, the central question is not expressivity--a dense neural network may contain the desired map--but finite-data identification, extrapolation, and certification. We introduce the structure gap: the finite-resource gap between a method that receives the governing structure and a learner that receives only examples. The strongest useful form of the claim is asymptotic rather than absolute: structure-agnostic learning may approach a structured solver as coverage grows, but every finite dataset can leave residual uncertainty that the structure resolves by construction. We prove this exactly for a Gaussian inverse problem: the known-operator Wiener solver attains Bayes risk, while the dense empirical learner in the correct linear class has persistent expected excess risk. We also prove a cell-coverage lower bound and an unobserved-orbit non-identifiability result. Controlled experiments in known-operator inversion, sparse recovery, and graph reachability with size extrapolation instantiate the mechanisms. When validated structure is available, it can constrain the hypothesis space before learning begins, leaving learning to address components the structure does not specify.

分析报告

暂无报告。点击“分析”开始生成。

个性化解读 与社区共享解读不同

用自己的话告诉 AI 你想要什么样的解读(比如"用大白话讲给非专业人士听"、"重点分析对我们团队 RAG 系统的可迁移性"),生成一份只属于你自己的版本;生成后也可以选择设为"愿意共享",被更多人看到、点赞。