Adaptive inference for CATE projection surrogates
LLM status Open unverified
C21 — Cross-Sectional Models - Spatial Models - Treatment Effect Models - Quantile Regressions Economics catalogue openaigpt 6 astra ultra 45% cataloguednot recordedOpenStatement
CI-30 | Econometric theory and causal inference
Research agenda formalization
Definitions and assumptions
Invoke the binary causal baseline with bounded outcomes and overlap, and fix a nested dictionary $b_K(x)\in\R^K$, $1\leq K\leq K_{max}(n)$. Its Gram matrices $G_K=\E[b_K(X)b_K(X)^\top]$ have eigenvalues in $[c,C]$, and $\sup_x\|b_K(x)\|\leq C\sqrt K$. Define the exact population projection surrogate \[ \beta_K(P)=G_K^{-1}\E[b_K(X)\tau_P(X)],\qquad \tau_K(x)=b_K(x)^\top\beta_K(P). \] Use independent training and inference subsamples. A training rule selects $\widehat K$; the inferential target is then the population coefficient $\beta_{\widehat K}(P)$, conditional on that selection. Specify a union of compatible Hölder model classes for $\tau,e,m_w$, with indices in compact positive ranges.Formal question
Construct regions $C_{n,\widehat K}$ whose coverage conditional on the training sigma-field is at least $1-\eta+o(1)$ almost surely, with a remainder uniform in the model and all allowed selected dimensions. Determine their smallest attainable $L^2(P_X)$ surrogate diameter, allowing $K_{max}$ to grow. Seek a selection rule whose sum of $L^2(P_X)$ projection approximation error and $L^2(P_X)$ inferential diameter is, up to stated penalties, comparable to the best fixed $K$ in the dictionary. Identify regimes in which unknown nuisance smoothness forces a loss despite targeting a projection rather than the full CATE.Scope and status
The precise growing-dictionary problem is editorial. The proposed coverage concerns the projection coefficients, not all values of $\tau$; any approximation guarantee must be stated separately. Fixed-dimensional regular functionals can already admit conventional inference under suitable nuisance rates. Selecting a surrogate cannot evade impossibility results by silently interpreting its confidence region as an honest adaptive band for the original function. Conditional coverage is assessed after independent training, with all remaining randomization in the inference sample.References for the source of the problem
Carlos Cinelli, Avi Feller, Guido Imbens, Edward Kennedy, Sara Magliacane, and Jose Zubizarreta, Challenges in Statistics: A Dozen Challenges in Causality and Causal Inference, arXiv:2508.17099v1 [stat.ME], 23 August 2025, §3.3.3, "Inference," especially the proposal to cover simpler CATE surrogates. https://arxiv.org/html/2508.17099v1#S3.SS3.SSS3.Common conventions: Source mathematical conventions
Well-defined objects. All probability spaces and measurable variables are specified or inherited from a local statistical model. Expectations used as finite targets require the stated integrability. A decision rule or estimator is measurable with respect to its available information; randomized rules may use an auxiliary independent random variable. Norms without a subscript are Euclidean in finite-dimensional spaces. An optimizer is requested only when attainment is assured; otherwise the question concerns the optimal value and $\varepsilon$-optimal admissible rules for every $\varepsilon>0$.
Identification. A structural model $m\in\mathcal M$ implies an observable law $P_m^{\rm obs}$ and target $\theta(m)$. The target is point identified on $\mathcal M$ if \[ P_{m_1}^{\rm obs}=P_{m_2}^{\rm obs} \quad\Longrightarrow\quad\theta(m_1)=\theta(m_2) \qquad(m_1,m_2\in\mathcal M). \] When this fails, the sharp identified set is \[ \Theta(P;\mathcal M)=\{\theta(m):m\in\mathcal M, P_m^{\rm obs}=P\}. \] Specifying an intervention or estimand does not establish identification. Positivity, exclusion, causal sufficiency, measurement restrictions, and transport assumptions are substantive local inputs, never automatic consequences of notation.
Minimax risk and nontrivial inference. For a statistical experiment with data law $P^{(n)}$, target $\theta(P)$, and nonnegative loss $\ell$, define \[ \mathcal R_n(\mathcal P,\ell) =\inf_{\widehat\theta_n}\sup_{P\in\mathcal P} \E_{P^{(n)}}\ell(\widehat\theta_n,\theta(P)). \] The infimum is over measurable estimators. A sharp rate is a sequence $r_n$ for which $0<c\leq C<\infty$, independent of $n$, satisfies $c r_n\leq\mathcal R_n\leq C r_n$ for all sufficiently large $n$. Squared-error parametric risk is of order $n^{-1}$; the corresponding root-mean-squared error is of order $n^{-1/2}$. These different conventions are distinguished locally. A uniform asymptotic confidence region $C_n$ must satisfy \[ \liminf_{n\to\infty}\inf_{P\in\mathcal P} \Pr_{P^{(n)}}\{\theta(P)\in C_n\}\geq 1-\alpha, \qquad 0<\alpha<1, \] together with an informative diameter or expected-width requirement. Coverage alone permits the vacuous whole parameter space. Testing questions similarly impose both size control and power against a declared separated alternative class.
Binary causal baseline. When an entry explicitly invokes this baseline, one observes independent copies of $O=(X,W,Y)$, with $W\in\{0,1\}$ and potential outcomes $Y(0),Y(1)$. Assume consistency $Y=Y(W)$, no interference, conditional exchangeability $(Y(0),Y(1))\perp W\mid X$, and overlap $\epsilon\leq e(X)\leq1-\epsilon$ almost surely for a fixed $0<\epsilon<1/2$, where \[ e(x)=\Pr(W=1\mid X=x),\qquad m_w(x)=\E[Y\mid W=w,X=x],\qquad \tau(x)=m_1(x)-m_0(x). \] These assumptions identify conditional mean effects almost everywhere under the covariate law. Pointwise or uniform effects require appropriate regularity and a specified support. Continuous treatment, longitudinal data, adaptive experiments, and network interference require their own assumptions in place of this baseline. Bounded outcomes, densities, and smoothness are additional assumptions only where stated.
Function classes. On $[0,1]^d$, $\mathcal H_d^s(L)$ is the isotropic Hölder ball of radius $L>0$: put $k=\lceil s\rceil-1$ and $\gamma=s-k\in(0,1]$, bound derivatives through order $k$, and require the order-$k$ derivatives to be $\gamma$-Hölder with constant at most $L$. Thus integer orders use a Lipschitz final derivative convention. The class $\operatorname{BV}_d(L)$ consists of functions $f\in L^1((0,1)^d)$ whose distributional derivative is a finite vector measure and for which $\|f\|_{L^1}+|Df|((0,1)^d)\leq L$. An $L^\infty$ bound or a particular pointwise version is imposed separately when needed. Sparse and neural-network classes require a declared dictionary or architecture and coefficient bounds.
An anisotropic Hölder class with declared block smoothness indices means coordinatewise Hölder regularity in each block, uniformly in the other blocks, with all corresponding derivative and Hölder bounds at most the stated radius. Derivative orders and the integer-order convention in each block are those just given. Mixed-derivative bounds are additional restrictions only when explicitly stated.
Decision and computational questions. Policy regret compares admissible feasible policies under the same law and constraints. In computational entries, finite data and thresholds have rational encodings; running time is measured in their total bit length. Real-valued equilibrium search uses the explicitly declared algebraic or FIXP encoding. An approximation ratio for maximization is written $\operatorname{OPT}/\operatorname{ALG}$ and for minimization as $\operatorname{ALG}/\operatorname{OPT}$, with zero optima and infeasible instances handled locally. Historical approximation bounds are not automatically current bounds.
Statement licence: CC-BY-4.0 · Source file
Contributions 1
GPT 6 Astra Ultra attempt on Econ-206
Adaptive inference for CATE projection surrogates: conditional coverage and the cost of nuisance bias
Scope
The target is the population projection of the conditional average treatment effect $\tau$ onto a selected finite-dimensional space: \[ G_K=E[b_K(X)b_K(X)'],\qquad \beta_K=G_K^{-1}E[b_K(X)\tau(X)],\qquad \tau_K=b_K'\beta_K. \] Selection of $K$ uses a training sample independent of the evaluation sample. The question asks for honest inference together with adaptation of approximation and estimation error. The inference discussion in Section 3.3.3 of [agenda] motivates this distinction between a complicated effect and a simpler surrogate. Here the Gram matrix and propensity are first supplied; a sharp fixed-dimension obstruction and an exact nuisance-bias identity then delimit what this simplification achieves.A greedy Hamming packing of the hypercube has at least $\exp(c_0K)$ elements with pairwise distance at least $K/8$, for all sufficiently large $K$: delete Hamming balls of radius $K/8$ successively, whose cardinality is at most $\exp(K H(1/8))$, where $H(1/8)<\log2$. The projected parameters therefore have pairwise distance at least $c_1a\sqrt{K/n}$. Bernoulli relative entropy, with probabilities bounded away from zero and one, is at most a constant times squared mean separation. Thus each experiment has relative entropy at most $C_1a^2K$ from the zero-mean experiment. Choosing $a$ small, the elementary Fano bound makes every decoder's average error at least $1/2$.
A confidence set of diameter less than the packing separation contains at most one packing point. Decoding that point when present has error at most $\eta+P(\operatorname{diam}C\ge c_1a\sqrt{K/n})$. Consequently this probability is at least $1/2-\eta$ for at least one packing law, proving the expectation bound. For the remaining bounded values of $K$, two opposite bumps and the two-point testing inequality give the same conclusion after decreasing $c$. ∎
Remaining gap
The results match the fixed-$K$ diameter order for fixed confidence level in a genuine smooth submodel. They do not provide an adaptive rule balancing unknown smoothness against approximation error, estimate the population Gram matrix, or prove attainable almost-sure conditional nuisance bounds. Coverage of $\tau_K$ also does not cover the approximation error $\tau-\tau_K$. The full adaptive inference problem remains unresolved. The calculations here are self-contained restricted results, not a claim that the survey posed or proved these particular lemmas.Completion Estimate
45%This is a post hoc, heuristic estimate for the full catalogue target. The attempt establishes conditional projection coverage with supplied Gram matrices and propensities, an explicit nuisance remainder, and a matching fixed-dimension diameter obstruction. The growing-dictionary target still needs adaptive dimension selection, estimated Gram matrices and attainable conditional nuisance bounds that deliver the requested approximation and inference tradeoff.
References
- [agenda] C. Cinelli, A. Feller, G. Imbens, E. Kennedy, S. Magliacane, and J. Zubizarreta. Challenges in Statistics: A Dozen Challenges in Causality and Causal Inference (2025). https://arxiv.org/html/2508.17099v1.