Econ-318 · economics · Economics

Econ-318

Estimating target heterogeneity from multiple studies

LLM status Open unverified

C21 — Cross-Sectional Models - Spatial Models - Treatment Effect Models - Quantile Regressions Economics catalogue openaigpt 6 astra ultra 62% cataloguednot recordedOpen

Statement

CI-25 |  Econometric theory and causal inference

Research agenda formalization

Definitions and assumptions

For studies $s=1,\ldots,S$, independently observe $n_s$ copies of $(X,W,Y)$; additionally observe $n_0$ covariates from a target population. Treatments are binary and $|Y|\leq1$. Within each study invoke consistency, no interference, conditional exchangeability, and overlap. Impose the transport restriction \[ \E[Y(w)\mid X=x,S=s]=\E[Y(w)\mid X=x,S=0]=m_w(x) \] on the target support, with common $m_w\in\mathcal H_d^\beta(L)$. Study-specific propensities $e_s$ lie in $\mathcal H_d^{\alpha_s}(L)$. Let $P_{ m mix}=\sum_s(n_s/\sum_jn_j)P_{X\mid S=s}$, and require $dP_{X\mid S=0}/dP_{ m mix}\leq\kappa$. Individual study supports may differ; their union must cover the target support.

Formal question

The target effect is $\tau_0(x)=m_1(x)-m_0(x)$. Determine its sharp minimax squared $L^2(P_{X\mid S=0})$ risk using all study data and target covariates. Quantify the roles of unequal sample sizes, study-specific assignment smoothness, support coverage, and density-ratio estimation. Construct a procedure that pools information without forcing identical covariate or assignment laws. Then replace the common-response restriction by $|m_{w,s}(x)-m_{w,0}(x)|\leq\delta_s$ and determine the resulting identified set and unavoidable estimation error.

Scope and status

This is a precise editorial transport model associated with the multiple-study agenda. Different observed study laws alone do not identify a target effect. The common conditional response is a substantive assumption; it can fail even when every study randomizes treatment. In the bounded-deviation extension, point identification must not be asserted unless the identified set collapses. The question concerns sharp guarantees in this specified class, without declaring all existing pooling or transport methods unresolved.

References for the source of the problem

Carlos Cinelli, Avi Feller, Guido Imbens, Edward Kennedy, Sara Magliacane, and Jose Zubizarreta, Challenges in Statistics: A Dozen Challenges in Causality and Causal Inference, arXiv:2508.17099v1 [stat.ME], 23 August 2025, §3.3.3, "New data structures." https://arxiv.org/html/2508.17099v1#S3.SS3.SSS3.

Common conventions: Source mathematical conventions

Well-defined objects. All probability spaces and measurable variables are specified or inherited from a local statistical model. Expectations used as finite targets require the stated integrability. A decision rule or estimator is measurable with respect to its available information; randomized rules may use an auxiliary independent random variable. Norms without a subscript are Euclidean in finite-dimensional spaces. An optimizer is requested only when attainment is assured; otherwise the question concerns the optimal value and $\varepsilon$-optimal admissible rules for every $\varepsilon>0$.

Identification. A structural model $m\in\mathcal M$ implies an observable law $P_m^{\rm obs}$ and target $\theta(m)$. The target is point identified on $\mathcal M$ if \[ P_{m_1}^{\rm obs}=P_{m_2}^{\rm obs} \quad\Longrightarrow\quad\theta(m_1)=\theta(m_2) \qquad(m_1,m_2\in\mathcal M). \] When this fails, the sharp identified set is \[ \Theta(P;\mathcal M)=\{\theta(m):m\in\mathcal M, P_m^{\rm obs}=P\}. \] Specifying an intervention or estimand does not establish identification. Positivity, exclusion, causal sufficiency, measurement restrictions, and transport assumptions are substantive local inputs, never automatic consequences of notation.

Minimax risk and nontrivial inference. For a statistical experiment with data law $P^{(n)}$, target $\theta(P)$, and nonnegative loss $\ell$, define \[ \mathcal R_n(\mathcal P,\ell) =\inf_{\widehat\theta_n}\sup_{P\in\mathcal P} \E_{P^{(n)}}\ell(\widehat\theta_n,\theta(P)). \] The infimum is over measurable estimators. A sharp rate is a sequence $r_n$ for which $0<c\leq C<\infty$, independent of $n$, satisfies $c r_n\leq\mathcal R_n\leq C r_n$ for all sufficiently large $n$. Squared-error parametric risk is of order $n^{-1}$; the corresponding root-mean-squared error is of order $n^{-1/2}$. These different conventions are distinguished locally. A uniform asymptotic confidence region $C_n$ must satisfy \[ \liminf_{n\to\infty}\inf_{P\in\mathcal P} \Pr_{P^{(n)}}\{\theta(P)\in C_n\}\geq 1-\alpha, \qquad 0<\alpha<1, \] together with an informative diameter or expected-width requirement. Coverage alone permits the vacuous whole parameter space. Testing questions similarly impose both size control and power against a declared separated alternative class.

Binary causal baseline. When an entry explicitly invokes this baseline, one observes independent copies of $O=(X,W,Y)$, with $W\in\{0,1\}$ and potential outcomes $Y(0),Y(1)$. Assume consistency $Y=Y(W)$, no interference, conditional exchangeability $(Y(0),Y(1))\perp W\mid X$, and overlap $\epsilon\leq e(X)\leq1-\epsilon$ almost surely for a fixed $0<\epsilon<1/2$, where \[ e(x)=\Pr(W=1\mid X=x),\qquad m_w(x)=\E[Y\mid W=w,X=x],\qquad \tau(x)=m_1(x)-m_0(x). \] These assumptions identify conditional mean effects almost everywhere under the covariate law. Pointwise or uniform effects require appropriate regularity and a specified support. Continuous treatment, longitudinal data, adaptive experiments, and network interference require their own assumptions in place of this baseline. Bounded outcomes, densities, and smoothness are additional assumptions only where stated.

Function classes. On $[0,1]^d$, $\mathcal H_d^s(L)$ is the isotropic Hölder ball of radius $L>0$: put $k=\lceil s\rceil-1$ and $\gamma=s-k\in(0,1]$, bound derivatives through order $k$, and require the order-$k$ derivatives to be $\gamma$-Hölder with constant at most $L$. Thus integer orders use a Lipschitz final derivative convention. The class $\operatorname{BV}_d(L)$ consists of functions $f\in L^1((0,1)^d)$ whose distributional derivative is a finite vector measure and for which $\|f\|_{L^1}+|Df|((0,1)^d)\leq L$. An $L^\infty$ bound or a particular pointwise version is imposed separately when needed. Sparse and neural-network classes require a declared dictionary or architecture and coefficient bounds.

An anisotropic Hölder class with declared block smoothness indices means coordinatewise Hölder regularity in each block, uniformly in the other blocks, with all corresponding derivative and Hölder bounds at most the stated radius. Derivative orders and the integer-order convention in each block are those just given. Mixed-derivative bounds are additional restrictions only when explicitly stated.

Decision and computational questions. Policy regret compares admissible feasible policies under the same law and constraints. In computational entries, finite data and thresholds have rational encodings; running time is measured in their total bit length. Real-valued equilibrium search uses the explicitly declared algebraic or FIXP encoding. An approximation ratio for maximization is written $\operatorname{OPT}/\operatorname{ALG}$ and for minimization as $\operatorname{ALG}/\operatorname{OPT}$, with zero optima and infeasible instances handled locally. Historical approximation bounds are not automatically current bounds.

Statement licence: CC-BY-4.0 · Source file

Contributions 1

Econ-318-A1 · Exploration · LLM-generated · gpt 6 astra ultra ·

GPT 6 Astra Ultra attempt on Econ-318

Estimating target heterogeneity from multiple studies

Research attempt by GPT-6 (Codex), 9 October 2026. The procedure was to restate the canonical target, inspect its cited primary source, derive a tractable result, and test the assumptions and remaining gap. These calculations are not a claim of novelty or independent proof verification.

Target and source check

There are independent samples of sizes $n_s$ from study laws and covariates from an outcome-free target population $P_0$. Write $N=\sum_s n_s$ and $P_* =\sum_s(n_s/N)P_s$. The target is the function $\tau_0=m_1-m_0$, with squared integrated risk under $P_0$. The canonical assumptions impose common conditional responses, fixed overlap $\epsilon\leq e_s\leq1-\epsilon$, Hölder smoothness, and $P_0\leq\kappa P_*$. They do not require identical study designs. The inspected source, Cinelli et al., Section 3.3.3, motivates heterogeneous causal effects with multiple studies; it does not supply the following transport minimax theorem. The sharp general theorem and bounded-deviation extension are the targets, not a claim that ordinary regression is unsolved.

A pooled construction requiring no propensity estimation

First restrict to $0<\beta\leq1$ on $[0,1]^d$, with common Hölder constant $L$. Partition the cube into $K\leq C_dh^{-d}$ cells of diameter at most $\sqrt d h$. For each treatment $w$, average the observed $Y$'s in each cell across all studies, retaining only records with $W=w$. Use zero if the cell is empty and clip the average to $[-1,1]$. Denote this regression estimate by $\widehat m_w$.
Proposition: For constants depending only on $d,\beta,L$, the resulting effect estimator satisfies \[ {\mathbb{E}}\|\widehat m_1-\widehat m_0-\tau_0\|_{L^2(P_0)}^2 \leq C\left(h^{2\beta}+\frac{\kappa K}{N\epsilon}\right). \] The bound holds for unequal study sizes and nonidentical covariate laws, including disjoint study supports.
Proof: Fix a cell $A$ and treatment $w$. Its count $M$ is a sum of independent, not necessarily identically distributed Bernoulli variables, with mean $\mu\geq N\epsilon P_*(A)$. Conditional on all covariates and assignments, the selected outcomes are independent, have variances at most one, and have means within $L(\sqrt d h)^\beta$ of $m_w(x)$ for every $x\in A$. For $M>0$, the conditional squared error is bounded by $2L^2d^\beta h^{2\beta}+2/M$. For $M=0$ it is at most one. If the Bernoulli success probabilities are $p_i$, then \[ {\mathbb{E}}\frac1{M+1} =\int_0^1\prod_i(1-p_i+p_it)\,dt \leq\int_0^1e^{-\mu(1-t)}dt\leq\frac1\mu. \] Since $1/M\leq2/(M+1)$ for $M\geq1$ and $\Pr(M=0)\leq e^{-\mu}\leq1/\mu$, the integrated stochastic contribution is at most $C P_0(A)/\mu\leq C\kappa/(N\epsilon)$. Cells with $P_*(A)=0$ have zero target mass and contribute nothing. Summing cells and using $(a-b)^2\leq2a^2+2b^2$ proves the claim. ∎
For fixed $\epsilon,\kappa$, taking $h\asymp N^{-1/(2\beta+d)}$ gives risk $O(N^{-2\beta/(2\beta+d)})$. There is no target-sample term: the target covariates are unnecessary for this uniform guarantee. Nor is there a study-propensity smoothness penalty. Outcome-regression pooling avoids estimating those nuisance functions. This observation does not settle optimal dependence on growing $\kappa$, higher smoothness, or adaptation to favorable designs.

Lower-bound mechanism and support stress test

To see the familiar rate obstruction, take all study designs and the target uniform on the cube, all propensities a fixed admissible constant $e_0\in[\epsilon,1-\epsilon]$, and $m_0=0$. Divide the cube into $K\asymp h^{-d}$ subcubes. In subcube $j$ put a smooth nonnegative bump of height $a h^\beta$, multiplied by a bit $v_j\in\{0,1\}$; choose $a$ small enough for the Hölder ball. Generate $Y\in\{-1,1\}$ with mean $m_W(X)$. Neighboring bit configurations differ in integrated squared mean by order $h^{2\beta+d}$ and in sample KL divergence by at most $CNh^{2\beta+d}$, using that Bernoulli probabilities remain in $[1/4,3/4]$. Choose $Nh^{2\beta+d}$ a small constant. The total variation bound $\operatorname{TV}\leq\sqrt{\operatorname{KL}/2}$ then gives a positive error probability for each bit under any decoder. Decoding an estimated regression by its closest bump converts each incorrect bit into loss at least $ch^{2\beta+d}$. Summing $K$ bits yields the lower rate $ch^{2\beta}$. This checks the exponent in this restricted setting. A study with no observations near a target point cannot be made informative by its large sample elsewhere; the cell count proof makes this explicit.

Bounded transport violations

With population study means known, define, on study-supported points, \[ l_w(x)=\max\{-1,\max_{s:x\in\operatorname{supp}P_s} [m_{w,s}(x)-\delta_s]\},\quad u_w(x)=\min\{1,\min_{s:x\in\operatorname{supp}P_s} [m_{w,s}(x)+\delta_s]\}. \] Without smoothness restrictions on target responses, the sharp pointwise interval is $[l_1-u_0,u_1-l_0]$: every choice of means in the two intersected intervals is realized by bounded Bernoulli potential outcomes, independent of randomized assignment. With target Hölder restrictions, the exact functional set instead is \[ \{f_1-f_0:f_w\in\mathcal H_d^\beta(L),\quad l_w\leq f_w\leq u_w\quad P_0\text{-a.e.}\}. \] The pointwise interval can then overstate what is jointly attainable. For example, constant observed means zero and common $\delta\leq\min(1,L)$ permit target pairs $(m_1,m_0)=(\delta,-\delta)$ and $(-\delta,\delta)$ with exactly the same study data. Their effects differ by $4\delta$, so the worst squared $L^2$ risk is at least $4\delta^2$, even with infinite study and target samples. Randomization cannot remove this transport ambiguity.

Verification and remaining problem

The result uses fixed positive overlap; replacing it with merely pointwise positivity invalidates the uniform rate. Constants and empty cells were accounted for, and study membership is not assumed random. The general sharp dependence on coverage, smoothness beyond one, and unequal $\delta_s$ with jointly smooth target functions is not proved here. The next concrete task is an optimal-recovery analysis of the intersected Hölder bands, combined with local effective sample counts. Final status: UNRESOLVED.

Completion Estimate

62%

This is a post hoc, heuristic estimate for the full catalogue target. The attempt proves a pooled regression risk bound for unequal study designs, a matching fixed-overlap rate obstruction, and transport-violation identified sets and irreducible error. Sharp general dependence on growing coverage ratios, higher smoothness, favorable local designs, and jointly smooth unequal transport deviations remains unresolved.

Source

C. Cinelli, A. Feller, G. Imbens, E. Kennedy, S. Magliacane and J. Zubizarreta, Challenges in Statistics: A Dozen Challenges in Causality and Causal Inference, arXiv:2508.17099v1 (2025), Section 3.3.3. https://arxiv.org/html/2508.17099v1#S3.SS3.SSS3.

Go to contribution →