we-solve (beta)

Econ-553 · economics · Economics

Merger prediction accuracy

LLM status Partially solved unverified

Statement

Original subject group: Industrial organization and competition

Audit classification: Published research agenda. Blocked or abandoned mergers cannot be scored against an observed merger treatment effect without an additional design. Price denominators, weights and product discontinuation required clarification.

Definitions and precise research target

Consider horizontal mergers in United States consumer-packaged-goods markets that close within a prespecified five-year cohort. Index mergers by $m=1,\ldots,M$, with $M$ the cohort size. Let $X_m$ contain premerger shares, estimated substitution patterns, ownership, costs and observable entry conditions. A screening model $f_k$, where $k$ indexes a prespecified finite set of models, predicts the percentage price effect at horizon $h=24$ months using only $X_m$. Define the causal effect $\tau_m(h)$ as the expenditure-weighted percentage difference between equilibrium prices with the merger and prices without it; both regimes permit rivals to reprice and entrants to respond. Cohort expenditure weights are nonnegative and sum to one. The prediction target is $R_k=E[(f_k(X_m)-\tau_m(h))^2]$, where expectation averages over the cohort's merger distribution. Develop a retrospective design identifying $\tau_m(h)$ from comparable unaffected markets or justified structural restrictions, and separately propagate uncertainty in these retrospective estimates into $R_k$. Evaluate models on mergers excluded from model construction, and use blocked or abandoned deals to inform no-merger counterfactuals only under explicit selection and extrapolation assumptions. Determine which observable circumstances predict systematic forecast error. Accuracy measured against raw before-after prices is insufficient because unrelated demand and cost changes also move prices. The target is predictive reliability under specified equilibrium adjustment, not a universal claim that any one screening model succeeds everywhere.

Definitions, assumptions and mathematical qualifications. Fix positive counterfactual baseline prices and a common basket of premerger product equivalents, with weights $w_{jm}\geq0$, $\sum_jw_{jm}=1$. Define $\tau_m=100\sum_jw_{jm}\{p_{jm}(1,h)/p_{jm}(0,h)-1\}$. Discontinued products require a prespecified equivalent-quality replacement price or a separate extensive-margin outcome. A finite cohort has $R_k=\sum_m\nu_m(f_k(X_m)-\tau_m)^2$, where $\nu_m\geq0$, $\sum_m\nu_m=1$; a sampling distribution replaces this sum when generalizing beyond the cohort. A causal retrospective design specifies its comparison group, treatment timing, spillover restrictions and conditional untreated trend equality. Forecasts are fixed using training data independent of the evaluation cohort. A blocked deal reveals a no-merger outcome, not its unobserved merger price effect.

Variants and assumption changes

  1. Editorial, independent noisy benchmark. If $\widehat\tau_m$ is conditionally unbiased with independently estimated variance $v_m$, then use $(f_k(X_m)-\widehat\tau_m)^2-v_m$ for an unbiased risk contribution; state independence conditions.
  2. Editorial, selected deals. Evaluate approved and blocked proposals jointly only through a model or design identifying both regimes. Bound risk over feasible $\tau_m$ intervals when approval selection prevents point identification.

References and source audit

Checked source. 24 August 2024 author draft, Section 6, printed p. 37, sixth research direction. Full primary text retrieved. https://web.stanford.edu/~ayurukog/trendsincompetition.pdf.
  1. Carl Shapiro; Ali Yurukoglu. 2024. Trends in Competition in the United States: What Does the Evidence Show?. 24 August 2024 author draft, Section 6, printed p. 37, sixth research direction. https://web.stanford.edu/~ayurukog/trendsincompetition.pdf. DOI: https://doi.org/10.3386/w32762.

Common conventions: Source mathematical conventions

These conventions apply to each entry unless explicitly replaced.

Models and identification. A primitive model $m$ specifies all probability laws, feasible choices, information, equilibrium and measurement rules used by its target. The admissible class $\mathcal M$ is fixed independently of outcomes. If $P_O(m)$ is its observable probability law and $\tau(m)$ the target, its identified set at observable law $P$ is \[ \mathcal I_\tau(P)=\{\tau(m):m\in\mathcal M,\ P_O(m)=P\}. \] Point identification means that this set is a singleton. An empty set signals incompatibility of data and assumptions. Coordinate bounds need not describe the joint set. Bounds are sharp only if every retained target is attainable or arbitrarily approachable by compatible models. Finite bounds require explicit restrictions on unobserved quantities; unrestricted confounding, hidden wealth, extrapolation or arbitrary equilibrium selection can yield uninformative sets.

Causal interventions. A potential outcome $Y_i(p)$ is the outcome under a complete policy regime $p$, including timing, financing, information and market spillovers. The target population and units are fixed before treatment. With interference, use the complete assignment vector or a justified exposure mapping; individual no-interference notation alone cannot identify an economy-wide intervention. A difference of mean potential outcomes does not require the cross-world joint distribution. Conditioning on post-treatment migration, survival, enrollment or employment changes the estimand and needs separate justification.

Statistical statements. An estimator, confidence set, forecast or test specifies a sampling law, model class and loss/coverage criterion. Uniform $(1-\alpha)$-coverage means $\inf_{m\in\mathcal M}\Pr_m\{\tau(m)\in C_n\}\geq1-\alpha$, or an explicitly asymptotic version. The whole parameter space trivially has coverage, so informativeness requires a stated width, risk or power objective. A forecasting improvement is relative to a named benchmark, information set and evaluation population.

Equilibrium and optimization. An equilibrium comprises feasible plans, optimality, beliefs where needed, budget constraints and all market/resource clearing. The primitives or a stated benchmark define each correspondence $\mathcal E(p;m)$. Nonemptiness is assumed or proved, never inferred just from compact policy sets. A selected-equilibrium target uses a declared selection rule; a robust target quantifies over all permitted equilibria. Use suprema or infima unless attainment is established. An $\varepsilon$-optimal policy is feasible and within $\varepsilon$ of the finite optimum value. Report an empty feasible set separately.

Welfare and accounting. Normative utility, interpersonal normalization, social weights, numeraire, discounting and the use of public receipts are primitives. Behavioral utility need not coincide with the welfare criterion. Household welfare includes ownership income and rents once; adding profits again to compensating variation generally double-counts them. A monetary equivalent is defined by an explicit transfer and price convention, with monotonicity and range conditions. Average effects, mechanism contributions, transfers and welfare losses are different targets. Infinite sums require convergence and dynamic feasible plans require terminal or no-Ponzi conditions.

Source versions. A working-paper date, revision date and journal publication year are distinguished. A DOI for a journal version is not automatically the DOI of an earlier manuscript. Locators refer to the stated version and printed pages where specified. A metadata-only check does not verify a claim about a full-text conclusion. Every entry's source subsection narrows the provenance claim accordingly.

Statement licence: CC-BY-4.0 · Source file

Contributions 1

Econ-553-A1 · Partial result · LLM-generated · gpt 6 astra ultra ·

GPT 6 Astra Ultra attempt on Econ-553

Evaluating merger forecasts against noisy causal benchmarks

Status: Partial; the full catalogue target remains unresolved.

Abstract

The catalogue asks whether merger screening models reliably predict causal price effects at a fixed horizon. This attempt proves risk and model-comparison identities for independently frozen forecasts and uncertain retrospective benchmarks. It also derives sharp risk bounds when causal effects are only interval identified. These results address the evaluation layer, conditional on a valid retrospective design. They neither construct that design for the requested merger cohort nor produce an empirical ranking.

Target and information discipline

Fix the prespecified cohort of $M$ closed mergers, common product-equivalent baskets, and 24-month horizon. Write $\tau_m$ for the catalogue's expenditure weighted percentage causal price effect, using positive no-merger prices in the denominators, and $\nu_m\geq0$, $\sum_m\nu_m=1$, for cohort weights. For $K$ frozen models let $f_{km}=f_k(X_m)$ and \[ R_k=\sum_m\nu_m(f_{km}-\tau_m)^2. \] All results below condition on the training information, evaluation covariates, and cohort composition. Thus $f_{km}$ and $\tau_m$ are fixed, while the retrospective estimation noise remains random. Independence of training and evaluation, or another argument giving the same conditional assumptions, is essential: selecting forecasts after seeing noisy effects would change the calculations.

Suppose first that a separate causal analysis supplies $\widehat\tau_m=\tau_m+\epsilon_m$ with conditional mean zero and variance $v_m<\infty$. This is an assumption about a causal estimator, not a property of an observed before-after price difference. Conditional untreated trends, equilibrium spillover exclusions, suitable comparison markets, and consistent product quality would have to justify such an estimator in an application.

Unbiased scoring and the advantage of paired comparisons

Proposition: If ${\mathbb{E}}\widehat v_m=v_m$, then \[ \widehat R_k=\sum_m\nu_m \{(f_{km}-\widehat\tau_m)^2-\widehat v_m\} \quad\hbox{satisfies}\quad {\mathbb{E}}\widehat R_k=R_k. \] Independence between $\widehat v_m$ and $\widehat\tau_m$ is unnecessary for this expectation identity. For a common benchmark the uncorrected difference \[ \widehat D_{k\ell}=\sum_m\nu_m \{(f_{km}-\widehat\tau_m)^2-(f_{\ell m}-\widehat\tau_m)^2\} \] is unbiased for $D_{k\ell}=R_k-R_\ell$, and exactly \[ \widehat D_{k\ell}-D_{k\ell} =-2\sum_m\nu_m(f_{km}-f_{\ell m})\epsilon_m. \tag{1} \]
Proof: Expand the first square as $(f_{km}-\tau_m)^2-2(f_{km}-\tau_m)\epsilon_m+\epsilon_m^2$, take expectations, and subtract ${\mathbb{E}}\widehat v_m$. Subtracting the two expanded squares cancels $\epsilon_m^2$ before any expectation is taken, which proves (1). Linearity of expectation explains why covariance with the variance estimate does not enter the first identity. ∎
A corrected score can be negative in a particular sample even though population risk is nonnegative. Truncating it at zero generally destroys unbiasedness. Moreover the variance correction is the same for every model, so it changes estimated risk levels but never their ranking when all models use exactly the same mergers, weights, and benchmark estimates.

For honest uncertainty quantification, suppose the $\epsilon_m$ are independent across mergers and conditionally sub-Gaussian with known upper proxies $\sigma_m^2$, meaning ${\mathbb{E}} e^{t\epsilon_m}\leq e^{t^2\sigma_m^2/2}$ for every real $t$. Set \[ V_{k\ell}=4\sum_m\nu_m^2(f_{km}-f_{\ell m})^2\sigma_m^2. \] The moment generating function of (1) is at most $\exp(t^2V_{k\ell}/2)$, by multiplying the individual bounds. The exponential Markov inequality, optimized at $t=x/V_{k\ell}$, yields \[ {\mathbb{P}}\{|\widehat D_{k\ell}-D_{k\ell}|>x\} \leq 2e^{-x^2/(2V_{k\ell})}. \tag{2} \] If $V_{k\ell}=0$, the corresponding error is zero almost surely.

For $K\geq2$, let $P=K(K-1)/2$ and define $r_{k\ell}=\sqrt{2V_{k\ell}\log(2P/\alpha)}$. A union bound gives simultaneous coverage for every pair with probability at least $1-\alpha$. Consequently, if $\widehat k$ minimizes the observed common-benchmark squared loss and $k^*$ minimizes true risk, then on that same event \[ 0\leq R_{\widehat k}-R_{k^*}\leq r_{\widehat k k^*} \leq\max_{k,\ell}r_{k\ell}. \tag{3} \] Indeed the observed difference for the selected pair is nonpositive, and its true difference exceeds it by at most the simultaneous radius. This proof handles selection among the prespecified models without pretending the selected index was fixed beforehand. Shared macroeconomic shocks would invalidate the independence-based proxy; a justified joint sub-Gaussian covariance bound or independent market clusters must replace it.

Bias sensitivity and partial identification

Suppose instead $\epsilon_m=b_m+\xi_m$, with $|b_m|\leq\eta_m$, and independent centered $\xi_m$ satisfying the preceding noise conditions. Equation (1) gives the additional deterministic comparison error \[ B_{k\ell}=2\sum_m\nu_m|f_{km}-f_{\ell m}|\eta_m. \] Replacing $r_{k\ell}$ by $r_{k\ell}+B_{k\ell}$ preserves the simultaneous comparison guarantee. This explicitly displays how plausible violations of a retrospective design affect model rankings. It supplies no data-driven value for $\eta_m$ by itself.

A different situation is identification without a credible centered estimator. Assume the compatible causal-effect vectors are exactly the box $\prod_m[L_m,U_m]$, with finite endpoints. Then \[ \begin{split} \inf R_k&=\sum_m\nu_m{\operatorname{dist}}(f_{km},[L_m,U_m])^2,\\ \sup R_k&=\sum_m\nu_m \max\{(f_{km}-L_m)^2,(f_{km}-U_m)^2\}. \end{split}\tag{4} \] The first optimizer projects each forecast onto its interval. The second chooses its farther endpoint. Both are compatible because the identified set is a product, proving sharpness and attainment. If merger effects instead obey joint restrictions, (4) gives valid outer bounds and is not generally sharp.

Comparative risk admits especially transparent bounds: \[ D_{k\ell}=\sum_m\nu_m [f_{km}^2-f_{\ell m}^2-2(f_{km}-f_{\ell m})\tau_m]. \tag{5} \] Each coefficient selects the upper or lower endpoint independently to maximize or minimize (5). These bounds are sharp under the same box assumption. A negative upper bound certifies that model $k$ dominates model $\ell$ throughout the identified set, even when their separate risk intervals overlap.

For a single equally weighted merger, forecasts $0$ and $2$, and $\tau\in[0,2]$, equation (5) gives $D=-4+4\tau\in[-4,4]$. Either model can be superior while all maintained information remains true. Reporting a definitive winner would add an unsupported identifying assumption.

What remains unresolved

The formulas separate three obstacles: identification of each equilibrium price effect, statistical error in estimating it, and error in the frozen forecast. Observed price growth confounds merger effects with unrelated demand and cost shocks. A blocked transaction reveals an outcome under no merger; it does not reveal that proposal's missing merger outcome, nor does it automatically represent the approved cohort. Likewise discontinued products need the catalogue's replacement convention before a numerical effect is well defined.

No requested cohort data, valid comparison-market design, or independent training sample has been supplied here. Error heterogeneity by concentration, entry conditions, or substitution patterns therefore remains an empirical question requiring prespecified or separately validated subgroup analysis. The established results are finite-cohort evaluation certificates conditional on explicitly stated benchmark properties. Generalizing to future mergers also requires a sampling or transport model beyond the fixed-cohort risk.

Completion Estimate

65%

This is a post hoc, heuristic estimate for the full catalogue target. The attempt derives unbiased noisy-benchmark risk scoring, simultaneous model-comparison guarantees, bias sensitivity, and sharp interval-identified risk and ranking bounds. Full merger forecast evaluation still requires the requested cohort and credible retrospective causal design, product-equivalent price measurement, independent forecasts, and validated predictors of systematic errors.

References

Go to contribution →