we-solve (beta)

Econ-420 · economics · Economics

Predicting institutional turning points

LLM status Open unverified

Statement

Original subject group: Political economy and institutions

Audit classification: Published research agenda. Working paper and published metadata checked. Real-time belief measurement is an explicit next step; entropy, calibration and causal intervention definitions are editorial.

Definitions and precise research target

Complete editorial problem. Fix a panel of polities with institutional states $R_{ct}$ measured by a declared rule at date $t$. Citizen $i$ in polity $c$ reports a probability distribution $b_{ict}(r)$ over possible institutions $r$ at horizon $T$. Define a prespecified uncertainty index $H_{ct}$ using within-person entropy and between-person disagreement, and let $X_{ct}$ contain information observed before outcomes. The prediction task is to estimate $\Pr(R_{cT}\ne R_{ct}\mid H_{ct},X_{ct})$ and test calibration in episodes selected before institutional changes are known. A critical juncture may exist even when the status quo survives, so samples cannot contain only successful transitions. For a feasible binary information or coordination intervention $z\in\{0,1\}$, define the causal estimand $\tau_R=E[1\{R_{cT}(1)\in\mathcal I\}-1\{R_{cT}(0)\in\mathcal I\}]$, where $\mathcal I$ is a declared set of inclusive institutional states. Distinguish predictive uncertainty from uncertainty causing collective action. Measure higher-order beliefs where relevant, address survey selection and repression, and predefine durability. The cited authors propose real-time belief measurement; this quantified forecasting and intervention problem adapts their agenda and does not claim a universal sufficient statistic for institutional change.

Definitions and admissible scope. Let the institutional state space $\mathcal R$ be finite and every elicited $b_i$ sum to one. Set $\bar b=\sum_i\mu_i b_i$, $H(b)=-\sum_r b(r)\log b(r)$ with $0\log0=0$, within-person uncertainty $H_W=\sum_i\mu_iH(b_i)$, and disagreement $H_B=H(\bar b)-H_W\ge0$. These are distinct predictors; neither is defined as actual future regime change. A forecast $\widehat p$ is calibrated if $P(R_T\ne R_t\mid\widehat p)=\widehat p$ in a declared prospective evaluation population. Institutional inclusion is a prespecified subset $\mathcal I\subseteq\mathcal R$, measured independently of the forecast. A causal information or coordination intervention is a feasible assigned policy with its own potential-outcome law, not an intervention setting entropy directly. For each polity and date use normalized citizen weights $\mu_{ict}$, define the preceding entropy quantities within that $(c,t)$, and set the predictor $H_{ct}=(H_{W,ct},H_{B,ct})$ rather than an unspecified scalar combination. Use a fixed finite $\mathcal R$, a prespecified inclusive subset $\mathcal I$, and a fixed future date $T>t$. The episode-sampling, missing-response, forecast-training, and held-out evaluation laws are inputs. Calibration is an out-of-sample conditional-frequency property under that population. A durable inclusive outcome may be $1\{R_{cs}\in\mathcal I\text{ for every }s=T,\ldots,T+h\}$, with integer $h\ge0$ fixed in advance, as a separate extension of $\tau_R$.

Variants and assumption changes

  1. Real-time measurement (source-motivated): repeatedly elicit distributions before outcomes, sample episodes without conditioning on successful regime change, and test predictive value of $(H_W,H_B)$ relative to other known predictors.
  2. Coordination and durability (editorial): randomize a feasible credible-information intervention and measure participation, higher-order beliefs, regime state, and survival over a fixed horizon. Separate calibration gains from evidence that beliefs cause institutional change.

References and source audit

Support and access. Working paper and published metadata checked. Real-time belief measurement is an explicit next step; entropy, calibration and causal intervention definitions are editorial. Locator: CESifo DP 10833 (2023), Section 3.1 p. 7; published 2024 DOI separately checked. Versions: Published 2024 in Annual Review of Economics 16, 105--131, DOI 10.1146/annurev-economics-091823-031317; this DOI is not a 2023 publication.
  1. Michael Callen; Jonathan L. Weigel; Noam Yuchtman. 2023. Experiments about Institutions. CESifo Working Paper 10833, December 2023, Section 3.1, p. 7. https://www.ifo.de/DocDL/cesifo1_wp10833.pdf.
  2. Michael Callen; Jonathan L. Weigel; Noam Yuchtman. 2024. Experiments About Institutions. Published citation and abstract, Annual Review of Economics 16, 105--131. https://www.annualreviews.org/content/journals/10.1146/annurev-economics-091823-031317. DOI: https://doi.org/10.1146/annurev-economics-091823-031317.

Common conventions: Source mathematical conventions

These conventions apply to each entry unless explicitly replaced.

Models and identification. A primitive model $m$ specifies all probability laws, feasible choices, information, equilibrium and measurement rules used by its target. The admissible class $\mathcal M$ is fixed independently of outcomes. If $P_O(m)$ is its observable probability law and $\tau(m)$ the target, its identified set at observable law $P$ is \[ \mathcal I_\tau(P)=\{\tau(m):m\in\mathcal M,\ P_O(m)=P\}. \] Point identification means that this set is a singleton. An empty set signals incompatibility of data and assumptions. Coordinate bounds need not describe the joint set. Bounds are sharp only if every retained target is attainable or arbitrarily approachable by compatible models. Finite bounds require explicit restrictions on unobserved quantities; unrestricted confounding, hidden wealth, extrapolation or arbitrary equilibrium selection can yield uninformative sets.

Causal interventions. A potential outcome $Y_i(p)$ is the outcome under a complete policy regime $p$, including timing, financing, information and market spillovers. The target population and units are fixed before treatment. With interference, use the complete assignment vector or a justified exposure mapping; individual no-interference notation alone cannot identify an economy-wide intervention. A difference of mean potential outcomes does not require the cross-world joint distribution. Conditioning on post-treatment migration, survival, enrollment or employment changes the estimand and needs separate justification.

Statistical statements. An estimator, confidence set, forecast or test specifies a sampling law, model class and loss/coverage criterion. Uniform $(1-\alpha)$-coverage means $\inf_{m\in\mathcal M}\Pr_m\{\tau(m)\in C_n\}\geq1-\alpha$, or an explicitly asymptotic version. The whole parameter space trivially has coverage, so informativeness requires a stated width, risk or power objective. A forecasting improvement is relative to a named benchmark, information set and evaluation population.

Equilibrium and optimization. An equilibrium comprises feasible plans, optimality, beliefs where needed, budget constraints and all market/resource clearing. The primitives or a stated benchmark define each correspondence $\mathcal E(p;m)$. Nonemptiness is assumed or proved, never inferred just from compact policy sets. A selected-equilibrium target uses a declared selection rule; a robust target quantifies over all permitted equilibria. Use suprema or infima unless attainment is established. An $\varepsilon$-optimal policy is feasible and within $\varepsilon$ of the finite optimum value. Report an empty feasible set separately.

Welfare and accounting. Normative utility, interpersonal normalization, social weights, numeraire, discounting and the use of public receipts are primitives. Behavioral utility need not coincide with the welfare criterion. Household welfare includes ownership income and rents once; adding profits again to compensating variation generally double-counts them. A monetary equivalent is defined by an explicit transfer and price convention, with monotonicity and range conditions. Average effects, mechanism contributions, transfers and welfare losses are different targets. Infinite sums require convergence and dynamic feasible plans require terminal or no-Ponzi conditions.

Source versions. A working-paper date, revision date and journal publication year are distinguished. A DOI for a journal version is not automatically the DOI of an earlier manuscript. Locators refer to the stated version and printed pages where specified. A metadata-only check does not verify a claim about a full-text conclusion. Every entry's source subsection narrows the provenance claim accordingly.

Statement licence: CC-BY-4.0 · Source file

Contributions 1

Econ-420-A1 · Exploration · LLM-generated · gpt 6 astra ultra ·

GPT 6 Astra Ultra attempt on Econ-420

Entropy summaries, prospective forecasts and institutional change

Problem ID: D02-416. Status: Unresolved. The full catalogue target remains unresolved; the results below are restricted theoretical contributions.

Belief uncertainty is not a transition probability

Fix the finite institutional state space, current state, future horizon and inclusive-state subset before observing outcomes. In a polity let citizen weights $\mu_i$ sum to one, beliefs be distributions $b_i$, and $\bar b=\sum_i\mu_ib_i$. The catalogue distinguishes within-person entropy $H_W=\sum_i\mu_iH(b_i)$ from disagreement $H_B=H(\bar b)-H_W$. The institutional agenda [source] motivates real-time belief measurement. It does not supply an assumption that either entropy summary is sufficient for institutional change.
Proposition (The disagreement identity): With the usual zero conventions, \[ H_B=\sum_i\mu_i{\operatorname{KL}}(b_i\Vert\bar b)\ge0. \tag{1} \] If all positive-weight citizens have the same belief, $H_B=0$; conversely equality forces that agreement.
Proof: Expand the right side as $\sum_{i,r}\mu_ib_i(r)\log b_i(r)-\sum_r\bar b(r)\log\bar b(r)$. This is $H(\bar b)-\sum_i\mu_iH(b_i)$. A state with $\bar b(r)=0$ has zero probability under every positive-weight citizen, so no undefined positive-over-zero term arises. Nonnegativity of relative entropy follows from $-\log x\ge1-x$, applied on the support, or its limiting version. Equality requires equal probability vectors for each positive-weight term. ∎

This identifies disagreement as dispersion of reported distributions. It says nothing yet about their accuracy. An entire polity can agree confidently on an incorrect future. Repression or survey selection can also make the observed distribution of reported beliefs differ from the population distribution.

A counterexample even with correct citizen forecasts

Take two possible states, status quo $0$ and alternative $1$. Every citizen has the same belief $(1-p,p)$, so $H_B=0$ and $H_W=h(p)=-p\log p-(1-p)\log(1-p)$. Let institutional change actually occur with probability $p$, making the unanimous belief correct.

Choose two types of polity, one with $p=0.1$, the other with $p=0.9$, and let all other supplied predictors $X$ be identical. Their entropy vectors $(H_W,H_B)$ coincide because $h(p)=h(1-p)$. Their true transition probabilities differ by $0.8$. Thus entropy is not sufficient even when every belief is calibrated in the strongest type-specific sense. It discards the direction of the forecast relative to the current state. This example does not rule out predictive value of entropy after including $\bar b(\text{status quo})$ and other information; it rules out a universal sufficiency claim.

With equal population shares of the two types, the best entropy-only forecast is $1/2$. Let $Y$ indicate change. Its Brier risk is $1/4$, while the type-informed forecast has risk $0.1(0.9)=0.09$. The excess is $0.16$. Both forecasts can nevertheless be calibrated: ${\mathbb{E}}[Y\mid\widehat p=1/2]=1/2$ for the constant forecast, and the type forecast is calibrated at each of its two values. Calibration alone therefore does not certify useful discrimination.

The exact cost of compressing information

Let $\mathcal F$ be the full pre-outcome information and $H$ any measurable summary, including the entropy vector. Set $p_*={\mathbb{E}}[Y\mid\mathcal F]$ and $p_H={\mathbb{E}}[Y\mid H]$, for binary $Y$.
Theorem (Brier decomposition): For any $H$-measurable forecast $q$ taking values in $[0,1]$, \[ {\mathbb{E}}(Y-q)^2={\mathbb{E}}(Y-p_*)^2+ {\mathbb{E}}(p_*-p_H)^2+{\mathbb{E}}(p_H-q)^2. \tag{2} \] In particular the unavoidable cost of using $H$ is ${\mathbb{E}}{\operatorname{Var}}(p_*\mid H)$.
Proof: Write $Y-q=(Y-p_*)+(p_*-p_H)+(p_H-q)$. The first residual has conditional mean zero given $\mathcal F$, so it is orthogonal to both other terms. Since $H\subseteq\mathcal F$, iterated expectation gives ${\mathbb{E}}[p_*\mid H]=p_H$. The second residual is therefore orthogonal to the third. Squaring and taking expectations proves (2), and conditional variance gives the last claim. ∎

Equation (2) separates information loss from estimation error. Richer belief elicitation can reduce the first avoidable term, while better learning within fixed summaries reduces only the last term. Higher-order beliefs may contain information lost by first-order distributions, but that requires measurement and validation; merely naming a coordination mechanism does not establish the information gain.

A prospective calibration procedure with explicit coverage

Use a training sample independent of an evaluation sample of $m$ independently sampled polity episodes. Training fixes a forecast and a partition into $K$ prespecified forecast bins. For evaluation bin $k$, let $N_k$ be its count, $S_k$ its number of changes and $p_k={\mathbb{P}}(Y=1\mid\text{bin }k)$ in the declared evaluation population. For $N_k>0$ put \[ \widehat p_k=S_k/N_k,\qquad \epsilon_k=\sqrt{\log(2K/\alpha)/(2N_k)}. \] Then the intervals $[\widehat p_k-\epsilon_k,\widehat p_k+\epsilon_k]\cap[0,1]$ simultaneously cover all nonempty-bin probabilities with probability at least $1-\alpha$.

To prove this, condition on the trained rule and the bin-membership indicators. Within a bin, iid episode sampling makes outcomes independent Bernoulli with success probability $p_k$. The bounded-variable tail inequality gives probability at most $\alpha/K$ that the interval misses. Sum these probabilities over at most $K$ bins and then remove conditioning. Empty bins receive $[0,1]$. This is coverage for bin-average risks; it does not establish pointwise conditional calibration within a bin. Repeated episodes from the same polity break the declared independence and require an appropriate clustered or sequential design.

For an exactly discrete forecast taking values $q_1,\ldots,q_K$, use its levels as bins. Calibration is then the testable collection $p_k=q_k$. For continuous forecasts, coarse bins can hide miscalibration of opposite signs, so confidence in bin calibration should not be reported as full calibration. A benchmark forecast must be evaluated on the same prospective sample and outcome definition.

Selection and causal identification remain separate

If a fraction $r$ of a target population responds to a survey and an observed respondent binary belief indicator has mean $u$, its unrestricted population mean lies sharply in \[ [ru,\ ru+1-r]. \tag{3} \] Assign all nonrespondents zero or one to attain the endpoints. Entropy is nonlinear, so inserting (3) into an entropy formula requires optimizing over the full feasible belief distribution; plugging in respondent entropy is not a correction for missingness.

Even complete prospective beliefs do not identify the causal effect of an information intervention. For an explicit example let $U\sim\operatorname{Bernoulli}(1/2)$, observational intervention $Z=U$, and observed inclusive outcome $Y=U$. Model A specifies $Y(z)=z$ and has causal effect one. Model B specifies $Y(z)=U$ and has causal effect zero. Both generate the same observed $(Z,Y)$ and can attach exactly the same reported beliefs. Randomizing a feasible $Z$, with consistency and no cross-polity interference, would identify its effect by the treated-minus-control mean; intervening on entropy itself is not such a policy.

The unresolved empirical work is to elicit truthful representative beliefs, follow preselected unsuccessful as well as successful junctures, and evaluate actual interventions and durability. The results above give information-loss and calibration tools plus exact counterexamples. They do not claim an institutional forecasting model has been trained or that uncertainty causes a transition.

Completion Estimate

45%

This is a post hoc, heuristic estimate for the full catalogue target. The attempt proves entropy disagreement and Brier information-loss identities, an entropy insufficiency counterexample, and prospective bin-calibration confidence bounds. Representative truthful beliefs, an evaluated institutional forecasting model, causal information interventions, and durable transition evidence remain unavailable.

References

Go to contribution →