REVIEW 4 major objections 4 minor 29 references
Regression discontinuity aggregation, with an application to the union effects on inequality
T0 review · 4 major / 4 minor · reviewed 2026-08-10 · deepseek-v4-flash
Pith's one-line read This paper shows that regression discontinuity designs still identify a local average causal effect when outcomes aggregate many discontinuity events, and that the rate of new unionization reduces within-cell wage inequality in the US.
desk verdict A clean, reusable formalization of aggregated RD designs with a credible equivalence result; the union application is plausible but depends on an untestable exclusion restriction. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The central object is the weight-share representation of the aggregated treatment and instrument. Each upper-level unit $i$ contains subunits $j$ with known importance weights $s_j$; the treatment is $X_i=\sum_{j\in J_i}s_j z_j$ with $z_j=\mathbf{1}[r_j\ge0]$, and the instrument $Z_i=\sum_{j\in C_i}s_j z_j$ keeps only subunits whose running variable falls within the bandwidth. The load-bearing identity is Proposition 1: the upper-level IV estimator is numerically equivalent to a subunit-level IV regression on the close-elections sample, with $z_j$ as the instrument, $q_j=(1,r_j,r_j^+)$ as controls, and $s_j$ as weights. This equivalence dictates the three RDA controls $Q_i=(\sum_{j\in C_i}s_j,\sum_{j\in C_i}s_j r_j,\sum_{j\in C_i}s_j r_j^+)$ as the correctly aggregated versions of standard local linear controls, and it is what lets the stacking estimator and the upper-level estimator converge to the same $\beta_0$. The lower-level estimator is the same regression without residualization, which is why both inherit the bias behavior of conventional fuzzy RD.
What would settle it
One concrete check is to estimate the reduced-form effect of close-election victories on the change in cell inequality for elections where the union won at the ballot box but certification was later reversed on appeal: under the exclusion restriction these elections should produce no effect, because the unionization share is unchanged, whereas any nonzero effect would signal that the election itself, rather than new unionization, drives the result.
Extended reading notes
Core claim
It is the paper's central formal claim that aggregated RD still identifies a local average treatment effect. Let $\beta_h^u$ be the estimand of the upper-level IV regression (6) and $\beta_h^\ell$ the estimand of the lower-level stacking regression (9). Proposition 2 states that under continuity, density, monotonicity, and an exclusion restriction (Assumptions 1–5), both estimands converge as $h\to 0$ to the same convexly weighted average of unit-level potential-outcome slopes, $$\beta_0=\frac{\mathbb{E}[s_j\,(Y_{i(j)}(X_{i(j)}(1,z_{i(j)-j}))-Y_{i(j)}(X_{i(j)}(0,z_{i(j)-j})))\mid r_j=0]}{\mathbb{E}[s_j\,(X_{i(j)}(1,z_{i(j)-j})-X_{i(j)}(0,z_{i(j)-j}))\mid r_j=0]},$$ so both procedures recover a causal local parameter rather than a confounded association. The paper further argues, and supports by Monte Carlo simulation, that including the aggregated local linear controls at the upper level—or their standard RD analogues at the lower level—preserves the bias-reduction advantages of local linear RD, which most existing aggregated-RD practice gives up.
Load-bearing premise
The causal interpretation of the inequality estimates rests on the exclusion restriction that a close union election affects a cell's inequality only through the share of newly unionized workers, not through election campaigns, organizing threats, or other channels.
Editorial extensions
If this is right
- In any design where treatment is a weighted sum of RD shocks, the upper-level IV with RDA controls and the lower-level stacking estimator converge to the same local average treatment effect, so aggregated RD studies can keep the bias-reducing controls of local linear RD.
- For the union application, a 1 percentage point increase in the rate of new unionization lowers the Gini coefficient by about 0.018, the top-10% income share by about 0.14 percentage points, and the variance of log wages by about 0.0025, which is roughly 1% of its mean.
- The inequality reduction comes mostly from lower wages at the top of the distribution (college graduates, the 90th percentile, and managers), not from higher wages at the bottom.
- If the estimated effects persist, the decline in new unionization since the 1960s explains about 34–38% of the growth in within-cell inequality from 1970 to 2010.
- The same upper-level or stacking template applies to legislature seat shares, firm political connections, school bond referenda, and spillover designs, where the paper argues current practice typically omits the necessary aggregated controls.
Reading between the lines
- The paper leaves formal bias expansions to future work; a natural extension would prove that the RDA controls reduce bias at a quadratic rate as $h\to0$ under smooth potential outcomes, turning the Monte Carlo evidence into a theorem.
- Because the weights in $\beta_0$ are $s_j$ times the first-stage effect, the target parameter is implicitly election-weighted; researchers wanting unit-level rather than subunit-level weights should reweight by the inverse of $\sum_{j\in C_i}s_j^2$, an adjustment the paper mentions only briefly.
- A testable consequence of the exclusion restriction is that close elections whose certification was later reversed should show zero reduced-form effect on cell inequality; the appeal cases the paper cites could serve as a placebo sample.
- The control for the total weight of close elections is equivalent to a recentering adjustment under a local randomization view of RD, suggesting that a local-randomization variant of RDA could sharpen inference in small samples.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper extends regression discontinuity (RD) methods to settings where the outcome is measured at a higher level of aggregation than the running variable, proposing two estimators: an upper-level IV estimator that instruments an aggregated treatment with a weighted sum of close-election RD shocks while controlling for aggregated local-linear controls, and a lower-level 'stacking' estimator that runs a fuzzy RD on the sample of close elections with repeated cell outcomes. The central theoretical claim (Proposition 2) is that both estimators converge, as the bandwidth h goes to zero, to the same convexly weighted average of potential-outcome slopes, under continuity, monotonicity, and an exclusion restriction. The paper also provides Monte Carlo evidence on bias reduction, a survey of existing practice, and an application to the effect of unionization on within-state-industry wage inequality, reporting significant negative effects on the Gini coefficient, top-10% share, and variance of log wages, with a back-of-the-envelope calculation attributing roughly 35% of the 1970-2010 rise in within-cell inequality to the decline in new unionization.
Significance. If Proposition 2 is correct, the paper contributes a practical and credible approach to a class of designs (legislative composition, spillovers, temporal aggregation) that currently rely on ad hoc or less transparent methods. The connection to shift-share equivalence (Borusyak, Hull, and Jaravel 2022) is elegant and likely useful for inference and bandwidth choice. The empirical application is policy-relevant, and the paper is careful in data construction, balance checks, placebo tests, and robustness analysis. The Monte Carlo evidence is honestly presented, and the authors explicitly flag the lack of formal bias theory. The main weakness is that the causal interpretation of the application hinges on an exclusion restriction that is plausible but not directly tested, and the empirical tables omit first-stage diagnostics.
major comments (4)
- [§2.4 and §5.1] The causal interpretation of the union application rests on the exclusion restriction stated in §2.4: that a close election's outcome affects cell-level inequality only through the share of newly unionized workers. In this setting, narrowly lost elections may affect inequality through union threat effects, employer responses to organizing drives, or changes in worker composition, all of which would violate the restriction. The balance tests in §5.3 and Appendix Table A5 establish exogeneity of the instrument with respect to observables but cannot address exclusion. The paper should either provide additional evidence against threat effects (e.g., reduced-form effects of close losses on outcomes in cells where unionization did not occur) or explicitly discuss the plausibility of the restriction in light of the literature on union threat effects (e.g., Fortin et al. 2022). This is load-bearing for the empirical claim.
- [§5.4, Table 3] The main empirical table reports only the IV coefficients, not the first-stage coefficients, F-statistics, or reduced-form coefficients. Given that the instrument is a constructed employment-share weighted sum of close-election outcomes, the first stage is not mechanical, and the strength of the instrument is important for interpreting the IV estimates. The paper should report the first-stage coefficient on Z_sit and the associated F-statistic (or effective F-statistic) for each specification in Table 3, and ideally the reduced-form coefficients corresponding to the main outcomes. This omission weakens the empirical contribution as currently presented.
- [§2.5 and Appendix A] The proof of Proposition 2 in Appendix A is only sketched. It relies on two unproven steps: (i) that the population coefficients on r_j and r_j^+ in the lower-level specification have limits as h goes to zero, and (ii) that the coefficients on the RDA controls in the upper-level specification converge so that residualization on Q_i is asymptotically irrelevant. The latter step is asserted with 'assuming again that the population coefficients ... converge' rather than established. Since Proposition 2 is the central theoretical result, the proof should be made complete. Relatedly, the paper explicitly states in §2.5 that 'We leave theoretical results establishing this property to future drafts' for the bias-reduction claims; the abstract and introduction do not overstate this, but the Monte Carlo evidence alone does not establish that the estimators 'inherit' the bias properties of local-linear RD. The authors should either provide a formal bias statement or temper the corresponding language.
- [§5.4, Panel B; §5.4 inference discussion] The lower-level stacking estimator repeats the same cell outcome and treatment for multiple elections in the same state-industry-decade, creating mechanical within-cell correlation in the error term. The paper states that clustering does not substantially change the standard errors but does not report the clustered estimates. Given that the stacking estimator is one of the two main proposals, the manuscript should show cluster-robust (by cell) standard errors for Panel B, or at least provide a quantitative comparison to heteroskedasticity-robust errors. As it stands, the reader cannot verify whether the reported significance of the lower-level estimates is robust to this clustering concern.
minor comments (4)
- [§5.4, paragraph after Table 3] The numerical magnitudes reported in the text are inconsistent with the coefficients in Table 3. If NewUnions is measured as a share (0.01 = 1 percentage point), then a 1 pp increase changes the college premium by approximately 0.003 log points, the 90/10 ratio by 0.0046 log points, and the Gini by 0.0018, not 0.31, 0.46, and 0.018 as stated. The top-10 share and variance statements are consistent with the table. Please correct these magnitudes or clarify the units of the treatment variable.
- [§2.2, equation (6) and text after it] The sentence in §3.2 describing the recentering procedure says 'recenter the instrument Z_i by subtracting 0.5 times the total weight of narrow elections' — should say 'the total weight of narrow elections' rather than omitting the word 'the' before 'narrow'; also, for consistency with the rest of the paper, 'narrow' is used interchangeably with 'close' in a few places. A unified terminology would improve readability.
- [§2.5, Figure 1 notes] Panel (c) of Figure 1 shows that the bias of the proposed estimators has slope approaching zero for smaller h, but the vertical axis range differs across panels; it would help to report the numeric bias values in the text or table, as the confidence intervals are stated to be hard to see on some panels.
- [§4.2, paragraph on Cellini et al.] The conjecture at the end of the paragraph ('we cautiously conjecture that the upper-level solutions also continues to be valid') deserves more justification or a formal statement; as written, it is an untested claim in a methodological paper.
Circularity Check
No significant circularity: the central equivalence result is a parameter-free algebraic theorem from prior published work, and the empirical estimates are not fitted versions of their own outputs.
full rationale
The paper's central claim (Proposition 2) is that the upper-level IV estimand (6) and lower-level stacking estimand (9) converge to the same convex-weighted average beta_0 in (10) under Assumptions 1-5. The proof is self-contained except for Proposition 1, which is imported from Borusyak, Hull, and Jaravel (2022, Prop. 1) and used to demonstrate a numerical equivalence between the upper-level IV regression and a shock-level IV regression. This is a parameter-free algebraic equivalence with stated assumptions that do not include the target result; it is independent support even though one author co-authored the cited paper. The empirical application estimates inequality effects using close-election RD variation; the treatment, instrument, and RDA controls are constructed from the data, not fitted to the outcomes, and the bandwidth is chosen from prior practice and optimal-bandwidth calculations. The exclusion restriction for the union application is an untested identifying assumption, but an untested assumption is not circularity. No equation in the paper reduces to its own inputs by construction, and no fitted parameter is relabeled as a prediction.
Assumptions & free parameters
free parameters (3)
- Close-election bandwidth =
10 percentage points (50% plus or minus 10pp)
- Instrument sample restrictions =
Minimum 20 votes; exclude ties and one-vote margins
- Cell size threshold =
At least 1,000 workers after projection weights
assumptions (6)
- domain assumption Assumption 3(a): expected reweighted potential outcomes and treatments are continuous in the running variable at the cutoff
- domain assumption Assumption 2: subunit labels within a unit are exchangeable
- domain assumption Assumption 4: the density of the running variable is positive and continuous at zero
- domain assumption Assumption 5: monotonicity and positive first stage for the treatment
- domain assumption Exclusion restriction: close election outcomes affect inequality only through the new unionization rate
- standard math Borusyak, Hull, and Jaravel (2022) Proposition 1 on shift-share equivalence
Cite this review
Pith. "Pith review of Regression discontinuity aggregation, with an application to the union effects on inequality." pith.science (2026). https://pith.science/paper/HPSA42J5
@misc{pith2026250100428,
author = {Pith},
title = {Pith review of: Regression discontinuity aggregation, with an application to the union effects on inequality},
year = {2026},
howpublished = {\url{https://pith.science/paper/HPSA42J5}},
note = {Machine review of arXiv:2501.00428}
}
read the original abstract
We extend the regression discontinuity (RD) design to settings where each unit's treatment status is an average or aggregate across multiple discontinuity events. Such situations arise in many studies where the outcome is measured at a higher level of spatial or temporal aggregation (e.g., by state with district-level discontinuities) or when spillovers from discontinuity events are of interest. We propose two novel estimation procedures - one at the level at which the outcome is measured and the other in the sample of discontinuities - and show that both identify a local average causal effect under continuity assumptions similar to those of standard RD designs. We apply these ideas to study the effect of unionization on inequality in the United States. Using credible variation from close unionization elections at the establishment level, we show that a higher rate of newly unionized workers in a state-by-industry cell reduces wage inequality within the cell.
Figures
Reference graph
Works this paper leans on
-
[3]
Peer effects in program participation
Gordon B Dahl, Katrine V Løken, and Magne Mogstad. Peer effects in program participation. American Economic Review, 104(7):2049–2074,
-
[4]
By Assumption 5, the denominator is positive. Moreover, by standard arguments (e.g., Yitzhaki [1996]), it is a convexly-weighted average of ∂Yi(x)/∂x (or the discrete analog thereof when Xi is discrete) across both units and values of treatment. By Proposition 1, the upper-level solution only differs by residualizing Yi and Xi on Qi. By Assumption 3b, we ...
work page 1996
-
[5]
Sources: Decennial Census and NLRB unionization data; authors’ calculations
Please refer to those tables for the specifications and the data construction. Sources: Decennial Census and NLRB unionization data; authors’ calculations. 50 Table A9: Definitions of Decades Decade NLRB Decennial Census CPS MORG CPS ASEC and ACS (for union density) (for fringe benefits) (1) (2) (3) (4) 1960s 1961–69 1970 minus 1960 n/a n/a 1970s 1970–79 ...
work page 1961
-
[6]
doi: 10.1086/711852. Chao Fu and Jesse Gregory. Estimation of an equilibrium model with externalities: Post-disaster neighbor- hood rebuilding. Econometrica, 87(2):387–421,
-
[10]
Algorithm is experiment: Machine learning, market design, and policy eligibility rules
Yusuke Narita and Kohei Yata. Algorithm is experiment: Machine learning, market design, and policy eligibility rules. arXiv preprint arXiv:2104.12909 ,
-
[13]
Regression discontinuity designs under interfer- ence
Elena Dal Torrione, Tiziano Arduini, and Laura Forastiere. Regression discontinuity designs under interfer- ence. arXiv preprint arXiv:2410.02727 ,
-
[15]
state” samples. For 1970, we combined the 2% “state
Invoking Assumption 3b again and assuming again that the population coefficients on Qi in the first-stage and reduced-form of (6) converge, this implies that residualizing on Qi makes no difference in (8), provided an intercept is included in that subunit-level specification. This concludes the proof. B Data Appendix Our analysis is at the level of state-...
work page 1960
-
[16]
Executive, Administrative, and Managerial
to identify the county composition of each metropolitan area and county group, and obtained the 1970 county populations from IPUMS NHGIS. 39 For each worker, we observe their pre-tax annual labor income (variable INCWAGE). Top-coded income values are multiplied by 1.5 [Autor et al., 2008]. We then compute the hourly wage as the income dividing by the week...
work page 1970
Show all 29 references
-
[22]
49A small issue also arises from the fact that about one-third of the unionization elections that happened in 1999 are recorded with NAICS codes
but multiple 3-digit NAICS codes. 49A small issue also arises from the fact that about one-third of the unionization elections that happened in 1999 are recorded with NAICS codes. We exclude these elections from the RDA variables construction. 42 sification. In the other direc...
1999
-
[24]
and Farber et al. [2021]. We select the sample or workers with either exactly a high-school degree or at least a college degree (or more). We then estimate the following regression by OLS with projection weights: log W ageo = γs(o)i(o)t(o)College o + β′ s(o)t(o)Xo + erroro (21...
2021
-
[25]
Equations
NBER Working Paper 4 3 Notes: This table lists published papers featuring research designs suitable for RDA. We have organized these papers into the five categories as in Sections 3.1–3.3 and 4.1–4.2, although some papers may belong to more than one category. The “Equations” c...
1961
-
[26]
Census projection weights are used
and NAICS-based (used from 2000 onwards). Census projection weights are used. Sources: Decennial Census; authors’ calculations. 45 Table A4: Instrument Balance, 15% Bandwidth NewUnions Z (1) (2) (3) (4) Log avg hourly wage t−1 1.056 0.188 -0.155 -0.013 (0.517) (0.127) (0.070) ...
2000
-
[28]
[2016], using CPS ASEC samples
51 Appendix Figures Figure A1: Within-Between Variance Decomposition of Log Wages, CPS Data 0.1 0.2 0.3 0.4 1980 1990 2000 2010 Y ear Variance of Log Wages Industry Type SIC NAICS Variance Type Total Within Between Notes: The plot presents a variance decomposition of log wages...
1980
-
[1979]
usual hours worked per week [in the last year]
The workers are asked if they are covered by an employer-sponsored pension plan (PENSION variable) and whether they enrolled in their employer’s group health plan during the previous year (INCLUGH variable). We use the same four individual-level sample restrictions as in the d...
1986
-
[1980]
Industry classification. To construct both labor market outcomes and new unionization rates by state- industry cells, we had to create an industry classification harmonized both across data sources and over time. The classifications in all our data sources are based, in one wa...
2000
-
[1986]
not specified
In those years, we only keep the elections in industries for which over 95% of national employment mapped to one of our (significantly more aggregated) codes. 47 Elections prior to 1972 use even earlier SIC schemes. We drop all elections that did not align with a single code i...
1972
-
[1997]
Gareth Nellis and Niloufer Siddiqui
Originally issued in 1962, revised edition. Gareth Nellis and Niloufer Siddiqui. Secular party rule and religious violence in pakistan. American Political Science Review, 112(1):49–67,
1962
-
[2000]
Not specified industries
The 2000 census, however, includes the IND1990 variable converted from INDNAICS using a crosswalk designed by IPUMS. We therefore compute the 1990 to 2000 change using our SIC-based classification. While the conversion could introduce noise in differenced outcomes, we find it ...
2000
-
[2003]
Sources: CPS ASEC samples; authors’ calculations. 52 Figure A2: The Counterfactual with Unionization Remaining at the 1960s Level: Other Inequality Outcomes 0.4 0.5 0.6 1970 1980 1990 2000 2010 Y ear Log(College Premium) 1.1 1.2 1.3 1.4 1970 1980 1990 2000 2010 Y ear Log(90/10...
1970
-
[2008]
Long-run impacts of unions on firms: New evidence from financial markets, 1961–1999
David S Lee and Alexandre Mas. Long-run impacts of unions on firms: New evidence from financial markets, 1961–1999. The Quarterly Journal of Economics , 127(1):333–378,
1961
-
[2009]
We observe the number of eligible voters in the bargaining unit, the number of votes cast for and against the union, as well as whether the union has been formed
We discuss industry classifications below. We observe the number of eligible voters in the bargaining unit, the number of votes cast for and against the union, as well as whether the union has been formed. In most cases, the union is formed when the vote share (out of the tota...
2004
-
[2010]
1987 Economic Censuses: Report series
US Census. 1987 Economic Censuses: Report series. Release 1E. Technical documentation. CD-ROM volume 1E. Number pt. 1 in 1987 Economic Censuses: Report Series. Release 1E. Technical Documentation. CD- ROM Volume 1E. U.S. Department of Commerce, Economics and Statistics Adminis...
1987
-
[2012]
1970 county group definitions: Composition file,
IPUMS USA. 1970 county group definitions: Composition file,
1970
-
[2016]
President obama’s open letter to america’s hardworking men and women
Barack Obama. President obama’s open letter to america’s hardworking men and women. https://obamawhitehouse.archives.gov/blog/2016/09/04/ president-obama-letter-americas-hardworking-men-and-women , September
2016
-
[2018]
Economic impacts of new unionization on private sector employers: 1984–
John DiNardo and David S Lee. Economic impacts of new unionization on private sector employers: 1984–
1984
-
[2021]
Regression discontinuity design with spillovers
Eric Auerbach, Yong Cai, and Ahnaf Rafi. Regression discontinuity design with spillovers. arXiv preprint arXiv:2404.06471,
-
[2022]
41 and the NAICS-based classification for the 2000s
provides empirical evidence that tied elections are very different from elections where the union lost or won by a slightly larger margin. 41 and the NAICS-based classification for the 2000s. For union elections filed before the end of 1998 (which covers most elections that to...
1998
-
[2023]
The persistent effects of peru’s mining mita
Melissa Dell. The persistent effects of peru’s mining mita. Econometrica, 78(6):1863–1903,
1903
-
[2024]
Regulation by shaming: Deterrence effects of publicizing violations of workplace safety and health laws
Matthew S Johnson. Regulation by shaming: Deterrence effects of publicizing violations of workplace safety and health laws. American economic review, 110(6):1866–1904,
1904
Reviewed August 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.