REVIEW 3 major objections 5 minor 1 cited by
Pulse Profile Variability of PSR J1022+1001 in NANOGrav Data
T0 review · 3 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read PSR J1022+1001's pulse shape changes are real, intrinsic pulsar behavior, not calibration artifacts or interstellar effects.
desk verdict Solid observational case that J1022+1001's profile variability is real and calibration-independent, but the scintillation argument needs quantitative support before the abstract's claim holds. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the polarimetric response (PR) of the telescope feed, the Mueller-matrix transformation that mixes the Stokes parameters $I$, $Q$, $U$, and $V$ on the way from source to recorded signal. The paper compares the standard ideal feed assumption (IFA) calibration against a two-stage scheme using Measurement Equation Modeling (MEM) and Measurement Equation Template Matching (METM), and then uses 25-MHz subbanded profiles to test whether shape deviations are uniform across the band. That subband comparison is what separates a scintillation origin from an intrinsic origin.
What would settle it
Compute, for every 1.4-GHz epoch in the data set, the correlation of the difference profiles across 25-MHz subbands; if the shape deviations are not coherent across the full band, or the coherence pattern follows the expected scintillation structure, the paper's central claim fails.
Extended reading notes
Core claim
The paper asserts that in the NANOGrav 15-yr data set the integrated pulse profile of PSR J1022+1001 changes shape from observation to observation at 430 MHz, 1.4 GHz, and 2 GHz, and that this variability is not a calibration artifact. Profiles calibrated with a full model of the feed's polarimetric response are no more stable than profiles calibrated under the ideal feed assumption, and the deviations appear consistently across 25-MHz subbands, which the authors argue interstellar scintillation combined with frequency-dependent profile evolution cannot produce. The authors therefore conclude that the variability is intrinsic to the pulsar's emission.
Load-bearing premise
The conclusion rests on visual inspection of a single example observation's 25-MHz subband profiles, so if that apparent across-band consistency is not real or not representative, the ruling-out of the scintillation explanation falls apart.
Editorial extensions
If this is right
- Pulsar timing arrays that use a fixed template to measure arrival times for PSR J1022+1001 will carry this variability as extra noise in the residuals.
- Polarization calibration improvements of the kind tested here will not remove the effect, since the more complete calibration leaves the variability unchanged.
- The scintillation-plus-frequency-evolution explanation for this pulsar's changing profile is disfavored, so searches for the mechanism should focus on the pulsar itself.
- A TOA-generation method that lets the pulse shape vary could recover some of the timing precision lost to the variability.
Reading between the lines
- If the intrinsic-variability claim survives a quantitative subband test, similar calibration comparisons on other highly polarized millisecond pulsars could reveal that unstable profiles are more common in pulsar timing array data than currently assumed.
- A direct extension of the paper's Figure 15 argument would be to compute a cross-band correlation statistic for all epochs, turning a visual ruling-out into a quantitative one.
- The few observations that show shape changes within a single observation, over roughly 10-15 minutes, suggest that whatever the mechanism is, it operates on timescales much shorter than the month-to-year variations, which would help narrow the candidates.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper analyzes 84 Arecibo observations of PSR J1022+1001 from the NANOGrav 15-yr data set and shows substantial epoch-to-epoch pulse profile variability at 430 MHz, 1.4 GHz, and 2 GHz. It tests whether this variability can be explained by the ideal feed assumption (IFA) used in NANOGrav's standard polarization calibration by re-calibrating the data with a combination of Measurement Equation Modeling and Measurement Equation Template Matching. The recalibrated profiles are found to be no less variable than the IFA-calibrated ones, and the METM-based timing solution is not improved. The paper then argues that the variability cannot be explained by interstellar scintillation combined with frequency-dependent profile evolution, concluding that intrinsic pulsar phenomena are the likely cause.
Significance. If the conclusions hold, this is a valuable result for pulsar timing array data quality, since pulse profile stability is a central assumption of standard timing methods, and it substantially extends the long-standing debate about the cause of PSR J1022+1001's profile variability. The manuscript's strengths include the use of independent template pulsars for the METM corrections, multiple variability metrics based on difference profiles and peak fitting, a Kolmogorov-Smirnov comparison between calibration schemes, and a full timing comparison between the IFA and METM data sets. The main vulnerability is the scintillation ruling-out, which currently rests on visual inspection of a single example observation and rough estimates of scintillation parameters; this needs quantitative support before the abstract's 'cannot be explained' claim is warranted.
major comments (3)
- [§4.2, Figure 15] The abstract's central claim that the subbanded profiles 'cannot be explained by interstellar scintillation in combination with profile evolution with frequency' rests on the statement in §4.2 that 'these subbanded profiles exhibited the same variability across the band within each observation,' but this is supported only by visual inspection of one example observation. Please provide a quantitative across-subband consistency metric (for example, a correlation or reduced chi-square between difference profiles in adjacent 25-MHz subbands, with uncertainties propagated from the data), report how many of the 84 observations show the same pattern, and demonstrate that the metric has power to detect the expected scintillation-induced decorrelation given the quoted 40-100 MHz scintillation bandwidths. Without this, the exclusion of scintillation is not established.
- [§4.2, final paragraph] The manuscript itself states that the scintillation bandwidths and timescales are 'rough estimates based on visual inspection' and that the short-timescale intra-observation variability 'in particular' has 'not been ruled out' as scintillation. These caveats are in direct tension with the unqualified 'cannot be explained' phrasing in the abstract and in §5. Either add a quantitative scintillation model that folds in the 25-MHz subband response, the measured scintillation timescales, and the observed frequency-dependent profile evolution, or soften the conclusion to 'unlikely' or 'not favored' so that the conclusion is consistent with the evidence presented.
- [§4.2, Figures 7-9] The difference-profile method is an appropriate way to visualize variability, but the binned standard deviations are presented without an estimate of the noise contribution to the difference profiles. Without propagating the off-pulse noise through the normalization and subtraction steps, the reader cannot tell which phase bins or epochs show variability in excess of measurement noise. Please add a noise estimate or significance threshold so that the variability measurement itself can be assessed quantitatively.
minor comments (5)
- [§2] There are two typographical errors in this section: 'reciever' should be 'receiver' and 'concontiguous bands' should be 'contiguous bands'.
- [§3.2] The FD parameter inclusion criterion is described only qualitatively ('if doing so did not cause a large change ... in the DMX average'); please specify the numerical threshold used and report how many FD parameters were included in each of the IFA and METM timing solutions.
- [§4.2, Figure 10] Please clarify whether the parabola fitting procedure used the same fitting window in phase bins for all three receivers, and report the number of bins used, since this affects the quoted peak-ratio uncertainties.
- [Table 3] The proper motion in ecliptic latitude is reported as -2(1) x 10^2 mas/yr, which appears implausibly large compared with the proper motion in longitude of -15.9(1) mas/yr; please check the units or the entry for a typographical error.
- [Figures 11-13] The error bars are described as the 1-sigma uncertainties from the least-squares parabola fit, but they do not include uncertainties from profile normalization; please state this limitation explicitly in the captions or text.
Circularity Check
No significant circularity: the calibration comparison and scintillation test are empirically self-contained; the paper's main weakness is under-quantified evidence, not circular reasoning.
full rationale
The paper's central claim—that PSR J1022+1001's profile variability persists after robust polarization calibration and is not explained by scintillation plus frequency-dependent profile evolution—does not reduce to its own inputs. The MEM/METM calibration is anchored to independent calibrators (B0525+21 for MEM; J0030+0451 and B1937+21 as METM template pulsars), so the IFA-versus-METM comparison is an empirical test rather than a tautology. The variability metrics (binned standard deviations of difference profiles, peak-ratio distributions, KS tests, timing RMS values) are computed directly from calibrated data and are not fitted parameters renamed as predictions. The scintillation test in Section 4.2 compares per-subband difference profiles against each subband's median profile, which is a legitimate way to remove profile frequency evolution; concluding that the subband deviations are consistent across the band is an observational judgment, not a definitional equivalence. The supporting evidence is admittedly qualitative—one example in Figure 15, with scintillation bandwidths and timescales described as 'rough estimates based on visual inspection'—and the paper itself flags that short-timescale variability 'has not been ruled out' as scintillation and that more accurate polarization calibration could be explored. These are evidentiary limitations and correctness risks, not circularity. The only self-citation element, following the calibration approach of Gentile et al. (2018) and Wahl et al. (2022) (co-authors), is methodological precedent with independent published content and is not load-bearing for the paper's conclusion. No circular step can be quoted or exhibited.
Assumptions & free parameters
free parameters (3)
- S/N threshold for profile removal =
not reported (chosen per receiver)
- Subband width for scintillation test =
25 MHz
- FD parameter inclusion criterion =
DMX change < ~0.1 pc cm^-3
assumptions (4)
- domain assumption Template pulsars B1937+21 (1.4 and 2 GHz) and J0030+0451 (430 MHz) have intrinsically stable integrated pulse profiles over the observing span.
- domain assumption The MEM polarimetric response solution for each receiver, obtained from a few B0525+21 observations, is valid over the full 2012-2023 span of the data.
- domain assumption The invariant interval I^2 - Q^2 - U^2 - V^2 normalization removes scintillation covariance with absolute gain G.
- domain assumption The rough scintillation bandwidth (40-100 MHz) and timescale (~20 min) estimates for the 1.4-GHz data are representative.
Cite this review
Pith. "Pith review of Pulse Profile Variability of PSR J1022+1001 in NANOGrav Data." pith.science (2026). https://pith.science/paper/UZOC62GK
@misc{pith2026241205452,
author = {Pith},
title = {Pith review of: Pulse Profile Variability of PSR J1022+1001 in NANOGrav Data},
year = {2026},
howpublished = {\url{https://pith.science/paper/UZOC62GK}},
note = {Machine review of arXiv:2412.05452}
}
abstract
Pulse profile stability is a central assumption of standard pulsar timing methods. Thus, it is important for pulsar timing array experiments such as the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) to account for any pulse profile variability present in their data sets. We show that in the NANOGrav 15-yr data set, the integrated pulse profile of PSR J1022+1001 as seen by the Arecibo radio telescope at 430, 1380, and 2030 MHz varies considerably in its shape from observation to observation. We investigate the possibility that this is due to the "ideal feed assumption" (IFA), on which NANOGrav's routine polarization calibration procedure relies. PSR J1022+1001 is $\sim 90\%$ polarized in one pulse profile component, and also has significant levels of circular polarization. Time-dependent deviations in the feed's polarimetric response (PR) could cause mixing between the intensity I and the other Stokes parameters, leading to the observed variability. We calibrate the PR using a mixture of Measurement Equation Modeling and Measurement Equation Template Matching techniques. The resulting profiles are no less variable than those calibrated using the IFA method, nor do they provide an improvement in the timing quality of this pulsar. We observe the pulse shape in 25-MHz bandwidths to vary consistently across the band, which cannot be explained by interstellar scintillation in combination with profile evolution with frequency. Instead, we favor phenomena intrinsic to the pulsar as the cause.
Figures
Figures from the paper (10 more)
Forward citations
Cited by 1 Pith paper
-
FAST Observations of the Microstructure in Interpulse Pulsars
Quasi-periodic submillisecond microstructure was detected in the interpulses of PSRs J0627+0706 and J0953+0755, with properties matching or differing from the main pulse depending on the pulsar.
Reference graph
Works this paper leans on
-
[1]
Agazie, G., Anumarlapudi, A., Archibald, A. M., et al. 2023a, ApJL, 951, L8, doi: 10.3847/2041-8213/acdac6
-
[2]
Agazie, G., Alam, M. F., Anumarlapudi, A., et al. 2023b, ApJL, 951, L9, doi: 10.3847/2041-8213/acda9a
-
[3]
Agazie, G., Anumarlapudi, A., Archibald, A. M., et al. 2023c, ApJL, 951, L10, doi: 10.3847/2041-8213/acda88
-
[4]
Alam, M. F., Arzoumanian, Z., Baker, P. T., et al. 2021, ApJS, 252, 4, doi: 10.3847/1538-4365/abc6a0
-
[5]
2023a, arXiv e-prints, arXiv:2306.16214, doi: 10.48550/arXiv.2306.16214
Antoniadis, J., Arumugam, P., Arumugam, S., et al. 2023a, arXiv e-prints, arXiv:2306.16214, doi: 10.48550/arXiv.2306.16214
-
[6]
Antoniadis, J., Babak, S., Bak Nielsen, A. S., et al. 2023b, arXiv e-prints, arXiv:2306.16224, doi: 10.48550/arXiv.2306.16224 Astropy Collaboration, Price-Whelan, A. M., Lim, P. L., et al. 2022, ApJ, 935, 167, doi: 10.3847/1538-4357/ac7c74
-
[7]
Backer, D. C. 1970, Nature, 228, 1297, doi: 10.1038/2281297a0
-
[8]
Britton, M. C. 2000, ApJ, 532, 1240, doi: 10.1086/308595
Show all 48 references
-
[9]
D., Bailes, M., Champion, D
Cameron, A. D., Bailes, M., Champion, D. J., et al. 2023, MNRAS, 523, 5064, doi: 10.1093/mnras/stad1712
2023 doi
-
[10]
J., Shrauner, J
Camilo, F., Nice, D. J., Shrauner, J. A., & Taylor, J. H. 1996, ApJ, 469, 819, doi: 10.1086/177829
1996 doi
-
[11]
1985, Annales de L’Institut Henri Poincare Section (A) Physique Theorique, 43, 107
Damour, T., & Deruelle, N. 1985, Annales de L’Institut Henri Poincare Section (A) Physique Theorique, 43, 107
1985
-
[12]
A., Wahl, H
Dey, L., McLaughlin, M. A., Wahl, H. M., et al. 2024, arXiv e-prints, arXiv:2406.13463. https://arxiv.org/abs/2406.13463
2024 arXiv
-
[13]
A., Vallisneri, M., Taylor, S
Ellis, J. A., Vallisneri, M., Taylor, S. R., & Baker, P. T. 2020, ENTERPRISE: Enhanced Numerical Toolbox Enabling a Robust PulsaR Inference SuitE, Zenodo, doi: 10.5281/zenodo.4059815
2020 doi
-
[14]
E., & Weisberg, J
Everett, J. E., & Weisberg, J. M. 2001, ApJ, 553, 341, doi: 10.1086/320652
2001 doi
-
[15]
2021, ApJ, 908, 105, doi: 10.3847/1538-4357/abd326
Feng, Y., Hobbs, G., Li, D., et al. 2021, ApJ, 908, 105, doi: 10.3847/1538-4357/abd326
2021 doi
- [16]
-
[17]
A., McLaughlin, M
Gentile, P. A., McLaughlin, M. A., Demorest, P. B., et al. 2018, ApJ, 862, 47, doi: 10.3847/1538-4357/aac9c9
2018 doi
-
[18]
Hamaker, J. P. 2000, A&AS, 143, 515, doi: 10.1051/aas:2000337
2000 doi
-
[19]
R., Millman, K
Harris, C. R., Millman, K. J., van der Walt, S. J., et al. 2020, Nature, 585, 357, doi: 10.1038/s41586-020-2649-2
2020 doi
-
[20]
2001, PASP, 113, 1274, doi: 10.1086/323289
Heiles, C., Perillat, P., Nolan, M., et al. 2001, PASP, 113, 1274, doi: 10.1086/323289
2001 doi
-
[21]
W., Bailes, M., & Ord, S
Hotan, A. W., Bailes, M., & Ord, S. M. 2004, MNRAS, 355, 941, doi: 10.1111/j.1365-2966.2004.08376.x
2004
-
[22]
Hunter, J. D. 2007, Computing in Science & Engineering, 9, 90, doi: 10.1109/MCSE.2007.55
2007 doi
-
[23]
J., Cordes, J
Jennings, R. J., Cordes, J. M., Chatterjee, S., et al. 2024, ApJ, 964, 179, doi: 10.3847/1538-4357/ad2930
2024 doi
-
[24]
L., McLaughlin, M
Jones, M. L., McLaughlin, M. A., Lam, M. T., et al. 2017, ApJ, 841, 125, doi: 10.3847/1538-4357/aa73df
2017 doi
-
[25]
M., Camilo, F., et al
Kramer, M., Xilouris, K. M., Camilo, F., et al. 1999, ApJ, 520, 324, doi: 10.1086/307449
1999 doi
-
[26]
T., McLaughlin, M
Lam, M. T., McLaughlin, M. A., Arzoumanian, Z., et al. 2019, ApJ, 872, 193, doi: 10.3847/1538-4357/ab01cd
2019 doi
-
[27]
J., et al
Liu, K., Karuppusamy, R., Lee, K. J., et al. 2015, MNRAS, 449, 1158, doi: 10.1093/mnras/stv397
2015 doi
-
[28]
R., & Kramer, M
Lorimer, D. R., & Kramer, M. 2004, Handbook of Pulsar Astronomy (UK: Cambridge University Press)
2004
-
[29]
2021, ApJ, 911, 45, doi: 10.3847/1538-4357/abe62f NANOGrav Collaboration, Arzoumanian, Z., Brazier, A., et al
Luo, J., Ransom, S., Demorest, P., et al. 2021, ApJ, 911, 45, doi: 10.3847/1538-4357/abe62f NANOGrav Collaboration, Arzoumanian, Z., Brazier, A., et al. 2015, ApJ, 813, 65, doi: 10.1088/0004-637X/813/1/65
2021 doi
-
[30]
V., Barr, E
Padmanabh, P. V., Barr, E. D., Champion, D. J., et al. 2021, MNRAS, 500, 1178, doi: 10.1093/mnras/staa3174
2021 doi
- [31]
-
[32]
Radhakrishnan, V., & Cooke, D. J. 1969, Astrophys. Lett., 3, 225
1969
-
[33]
2003, A&A, 407, 1085, doi: 10.1051/0004-6361:20031036
Ramachandran, R., & Kramer, M. 2003, A&A, 407, 1085, doi: 10.1051/0004-6361:20031036
2003 doi
- [34]
-
[35]
M., Demorest, P., Ford, J., et al
Ransom, S. M., Demorest, P., Ford, J., et al. 2009, in American Astronomical Society Meeting Abstracts, Vol. 214, American Astronomical Society Meeting Abstracts #214, 605.08
2009
-
[36]
J., Zic, A., Shannon, R
Reardon, D. J., Zic, A., Shannon, R. M., et al. 2023, ApJL, 951, L6, doi: 10.3847/2041-8213/acdd02
2023 doi
-
[37]
M., & Cordes, J
Shannon, R. M., & Cordes, J. M. 2012, ApJ, 761, 64, doi: 10.1088/0004-637X/761/1/64
2012 doi
-
[38]
Shao, M., & You, X. P. 2016, Acta Astronomica Sinica, 57, 517
2016
-
[39]
Sotomayor-Beltran, C., Sobey, C., Hessels, J. W. T., et al. 2013, A&A, 552, A58, doi: 10.1051/0004-6361/201220728
2013 doi
-
[40]
H., Thorsett, S
Stairs, I. H., Thorsett, S. E., & Camilo, F. 1999, ApJS, 123, 627, doi: 10.1086/313245
1999 doi
-
[41]
H., Lyne, A
Stairs, I. H., Lyne, A. G., Kramer, M., et al. 2019, MNRAS, 485, 3230, doi: 10.1093/mnras/stz647
2019 doi
- [42]
-
[43]
Taylor, J. H. 1992, Philosophical Transactions of the Royal Society of London Series A, 341, 117, doi: 10.1098/rsta.1992.0088 Van Rooy, P., Whitlow, D., & Seymour, A. 2017, in American Astronomical Society Meeting Abstracts, Vol. 229, American Astronomical Society Meeting Abst...
1992
-
[44]
E., et al
Virtanen, P., Gommers, R., Oliphant, T. E., et al. 2020, Nature Methods, 17, 261, doi: 10.1038/s41592-019-0686-2
2020 doi
-
[45]
M., McLaughlin, M
Wahl, H. M., McLaughlin, M. A., Gentile, P. A., et al. 2022, ApJ, 926, 168, doi: 10.3847/1538-4357/ac4045
2022 doi
-
[46]
N., & Johnston, S
Wang, N., Manchester, R. N., & Johnston, S. 2007, MNRAS, 377, 1383, doi: 10.1111/j.1365-2966.2007.11703.x
2007
-
[47]
2023, Research in Astronomy and Astrophysics, 23, 075024, doi: 10.1088/1674-4527/acdfa5
Xu, H., Chen, S., Guo, Y., et al. 2023, Research in Astronomy and Astrophysics, 23, 075024, doi: 10.1088/1674-4527/acdfa5
2023 doi
- [48]
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.