arxiv: 2604.22340 · v2 · submitted 2026-04-24 · 🌌 astro-ph.IM · physics.ed-ph

Recognition: unknown

The Leiden/ESA Astrophysics Program for Summer Students (LEAPS)

S. Bellotti , A. D. Sellek , P. Sharda , K. M. Dutkowska , A. Chrimes , H. R\"ottgering

Authors on Pith no claims yet

Pith reviewed 2026-05-08 09:55 UTC · model grok-4.3

classification 🌌 astro-ph.IM physics.ed-ph

keywords summer research programastrophysics educationundergraduate researchPhD progressioninternational mobilitydiversity in STEMresearch mentorship

0 comments

The pith

The LEAPS summer program has prepared more than half its participants for PhD studies in astrophysics.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The paper presents the Leiden/ESA Astrophysics Program for Summer Students, a 10-week fully funded research experience for undergraduates and master's students. It reports outcomes for 194 participants from over 40 countries since 2013, including that more than half of 165 tracked students have entered PhD programs and that the group has produced at least 25 peer-reviewed papers. The authors conclude that the combination of hands-on projects, mentorship, and international exposure prepares students for research careers while addressing financial and diversity barriers in astrophysics.

Core claim

The LEAPS program offers a 10-week, fully funded research program at Leiden Observatory and ESA's ESTEC centre for undergraduate and master's students. Data collected for 165 of the 194 participants from over 40 countries reveal that over 50% have progressed to Ph.D. studies, with some securing competitive fellowships. Participants have contributed to at least 25 peer-reviewed publications and 13 international conference presentations. The program claims to successfully prepare students for research careers through hands-on experience, mentorship, and scientific exposure while promoting inclusive academic mobility.

What carries the argument

The fully funded 10-week research internship providing hands-on experience, mentorship, and scientific exposure at Leiden Observatory and ESA ESTEC.

If this is right

Over 50% of tracked participants progress to PhD studies.
Participants contribute to at least 25 peer-reviewed publications.
The program hosts students from over 40 countries, supporting diversity.
It addresses financial barriers to enable international academic mobility.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

Similar programs in other disciplines could increase diversity in research training.
Long-term follow-up on participants' careers beyond PhD entry would reveal broader impacts.
Implementing control groups in future assessments could better establish the program's causal effects on career outcomes.
Expanding recruitment from additional countries could further globalize participation.

Load-bearing premise

The high PhD progression rate is a result of the program's design and opportunities rather than self-selection by already successful students.

What would settle it

A study comparing PhD progression rates between LEAPS participants and a matched sample of non-participants with similar academic backgrounds and motivations.

Figures

Figures reproduced from arXiv: 2604.22340 by A. Chrimes, A. D. Sellek, H. R\"ottgering, K. M. Dutkowska, P. Sharda, S. Bellotti.

**Figure 1.** Figure 1: Country of affiliation at the moment of application for students that participated in LEAPS between 2013 and 2023. The countries are colour-coded based on the number of students affiliated with that specific country. a talk or presented a poster. We retrieved the data on the country of affiliation from the archives of the program. For the career path and the scientific output, we contacted the students tha… view at source ↗

**Figure 2.** Figure 2: Number of students each year who have subsequently undertaken a Ph.D. program normalised by the total number of participants for that year. The red bars for 2022 and 2023 indicate the students who, after LEAPS, were enrolled in a masters program at the time of our survey. one De Sitter fellowship. For the scientific output of LEAPS, we found that at least 25 research papers have been published in peer-revi… view at source ↗

read the original abstract

International student mobility plays a critical role in shaping future research careers, particularly in highly globalized fields such as astrophysics. The Leiden/ESA Astrophysics Program for Summer Students (LEAPS) offers a 10-week, fully funded research program at Leiden Observatory and the European Space Agency's ESTEC centre for undergraduate and master's students. Designed to foster early research involvement, LEAPS supports students from diverse academic and cultural backgrounds. Since its inception in 2013, LEAPS has hosted 194 students from over 40 countries. Data collected for 165 participants reveal that over 50% have progressed to Ph.D. studies, with some members of earlier cohorts already securing competitive international fellowships in astronomy. LEAPS participants have collectively contributed to at least 25 peer-reviewed publications and 13 international conference presentations. LEAPS has contributed successfully in preparing undergraduates for research careers in astrophysics through hands-on experience, mentorship, and scientific exposure. By addressing barriers related to financial means and promoting diversity, the program not only enhances individual career trajectories but also contributes to the broader goal of inclusive academic mobility. Continued efforts are needed to further increase global representation and assess long-term impacts on participants' scientific careers.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

This is a descriptive report on an existing summer program with participation counts and outcomes, but the success claims lack any control group or baseline to separate program effects from self-selection.

read the letter

The main takeaway is that this paper summarizes outcomes from the LEAPS summer student program rather than introducing new methods, data, or theory. Since 2013 it has hosted 194 students from over 40 countries in 10-week funded placements at Leiden and ESTEC. They tracked 165 participants and report that more than half progressed to PhDs, with the group producing at least 25 papers and 13 conference talks. The program structure itself is laid out clearly, including the focus on removing financial barriers and supporting students from varied backgrounds.

Referee Report

3 major / 1 minor

Summary. The manuscript describes the Leiden/ESA Astrophysics Program for Summer Students (LEAPS), a 10-week fully funded research internship hosted at Leiden Observatory and ESA ESTEC since 2013. It reports participation by 194 students from over 40 countries, with tracking data for 165 participants indicating that over 50% have progressed to PhD studies, along with collective contributions of at least 25 peer-reviewed publications and 13 conference presentations. The paper claims that LEAPS successfully prepares undergraduates for astrophysics research careers through hands-on experience and mentorship, addresses financial barriers, promotes diversity, and advances inclusive academic mobility.

Significance. If the reported participant outcomes can be shown to reflect program impact rather than selection effects, the work provides a useful case study of how funded international summer programs can support early research involvement and diversity in astrophysics. It offers practical details on program structure that could inform similar initiatives at other institutions.

major comments (3)

[Abstract and participant outcomes section] Abstract and participant outcomes section: The claim that LEAPS 'has contributed successfully in preparing undergraduates for research careers' and 'enhances individual career trajectories' rests on the >50% PhD progression rate among 165 tracked participants. No control cohort, matched non-participants, or baseline PhD rates for comparable undergraduates (e.g., those applying to but not selected for the program) are provided, so the data cannot separate program effects from self-selection of already motivated and high-achieving students.
[Data collection and tracking description] Data collection and tracking description: The manuscript supplies no information on how the 165 tracked participants were identified or followed up, including survey methods, response rates, alumni contact procedures, or handling of non-response. This omission leaves open the possibility of substantial reporting bias, where successful alumni are more likely to reply, rendering the >50% figure and associated claims weakly supported.
[Discussion of limitations and causality] Discussion of limitations and causality: There is no quantitative assessment of statistical uncertainty on the reported percentages, no comparison to general astrophysics PhD progression rates, and no explicit treatment of confounding factors such as the competitive admission process. These elements are load-bearing for the central success and diversity claims.

minor comments (1)

[Abstract] The abstract and main text would benefit from consistent use of exact counts alongside percentages and from explicit statements that the reported outcomes are observational.

Simulated Author's Rebuttal

3 responses · 1 unresolved

We thank the referee for their constructive comments, which have helped us identify areas where the manuscript can be improved in terms of transparency and balanced interpretation of results. We address each major comment below and outline the revisions we will make to the manuscript.

read point-by-point responses

Referee: The claim that LEAPS 'has contributed successfully in preparing undergraduates for research careers' and 'enhances individual career trajectories' rests on the >50% PhD progression rate among 165 tracked participants. No control cohort, matched non-participants, or baseline PhD rates for comparable undergraduates (e.g., those applying to but not selected for the program) are provided, so the data cannot separate program effects from self-selection of already motivated and high-achieving students.

Authors: We agree that our data are observational and do not permit causal claims about the program's impact independent of selection effects. The >50% PhD progression rate is presented as an outcome for the tracked cohort, not as evidence of program efficacy beyond self-selection. In the revised manuscript, we will modify the abstract and outcomes section to use more cautious language, such as 'participants have shown high rates of progression to PhD studies' rather than implying direct contribution to career preparation. We will also add a paragraph in the discussion explicitly noting the competitive selection process and the lack of a control group. However, we do not have data on non-selected applicants or a matched cohort, so a quantitative comparison is not possible. revision: partial
Referee: The manuscript supplies no information on how the 165 tracked participants were identified or followed up, including survey methods, response rates, alumni contact procedures, or handling of non-response. This omission leaves open the possibility of substantial reporting bias, where successful alumni are more likely to reply, rendering the >50% figure and associated claims weakly supported.

Authors: We will add a new subsection under 'Participant Outcomes' detailing the data collection process. Alumni were contacted primarily through email addresses collected at the time of the internship, supplemented by professional networking platforms such as LinkedIn for those whose emails were outdated. Follow-ups were conducted over a period of several months in 2023-2024. We will report the response rate (noting that 165 out of 194 provided updates) and describe efforts to reach non-respondents. While this does not eliminate all potential bias, it provides transparency on the methods used. This information was omitted in the original submission for brevity but will be included in the revision. revision: yes
Referee: There is no quantitative assessment of statistical uncertainty on the reported percentages, no comparison to general astrophysics PhD progression rates, and no explicit treatment of confounding factors such as the competitive admission process. These elements are load-bearing for the central success and diversity claims.

Authors: We will incorporate quantitative uncertainty by adding binomial proportion confidence intervals to the reported percentages (e.g., for the PhD progression rate). We will also include a brief comparison to available statistics on PhD progression rates among astrophysics undergraduates, drawing from sources such as the American Astronomical Society surveys or similar reports, noting that direct comparisons are approximate due to differences in populations. A new 'Limitations' section will be added to explicitly discuss confounding factors, including the competitive admission process, self-selection of motivated students, and potential response bias. This will temper the claims and provide a more balanced view. revision: yes

standing simulated objections not resolved

We cannot retroactively collect data on a control cohort of non-selected students or matched non-participants, as the program did not track such information.

Circularity Check

0 steps flagged

No circularity: purely descriptive observational report with no derivations or self-referential modeling

full rationale

The paper is a program summary reporting raw counts (194 students hosted, 165 tracked, >50% PhD progression, 25 publications, 13 presentations) and qualitative statements of success. No equations, fitted parameters, predictions, ansatzes, or uniqueness theorems appear anywhere. The central claim that LEAPS 'has contributed successfully' rests on observed outcomes rather than any derivation that reduces to its own inputs by construction. Self-citation is absent from the provided text and abstract. This is a standard non-circular descriptive evaluation; any concerns about causality or selection bias fall under scientific validity, not circularity.

Axiom & Free-Parameter Ledger

0 free parameters · 1 axioms · 0 invented entities

The central claims rest entirely on observational counts from program participants; no mathematical models, physical axioms, or new theoretical entities are introduced.

axioms (1)

domain assumption Participant career-progression data accurately reflect program impact without substantial selection or reporting bias.
The success narrative depends on the 165-participant sample being representative and the observed PhD rate being attributable to the program.

pith-pipeline@v0.9.0 · 5535 in / 1362 out tokens · 49135 ms · 2026-05-08T09:55:00.407705+00:00 · methodology

discussion (0)

Reference graph

Works this paper leans on

17 extracted references

[1]

Brooks, R., Courtois, A., Faas, D., Jayadeva, S., and Beech, S. (2024). International student mobility within europe: responding to contemporary challenges.Higher Education, 88:1663–1672

2024
[2]

and Waters, J

Brooks, R. and Waters, J. (2011).Student Mobilities, Migration and the Internationalization of Higher Education. Palgrave Macmillan London. Hernández, F. (2020). The effect of university graduates’ interna- tional mobility on labour outcomes in spain.Studies in Higher Education, 47:1–12

2011
[3]

Jacob, M., Kühhirt, M., and Rodrigues, M. (2019). Labour mar- ket returns to graduates’ international experience: Exploring cross-country variation in europe.European Sociological Re- view, 35(4):pp. 491–505

2019
[4]

King, R., Findlay, A., and Ahrens, J. (2010). International student mobility literature review.HEFCE

2010
[5]

K., Wiborg, V

Knutsen, T. K., Wiborg, V. S., and Wiers-Jenssen, J. (2024). Impact of international student mobility on international profile of jobs.Higher Education

2024
[6]

and Netz, N

Kratz, F. and Netz, N. (2018). Which mechanisms explain mon- etary returns to international student mobility?Studies in Higher Education, 43(2):375–400

2018
[7]

and Cordua, F

Netz, N. and Cordua, F. (2021). Does studying abroad influence graduates’ wages? a literature review.Journal of International Students, 11(4):768–789

2021
[8]

and Moog, P

Petzold, K. and Moog, P. (2018). What shapes the intention to study abroad? an experimental approach.Higher Education, 75:35–54

2018
[9]

and Rodriguez-Medina, L

Ramirez, V. and Rodriguez-Medina, L. (2024). Well-being and the internationalisation of academic life: an exploration from the periphery.Higher Education, 87:1551–1568

2024
[10]

Rodrigues, M. (2012). Determinants and impacts of student mo- bility: a literature review.Publications Office of the European Union

2012
[11]

Rodrigues, M. M. (2013). Does student mobility during higher education pays? evidence from 16 european countries. Sci- entific analysis or review LB-NA-26089-EN-N, Luxembourg (Luxembourg)

2013
[12]

M., Riggs, M

Salto, L. M., Riggs, M. L., Delgado De Leon, D., Casiano, C. A., and De Leon, M. (2014). Underrepresented minority high school and college students report stem-pipeline sustaining gains after participating in the loma linda university summer health disparities research program.PLOS ONE, 9(9):1–13

2014
[13]

(2020).Inequality, Innovation and Reform in Higher Education: Challenges of Migration and Ageing Populations

Slowey, M., Schuetze, H., and Zubrzycki, T. (2020).Inequality, Innovation and Reform in Higher Education: Challenges of Migration and Ageing Populations

2020
[14]

Souto-Otero, M., Huisman, J., Beerkens, M., de Wit, H., and Vu- jiĆ, S. (2013). Barriers to international student mobility: Evi- dence from the erasmus program.Educational Researcher, 42(2):70–77

2013
[15]

and Janson, K

Teichler, U. and Janson, K. (2007). The professional value of temporary study in another european country: Employment and work of former erasmus students.Journal of Studies in International Education, 11(3-4):486–495

2007
[16]

Tenn, J. S. (2023). The Astronomy Genealogy Project is ten years old: here are ten ways you can use it.Journal of Astronomical History and Heritage, 26(2):499–508. Van Mol, C. (2017). Do employers value international study and internships? a comparative analysis of 31 countries.Geofo- rum, 78:52–60

2023
[17]

and Neyer, F

Zimmermann, J. and Neyer, F. J. (2013). Do we become a differ- ent person when hitting the road? personality development of sojourners.Journal of Personality and Social Psychology, Bellotti et al. | 7 105(3):515–530

2013