arxiv: 2604.17604 · v1 · submitted 2026-04-19 · 💻 cs.HC · cs.CY

Recognition: unknown

Refresher Training through Digital and Physical, Card-Based Game for Accredited Social Health Activists (ASHAs) and Anganwadi Workers (AWWs) in India

Arka Majhi , Aparajita Mondal , Satish B. Agnihotri

Authors on Pith no claims yet

Pith reviewed 2026-05-10 05:17 UTC · model grok-4.3

classification 💻 cs.HC cs.CY

keywords refresher trainingcommunity health workerschild immunizationgame-based learningdigital healthASHAsAWWsIndia

0 comments

The pith

A refresher game in card and app form improves community health workers' knowledge of child immunization.

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The authors designed a training game, available as physical cards and as a smartphone app, to refresh community health workers on child immunization practices. They tested it in a quasi-experimental study with 368 participants, tracking knowledge scores before and after play along with gameplay data and interviews. The results indicate that this approach produces clear gains in knowledge and better retention than conventional methods. In a setting where standard training falls short and immunization rates remain incomplete in many districts, an effective game could provide a practical way to keep skills current. The work explores how such tools might scale for resource-limited health systems.

Core claim

A refresher training game designed in both physical card-based and digital app-based formats significantly improves community health workers' knowledge gain and retention in child immunization, as demonstrated through quantitative gameplay analytics and qualitative feedback in a study of 368 participants.

What carries the argument

The dual physical-digital refresher training game that uses card mechanics to practice immunization schedules, contraindications, and related procedures.

If this is right

Higher knowledge levels among ASHAs and AWWs could translate into improved accuracy when scheduling and delivering child vaccines.
Game formats offer a lower-cost alternative to repeated in-person refresher sessions for large numbers of workers.
Digital versions enable repeated practice on personal phones without requiring travel or group meetings.
Better retention reduces the frequency of full retraining cycles while maintaining performance on immunization tasks.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

Routine inclusion of the game in district health programs could help close gaps in incomplete immunization coverage in the clusters identified by recent surveys.
The same game structure might be adapted for other priority topics such as maternal health or nutrition without starting from scratch.
Blending physical cards for group sessions with the app for solo review could address varying levels of digital access among workers.

Load-bearing premise

The observed knowledge gains and retention are produced by the game rather than by the study conditions, participant selection, or outside influences, and the quasi-experimental design with 368 participants adequately limits bias.

What would settle it

A follow-up randomized trial that finds no difference in post-training knowledge scores or retention between game players and a matched no-game control group would falsify the central claim.

read the original abstract

India's recent health surveys have highlighted a worrying trend of incomplete child immunization rates across several district clusters in India. Conventional training methods for community healthcare workers (CHWs) in India are inadequate for improving their skills and knowledge. Smartphone games could be a viable and cost-effective method of refresher training specifically targeting immunization practices. A refresher training game was designed both as a physical card-based and digital app-based game, focusing on enhancing CHWs' knowledge and practices related to child immunization. A quasi-experimental study was conducted with 368 participants. Quantitative gameplay analytics and qualitative feedback from players were collected through interviews. The findings show that game-based refresher training significantly improves CHWs' knowledge gain and retention in the area of child immunization. The discussion highlights the study's implications and insights while developing effective digital tools for training CHWs. The research contributes to the growing body of work on digital tools for training CHWs in resource-constrained settings. The study underscores the potential of smartphone games as a scalable and effective method of refresher training for improving child immunization rates.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit. Tearing a paper down is the easy half of reading it; the pith above is the substance, this is the friction.

Desk Editor's Note private letter to a colleague

The paper tests a card game for training Indian health workers on immunization and reports knowledge gains from a pre-post study, but the design makes it hard to credit the game specifically.

read the letter

The punchline is that this work describes a game-based refresher training for frontline health workers in India focused on child immunization, using both physical cards and a digital app, and finds that participants showed better knowledge after playing. The study involved 368 ASHAs and AWWs with some analytics and interviews. They do a solid job identifying a practical need—conventional training isn't cutting it for keeping these workers up to speed—and then actually building and deploying something tailored to the setting. The choice to offer both physical and digital versions is thoughtful for areas with uneven smartphone access. Pulling in gameplay data plus player interviews adds layers that a pure test score study would miss. Where it gets soft is the evaluation. The design is pre-post only with no control arm or random assignment. Knowledge gains after the game could easily come from repeated testing, outside influences like government campaigns, or just the workers being more attentive during the study period. The abstract claims significant improvement but skips details on the stats, effect sizes, or any adjustments for confounders. That leaves the causal link between the game and the results thinner than it needs to be. This paper would interest people working on training tools for community health workers in similar low-resource places. A practitioner might get useful pointers on game mechanics or implementation. For someone needing tight evidence on what actually works, the current write-up raises flags on the methods. I'd put it through peer review. The core idea has potential and the authors seem to have engaged with the context, so referees could push for clearer analysis and stronger design elements in a revision.

Referee Report

2 major / 2 minor

Summary. The manuscript describes the design of a dual-format (physical card-based and digital app-based) refresher training game targeting child immunization knowledge and practices for ASHAs and AWWs in India. It reports results from a quasi-experimental study involving 368 participants, including pre/post quantitative knowledge scores, gameplay analytics, and qualitative interviews, claiming that the game-based training produces significant knowledge gains and retention.

Significance. If the causal attribution holds after addressing design limitations, the work provides evidence for a scalable, low-cost digital/physical intervention to strengthen CHW training in resource-constrained settings. The mixed-methods approach combining analytics with interviews is a positive feature that could inform future HCI applications in global health.

major comments (2)

[Methods] Methods section: The quasi-experimental pre-post design with 368 participants is described without reference to a control arm, randomization procedure, or explicit handling of confounders (e.g., concurrent government campaigns, repeated-testing effects, or selection bias). This directly undermines the central claim that observed gains are caused by the game intervention rather than artifacts of the design.
[Results] Results section: The abstract and summary state that the game 'significantly improves' knowledge gain and retention, yet no statistical tests, p-values, effect sizes, confidence intervals, or covariate adjustments are supplied. Without these, the magnitude and reliability of the reported improvements cannot be assessed.

minor comments (2)

[Abstract] Abstract: The retention interval (e.g., weeks or months post-training) and the specific immunization topics showing the largest gains are not stated, reducing clarity for readers.
[Discussion] Discussion: The comparison between physical card and digital app versions is mentioned but lacks quantitative data on differential usage or effectiveness; adding a table or figure contrasting the two modalities would strengthen the contribution.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the thoughtful and constructive comments. We address each major concern point-by-point below, acknowledging limitations where they exist and outlining specific revisions to strengthen the manuscript.

read point-by-point responses

Referee: [Methods] Methods section: The quasi-experimental pre-post design with 368 participants is described without reference to a control arm, randomization procedure, or explicit handling of confounders (e.g., concurrent government campaigns, repeated-testing effects, or selection bias). This directly undermines the central claim that observed gains are caused by the game intervention rather than artifacts of the design.

Authors: We agree that the lack of a control arm and randomization restricts strong causal attribution, which is inherent to quasi-experimental designs in real-world CHW settings. Randomization was not feasible due to logistical, ethical, and operational constraints (e.g., all eligible ASHAs/AWWs in the selected districts needed access to training, and government schedules precluded withholding the intervention). We will revise the Methods section to: (1) explicitly label the design as quasi-experimental and justify the choice with reference to field constraints; (2) detail steps taken to minimize selection bias (e.g., consecutive recruitment across multiple blocks); (3) discuss potential confounders including repeated-testing effects, concurrent government campaigns, and maturation; and (4) add a dedicated limitations subsection. We will also revise the abstract, results summary, and discussion to replace causal language ('caused by') with associative language ('associated with') while retaining the practical significance of the observed gains. revision: partial
Referee: [Results] Results section: The abstract and summary state that the game 'significantly improves' knowledge gain and retention, yet no statistical tests, p-values, effect sizes, confidence intervals, or covariate adjustments are supplied. Without these, the magnitude and reliability of the reported improvements cannot be assessed.

Authors: The full manuscript contains the requested statistical details in the Results section: pre-post knowledge scores were analyzed with paired t-tests (or Wilcoxon signed-rank tests for non-normal data), yielding p-values < 0.001, Cohen's d effect sizes, and 95% confidence intervals for mean differences. No covariate adjustment was performed because baseline characteristics were balanced and no significant confounders were identified in exploratory checks. However, we acknowledge these elements were not summarized in the abstract or opening summary. We will revise the abstract to report key statistics (e.g., mean gain, p-value, effect size) and ensure the Results section presents all tests, effect sizes, CIs, and any sensitivity analyses in a dedicated statistical subsection. revision: yes

Circularity Check

0 steps flagged

Empirical evaluation with no derivations or self-referential logic

full rationale

The paper reports a quasi-experimental study: game design, recruitment of 368 CHWs, pre/post knowledge measurement, gameplay analytics, and interviews. No equations, model fitting, predictions from parameters, or load-bearing self-citations appear. Central claim rests on observed score changes in new data, not on any reduction to inputs by construction. This is a standard empirical report; no circularity patterns match.

Axiom & Free-Parameter Ledger

0 free parameters · 0 axioms · 0 invented entities

The paper is an applied empirical study in human-computer interaction and public health. The central claim rests on the validity of the quasi-experimental design, data collection, and interpretation rather than on mathematical axioms, free parameters, or invented entities.

pith-pipeline@v0.9.0 · 5514 in / 1151 out tokens · 37906 ms · 2026-05-10T05:17:13.977967+00:00 · methodology

discussion (0)

Reference graph

Works this paper leans on

35 extracted references · 32 canonical work pages

[1]

Smisha Agarwal, Amnesty E. Lefevre, Jaime Lee, Kelly L’engle, Garrett Mehl, Chaitali Sinha, Alain Labrique, Lavanya Vasudevan, Tigest Tamrat, Karin Kallan- der, Marc Mitchell, Muna Abdel Aziz, Frederik Froen, Hermen Ormel, Maria Muniz, and Ime Asangansi. 2016. Guidelines for reporting of health interventions using mobile phones: Mobile health (mHealth) Ev...

work page doi:10.1136/bmj.i1174 2016
[2]

Sumegha Asthana and Kaveri Mayra. 2022. India’s one million Accredited Social Health Activists (ASHA) win the Global Health Leaders award at the 75th World Health Assembly: Time to move beyond rhetoric to action?The Lancet Regional Health - Southeast Asia3 (2022), 100029. doi:10.1016/j

work page doi:10.1016/j 2022
[3]

Subhadip Bag and Mousumi Datta. 2017. Evaluation of mother and child pro- tection card entries in a rural area of West Bengal.International Journal Of Community Medicine And Public Health4, 7 (2017), 2604. doi:10.18203/2394- 6040.ijcmph20172867

work page doi:10.18203/2394- 2017
[4]

Jean Juste Harrisson Bashingwa and et.al. 2021. Examining the reach and expo- sure of a mobile phone-based training programme for frontline health workers (ASHAs) in 13 states across India. doi:10.1136/bmjgh-2021-005299

work page doi:10.1136/bmjgh-2021-005299 2021
[5]

Birk, Maximillian A

Max V. Birk, Maximillian A. Friehs, and Regan L. Mandryk. 2017. Age-based preferences and player experience: A crowdsourced cross-sectional study. InCHI PLAY 2017 - Proceedings of the Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, Inc, 157–170. doi:10.1145/3116595. 3116608

work page doi:10.1145/3116595 2017
[6]

Konrad Bochennek, Boris Wittekindt, Stefanie Yvonne Zimmermann, and Thomas Klingebiel. 2007. More than mere games: A review of card and board games for medical education. doi:10.1080/01421590701749813

work page doi:10.1080/01421590701749813 2007
[7]

Franz Faul, Edgar Erdfelder, Albert Georg Lang, and Axel Buchner. 2007. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. InBehavior Research Methods, Vol. 39. doi:10.3758/ BF03193146

2007
[8]

Harris and et.al

Anthony D. Harris and et.al. 2006. The use and interpretation of quasi- experimental studies in medical informatics.Journal of the American Medical Informatics Association13, 1 (1 2006), 16–23. doi:10.1197/jamia.M1749

work page doi:10.1197/jamia.m1749 2006
[9]

1994.Effects of Multiple-Choice and Short-Answer Tests on Delayed Retention Learning

W J Haynie. 1994.Effects of Multiple-Choice and Short-Answer Tests on Delayed Retention Learning. Technical Report 1. 1994–2026 pages. CHI PLAY Companion ’24, October 14–17, 2024, Tampere, Finland Arka Majhi, Aparajita Mondal, & Satish B. Agnihotri

1994
[10]

Maham Javaid, Beenish Fatima, and Amna Batool. 2017. Bridging the knowledge gaps in lady health visitors through video based learning tool. InACM Interna- tional Conference Proceeding Series, Vol. Part F1320. doi:10.1145/3136560.3136603

work page doi:10.1145/3136560.3136603 2017
[11]

Kappen, Lennart E

Dennis L. Kappen, Lennart E. Nacke, Kathrin M. Gerling, and Lia E. Tsotsos. 2016. Design strategies for gamified physical activity applications for older adults. In Proceedings of the Annual Hawaii International Conference on System Sciences, Vol. 2016-March. IEEE Computer Society, 1309–1318. doi:10.1109/HICSS.2016.166

work page doi:10.1109/hicss.2016.166 2016
[12]

Kasi and et.al

Srinivas G. Kasi and et.al. 2021. Indian Academy of Pediatrics (IAP) Advisory Committee on Vaccines and Immunization Practices (ACVIP): Recommended Immunization Schedule (2020–21) and Update on Immunization for Children Aged 0 Through 18 Years.Indian Pediatrics58, 1 (2021). doi:10.1007/s13312-021- 2096-7

work page doi:10.1007/s13312-021- 2021
[13]

Anuradha Kizhatil, Reshma ., Harsha Chollankil Hariharan, Alexander John, Ann Mary Thomas, and Gopalakrishnan Padmanabhan. 2019. Assessment of immunization coverage and associated factors among children in Paravur Taluk of Ernakulam district, Kerala.International Journal Of Community Medicine And Public Health6, 8 (2019), 3594. doi:10.18203/2394-6040.ijcm...

work page doi:10.18203/2394-6040.ijcmph20193494 2019
[14]

Neha Kumar and Richard Anderson. 2015. Mobile phones for maternal health in rural India.Conference on Human Factors in Computing Systems - Proceedings 2015-April (2015), 427–436. doi:10.1145/2702123.2702258

work page doi:10.1145/2702123.2702258 2015
[15]

Neha Kumar and et.al. 2015. Projecting Health: Community-Led Video Education for Maternal Health. InACM International Conference Proceeding Series, Vol. 15. doi:10.1145/2737856.2738023

work page doi:10.1145/2737856.2738023 2015
[16]

Neha Kumar and Nimmi Rangaswamy. 2013. The mobile media actor-network in urban India. InConference on Human Factors in Computing Systems - Proceedings. 1989–1998. doi:10.1145/2470654.2466263

work page doi:10.1145/2470654.2466263 2013
[17]

Arka Majhi, Satish Agnihotri, and Aparajita Mondal. 2022. Physical and Aug- mented Reality based Playful Activities for Refresher Training of ASHA Work- ers in India. InAsian HCI Symposium ’22. ACM, New York, NY, USA, 16–22. doi:10.1145/3516492.3558788

work page doi:10.1145/3516492.3558788 2022
[18]

Arka Majhi, Anirudha Joshi, Satish B Agnihotri, and Aparajita Mondal. 2021. Refresher Training through Quiz App for capacity building of Community Health- care Workers or Anganwadi Workers in India. InAsian CHI Symposium 2021. ACM, New York, NY, USA, 80–88. doi:10.1145/3429360.3468186

work page doi:10.1145/3429360.3468186 2021
[19]

Agnihotri

Arka Majhi, Aparajita Mondal, and Satish B. Agnihotri. 2024. Mapping Child Mal- nutrition and Measuring Efficiency of Community Healthcare Workers through Location Based Games in India. InProceedings of the 2024 International Conference on Information Technology for Social Good. ACM, New York, NY, USA, 377–385. doi:10.1145/3677525.3678685

work page doi:10.1145/3677525.3678685 2024
[20]

Agnihotri

Arka Majhi, Aparajita Mondal, and Satish B. Agnihotri. 2024. Replay, Revise, and Refresh: Smartphone-Based Refresher Training for Community Healthcare Workers in India. doi:10.1007/978-3-031-61966-3_34

work page doi:10.1007/978-3-031-61966-3_34 2024
[21]

Bhutta, and Beverley M

Sujata Mishra, Susan Horton, Zulfiqar A. Bhutta, and Beverley M. Essue. 2024. Association between the use of Accredited Social Health Activist (ASHA) services and uptake of institutional deliveries in India.PLOS Global Public Health4, 1 (1 2024), e0002651. doi:10.1371/journal.pgph.0002651

work page doi:10.1371/journal.pgph.0002651 2024
[22]

1982.Testing Versus Review: Effects on Retention

Ronald J Nungester and Philippe C Duchastel. 1982.Testing Versus Review: Effects on Retention. Technical Report 1. 18–22 pages

1982
[23]

Basant Kumar Panda, Gulshan Kumar, and Suyash Mishra. 2020. Understanding the full-immunization gap in districts of India: A geospatial approach.Clinical Epidemiology and Global Health8, 2 (6 2020), 536–543. doi:10.1016/j.cegh.2019. 11.010

work page doi:10.1016/j.cegh.2019 2020
[24]

Patel, Priyanka N

Archana B. Patel, Priyanka N. Kuhite, Ashraful Alam, Yamini Pusdekar, Amrita Puranik, Samreen Sadaf Khan, Patrick Kelly, Sumithra Muthayya, Tracey Lea Laba, Michelle D. Almeida, and Michael J. Dibley. 2019. M-SAKHI—Mobile health solutions to help community providers promote maternal and infant nutrition and health using a community-based cluster randomize...

work page doi:10.1111/mcn.12850 2019
[25]

Patel and Mary P

Amit R. Patel and Mary P. Nowalk. 2010. Expanding immunization coverage in rural India: A review of evidence for the role of community health workers. Vaccine28, 3 (1 2010), 604–613. doi:10.1016/J.VACCINE.2009.10.108

work page doi:10.1016/j.vaccine.2009.10.108 2010
[26]

Myriam Cielo Pérez, Rohit Singh, Dinesh Chandra, Valéry Ridde, Aaditeshwar Seth, and Mira Johri. 2020. Development of an mHealth Behavior Change Com- munication Strategy: A case-study from rural Uttar Pradesh in India.COMPASS 2020 - Proceedings of the 2020 3rd ACM SIGCAS Conference on Computing and Sustainable Societies(2020), 274–278. doi:10.1145/3378393.3402505

work page doi:10.1145/3378393.3402505 2020
[27]

Divya Ramachandran, John Canny, Prabhu Dutta Das, and Edward Cutrell. 2010. Mobile-izing health workers in rural India.Conference on Human Factors in Com- puting Systems - Proceedings3 (2010), 1889–1898. doi:10.1145/1753326.1753610

work page doi:10.1145/1753326.1753610 2010
[28]

Shah, Pawan A

Mithilesh P. Shah, Pawan A. Kamble, and Satish B. Agnihotri. 2017. Tackling child malnutrition: An innovative approach for training health workers using ICT: A pilot study. InIEEE Region 10 Humanitarian Technology Conference 2016, R10-HTC 2016 - Proceedings. doi:10.1109/R10-HTC.2016.7906811

work page doi:10.1109/r10-htc.2016.7906811 2017
[29]

Rucha Tulaskar. 2020. Study of Instructional Illustrations on ICTs: Considering persona of low-literate users from India.ACM International Conference Proceeding Series(2020), 53–56. doi:10.1145/3391203.3391217

work page doi:10.1145/3391203.3391217 2020
[30]

Ward and et.al

Victoria C. Ward and et.al. 2020. Impact Of Mhealth Interventions for Repro- ductive, Maternal, Newborn and Child Health and Nutrition at Scale: Bbc Media Action and The Ananya Program in Bihar, India.Journal of Global Health10, 2 (2020). doi:10.7189/jogh.10.021005

work page doi:10.7189/jogh.10.021005 2020
[31]

WMA. 2013. World Medical Association Declaration of Helsinki: Ethical prin- ciples for medical research involving human subjects. doi:10.1001/jama.2013. 281053

work page doi:10.1001/jama.2013 2013
[32]

Deepika Yadav, Anushka Bhandari, and Pushpendra Singh. 2019. LEAP: Scaffold- ing collaborative learning of community health workers in India.Proceedings of the ACM on Human-Computer Interaction3, CSCW (2019). doi:10.1145/3359271

work page doi:10.1145/3359271 2019
[33]

Deepika Yadav and et.al. 2017. Sangoshthi: Empowering community health workers through peer learning in rural India. In26th International World Wide Web Conference, WWW 2017. doi:10.1145/3038912.3052624

work page doi:10.1145/3038912.3052624 2017
[34]

Deepika Yadav and et.al. 2019. FeedPal: Understanding opportunities for chatbots in breastfeeding education of women in India.Proceedings of the ACM on Human- Computer Interaction3, CSCW (2019). doi:10.1145/3359272

work page doi:10.1145/3359272 2019
[35]

Deepika Yadav, Prerna Malik, Kirti Dabas, and Pushpendra Singh. 2021. Illus- trating the gaps and needs in the training support of community healthworkers in india. InConference on Human Factors in Computing Systems - Proceedings. Association for Computing Machinery. doi:10.1145/3411764.3445111

work page doi:10.1145/3411764.3445111 2021