A Methodological Framework for Capturing Cognitive-Affective States in Collaborative Learning

Nathaniel Blanchard; Sifatul Anindho; Videep Venkatesha

REVIEW 4 major objections 5 minor 41 references

A Methodological Framework for Capturing Cognitive-Affective States in Collaborative Learning

T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read This paper claims that a retrospective cued recall procedure can timestamp cognitive-affective states in collaborative groups without interrupting the task itself.

desk verdict Honest pilot study with a useful new data collection variant, but the temporal fidelity assumption is unvalidated—so treat the frequency and temporal claims as descriptive, not confirmatory. read the letter →

arxiv 2507.01166 v1 pith:RGENYGIL submitted 2025-07-01 cs.HC

Sifatul Anindho , Videep Venkatesha , Nathaniel Blanchard This is my paper · ORCID

classification cs.HC

keywords CollaborativeLearningCognitive-AffectiveStatesRetrospectiveCuedRecallSelf-CaughtReportsProbe-CaughtAffectiveComputingEducationalDataMiningTemporalDynamics

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper claims that a retrospective cued recall procedure—participants watch a video of their own collaborative session and report cognitive-affective states either on their own or when prompted—can capture those states with temporal detail without disrupting the collaboration itself. Drawing on 27 participants in nine three-person groups solving a weights task, the paper reports an initial analysis of 359 labeled reports in which Optimistic, Curious, and Confused dominate. The temporal scatterplot shows early curiosity, sustained confusion, rising disengagement, and mid-task frustration, and the authors read these patterns as consistent with existing accounts of affective dynamics. If the method is sound, it would give the educational data mining community a low-disruption measurement tool for studying how group-level cognitive-affective states unfold and for building adaptive learning systems that react to them.

What carries the argument

The central object is a retrospective cued recall interface: an interactive application plays back the group's session video and opens a survey either when the participant chooses to report (self-caught) or automatically after about 60 seconds of idleness (probe-caught). The survey constrains reports to a pre-identified set of cognitive-affective states—Confused, Disengaged, Curious, Optimistic, Frustrated, Conflicted, Surprised, plus Other—and lets participants report multiple states at once with an onset/ongoing distinction. The mechanism for temporal analysis is the report timestamp: timestamps are normalized within each group by the group's video length, which turns the raw reports into a scatterplot of label occurrences over task time. Frequency distributions and descriptive statistics of self-caught versus probe-caught reports are then compared as a check on whether the two collection modes yield similar pictures.

What would settle it

Run the same cued recall procedure alongside concurrent behavioral and physiological recording, then align the reported onset times for states like Confused and Frustrated with machine-coded facial action units, posture shifts, or voice cues from the original session. If the report timestamps consistently lag or lead the marker signals by large, variable amounts, the method's temporal fidelity claim fails; if they align within a small window, the method's core assumption is supported.

Watch

Extended reading notes

Core claim

The central claim is that a structured, video-stimulated recall survey can produce a usable timestamped trace of the cognitive-affective states individuals experience during collaborative problem solving. In the reported data, participants used a fixed menu of seven labels plus an 'Other' option, reported multiple overlapping states freely, and marked each state as onset or ongoing; the system recorded either self-caught reports or probe-caught reports triggered after 60 seconds without input. The resulting 359 labels were led by Optimistic (91), Curious (82), and Confused (66), with self-caught and probe-caught subsets showing a similar top three. Over normalized task time, Curious appeared early, Confused persisted across long stretches, Disengaged rose in the latter half, and Frustrated peaked mid-task before dropping off; the paper takes these temporal shapes as evidence that the paradigm captures state dynamics, not just aggregate frequencies.

Load-bearing premise

Participants can accurately recall and timestamp the cognitive-affective states they felt during the task while watching their own video, rather than reconstructing them after the fact.

Editorial extensions

If this is right

If the method is valid, cognitive-affective states in collaborative groups can be timestamped without interrupting the task itself, since reports happen during video review rather than during collaboration.
The similar top-three label distributions under self-caught and probe-caught collection suggest that a 60-second auto-probe can broaden coverage without heavily distorting which states people report.
The temporal patterns—early Curious, sustained Confused, rising Disengaged, mid-task Frustrated—offer concrete hypotheses about collaborative state dynamics that future studies with larger samples can test.
Because each report carries a timestamp, the data can be aligned with behavioral and physiological recordings, enabling multimodal models that connect reported states to observable cues, which the paper names as future work.
Affect-aware adaptive learning systems could use such timestamped reports to detect when a group is persistently confused or disengaging and respond in time.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

Because the menu is fixed to seven labels, the high counts for Optimistic and Curious may partly reflect label availability rather than true prevalence; adding an explicit 'neutral-engaged' label, which the paper suggests participants were reaching for, could redistribute the frequencies.
The 60-second probe interval sets a practical floor on how short a state must be to appear in probe-caught data, so very brief affective events may be underrepresented in this collection mode.
A direct test of the method's temporal fidelity is available in the existing recordings: align report timestamps with facial action units or physiological signals from the same session and measure the lag between marker onset and report time.
If the approach transfers to other tasks, the normalized-time scatterplot could become a standard diagnostic for comparing state dynamics across different collaborative learning activities.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Short version: this is a small, honest pilot study that extends the authors' own retrospective cued-recall paradigm with a self-caught versus probe-caught structured survey. The new dataset and the two-mode design are real additions, and the paper is refreshingly candid about its limits. But the load-bearing assumption—that retrospective reports preserve in-the-moment temporal fidelity—is not validated, and the authors concede exactly this in Section 6. So the frequency counts and temporal patterns should be read as descriptive outputs of the method, not as evidence about actual affective dynamics.

What's genuinely new: the structured survey with a fixed 60-second probe schedule plus voluntary self-caught reports, applied to collaborative problem-solving groups. The 27-participant corpus, with time-aligned labels and scatterplot visualizations, is new. The simple classification rule for self- versus probe-caught based on inter-report intervals is a neat operational detail, though it depends on exact alignment.

What the paper does well: it is clearly written, the procedure is reproducible from the description, and the limitations discussion is honest—temporal fidelity, small n, generalizability, and the possibility that Optimistic and Curious are stand-ins for a neutral-engaged state are all flagged. It does not oversell the results.

The soft spots are real but proportionate to the pilot status. First, temporal fidelity is the crux, and Section 6 leaves it open; the stress-test concern about the 60-second probe schedule is valid, because the probes are tied to clock time, not to state onsets or behavioral cues. Second, the comparison between self-caught (129 labels) and probe-caught (230 labels) mixes different denominators, and no statistical test accompanies the claimed distributional differences. Third, the temporal narrative about Curious early, Confused sustained, Disengaged late, and Frustrated mid-task is based on eyeballing a scatterplot, not any test. These are limitations, not fatal flaws, given the paper frames itself as an initial analysis.

The citation pattern is fine; it builds on the authors' prior work and D'Mello and Graesser, and the self-reference is legitimate. No equation-level circularity.

Who should read it: people working on affect measurement methods in educational data mining, especially those interested in retrospective recall and low-disruption annotation. It doesn't deserve a desk reject; a serious referee could push for validation against behavioral or physiological data, and for statistical rigor in the comparisons.

My recommendation: send it out for review with a clear request that the authors either add validation or sharpen the claims to match the evidence.

Referee Report

4 major / 5 minor

Summary. The paper reports a pilot methodology for capturing cognitive-affective states of individuals in collaborative groups using retrospective cued recall. Participants first completed a collaborative weights task in groups of three; afterward they watched a video of their session and reported their internal states through an interactive interface. Reports were collected either as self-caught reports (participants voluntarily opened the survey) or probe-caught reports (the survey opened automatically after 60 seconds of idleness). The manuscript presents descriptive frequency statistics (359 labels total across 27 participants), compares the label distributions between self-caught and probe-caught reports, and describes temporal patterns in the reported states over normalized task time. The authors find that Optimistic, Curious, and Confused were the most frequent labels, and they interpret temporal patterns such as early Curious, sustained Confused, rising Disengaged, and mid-task Frustrated as consistent with prior work on affect dynamics. The paper explicitly frames itself as an initial analysis and acknowledges that the temporal fidelity of self-reports remains undetermined, calling for future validation against behavioral and physiological measurements.

Significance. If the reported method is validated, it would be a useful low-disruption tool for studying cognitive-affective state dynamics in collaborative learning, and it has clear relevance for educational data mining and adaptive learning systems. The paper benefits from a transparent statement of limitations, a reproducible description of the experimental procedure, direct measurement of report frequencies, and a publicly available source-code link. The descriptive observations about label frequencies and temporal distributions are concrete and checkable. However, the current manuscript does not yet establish the central validity claim that the captured reports faithfully reflect in-the-moment cognitive-affective states, and several quantitative comparisons are presented without appropriate statistical support. The paper is best read as a work-in-progress methodology; its significance as a published contribution depends on strengthening the link between the reported measures and actual state dynamics, or on carefully narrowing the claims to what the descriptive data can support.

major comments (4)

[§5, §6] The central interpretive claim that the frequency counts and temporal patterns describe actual cognitive-affective state dynamics relies on the assumption that retrospective cued recall is temporally faithful. Section 6 explicitly concedes that "the temporal fidelity of self-reports also remains undetermined." With no validation against behavioral or physiological measurements, statements in Section 5 such as "Confused reports persisted over longer periods without interruption" and "Frustrated reports peaked mid-task" are not supported as claims about real state dynamics; they are observations about report timing. The manuscript should either add a validation component or systematically rephrase the Discussion and Conclusion to characterize the results as properties of the reporting behavior rather than of the underlying affective states.
[§4, Table 2, Figures 4–5] The comparison between self-caught and probe-caught distributions is based on unequal totals (129 versus 230 labels) and is not accompanied by any statistical test or normalized rate. Because participants could report multiple labels per survey, raw label counts conflate the number of reports with the number of labels per report. The claim that the distributions "changed across the two collections" is therefore not substantiated. The authors should report per-report proportions or rates, and apply an appropriate inferential test (or explicitly state that all conclusions are purely descriptive and forgo comparative claims).
[§3.1.4] The classification of reports as self-caught versus probe-caught is based on the time difference between consecutive reports "align[ing] exactly with the probe-frequency." This rule is underspecified: no tolerance or jitter is defined, the 60-second probe interval interacts with the 1-second video skip after self-reports, and survey completion time could shift the next report timestamp. Without a precise, robust decision rule and a sensitivity check, misclassification between the two conditions could bias the distributional comparisons in Table 2 and Figures 4–5.
[§3.1.4, §3.2, §4] The "Other" response option was added after the second experimental group, so groups 1–2 had a different, smaller label set than groups 3–9. Pooling all participants for the frequency distributions and self- versus probe-caught comparisons therefore mixes two different measurement conditions. At a minimum, the authors should report whether the main frequency patterns hold when restricted to the subset of participants who had the full label set, and should note this inconsistency explicitly in the Results.

minor comments (5)

[§3.1.2 and §6] The text cites Khebour et al. and the task-generalization concern with reference [20], but reference [20] in the bibliography is Highhouse's "Designing experiments that generalize"; the in-text citation numbering appears to be shifted and should be corrected throughout.
[§4, Table 3] Table 3 reports an average inter-report time difference of 40.43 seconds, which is notably shorter than the 60-second probe interval; the authors should explain this discrepancy, for example by separating self-caught and probe-caught intervals or by reporting the effect of the 1-second video skip and multiple self-reports.
[§4, Table 2] The row labels in Table 2, particularly "Mean," "SD," and "Standard Error," should specify the unit of analysis (labels per participant or per report) so that the descriptive statistics are unambiguous.
[§5] The statement that participants "reported more low-arousal emotions when probed" is not tied to a definition of low-arousal or to a quantitative comparison; either provide the supporting analysis or remove the claim.
[§4, Figure 6] The scatterplot in Figure 6 would be easier to interpret if the axes were labeled directly in the figure and if overplotted points were given some visual transparency or jitter, since many reports occur near the same normalized times.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the reported frequency and temporal distributions are direct observations, not predictions derived from fitted inputs or from the authors' prior work.

full rationale

The paper does not perform a derivation or fit. It reports descriptive statistics and scatterplot-based temporal patterns from participant reports collected under a retrospective cued-recall procedure. The only self-reference is the adoption of a label set from the authors' prior study [1] ("This study extends Anindho et al.'s retrospect cued recall paradigm [1]... to capture a subset of these states"). That choice constrains the measurement instrument, but it does not force the observed counts (e.g., Optimistic=91, Curious=82, Confused=66) or the temporal distributions. These are empirical observations conditional on the chosen labels, not quantities derived from [1]'s data. No equation-level reduction, fitted-input-as-prediction, or uniqueness argument is present. The paper's own limitation statement disclaims the key validity assumption ("The temporal fidelity of self-reports also remains undetermined, since the method has not been compared to the behavioral and physiological measurements of our data"), which is a correctness limitation rather than a circularity. Because no load-bearing step reduces to its own input, the circularity score is 0.

Assumptions & free parameters 1 free parameters · 2 assumptions · 0 invented entities

The paper makes no mathematical derivation; the main assumption is the validity of retrospective self-report. The probe interval is a hand-chosen design parameter. No new entities are introduced.

free parameters (1)

Probe interval = 60 seconds
Chosen by hand; determines how often probe-caught reports are collected and therefore shapes the self-caught versus probe-caught comparison. A different interval would change the frequency distributions.

assumptions (2)

domain assumption Participants' retrospective reports during video review faithfully reflect the cognitive-affective states they experienced during the original task.
Central to interpreting frequency and temporal distributions as evidence about actual states; the paper states in Section 6 that temporal fidelity is undetermined.
domain assumption The seven provided labels plus 'Other' adequately cover the cognitive-affective states participants experienced.
The label set is fixed from prior work; any state outside this set is only captured if participants choose Other, which was absent for groups 1-2.

how reviews work

0 comments

Cite this review

Pith. "Pith review of A Methodological Framework for Capturing Cognitive-Affective States in Collaborative Learning." pith.science (2026). https://pith.science/paper/RGENYGIL

@misc{pith2026250701166,
  author       = {Pith},
  title        = {Pith review of: A Methodological Framework for Capturing Cognitive-Affective States in Collaborative Learning},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/RGENYGIL}},
  note         = {Machine review of arXiv:2507.01166}
}

read the original abstract

Identification of affective and attentional states of individuals within groups is difficult to obtain without disrupting the natural flow of collaboration. Recent work from our group used a retrospect cued recall paradigm where participants spoke about their cognitive-affective states while they viewed videos of their groups. We then collected additional participants where their reports were constrained to a subset of pre-identified cognitive-affective states. In this latter case, participants either self reported or reported in response to probes. Here, we present an initial analysis of the frequency and temporal distribution of participant reports, and how the distributions of labels changed across the two collections. Our approach has implications for the educational data mining community in tracking cognitive-affective states in collaborative learning more effectively and in developing improved adaptive learning systems that can detect and respond to cognitive-affective states.

Figures

Figures reproduced from arXiv: 2507.01166 by the authors.

**Figure 2.** The physical environment of the experiment (The [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗

**Figure 3.** Distribution of the 10 most frequent labels reported [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗

Figures from the paper (3 more)

**Figure 4.** Figure 4: Distribution of the 10 most frequent labels collected [PITH_FULL_IMAGE:figures/full_fig_p003_4.png]

**Figure 5.** Figure 5: Distribution of the 10 most frequent labels collected [PITH_FULL_IMAGE:figures/full_fig_p003_5.png]

**Figure 6.** Figure 6: A scatter plot showing the distribution of the 7 most frequent cognitive-affective state reports over normalized task [PITH_FULL_IMAGE:figures/full_fig_p004_6.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

41 extracted references · 40 canonical work pages

[1]

Here, we present initial experiments with retrospective cued recall paradigm for identifying cognitive-affective states of individ- uals in collaborative groups

INTRODUCTION Recently, researchers in educational data mining have been interested in modeling group dynamics in collaborative learn- ing environments to understand how students interact, learn, and solve problems together [29, 5, 21, 31, 32, 6]. Here, we present initial experiments with retrospective cued recall paradigm for identifying cognitive-affecti...

work page
[2]

A Methodological Framework for Capturing Cognitive-Affective States in Collaborative Learning

RELA TED WORK Traditional methods of tracking cognitive-affective states in learning include self-reports [26, 25, 23, 11], think-aloud pro- tocols [8], and the use of behavioral observations by human coders [4, 9]. Self-reporting is where individuals provide information about their emotional experiences through sur- veys, questionnaires, or interviews [2...

work page Pith review arXiv 2009
[3]

Confused

METHODS 3.1 Collaborative Task Experiments 3.1.1 Participants We recruited a total of 27 participants, organized into 9 groups of 3 individuals each. Participants were required to be at least 18 years old and able to speak in English. Re- cruitment efforts were focused in the department where the authors are appointed, and potential participants were in- ...

work page
[4]

Optimistic

RESULTS Table 2: Statistics on the number of Labels of Cognitive- Affective States Reported All Labels Self-Caught Probe-Caught Total Count 359 129 230 Mean 13.30 4.78 8.52 SD 4.67 4.81 5.69 Table 2 shows the descriptive statistics on the number of labels of cognitive-affective states reported. Figure 3 shows the overall distribution of the 10 most freque...

work page 2025
[5]

Optimistic

DISCUSSION The distribution of states was largely consistent between self-caught and probe-caught reports, with minor deviations. The prevalence of “Optimistic” and “Curious” reports may suggest that participants were in a neutral-engaged state [14], and co-opted one of these labels as the closest approx- imate for that state. In the original collection b...

work page
[6]

Additionally, the results may not generalize to other collaborative learning tasks, and val- idation of a different task may be necessary to confirm find- ings [20]

LIMITA TIONS AND FUTURE WORK This study’s small dataset and broad category of labels in this study limited the scope of the analysis and the experi- ences of the participants [27]. Additionally, the results may not generalize to other collaborative learning tasks, and val- idation of a different task may be necessary to confirm find- ings [20]. The tempor...

work page
[7]

CONCLUSION This study investigated a retrospective cued recall paradigm to capture cognitive-affective states in collaborative learn- ing, combining self-caught and probe-caught methods with retrospective video-stimulated recall. Our initial findings provide insights into the dynamics of these states and their distributions using different reporting metho...

work page
[8]

Cotton and K

D. Cotton and K. Gresty. Reflecting on the think-aloud method for evaluating e-learning. British Journal of Educational Technology, 37(1):45–54, 2006

work page 2006

Show all 41 references

[9]

Anindho, V

S. Anindho, V. Venkatesha, M. Bradford, A. M. Cleary, and N. Blanchard. An exploration of internal states in collaborative problem solving. In International Conference on Human-Computer Interaction, pages 135–150. Springer, 2025

2025
[10]

Aoyama Lawrence and A

L. Aoyama Lawrence and A. Weinberger. Being in-sync: A multimodal framework on the emotional and cognitive synchronization of collaborative learners. In Frontiers in Education, volume 7, page 867186. Frontiers Media SA, 2022

2022
[11]

R. S. Baker, S. K. D’Mello, M. M. T. Rodrigo, and A. C. Graesser. Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environments. International Jou...

2010
[12]

Bosch, S

N. Bosch, S. K. D’mello, J. Ocumpaugh, R. S. Baker, and V. Shute. Using video to automatically detect learner affect in computer-enabled classrooms. ACM Transactions on Interactive Intelligent Systems (TiiS) , 6(2):1–26, 2016

2016
[13]

Bradford, I

M. Bradford, I. Khebour, N. Blanchard, and N. Krishnaswamy. Automatic detection of collaborative states in small groups using multimodal features. In International Conference on Artificial Intelligence in Education , pages 767–773. Springer, 2023

2023
[14]

Surprised

that follows as challenges continue. “Surprised” was in- termittent and transitory [3]
[15]

Chandler, T

C. Chandler, T. Breideband, J. G. Reitman, M. Chitwood, J. B. Bush, A. Howard, S. Leonhart, P. W. Foltz, W. R. Penuel, and S. K. D’Mello. Computational modeling of collaborative discourse to enable feedback and reflection in middle school classrooms. In Proceedings of the 14th...

2024
[16]

Corradi-Dell’Acqua, C

C. Corradi-Dell’Acqua, C. Hofstetter, and P. Vuilleumier. Cognitive and affective theory of mind share the same local patterns of activity in posterior temporal but not medial prefrontal cortex. Social cognitive and affective neuroscience, 9(8):1175–1184, 2014

2014
[17]

R. S. d Baker, S. M. Gowda, M. Wixon, J. Kalka, A. Z. Wagner, A. Salvi, V. Aleven, G. W. Kusbit, J. Ocumpaugh, and L. Rossi. Towards sensor-free affect detection in cognitive tutor algebra. International Educational Data Mining Society , 2012

2012
[18]

R. J. Davidson. Affective style and affective disorders: Perspectives from affective neuroscience. Cognition & emotion, 12(3):307–330, 1998

1998
[19]

D’Mello, E

S. D’Mello, E. Dieterle, and A. Duckworth. Advanced, analytic, automated (aaa) measurement of engagement during learning. Educational psychologist, 52(2):104–123, 2017

2017
[20]

D’Mello and A

S. D’Mello and A. Graesser. The half-life of cognitive-affective states during complex learning. Cognition & Emotion , 25(7):1299–1308, 2011

2011
[21]

S. K. D’mello and J. Kory. A review and meta-analysis of multimodal affect detection systems. ACM computing surveys (CSUR) , 47(3):1–36, 2015

2015
[22]

D’Mello and A

S. D’Mello and A. Graesser. Dynamics of affective states during complex learning. Learning and Instruction, 22(2):145–157, 2012

2012
[23]

D’Mello, B

S. D’Mello, B. Lehman, R. Pekrun, and A. Graesser. Confusion can be beneficial for learning. Learning and Instruction, 29:153–170, 2014

2014
[24]

D. W. Eccles and G. Arsal. The think aloud method: what is it and how do i use it? Qualitative Research in Sport, Exercise and Health , 9(4):514–531, 2017

2017
[25]

Hailpern, K

J. Hailpern, K. Karahalios, J. Halle, L. Dethorne, and M.-K. Coletto. A3: Hci coding guideline for research using video annotation to assess behavior of nonverbal subjects with computer-based intervention. ACM Transactions on Accessible Computing (TACCESS), 2(2):1–29, 2009

2009
[26]

A. T. Hayes, C. E. Hughes, and J. Bailenson. Identifying and coding behavioral indicators of social presence with a social presence behavioral coding system. Frontiers in Virtual Reality, 3:773448, 2022

2022
[27]

R. E. Heyman, M. F. Lorber, J. M. Eddy, and T. V. West. Behavioral Observation and Coding , page 345–372. Cambridge University Press, 2014

2014
[28]

Highhouse

S. Highhouse. Designing experiments that generalize. Organizational Research Methods, 12(3):554–566, 2009

2009
[29]

Khebour, K

I. Khebour, K. Lai, M. Bradford, Y. Zhu, R. Brutti, C. Tam, J. Tu, B. Ibarra, N. Blanchard, N. Krishnaswamy, et al. Common ground tracking in multimodal dialogue. arXiv preprint arXiv:2403.17284, 2024

2024 arXiv
[30]

D. L. Paulhus, S. Vazire, et al. The self-report method. Handbook of research methods in personality psychology, 1(2007):224–239, 2007

2007
[31]

R. Pekrun. Using self-report to assess emotions in education. Methodological advances in research on emotion and education , pages 43–54, 2016

2016
[32]

R. Pekrun. Self-report is indispensable to assess students’ learning. Frontline learning research, 8(3):185–193, 2020

2020
[33]

Pekrun and M

R. Pekrun and M. B ¨uhner. Self-report measures of academic emotions. In International handbook of emotions in education , pages 561–579. Routledge, 2014

2014
[34]

Pekrun, T

R. Pekrun, T. Goetz, W. Titz, and R. P. Perry. Academic emotions in students’ self-regulated learning and achievement: A program of qualitative and quantitative research. Educational psychologist, 37(2):91–105, 2002

2002
[35]

Riener, S

G. Riener, S. Schneider, and V. Wagner. Addressing validity and generalizability concerns in field experiments. DICE Discussion Paper, 2020

2020
[36]

E. L. Rosenberg. Levels of analysis and the organization of affect. Review of general psychology , 2(3):247–270, 1998

1998
[37]

C. Sun, V. J. Shute, A. Stewart, J. Yonehiro, N. Duran, and S. D’Mello. Towards a generalized competency model of collaborative problem solving. Computers & Education , 143:103672, 2020

2020
[38]

M. K. Underwood. Peer social status and children’s understanding of the expression and control of positive and negative emotions. Merrill-Palmer Quarterly (1982-), pages 610–634, 1997

1982
[39]

VanderHoeven, M

H. VanderHoeven, M. Bradford, C. Jung, I. Khebour, K. Lai, J. Pustejovsky, N. Krishnaswamy, and N. Blanchard. Multimodal design for interactive collaborative problem-solving support. In International Conference on Human-Computer Interaction, pages 60–80. Springer, 2024

2024
[40]

Vrzakova, M

H. Vrzakova, M. J. Amon, A. Stewart, N. D. Duran, and S. K. D’Mello. Focused or stuck together: multimodal patterns reveal triads’ performance in collaborative problem solving. In Proceedings of the tenth international conference on learning analytics & knowledge, pages 295–304, 2020

2020
[41]

A. P. Zanesco, E. Denkova, and A. P. Jha. Mind-wandering increases in frequency over time during task performance: An individual-participant meta-analytic review. Psychological bulletin, 2024

2024

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.

[1] [1]

Here, we present initial experiments with retrospective cued recall paradigm for identifying cognitive-affective states of individ- uals in collaborative groups

INTRODUCTION Recently, researchers in educational data mining have been interested in modeling group dynamics in collaborative learn- ing environments to understand how students interact, learn, and solve problems together [29, 5, 21, 31, 32, 6]. Here, we present initial experiments with retrospective cued recall paradigm for identifying cognitive-affecti...

work page

[2] [2]

A Methodological Framework for Capturing Cognitive-Affective States in Collaborative Learning

RELA TED WORK Traditional methods of tracking cognitive-affective states in learning include self-reports [26, 25, 23, 11], think-aloud pro- tocols [8], and the use of behavioral observations by human coders [4, 9]. Self-reporting is where individuals provide information about their emotional experiences through sur- veys, questionnaires, or interviews [2...

work page Pith review arXiv 2009

[3] [3]

Confused

METHODS 3.1 Collaborative Task Experiments 3.1.1 Participants We recruited a total of 27 participants, organized into 9 groups of 3 individuals each. Participants were required to be at least 18 years old and able to speak in English. Re- cruitment efforts were focused in the department where the authors are appointed, and potential participants were in- ...

work page

[4] [4]

Optimistic

RESULTS Table 2: Statistics on the number of Labels of Cognitive- Affective States Reported All Labels Self-Caught Probe-Caught Total Count 359 129 230 Mean 13.30 4.78 8.52 SD 4.67 4.81 5.69 Table 2 shows the descriptive statistics on the number of labels of cognitive-affective states reported. Figure 3 shows the overall distribution of the 10 most freque...

work page 2025

[5] [5]

Optimistic

DISCUSSION The distribution of states was largely consistent between self-caught and probe-caught reports, with minor deviations. The prevalence of “Optimistic” and “Curious” reports may suggest that participants were in a neutral-engaged state [14], and co-opted one of these labels as the closest approx- imate for that state. In the original collection b...

work page

[6] [6]

Additionally, the results may not generalize to other collaborative learning tasks, and val- idation of a different task may be necessary to confirm find- ings [20]

LIMITA TIONS AND FUTURE WORK This study’s small dataset and broad category of labels in this study limited the scope of the analysis and the experi- ences of the participants [27]. Additionally, the results may not generalize to other collaborative learning tasks, and val- idation of a different task may be necessary to confirm find- ings [20]. The tempor...

work page

[7] [7]

CONCLUSION This study investigated a retrospective cued recall paradigm to capture cognitive-affective states in collaborative learn- ing, combining self-caught and probe-caught methods with retrospective video-stimulated recall. Our initial findings provide insights into the dynamics of these states and their distributions using different reporting metho...

work page

[8] [8]

Cotton and K

D. Cotton and K. Gresty. Reflecting on the think-aloud method for evaluating e-learning. British Journal of Educational Technology, 37(1):45–54, 2006

work page 2006