Pith. sign in

REVIEW 5 major objections 5 minor 67 references

Human-Centered Design for AI-based Automatically Generated Assessment Reports: A Systematic Review

T0 review · 5 major / 5 minor · reviewed 2026-08-10 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Automated assessment reports for K-12 STEM teachers underuse text, plots, and visual aids, and this review argues that this raises teachers' cognitive load.

desk verdict A useful descriptive framework for AutoRs, weakened by an unsupported causal claim and several concrete reporting errors that need fixing. read the letter →

arxiv 2501.00081 v1 pith:XWBLBI6I submitted 2024-12-30 cs.HC cs.CY

Ehsan Latif , Ying Chen , Xiaoming Zhai , Yue Yin This is my paper · ORCID
classification cs.HCcs.CY
keywords automaticallygeneratedassessmentreportscognitiveloadtheoryformativelearninganalyticsdashboardsK-12STEMeducationhuman-centereddesignAIinlatentclassanalysis
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that automatically generated assessment reports (AutoRs) for K-12 STEM teachers are designed in ways that create avoidable cognitive load: they favor tables and raw score data while underusing text summaries, plots, and visual aids that cognitive load theory predicts would ease interpretation. Guided by a proposed framework with three dimensions — cognitive demands, AI embodiment, and human-centered design — the authors reviewed 29 existing AutoRs and coded their features. Their evidence shows text-based formats appear in only 17% of AutoRs, while plots appear in 69% and special visual aids in 62%, yet these low-load formats remain underutilized relative to what the theory prescribes. The paper concludes that current AutoRs impose a high initial cognitive demand on teachers and proposes the framework as a design, implementation, and evaluation guide for future systems that balance usability against functionality.

What carries the argument

The carrying mechanism is a three-part conceptual framework for AutoR design built on cognitive load theory. The first dimension, cognitive demands, separates content from information synthesis level and depth of data mining; the second, human-centered design support, covers user functionality (live, collaborative, filtering) and information presentation (text, tables, plots, visual aids); the third, AI embodiment, tracks how AI is integrated and aligned with curricula. The framework operationalizes cognitive load as element interactivity — the number of elements teachers must hold together at once — and turns that theory into observable, codeable features. Latent class analysis then sorts the reviewed AutoRs into classes within these dimensions, giving the review its empirical structure.

What would settle it

Conduct a controlled usability study in which teachers interpret equivalent assessment results presented either as tables only or as text summaries with visual aids, measuring mental effort (e.g., NASA-TLX, dual-task performance, or eye tracking) and interpretation accuracy; if the table-only version does not produce higher measured cognitive load, the paper's central claim that current presentation choices drive high initial demands would be undercut.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is a gap: the design features most strongly associated with reducing teachers' extraneous cognitive load — connected text, explanatory plots, and special visual aids — are exactly the features least often found in the AutoRs reviewed. Most AutoRs present results as tables of individual and class-level scores with filtering, and most embed AI for reporting or administrative automation rather than for curriculum-aligned, teacher-facing interpretation. Using latent class analysis, the authors identify distinct design patterns — fully functional, information-highlighting, and live-feedback systems — and argue that the high-functionality classes add operational demands that offset some of their usability gains. The conclusion is that teachers' initial cognitive burden comes less from the information itself than from how it is presented, and that presentation choices are the most actionable design lever.

Load-bearing premise

The review assumes that a teacher's cognitive load can be inferred from the presence or absence of design features coded from public websites and developer descriptions, without directly measuring how much mental effort teachers actually experience.

Editorial extensions

If this is right

  • If design features drive extraneous load, then adding text summaries and explanatory visual aids to existing AutoRs should lower the initial effort teachers need to interpret results.
  • Designers can use the three-dimension framework as a checklist to decide whether a feature adds germane value or only extra extraneous load.
  • AutoRs that add live and collaborative functions should anticipate teaching new operational skills, since those features carry their own cognitive demands.
  • The underuse of text formats (17%) and the incomplete adoption of visual aids mark concrete room for improvement in commercial and research platforms.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct testable extension would be to measure teachers' actual workload (e.g., via self-report or dual-task measures) while using AutoRs from each latent class; the paper's claim predicts that Low-load classes yield lower measured mental effort.
  • The framework likely applies beyond K-12 STEM to higher education and non-STEM dashboards, since its coding categories are content-agnostic.
  • The paper implies that AI functions aligned with curriculum and personalized feedback matter more than raw automation, but it does not demonstrate a learning-outcome difference; comparing outcome gains across AI-function types is a natural next experiment.
  • There may be a tension between predicted cognitive load and teacher preference: teachers accustomed to tables may resist text-heavy alternatives even if those reduce mental effort, and the framework does not address preference.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. The paper proposes a human-centered design framework for automatically generated assessment reports (AutoRs) in K-12 STEM, grounded in cognitive load theory, and uses it to review publicly available AutoRs. The authors code each platform for content, synthesis level, depth of data mining, user functionality, information presentation, and AI integration; they report feature frequencies, apply latent class analysis (LCA) to identify design patterns, and conclude that text, plots, and visual aids are underutilized, which they argue leads to high initial cognitive demands and limited teacher engagement.

Significance. If accepted as a descriptive review, the paper makes a useful contribution: it offers a concrete, theory-grounded coding framework, applies it to 29 real platforms (a larger corpus than many dashboard reviews), and provides frequency data that directly support the underuse of text (17%) and the moderate uptake of plots and visual aids (69% and 62%). The LCA analysis adds a clustering perspective that could inform future design taxonomies. The main value is in the framework and the descriptive frequency results, not in the stronger causal claims about experienced cognitive load, which the study design cannot support.

major comments (5)
  1. [§4.1, §5.1, Table 3] The manuscript is internally inconsistent about the sample size. Section 4 says 29 AutoRs remained after screening, and Table 3's first row reports N=29, but §4.1 states that the analysis was conducted on 'the 26 AutoRs' and the Table 3 caption repeats '26.' Every percentage and LCA result depends on N, so the authors must reconcile this discrepancy and report the exact number of platforms analyzed.
  2. [Abstract, §7] The central claim that underuse of text, plots, and visual aids 'lead[s] to high initial cognitive demands and limited engagement' is not supported by the study design. Section 4.1 explains that coding was based on public websites, developer descriptions, and related publications; no teacher interacted with any AutoR, and no cognitive-load or engagement variable was measured. Feature presence or absence is at best a proxy for potential cognitive demand. The abstract and conclusion should be reframed as reporting a design-feature gap rather than an empirically demonstrated causal effect on teachers' cognitive load or engagement.
  3. [§5.2, Table 4] Table 4 is labeled as comparing four models but contains only three rows, and the text states that the 3-Class model 'achieves the lowest values for all three criteria,' which is false: the 3-Class BIC (913.5526) is higher than the 1-Class BIC (872.6305) and the 2-Class BIC (893.4405). The model comparison and the choice of the 3-Class solution need to be corrected and reported accurately, including any 4-Class row that may have been omitted.
  4. [§5.1] The three-tier classification is internally inconsistent with its own thresholds. The text defines elementary characteristics as appearing in more than 70% of AutoRs, optional as 40–70%, and advanced as less than 40%, yet timely performance (83%), class-level synthesis (79%), and descriptive statistics (83%) are listed as optional. Since this taxonomy is used in the Discussion to explain design trade-offs, the exemplars must either be moved to the correct tier or the definitions must be revised.
  5. [§4.1, §5.2–§5.4] The LCA reporting is insufficient for the weight placed on it. Section 4.1 says LCA is exploratory and that final classes were determined by researcher judgment, but Sections 5.2–5.4 present the class solutions as substantive findings without reporting class counts, entropy, item-response probabilities in tabular form, or the number of indicators in each model. Please provide the full LCA output needed for reproducibility and soften the definitive interpretation of the class solutions.
minor comments (5)
  1. [Figure 1 and Section 3.3] There are typographical errors in the figure caption and section headings, including 'dimentions,' 'intergration,' and 'alignmrnt.' These should be corrected.
  2. [§4.1] The reference 'Tab. ??' appears before the coding rubric is presented; the table number should be filled in.
  3. [§6] The Discussion refers to AutoRs being categorized into 'two groups: high cognitive load and low cognitive load,' but Section 5.2 identifies three classes. Please harmonize the terminology.
  4. [Table 5] In Table 5, the reported BIC values are lower than the AIC values for every model, which is atypical for the standard BIC formula; please verify that the fit statistics were extracted correctly from poLCA.
  5. [General] No list of the 29 included AutoRs or the raw coding matrix is provided. A supplementary appendix with the platform names and the complete coding decisions would substantially improve reproducibility.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; the review's frequency claims are self-contained and the cognitive-load interpretation is an external theory application, not a fitted prediction.

full rationale

The paper's derivation chain is a systematic review: it constructs a coding framework from cognitive load theory and prior dashboard research, applies that framework to 29 publicly available AutoRs, reports observed feature frequencies (Table 3), and uses latent class analysis to group systems by feature profiles. No parameter is fitted to a subset of data and then renamed as a prediction; the frequency claims (e.g., text 17%, plots 69%, visual aids 62%) are direct coding outcomes, not outputs of a model trained on those same codes. The central conclusion that text, plots, and visual aids are underutilized is a straightforward reading of the frequency table. The further claim that underuse 'lead[s] to high initial cognitive demands' is a theoretical interpretation grounded in external cognitive load research (e.g., Sweller; Clark et al.), not a circular derivation from the framework itself; whether that interpretation is empirically warranted is a validity question, not a circularity. The paper's many self-citations to prior work by the same authors are contextual and do not carry the load of the review's conclusions, which rest on the coded data and cited external theory. The N=29/N=26 inconsistency in Section 4.1 is an internal inconsistency, not evidence of circularity. No quoted step exhibits a definitional reduction of output to input, so the appropriate finding is no circularity.

Assumptions & free parameters 0 free parameters · 4 assumptions · 0 invented entities

The central claims rest on analytical assumptions about how to infer cognitive load from design features and on small-sample statistical modeling, not on free parameters or invented entities. The framework is an interpretive lens, so the key assumptions are domain assumptions about the validity of that lens.

assumptions (4)
  • domain assumption Cognitive load theory categories apply to teachers' interpretation of AutoRs.
    Section 3 grounds the framework in Sweller's cognitive load theory without empirical validation in this population.
  • ad hoc to paper Element interactivity can be operationalized as the amount, synthesis, and depth of features in a report.
    Section 3 defines element interactivity in terms of content, synthesis level, and data-mining depth; this is a novel operationalization that is not independently validated.
  • domain assumption Public website descriptions and GUIs reliably indicate the actual design and use of an AutoR.
    Section 4 says coding was based on official sources and developer descriptions; no usability testing or teacher interviews were used.
  • domain assumption Latent class analysis on a sample of 26 to 29 systems yields stable and meaningful classes.
    Section 5 applies LCA with very small sample sizes and selects classes partly by researcher interpretation; stability is not demonstrated.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Human-Centered Design for AI-based Automatically Generated Assessment Reports: A Systematic Review." pith.science (2026). https://pith.science/paper/XWBLBI6I

@misc{pith2026250100081,
  author       = {Pith},
  title        = {Pith review of: Human-Centered Design for AI-based Automatically Generated Assessment Reports: A Systematic Review},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/XWBLBI6I}},
  note         = {Machine review of arXiv:2501.00081}
}
read the original abstract

This paper provides a comprehensive review of the design and implementation of automatically generated assessment reports (AutoRs) for formative use in K-12 Science, Technology, Engineering, and Mathematics (STEM) classrooms. With the increasing adoption of technology-enhanced assessments, there is a critical need for human-computer interactive tools that efficiently support the interpretation and application of assessment data by teachers. AutoRs are designed to provide synthesized, interpretable, and actionable insights into students' performance, learning progress, and areas for improvement. Guided by cognitive load theory, this study emphasizes the importance of reducing teachers' cognitive demands through user-centered and intuitive designs. It highlights the potential of diverse information presentation formats such as text, visual aids, and plots and advanced functionalities such as live and interactive features to enhance usability. However, the findings also reveal that many existing AutoRs fail to fully utilize these approaches, leading to high initial cognitive demands and limited engagement. This paper proposes a conceptual framework to inform the design, implementation, and evaluation of AutoRs, balancing the trade-offs between usability and functionality. The framework aims to address challenges in engaging teachers with technology-enhanced assessment results, facilitating data-driven decision-making, and providing personalized feedback to improve the teaching and learning process.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

67 extracted references · 50 canonical work pages

  1. [1]

    write newline

    " write newline " cite write " FUNCTION editor.postfix editor num.names #1 > "( )" "( )" if FUNCTION editor.trans.postfix editor num.names #1 > "( )" "( )" if FUNCTION trans.postfix translator num.names #1 > "( )" "( )" if FUNCTION authors.editors.reflist.apa5 'field := 'dot := field num.names 'numnames := numnames 'format.num.names := format.num.names na...

  2. [2]

    , " * write output.state after.block = add.period write newline

    ENTRY address author booktitle chapter doi edition editor eid howpublished institution journal key keywords month note number organization pages publisher school series title type url volume year eprint archive archivePrefix primaryClass adsurl adsnote version label INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION init.sta...

  3. [3]

    write newline

    " write newline "" before.all 'output.state := FUNCTION if.digit duplicate "0" = swap duplicate "1" = swap duplicate "2" = swap duplicate "3" = swap duplicate "4" = swap duplicate "5" = swap duplicate "6" = swap duplicate "7" = swap duplicate "8" = swap "9" = or or or or or or or or or FUNCTION n.separate 't := "" #0 'numnames := t empty not t #-1 #1 subs...

  4. [4]

    Aljohani, N.R. and H.C. Davis 2013. Learning analytics and formative assessment to provide immediate detailed feedback using a student centered mobile dashboard. In 2013 Seventh international conference on next generation mobile apps, services and technologies , pp.\ 262--267. IEEE

    work page 2013

  5. [5]

    Conte, C

    Barana, A., A. Conte, C. Fissore, M. Marchisio, S. Rabellino, et al. 2019. Learning analytics to improve formative assessment strategies. JE-LKS. Journal of e-learning and knowledge society\/ 15\/ (3): 75--88

    work page 2019

  6. [6]

    Foster, and J.E

    Borrego, M., M.J. Foster, and J.E. Froyd. 2014. Systematic literature reviews in engineering education and other developing interdisciplinary fields. Journal of Engineering Education\/ 103\/ (1): 45--76

    work page 2014

  7. [7]

    Mackinlay, and B

    Card, S.K., J. Mackinlay, and B. Shneiderman. 1999. Readings in information visualization: using vision to think . Morgan Kaufmann

    work page 1999

  8. [8]

    Flynn, E.S

    Carroll, A., L. Flynn, E.S. O’Connor, K. Forrest, J. Bower, S. Fynes-Clinton, A. York, and M. Ziaei. 2021. In their words: listening to teachers’ perceptions about stress in the workplace and how to address it. Asia-Pacific Journal of Teacher Education\/ 49\/ (4): 420--434

    work page 2021

Show all 67 references
  1. [9]

    Chen, F., J. Zhou, Y. Wang, K. Yu, S.Z. Arshad, A. Khawaji, and D. Conway. 2016. Robust multimodal cognitive load measurement . Springer

    2016

  2. [10]

    Chen, W. 2017. Knowledge convergence among pre-service mathematics teachers through online reciprocal peer feedback. Knowledge Management & E-Learning\/ 9\/ (1): 1--18

    2017

  3. [11]

    Nguyen, and J

    Clark, R.C., F. Nguyen, and J. Sweller. 2011. Efficiency in learning: Evidence-based guidelines to manage cognitive load . John Wiley & Sons

    2011

  4. [12]

    DeStefano, D. and J.A. LeFevre. 2007. Cognitive load in hypertext reading: A review. Computers in human behavior\/ 23\/ (3): 1616--1641

    2007

  5. [13]

    Duval, E. 2011. Attention please! learning analytics for visualization and recommendation. In Proceedings of the 1st international conference on learning analytics and knowledge , pp.\ 9--17

    2011

  6. [14]

    Martinez-Maldonado, S.B

    Echeverria, V., R. Martinez-Maldonado, S.B. Shum, K. Chiluiza, R. Granda, and C. Conati. 2018. Exploratory versus explanatory visual learning analytics: Driving teachers’ attention through educational data storytelling. Journal of Learning Analytics\/ 5\/ (3): 73--97

    2018

  7. [15]

    Garc \' a-Pe \ n alvo, F.J. 2020. Learning analytics as a breakthrough in educational improvement. Radical Solutions and Learning Analytics: Personalised Learning and Teaching Through Big Data\/ : 1--15

    2020

  8. [16]

    Bradford, and M.C

    Gerard, L., A. Bradford, and M.C. Linn. 2022. Supporting teachers to customize curriculum for self-directed learning. Journal of Science Education and Technology\/ 31\/ (5): 660--679

    2022

  9. [17]

    Latif, Y

    Guo, S., E. Latif, Y. Zhou, X. Huang, and X. Zhai. 2024. Using generative ai and multi-agents to provide automatic feedback. arXiv preprint arXiv:2411.07407\/

    2024 arXiv

  10. [18]

    Hofmann, M

    Hollender, N., C. Hofmann, M. Deneke, and B. Schmitz. 2010. Integrating cognitive load theory and concepts of human--computer interaction. Computers in human behavior\/ 26\/ (6): 1278--1288

    2010

  11. [19]

    Gabriele, and K

    Joram, E., A.J. Gabriele, and K. Walton. 2020. What influences teachers’“buy-in” of research? teachers’ beliefs about the applicability of educational research to their practice. Teaching and Teacher Education\/ 88\/ (102980): 1--12

    2020

  12. [20]

    Chejara, L.P

    Kasepalu, R., P. Chejara, L.P. Prieto, and T. Ley. 2022. Do teachers find dashboards trustworthy, actionable and useful? a vignette study using a logs and audio dashboard. Technology, Knowledge and Learning\/ 27\/ (3): 971--989

    2022

  13. [21]

    Paas, and P.A

    Kirschner, F., F. Paas, and P.A. Kirschner. 2009. A cognitive load approach to collaborative learning: United brains for complex tasks. Educational psychology review\/ 21: 31--42

    2009

  14. [22]

    Latson, Q

    Lamar, C., V. Latson, Q. Brown, L. Jackson, and G. Fink 2013. Using a dashboard as a visualization tool for assessment data. In Proceedings of the International Conference on Frontiers in Education: Computer Science and Computer Engineering (FECS) , pp.\ 1. The Steering Commit...

    2013

  15. [23]

    Parasuraman, and X

    Latif, E., R. Parasuraman, and X. Zhai 2024. Physicsassistant: An llm-powered interactive learning robot for physics lab investigations. In 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN) , pp.\ 864--871

    2024

  16. [24]

    Latif, E. and X. Zhai 2024a. Automatic scoring of students' science writing using hybrid neural network. In AAAI Workshop on Artificial Intelligence for Education , pp.\ 1--13. PMLR

  17. [25]

    Latif, E. and X. Zhai. 2024b. Fine-tuning chatgpt for automatic scoring. Computers and Education: Artificial Intelligence\/ 6: 100210

  18. [26]

    Latif, E., X. Zhai, H. Amerman, and X. He. 2024. Ai-scorer: An artificial intelligence-augmented scoring and instruction system, In Uses of Artificial Intelligence in STEM Education , eds. Zhai, X. and J. Karjcik, Chapter 13. Oxford University Press

    2024

  19. [27]

    Zhai, and L

    Latif, E., X. Zhai, and L. Liu. 2023. Ai gender bias, disparities, and fairness: Does training data matter? arXiv preprint arXiv:2312.10833\/

    2023 arXiv

  20. [28]

    Latif, E., Y. Zhou, S. Guo, L. Shi, Y. Gao, M. Nyaaba, A. Bewerdorff, X. Yang, and X. Zhai. 2024. Can openai o1 outperform humans in higher-order cognitive thinking? arXiv preprint arXiv:2412.05753\/

    2024 arXiv

  21. [29]

    Latif, L

    Lee, G.G., E. Latif, L. Shi, and X. Zhai. 2023. Gemini pro defeated by gpt-4v: Evidence from education. arXiv preprint arXiv:2401.08660\/

    2023 arXiv

  22. [30]

    Latif, X

    Lee, G.G., E. Latif, X. Wu, N. Liu, and X. Zhai. 2024. Applying large language models and chain-of-thought for automatic scoring. Computers and Education: Artificial Intelligence\/ 6: 100213

    2024

  23. [31]

    Linzer, D.A. and J.B. Lewis. 2011. polca: An r package for polytomous variable latent class analysis. Journal of Statistical Software\/ 42\/ (10): 1--29

    2011

  24. [32]

    Liu, O.L., J.A. Rios, M. Heilman, L. Gerard, and M.C. Linn. 2016. Validation of automated scoring of science assessments. Journal of Research in Science Teaching\/ 53\/ (2): 215--233

    2016

  25. [33]

    Kroparo, and A

    Michaeli, S., D. Kroparo, and A. Hershkovitz. 2020. Teachers’ use of education dashboards and professional growth. International Review of Research in Open and Distributed Learning\/ 21\/ (4): 61--78

    2020

  26. [34]

    Graf, and N.S

    Mottus, A., Kinshuk, S. Graf, and N.S. Chen. 2015. Use of dashboards and visualization techniques to support teacher decision making. Ubiquitous learning environments and technologies\/ : 181--199

    2015

  27. [35]

    Narciss, S. 2008. Feedback strategies for interactive learning tasks, Handbook of research on educational communications and technology , 125--143. Routledge

    2008

  28. [36]

    Nyland, R. 2018. A review of tools and techniques for data-enabled formative assessment. Journal of Educational Technology Systems\/ 46\/ (4): 505--526

    2018

  29. [37]

    Nylund-Gibson, K. and A.Y. Choi. 2018. Ten frequently asked questions about latent class analysis. Translational Issues in Psychological Science\/ 4\/ (4): 440

    2018

  30. [38]

    Panjwani-Charania, S. and X.a. Zhai. 2023. Ai for students with learning disabilities: A systematic review. pp.\ 471--495

    2023

  31. [39]

    Podgorelec, V. and S. Kuhar. 2011. Taking advantage of education data: Advanced data analysis and reporting in virtual learning environments. Elektronika ir Elektrotechnika\/ 114\/ (8): 111--116

    2011

  32. [40]

    Rodriguez-Triana, A

    Schwendimann, B.A., M.J. Rodriguez-Triana, A. Vozniuk, L.P. Prieto, M.S. Boroujeni, A. Holzer, D. Gillet, and P. Dillenbourg. 2016. Perceiving learning at a glance: A systematic literature review of learning dashboard research. IEEE transactions on learning technologies\/ 10\/...

    2016

  33. [41]

    Mannens, and K

    Sedrakyan, G., E. Mannens, and K. Verbert. 2019a. Guiding the choice of learning dashboard visualizations: Linking dashboard design and data visualization concepts. Journal of Computer Languages\/ 50: 19--38

  34. [42]

    Mannens, and K

    Sedrakyan, G., E. Mannens, and K. Verbert. 2019b, February. Guiding the choice of learning dashboard visualizations: Linking dashboard design and data visualization concepts. Journal of Computer Languages\/ 50: 19--38

  35. [43]

    Shemshack, A. and J.M. Spector. 2020. A systematic literature review of personalized learning terms. Smart Learning Environments\/ 7\/ (1): 33

    2020

  36. [44]

    Skulmowski, A. and K.M. Xu. 2022. Understanding cognitive load in digital and online learning: A new perspective on extraneous cognitive load. Educational psychology review\/ 34\/ (1): 171--196

    2022

  37. [45]

    Spector, J. and M.D. Merrill. 2008. Editorial: Effective, efficient and engaging (e3) learning in the digital age. Distance Education\/ 29\/ (2): 123--126

    2008

  38. [46]

    Ifenthaler, D

    Spector, J.M., D. Ifenthaler, D. Sampson, L.J. Yang, E. Mukama, A. Warusavitarana, K.L. Dona, K. Eichhorn, A. Fluck, R. Huang, et al. 2016. Technology enhanced formative assessment for 21st century learning. Journal of educational technology & society\/ 19\/ (3): 58--71

    2016

  39. [47]

    Sweller, J. 2016. Working memory, long-term memory, and instructional design. Journal of Applied Research in Memory and Cognition\/ 5\/ (4): 360--367

    2016

  40. [48]

    Sweller, J. 2020. Cognitive load theory and educational technology. Educational Technology Research and Development\/ 68\/ (1): 1--16

    2020

  41. [49]

    van Merri \"e nboer, and F

    Sweller, J., J.J. van Merri \"e nboer, and F. Paas. 2019. Cognitive architecture and instructional design: 20 years later. Educational psychology review\/ 31: 261--292

    2019

  42. [50]

    Govaerts, E

    Verbert, K., S. Govaerts, E. Duval, J.L. Santos, F. Van Assche, G. Parra, and J. Klerkx. 2014. Learning dashboards: an overview and future research opportunities. Personal and Ubiquitous Computing\/ 18: 1499--1514

    2014

  43. [51]

    Ochoa, R

    Verbert, K., X. Ochoa, R. De Croon, R.A. Dourado, and T. De Laet 2020. Learning analytics dashboards: The past, the present and the future. In Proceedings of the tenth international conference on learning analytics & knowledge , pp.\ 35--40

    2020

  44. [52]

    Saraf, G.G

    Wu, X., P.P. Saraf, G.G. Lee, E. Latif, N. Liu, and X. Zhai. 2024. Unveiling scoring processes: Dissecting the differences between llms and human graders in automatic scoring. arXiv preprint arXiv:2407.18328\/

    2024 arXiv

  45. [53]

    Xu, W. and K. Zammit. 2020. Applying thematic analysis to education: A hybrid approach to interpreting data in practitioner research. International journal of qualitative methods\/ 19: 1609406920918810

    2020

  46. [54]

    Yigitbasioglu, O.M. and O. Velcu. 2012. A review of dashboards in performance management: Implications for design and research. International Journal of Accounting Information Systems\/ 13\/ (1): 41--59

    2012

  47. [55]

    Lee, I.H

    Yoo, Y., H. Lee, I.H. Jo, and Y. Park 2015. Educational dashboards for smart learning: Review of case studies. In Emerging issues in smart learning , pp.\ 145--155. Springer

    2015

  48. [56]

    Zhai, X. 2021. Practices and theories: How can machine learning assist in innovative assessment practices in science education. Journal of Science Education and Technology\/ 30\/ (2): 139--149

    2021

  49. [57]

    He, and J

    Zhai, X., P. He, and J. Krajcik. 2022. Applying machine learning to automatically assess scientific models. Journal of Research in Science Teaching\/ 59\/ (10): 1765--1794

    2022

  50. [58]

    Zhai, X. and E. Wiebe. 2023. Technology-based innovative assessment. Classroom-based STEM assessment\/ : 99--125

    2023

  51. [59]

    , " * write output.state after.block = add.period write newline

    ENTRY address archive author booktitle chapter doi edition editor eid eprint howpublished institution journal key keywords month note number organization pages publisher school series title type url volume year archivePrefix primaryClass adsurl adsnote version label extra.labe...

  52. [60]

    write newline

    " write newline "" before.all 'output.state := FUNCTION add.period duplicate empty 'skip "." * add.blank if FUNCTION if.digit duplicate "0" = swap duplicate "1" = swap duplicate "2" = swap duplicate "3" = swap duplicate "4" = swap duplicate "5" = swap duplicate "6" = swap dupl...

  53. [61]

    write newline

    " write newline "" before.all 'output.state := FUNCTION output.doi doi empty skip "doi:" doi * "" * output if FUNCTION format.archive archivePrefix empty "" archivePrefix ":" * if FUNCTION format.primaryClass primaryClass empty "" " [" primaryClass * "] " * if FUNCTION format....

  54. [62]

    write newline

    " write newline "" before.all 'output.state := FUNCTION string.to.integer 't := t text.length 'k := #1 'char.num := t char.num #1 substring 's := s is.num s "." = or char.num k = not and char.num #1 + 'char.num := while char.num #1 - 'char.num := t #1 char.num substring FUNCTI...

  55. [63]

    write newline

    " write newline "" before.all 'output.state := FUNCTION string.to.integer 't := t text.length 'k := #1 'char.num := t char.num #1 substring 's := s is.num s "." = or char.num k = not and char.num #1 + 'char.num := while char.num #1 - 'char.num := t #1 char.num substring FUNCTI...

  56. [64]

    , " * write output.state after.block = add.period write newline

    ENTRY address archive author booktitle chapter edition editor eprint howpublished institution journal key keywords month note number organization pages publisher school series title type url doi volume year archivePrefix primaryClass eid adsurl adsnote version label INTEGERS o...

  57. [65]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

  58. [66]

    Available from:

    ENTRY address assignee author booktitle chapter cartographer day edition editor howpublished institution inventor journal key keywords month note number organization pages part publisher school series title type volume word year eprint doi url lastchecked updated archive archi...

  59. [67]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.