Keywords
longitudinal emotion
learner experience
discussion forums
discourse measurement
educational analytics
Abstract
What evidence is needed to determine how affiliation and emotion evolve during a course and what those trends can legitimately reveal about learner experience? This review answers by treating longitudinal discourse measurement as a property of a sociotechnical workflow rather than a feature that can be read from average accuracy. The focal setting is discussion forums from large open online courses whose participation and language change over time, where behavioral traces are selective and explanations can be persuasive without being faithful to the decision process. Evidence from the assigned publications is synthesized with foundational studies of calibration, distribution shift, causal structure, and responsible deployment. Four requirements follow: preserve the lineage of discussion text, interaction sequences, item attributes, explanation pools, temporal context, and user feedback; measure stability across relevant perturbations; connect confidence to a specific action; and maintain a route for human challenge and correction. The framework distinguishes descriptive performance from decision utility and separates uncertainty about the world from uncertainty created by the model and its evaluator. It also shows why faster inference or richer reasoning is valuable only when it improves a defined decision under a transparent resource budget. The article is a literature review and research agenda, not a report of a newly completed trial.
References
Hu, Jing, et al. “Temporal Changes in Affiliation and Emotion in MOOC Discussion Forum Discourse.” Artificial Intelligence in Education, edited by Carolyn Penstein Rosé et al., Springer, 2018, pp. 145–49, https://doi.org/10.1007/978-3-319-93846-2_26.
Ribeiro, Marco Tulio, Sameer Singh, and Carlos Guestrin. “Why Should I Trust You?: Explaining the Predictions of Any Classifier.” Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 1135–44.
Lundberg, Scott M., and Su-In Lee. “A Unified Approach to Interpreting Model Predictions.” Advances in Neural Information Processing Systems, vol. 30, 2017.
Selbst, Andrew D., et al. “Fairness and Abstraction in Sociotechnical Systems.” Proceedings of the Conference on Fairness, Accountability, and Transparency, 2019, pp. 59–68.
Siemens, George, and Ryan S. J. d. Baker. “Learning Analytics and Educational Data Mining: Towards Communication and Collaboration.” Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, 2012, pp. 252–54.
Kizilcec, René F., Chris Piech, and Emily Schneider. “Deconstructing Disengagement: Analyzing Learner Subpopulations in Massive Open Online Courses.” Proceedings of the Third International Conference on Learning Analytics and Knowledge, 2013, pp. 170–79.
Rosé, Carolyn Penstein, et al. “Social Factors That Contribute to Attrition in MOOCs.” Proceedings of the First ACM Conference on Learning at Scale, 2014, pp. 197–98.
Blei, David M., Andrew Y. Ng, and Michael I. Jordan. “Latent Dirichlet Allocation.” Journal of Machine Learning Research, vol. 3, 2003, pp. 993–1022.
Rabiner, Lawrence R. “A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition.” Proceedings of the IEEE, vol. 77, no. 2, 1989, pp. 257–86.
Hidasi, Balázs, et al. “Session-Based Recommendations with Recurrent Neural Networks.” International Conference on Learning Representations, 2016.
Kang, Wang-Cheng, and Julian McAuley. “Self-Attentive Sequential Recommendation.” 2018 IEEE International Conference on Data Mining, 2018, pp. 197–206.