Abstract
A central challenge in LLM social agents and automated program repair is to compare studies whose mechanisms and validation settings do not share a single denominator. The present review uses a realistic benchmark centered on persistent LLM-based social-media agents and execution-grounded reinforcement learning with sequence- and line-level reward models as focal cases for a boundary-aware synthesis. The review draws on two focal records and 12 established sources already present in the project evidence cache. Its comparative framework links behavioral realism, memory, and interaction effects to downstream questions of safety and benchmark validity. The combined literature indicates that methodological gains become actionable only when behavioral realism and memory are evaluated together and when limits associated with benchmark validity are explicit. This shifts the emphasis from isolated scores toward traceable chains of evidence and decision relevance. The article concludes with a research agenda built around transparent comparators, targeted stress tests, and evidence records that can be reused without overstating causal or practical reach.
References
Xue, D., Cui, J., Qian, S., Hu, C., & Xu, C. (2026). SoMe: A Realistic Benchmark for LLM-based Social Media Agents. Proceedings of the AAAI Conference on Artificial Intelligence, 40(2), 1391-1399.
Li, Y., Wang, H., Shang, X., Tang, X., Cao, Y., & Chen, X. (2026). BoostAPR: Boosting Automated Program Repair via Execution-Grounded Reinforcement Learning with Dual Reward Models. arXiv preprint arXiv:2605.09134.
Lee, W. Y., Kim, J. H., Leem, J., Lee, B. W., Lee, S., & Kim, Y. W. (2026). Benchmark Evaluation of a Tool-Augmented Large Language Model Agent Using Traditional Asian Medicine Metadata. Applied Sciences, 16(7), 3377. https://doi.org/10.3390/app16073377
Hanna, C., Blot, A., & Petke, J. (2025). Reinforcement learning for mutation operator selection in automated program repair. Automated Software Engineering, 32(2). https://doi.org/10.1007/s10515-025-00501-z
Thomas J. Bennett,, Samuel K. O’Neill,, & Laura M. Harding, (2026). Multi-Agent Reinforcement Learning for Cooperative Large Language Model Collaboration. Global Media and Social Sciences Research Journal, 7(1), 225-233. https://doi.org/10.71465/gmssrj167
Kumar Karne, V., Noone Srinivas,, Nagaraj Mandaloju,, & Parameshwar Reddy Kothamali, (2020). Reinforcement Learning for Optimizing Test Case Execution in Automated Testing. Innovative Research Thoughts, 6(3), 13-27. https://doi.org/10.36676/irt.v6.i3.1494
Zhao, X., Lu, Y., Huang, H., Li, G., & Wang, C. (2026). A multi-agent large language model workflow for analyzing perceived cultural values from social media: A study of 141 Chinese cities. Cities, 175, 107232. https://doi.org/10.1016/j.cities.2026.107232
Hao, S., Shi, X., Liu, H., Yin, Y., & Chen, X. (2026). Template-guided interpretable reasoning with execution feedback for LLM-based program repair. Information and Software Technology, 193, 108058. https://doi.org/10.1016/j.infsof.2026.108058
Eunji Kwon,, Julien Simon,, & Noemie Duval, (2026). Large Language Model Based Investment Agents Under Long Horizon Market Evaluation: A Comprehensive Analytical Framework. Global Media and Social Sciences Research Journal, 7(1), 104-115. https://doi.org/10.71465/gmssrj191
Wan, H., Luo, H., Li, M., & Luo, X. (2024). Automated Program Repair for Introductory Programming Assignments. IEEE Transactions on Learning Technologies, 17, 1705-1720. https://doi.org/10.1109/tlt.2024.3403710
Yuan, D., Chen, Y., Liu, G., Li, C., Tang, C., Zhang, D., et al. (2025). DMT-RoleBench: A Dynamic Multi-Turn Dialogue Based Benchmark for Role-Playing Evaluation of Large Language Model and Agent. Proceedings of the AAAI Conference on Artificial Intelligence, 39(24), 25760-25768. https://doi.org/10.1609/aaai.v39i24.34768
Yin, Z., Lin, W., & Kong, X. (2026). Heterogeneous multi-expert collaborative reinforcement learning for automated CAD program synthesis from engineering drawings. Discover Artificial Intelligence. https://doi.org/10.1007/s44163-026-01731-0
Pi, W., & He, C. (2026). Reliability Evaluation of Large Language Models for Social Media Sentiment Annotation: An Empirical Study Based on Model Agreement and Downstream Tasks. Computers and Artificial Intelligence, 3(3), 193-199. https://doi.org/10.70267/cai.26v3n3.193199
Jha, A. C. (2025). Automated Firewall Policy Generation with Reinforcement Learning. International journal of IoT, 5(1), 190-211. https://doi.org/10.55640/ijiot-05-01-10

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Copyright (c) 2026 Heath Benson, Ivan Norton, Jake Walsh (Author)
