EduQuest: Evaluating Pedagogical Impact and User Experience of an AI-Powered Real-Time Quiz Platform

This paper evaluated the impact of EduQuest, a real-time AI-powered quiz platform, in higher education and found significant improvements in both educator efficiency and student engagement. The study showed a 74.3% reduction in quiz preparation time, 37.9% lower educator cognitive load, 68.2% higher student session completion rate, and a 19.4% improvement in knowledge retention after 72 hours. The platform also achieved an excellent usability score of 81.6 on the System Usability Scale. These findings indicate that AI-assisted gamified assessment systems can effectively reduce educator workload while improving student participation and learning outcomes. Future work includes conducting long-term studies, expanding to non-engineering disciplines, comparing AI-generated and manual questions, adding adaptive difficulty features, and integrating advanced learning analytics dashboards.

[1] D. Nicol and D. Macfarlane-Dick, "Formative assessment and self-regulated learning: A model and seven principles of good feedback practice," Studies in Higher Education, vol. 31, no. 2, pp. 199–218, Apr. 2006. [2] L. Chen, P. Chen, and Z. Lin, "Artificial intelligence in education: A review," IEEE Access, vol. 8, pp. 75264–75278, 2020. [3] M. Prensky, "Digital natives, digital immigrants," On the Horizon, vol. 9, no. 5, pp. 1–6, Oct. 2001. [4] Y. Chaiyo and R. Nokham, "The effect of Kahoot, Quizizz, and Google Forms on the student perception in the classrooms," in Proc. Int. Conf. on Digital Arts, Media and Technology (ICDAMT), Chiang Mai, Thailand, 2017, pp. 178–182. [5] Google AI, "Gemini API Documentation," Google for Developers, 2024. [Online]. Available: https://ai.google.dev/docs [6] E. Kochmar et al., "Automated personalized feedback improves learning gains in an intelligent tutoring system," in Proc. Int. Conf. on Artificial Intelligence in Education (AIED), Online, 2021, pp. 140–146. [7] S. G. Hart and L. E. Staveland, "Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research," Advances in Psychology, vol. 52, pp. 139–183, 1988. [8] J. Brooke, "SUS: A quick and dirty usability scale," in Usability Evaluation in Industry, P. W. Jordan et al., Eds. London: Taylor and Francis, 1996, pp. 189–194. [9] J. Sweller, "Cognitive load during problem solving: Effects on learning," Cognitive Science, vol. 12, no. 2, pp. 257–285, Apr. 1988. [10] F. Paas, A. Renkl, and J. Sweller, "Cognitive load theory and instructional design: Recent developments," Educational Psychologist, vol. 38, no. 1, pp. 1–4, Mar. 2003.