L. Meyer, A. Dannecker
University of Applied Sciences and Arts Northwestern Switzerland FHNW (SWITZERLAND)
The integration of generative AI into education presents transformative opportunities to enhance learning tools and certification preparation processes. This paper explores the creation and evaluation of a question bank designed to prepare candidates for the IPMA Level D Project Management certification. Using generative AI, particularly ChatGPT, a comprehensive set of questions was developed from a 383-page study book encompassing 29 chapters. Questions include open-ended and single-choice formats, crafted to align with certification learning objectives while providing detailed explanations and references.
While the process of creating the question bank is briefly outlined, the focus shifts to evaluating its impact on participants. Two key outcomes are assessed: perceived effectiveness of the question bank and actual performance results in the certification. Participants will rate the quality of the questions in terms of clarity, relevance, difficulty, structural coherence, and interactivity. Additionally, they will reflect on their preparedness and engagement with the material. An end-of-training assessment will gather insights into satisfaction levels and areas for improvement, ensuring feedback loops for future refinement.
The second phase evaluates certification outcomes, comparing participants’ exam results to gauge the effectiveness of the preparation tool. Insights include correlations between user feedback and exam success rates, providing a robust measure of the question bank's practical utility. Further examination considers the scalability of this approach for broader educational and certification contexts.
Additional aspects for exploration include:
- The balance between AI-generated question complexity and pedagogical effectiveness.
- User experiences in navigating and interacting with the digital platform.
- Insights into generative AI's role in fostering active learning and critical thinking.
By combining user feedback with objective performance metrics, this study provides actionable recommendations for leveraging generative AI to create high-quality, interactive learning tools for certification programs. These findings contribute to ongoing discussions on the potential of AI in education and its role in reshaping the future of learning.
Keywords: Generative AI, IPMA Level D Certification, Question Bank Evaluation, Learning Effectiveness, AI in Education, Participant Assessment, Feedback Analysis, Exam Preparation, Pedagogical Design, Emerging Educational Technologies.