Other ways to search: Events Calendar | UTHSC | UTHSC News

Assessing with Artificial Intelligence

|

Reviewed:
May 28, 2025

First Published:
November 26, 2024

 

AI is reshaping assessment in health science education, providing tools for personalized, precise evaluations that help identify learner strengths and areas for improvement. While AI can enhance formative assessment, relying on it too heavily may limit the development of critical thinking and adaptability—skills essential for healthcare practice. Educators play a key role in maintaining the integrity of assessment by combining AI tools with sound instructional practices and the human connection that supports meaningful learning. This shift redefines their role—from delivering content to guiding students in navigating, analyzing, and applying information within AI-supported, team-based environments. When used with intention, AI can strengthen learning and support professional growth without compromising educational quality.

 
Use the comments section below to let us know your ideas about assessing with artificial intelligence.

  • As AI tools reshape assessment practices, it’s essential to ground their use in strong teaching principles, ethical considerations, and faculty readiness. Recent research highlights that effective integration of AI depends on reimagining assessment design in ways that promote self-regulated learning, academic integrity, and holistic student development — not just automation.

    • Xia, Q., Weng, X., Ouyang, F. et al. (2024). A scoping review on how generative artificial intelligence transforms assessment in higher education. International Journal of Educational Technology in Higher Education, 21, 40. https://doi.org/10.1186/s41239-024-00468-z

  • AI can enhance assessment in health sciences education by providing timely, adaptive feedback, but its value depends on thoughtful integration. In health professions education, aligning AI tools with sound pedagogy and ethical practice ensures they support — not replace — the expertise and human connection that educators bring.

    • Masters, K., MacNeil, H., Benjamin, J., Carver, T., Nemethy, K., Valanci-Aroesty, S., Taylor, D., Thoma, B. & Thesen, T. (2025): Artificial Intelligence in Health Professions Education assessment: AMEE Guide No. 178, Medical Teacher, 1-15. http://doi: 10.1080/0142159X.2024.2445037

  • AI is highly effective in facilitating formative assessments, but its improper application can prevent students from identifying and addressing their own weaknesses, thereby limiting the learning that emerges from grappling with uncertainty and diverse thought processes.

    • Mitra, N.K., Chitra, E., Wong, P.S., Sow, C.F., Abd Razak, S., Er, H., & Nadarajah, V. (2023). Artificial Intelligence: Opportunities and Challenges in Health Professions Education. International e-Journal of Science Medicine & Education. 17. 2-8. https://doi.org/10.56026/imu.17.3.2

  • As AI becomes embedded in healthcare education, interprofessional training must evolve to prepare learners for collaborative, tech-enhanced environments. Research shows that integrating AI into interprofessional curricula fosters adaptive, team-based skills and prepares students to critically assess and apply information across disciplines — a shift essential for modern, patient-centered care.

    • Connolly, C., Hernon, O., & Walsh, J. C. (2023). Artificial Intelligence in Interprofessional Healthcare Practice Education: Insights from the Home Health Project, an Exemplar for Change. Computers in the Schools, 40(4), 412-429. https://doi.org/10.1080/07380569.2023.2247393

  • Reflect on the challenges and opportunities AI presents for educators and decide how you will address AI in your assignments and assessments. 
  • Shift the focus from knowledge recall to higher-order skills and competency-based assessment. 
  • Develop authentic assessments that evaluate skills and consider if you want to discourage its use or incorporate AI knowledge, skills, and ethical understanding in your assessments. 
  • Leverage AI to enhance assessment processes and feedback
  • Consider alternative strategies to traditional assessments for learning (formative) and of learning (summative). 
  •