Technology Enhanced Learning
This scholarly programme highlights the increasing role of technology in enhancing learning and assessment in healthcare education. Artificial intelligence-based assessments and automated video analytics are emerging tools that offer more objective and scalable evaluation of technical skills, though they require further research to refine their use and effectiveness. The MyPsych Toolkit exemplifies how digital platforms can support medical education by providing accessible, user-friendly resources, demonstrating the potential of technology to improve learning outcomes and resource accessibility across different medical specialties.
AI Based Assessment
Technical skills assessment: The expert versus the algorithm
This article explores the growing use of artificial intelligence-based assessment (AIBA) in healthcare education, particularly for evaluating technical skills. While expert-based assessment (EBA) is commonly used, AIBA offers potential advantages, such as improved efficiency and cost-effectiveness. Studies have shown correlations between AIBA and EBA, suggesting AIBA's ability to assess technical proficiency, though it lacks the ability to provide detailed feedback. A hybrid approach combining both methods may be most effective. Despite limitations, such as reduced context awareness and challenges with validity and implementation, AIBA is likely to become more prevalent in technical skills assessment.
Identifying novel metrics of operative performance in surgical training: protocol for a Delphi consensus study
This study aims to identify the most relevant objective performance metrics for surgical trainees and determine how they should be applied in training. Traditional assessment methods are time-consuming and prone to bias, while digital technology offers more objective, scalable measures of operative performance. A three-round electronic Delphi study will gather input from trainees, trainers, researchers, and institutions to reach consensus on these metrics.
Automated analysis of operative video in surgical training: Scoping review
This scoping review explores the use of automated video analytics in surgical training, identifying 13 studies that applied this technology to assess trainee-performed operations. Most studies used computer vision tracking to generate metrics on instrument movement and operation phases, with some evaluating critical safety elements. Automated metrics successfully distinguished skill levels and correlated with traditional assessments. However, there is a lack of research on the long-term impact of these tools on training outcomes, indicating a need for further investigation.
Digital Platform Development
The MyPsych Foundation Doctors Toolkit: Your one-stop-shop for digital psychiatry support
(link to: The MyPsych Foundation Doctors Toolkit: your one-stop-shop f (nes.digital))
The NHS Lothian team developed a "MyPsych Foundation Doctors Toolkit" to provide accessible, reliable mental health resources aligned with the UK Foundation Programme Curriculum. Using an action research methodology, the toolkit was iteratively improved based on user feedback and data analysis. It offers concise information on mental health emergencies, psychiatric conditions, legal forms, and wellbeing resources, designed for non-psychiatrist clinicians. Since its launch, over 1,100 users have found it helpful and user-friendly. The toolkit is available as an app and online, with further promotion and development planned.
