Use of AI in ePortfolio
RCPCH ePortfolio is the platform that paediatric doctors use to record their learning and monitor progress.
GAIT is being used more frequently in academic and professional writing to perform tasks, including reflections and when contributing to MSF (Multi-Source Feedback), such that very similar pieces are being seen within ePortfolios.
We recognise that it is neither possible nor desirable to mandate that doctors should never use AI for ePortfolio entries. AI can be a useful tool to support aspects of personal and educational development, including to plan written reflections, improve clarity and streamline language.
Using AI safely, effectively and critically is a skill that all doctors need to develop, and this includes appropriate use of AI in recording and reflecting on training.
ePortfolio users do not need to declare their use of AI, with the understanding they abide by the general principles of ePortfolio such as probity.
Reflection
Reflective practice is a key element of training in medical education and is a significant part of revalidation both during training and as a consultant. Doctors are expected to demonstrate their ability to be a reflective practitioner by developing both written and verbal reflection skills. AI should only be considered as a supplement to writing skills and not as a substitute.
There are no hard and fast rules on how to reflect and we recognise that all doctors may reflect differently (General Medical Council (GMC) ‘The Reflective Practitioner’). However, at its core, reflection must be meaningful and demonstrate insight and learning. Trainers must ensure that doctors in training are able to develop and demonstrate reflective practice and support that development where needed.
Governance
Most AI platforms (including the models they are based on) operate by retraining their model based on user data and submissions. On occasion, this can lead to sharing of data that should be confidential and its use in such may breach privacy and contribute to perpetuating bias and harmful stereotypes. Users of AI should be aware of the risk of using unoriginal or plagiarised content.
Environmental considerations
It is increasingly recognised that generative AI tools have a significant carbon footprint. This varies according to the tools used and is an area of developing knowledge, but it a factor which should be considered.
Principles
- All ePortfolio entries with clinical content must relate to real events and cases which the doctor in training has experienced/engaged with. This includes all development log entries, skills logs and assessments along with work-based assessments.
- While AI might help with creating an outline for reflection, using AI to create artificial patient encounters or to take a purely mechanistic ‘cut and paste’ approach to ePortfolio entries risks raising concerns surrounding probity.
- Educational supervisors should explore reflective ePortfolio entries with their supervisee during supervision meetings and should routinely discuss reflection and encourage verbal reflection, an essential skill for trainees.
- Verbal reflection is particularly important for trainees to process, reflect and learn from serious incidents that they have been involved in and in some cases this might be an appropriate alternative to formal written reflection. In these cases, the supervisor should indicate that appropriate reflection has occurred.
- Supervisors and/or ARCP panels should explore ePortfolio entries where there are concerns about the authenticity of the content or the quality of the learning.
- Doctors in training should expect to have some of their ePortfolio entries explored by their educational supervisor and/or the ARCP panel.
Use of AI in RCPCH START
START is the Specialty Trainee Assessment of Readiness for Tenure. This online assessment guides postgraduate doctors in training as they prepare to complete training and practice as a consultant.
We understand that you may wish to use AI to help you prepare for START, for example on the critical appraisal scenarios.
We strongly advise against using generative AI during START. This assessment focuses on your extempore ability to manage patients with complex needs in the context of a hypothetical case scenario. This in turn indicates your complex decision-making abilities in real life situations where use of AI will be ineffective, untimely and potentially unsafe. Generative AI may often provide inaccurate information in such nuanced contexts. It is important to recognise that inappropriate use of AI during the START assessment falls within the realm of probity, which the RCPCH regards as a serious matter.
Use of AI in Multi-Source Feedback (MSF) and other forms of feedback
The MSF is an assessment tool that gathers a range of views from colleagues and patients/families on a doctor's clinical care.
Feedback and self-reflection in the MSF (see Assessment guide) should not be generated by AI. Whilst the use of spell or grammar check may be appropriate and sometimes happens automatically, feedback is only valuable when authentic and many trainees rely on this for development of professional development plans. The use of AI generated responses may result in feedback which is invalid and could be of detriment to those trainees in need of trusted feedback.
RCPCH expects all doctors to maintain professionalism and integrity in their use of ePortfolio and when contributing to others’ portfolios. This is true whether AI is used or not.
We recognise that this is a field in which there is emerging AI technology, and this guidance will be reviewed in accordance with developments and evolving GMC policy.
Useful resources:
- GMC The reflective practitioner - guidance for doctors and medical students
- The Russell Group - Principles of using AI in education
- Academy of Royal Medical Colleges - Reflective practice toolkit (PDF)
- RCPCH: Artificial intelligence - position statement - on the use of AI in paediatric healthcare planning and delivery