Pilot Implementations on Clinical Reasoning

Looking back at our last chunk of time in the DID-ACT project, we have a lot to be proud of and a lot to look forward to. One of the most exciting and hands-on aspects of this clinical reasoning curriculum launch is where we are right now: Pilot Implementations.

Train the trainer course on clinical reasoning 

In our latest report published, Pilot implementations of the train-the-trainer course, we focused on the train the trainer learning units for our curriculum. These pilots were valuable and insightful in terms of helping the team iron out kinks in content, strategy, communications, etc. Overall, we had 7 courses that covered 4 different clinical reasoning topics up until the end of October. We are pleased to share that this made for a total of 69 participants who included professions such as medicine, nursing, paramedics, basic sciences and physiotherapy, from various partner-, associate-partner, and external institutions. We also had student participants. Overall the feedback was very positive. Next up is to take this feedback given and implement it into the curriculum. 

Quality criteria for pilot implementations

Our quality criteria, which we were successful in achieving, were the following: 

  • More than 50 participants from partner and associate partner institutions, as well as external participants
  • Covering a wide range of topics of the train-the-trainer courses that fit to the partner faculty development programs
  • Piloting of at least two same learning units by 2-3 partners
  • Thoroughly evaluated based on questionnaires for participants and instructors and learning analytics (in alignment with WP5).

Methods for a train the trainer implementation

We used our chosen learning platform Moodle to host our blended learning curriculum. There were several steps taken to ensure implementations were as smooth and consistent as possible. It began with a succinct planning phase. 

Planning phase 

Most of the train-the-trainer courses were chosen in tandem with their student curriculum counterparts. This was done intentionally so that trainers would be adequately prepared themselves to teach the students. Each institution chose their learning unit based on their individual needs and requirements. 
During this time, the consortium met on a regular basis to plan and ensure that quality criteria would be met. As well, alongside doing pilots within our consortium, we elected to have external participants as well for external applicability. 

Implementation phase 

The implementation happened differently at each institution and recruitment ranged from emails to specific cohorts to full public university call. During this time, each member was supported by Instruct to ensure that course access, structure of the pilots, and required facilitator resources were accessible and clear. This included a roadmap on how to use the Moodle platform as that was highlighted previously as an area with need support. Differences were also du to use of course forums and analysis of feedback within the learning platform.

Analysis and feedback phase

One of the deliverables for work package 5 was an evaluation questionnaire, as well as an analysis of the usage data. The former was given to participants at the end of the learning unit. Alongside this evaluation, each facilitator was given a short template to fill in for more qualitative reporting on their experience. Each of the responses was categorized and discussed together.

Results 

In the end, we piloted 4 interprofessional sessions and 3 with external participants. Feedback was generally positive and otherwise anything that could be termed as less than ideal is being used as constructive feedback for further refinement. Our biggest wins were that the interactive aspect was found to be highly valuable and the facilitators from varied professions was appreciated. Our constructive feedback was around Moodle and Casus being unclear as tools, too little time, teaching topic vs teaching how to teach was a crunch, as well as how the conversation veered toward medicine due to the unbalanced participant professions (i.e too many phyisicans versus physiotherapists in one group).

Pilot implementation conclusions

Overall, the consortium deems this round of clinical reasoning pilot implementations a success. There are points we need to work on, such as Moodle clarification, additional tutorial video was already produced,  and time constraints, which will all be addressed in the coming review period for the learning units. What’s more, the consortium will be delving during to the conclusions on the didactical and content-level for the learning units via the evaluation results reported in D5.2. These will all be brought forward during the overall revisions and improvements slated for D3.3 which begins in January 2022. 

How to teach synchronously in a virtual setting

  • You need a reliable camera, microphone, and virtual platform and be familiar with its features, such as whiteboard, chat, polling, breakout rooms, etc.
  • At the beginning establish communication rules, e.g. whether participants should raise their (virtual) hand, use the chat, and/or just speak. Also, we recommend asking participants to turn on their camera
  • For small group work break out rooms work very well, just be clear about the tasks the groups should work on prior to dividing them into the groups.
  • For collaboration the use of integrated virtual whiteboards or other platforms such as Padlet are very useful. Just make sure prior to the session that you have everything setup and the links at hand, e.g. to post them in the chat.
  • Allow a bit more time for starting the session and the group works as there might be participants who are not familiar with the platform or technical problems might occur.

How to motivate unprepared participants

  • Make clear that the asynchronous assignments are a core part of the course and that its content will not be repeated. Even if it is difficult, stick to that when starting the synchronous teaching session.
  • If you expect unprepared participants, you can start the session with a student-centered group exercise mixing prepared and unprepared students to increase peer-pressure and make them realize that being unprepared does not feel good.  
  • Use the introductory or closing quizzes / tests so that participants can self- assess whether they have the required knowledge and you as a facilitator can see the level of knowledge and preparation of your participants.

Further recommended reading:

How to involve participants with different levels of experience

  • To account for such different levels, we recommend making use of the asynchronous preparatory phases which also include introductory quizzes in which participants can self-assess their prior knowledge and you as a facilitator can assess the differences within your group. Participants with less prior experience can also be guided to additional preparatory resources.
  • Encourage participants to work in pairs or small groups when preparing so that they can help and learn from each other. You could even facilitate this by dividing them into groups with different levels of experience.
  • Similarly, during the synchronous phases, we recommend forming groups with participants different levels of experience and emphasize the peer support aspects of such group activities.
  • We also recommend starting with rather smaller groups and allow more time than stated in the course outlines, if you expect a heterogenous level of experience. This way you can better manage this challenge.
  • Encourage your participants to ask questions, emphasizing that nobody knows everything and that it is important for learning to ask questions.  
  • Especially in the train-the-trainer course you might have to deal with over-confident participants, who especially in an interprofessional setting can dominate the group. This is a complex cultural challenge, but you could try to establish (and follow) communication rules at the beginning of a session.  

How to address potential overlaps or redundancies

  • Identify what is already included and what is missing in your curriculum related to clinical reasoning outcomes and compare it to the DID-ACT blueprint. Prioritize learning outcomes that are not yet covered but regarded as important.
  • Identify activities, resources, or teaching sessions with similar learning outcomes that might be in need for change anyway because of low evaluation results, teachers or students struggle with it. These could be suitable for adding or replacing parts with DID-ACT activities.
  • Ask teachers and students about overlaps and gaps they see in their teaching / learning of clinical reasoning and where they struggle. This could also be done by a reflection round after related teaching activities in the curriculum
  • Although ideally a longitudinal integration is aimed at, we recommend to starting small with a pilot implementation to gain experience and develop a show case.

How to teach in an interprofessional setting

  • Allow for enough time prior to the teaching for the organization and motivation / encouragement of stakeholders and participants
  • Allow for enough time and guidance during the course so that the participants from the different professions can get to know each other and their professions and discuss their different perspectives. This might mean that you need to calculate some extra time in addition to the suggested duration of the learning unit.
  • There may be a different understanding of clinical reasoning in the different health professions, so we recommend making participants aware of this. You could for example use and adapt activities from the learning units on the health profession roles to facilitate this.
  • Courses in an interprofessional setting should not come too early in the curriculum (not before professions have formed their own professional identity - however, this also depends on the aim of the course). 
  • Make sure you have enough participants from different professions. If possible, the facilitator could divide the participants in smaller groups with an equal distribution of professions. 
  • Similarly, you need an equal distribution of facilitators / facilitators from different professions.
  • Develop customized learning materials considering the different professions. If needed you can adapt the material and activities provided in the DID-ACT curriculum.

Further recommended reading:

van Diggele, C., Roberts, C., Burgess, A. et al. Interprofessional education: tips for design and implementation. BMC Med Educ 20, 455 (2020). (Link)

Skip to content