Saturday, November 1, 2008
CAN CLINICAL TEACHING BE BOTH HIGH QUALITY AND EFFICIENT?
The other day I was observing a clinical teacher with a group of residents and students during rounds. It was quite a sight. I wish I would have had a video camera, because this was a clear example of teaching expertise in action. The attending interacted with everyone on the team, the flow was quick and there did not seem to be a minute wasted as the team moved from room to room. The questions she asked were insightful. She provided quick feedback and was at the same time respectful to the "senior", asking him to "teach" at one point.
So... What is your secret? How do you make time to observe, give feedback, provide focused teaching? If each person that receives this BLOG could share one idea, we would really have something worth saving!
Friday, October 31, 2008
OCTOBER SUMMARY
The responses to the October’s Question, “GLOBAL RATING SCALES: USELESS AS A TOOL FOR IMPROVING PERFORMANCE” were insightful and honest as well as practical. If you have not already read them, I encourage you to go to the OCTOBER Archives and read each one. The following are just a few “pearls” from the list.
There was a consensus that “global ratings” alone do little to assist our learners in improving practice. Some quotes:
- “The student requires a specific notion of what should be improved and therefore numeric value will be useless if there are no specific comments that will provide further feedback and insight”.
- “I agree that a global rating scale number such as "7" alone provides little information to a student about performance. Descriptive feedback is definitely better at elucidating areas of strength and weakness. This type of feedback allows the student to internalize and re-assess their performance with opportunity to adapt to expectations and/or standards.”
Others responded to GRS reliability and the use of data to compare students or residents. Some notes and quotes:
- “Just like with Likert scales, things are given a numerical assessment and each number is exactly the same distance from the other, yet what these numbers mean is not uniform in distance. For example, the distance between what someone would rate a 5 and an 8 on these scales is much smaller than the difference between 1 and 4. In fact I don't even know if 1 exists! This renders the scale even more arbitrary than what is just personal point of view of what an 8 means, etc. This has direct implications on using the numbers in any way - for example averaging and comparing.”
- “…. I think that the information from these GRFs becomes more meaningful when there are a number of raters. In this case, if a student consistently is scroing much lower than his or her peers, (across several stations) then we can intervene with that student and provide targeted input, correction, remediation -- whatever you want to call it. Yet, the students say that they learn the most from the narrative comments that the SP's put on each section of the form, noting what the student did well and what could be improved. I don't think that it's really a question of GRFs vs. narative feedback; we need both as they meet different aims
There are good questions about the value and psychometric properties of Global Rating Scales. A nice short article that addresses the inherent problems with GRS is listed below.
Farrell, S E. (2005) Evaluation of student performance: clinical and professional performance. Academic Emergency Medicine. 12(4): 302e6.
Wednesday, October 15, 2008
GLOBAL RATING SCALES: USELESS AS A TOOL FOR IMPROVING PERFORMANCE
The problem, as I see it, is not the competencies, but how we assess them. For the first five years after the introduction of the Competencies, new Global Rating Forms (GRFs) were introduced as the "answer" for assessing the competencies. In this approach, students or residents are assigned a number from a scale, for example, a "5" out of a possible "10" on one of the competencies. The faculty member has "done his/her duty", but how satisfying is the process for our teachers, and what in the world does that student or resident do with that "5".
Our medical school (CCLCM) is a competency-based school that approaches assessment systematically by emphasizing formative narrative feedback organized through a portfolio sytem. Students never are assigned a number, rather they receive narrative feedback about their "strengths" and "areas needing improvement". This seems to be working really well, although, there is a bit of a "learning curve".
So.. what do you think? Are there some strengths to GRFs that I am missing? Have you found ways to make those "numbers" tell a story that leads to improvement? Let us know what you think? Any residents or students reading this link? What do you think?
Tuesday, September 30, 2008
SEPTEMBER SUMMARY
We had a record “20” responses this month. If you have not already read them, I encourage you to go to the September Archives and read each one. The following are just a few “pearls” from the list.
- 3 or 4 of our responding BLOGGERS mentioned the importance of keeping material new, reading and adding up-to-date information to the “talk”. New findings with their implications for practice can be a great springboard for comparing old with new and many other teaching strategies and stories that go beyond the simple facts
- Another theme was changing from thinking about what and how to teach to thinking about your learners’ needs. What do they need to learn? Where are they now? And What can you offer to help “fill the gap” By focusing on each new groups’ learning needs, you are probably starting at a different place and covering similar material but with the focus not on teaching , but helping the learners succeed.
- Another theme was very practical and focused on extrinsic as well as intrinsic rewards. Extrinsic rewards come from students, one BLOGGER suggested keeping those positive letters and notes from students for a “rainy day” when your motivation needs a boost. Others used feedback as a tool in refining their teaching. Intrinsically reward yourself by communicating with other dedicated teachers.
- Finally, TRY NEW THINGS!!! Get out of your “comfort zone”, go to workshops when offered and learn new approaches to teaching. And most importantly do it with enthusiasm. If you don’t feel enthusiastic, “fake it”, then feed off the students response until you really feel it. Or as one BLOGGER offered, Just say, I’m not on my “A” Game today, let’s go get coffee and do “flash cards”
- My humble addition is to mentor a new teacher on the faculty. No, not that “star” that is a natural, but that highly motivated, limited teaching skill faculty member that really needs you! When I hear that faculty member has gotten great reviews by students, I’ve got a smile on my face a mile wide.
Hope these suggestions were useful to you!
Monday, September 1, 2008
KEEPING A FRESH PERSPECTIVE ON TEACHING
Some faculty say, "teaching is its own reward" and I would agree. But how do you keep your teaching "fresh" in the face of all the other demands on your time. This was not the question I had planned for September, but a gifted "early career" teacher stopped me today and asked, "How do they do it! How do some of these guys teach year after year and act like they are teaching this material for the first time? How can I keep my enthusiasm? Sometimes I just feel tired"
So this question is to our faculty who have been doing this for a few years. How do you keep it "fresh" (or appear to)? Any tips you have for keeping your enthusiasm and avoiding burnout would be most welcome. Let's break our record of 10 responses.
Sunday, August 31, 2008
AUGUST SUMMARY
The responses to the Augusts’ Question, “Shhhh! Quiet Learner at Work” were insightful as well as practical. We also had our highest response with faculty posting 10 different responses and ideas. If you have not already read them, I encourage you to go to the August Archives and read each one. The following are just a few “pearls” from the list.
- Two of the responders thought that giving quieter students or residents a specific role to play can increase their interaction.
- One responder mentioned assigning a paper, then asking the quieter student to present the next day, another suggested asking them to serve as “teacher”
- In one-to-one teaching it is not as much of a problem since dialog is pretty much mandated. However, if you want to increase students’ one and two word responses, first, ask more open-ended questions and second, make your expectations for depth of response clear.
- One responder suggested killing two birds with one stone by enlisting the “talker or dominant student” to solicit opinions from the quieter student.
- Two responders thought that one needed to consider cultural background as certain cultures regard speaking out as impolite. Again, expectations need to be made clear
- Finally, before labeling the student as quiet and non responsive make sure your own behavior is not intimidating to all but the most aggressive learner.
One thing I might add from years of working with faculty (who can also fall into this category) is to create a “reason for communicating”. Many times the learner themselves prefers to learn through observation and checking the “answer in their head” with those verbalized. They have no personal need to verbalize their understanding. GIVE THEM A REASON!
Hope these suggestions were useful to you!
Monday, August 4, 2008
Shhhh! Quiet Learner at Work
The dilemma of the "quiet student"!
I've often wondered "Who's problem is it anyway?" Maybe it is just me? The more reflective quiet student or resident seems fairly content handling their learning. Or do we do them a disservice by not challenging them?
How do you all handle "quiet students?" Has anyone found a way of engaging these reluctant participants and getting a good sense of their knowledge and understanding?
Please "comment" if you have an idea.
Thursday, July 31, 2008
JULY SUMMARY
The responses to the July’s Question, “When Learners get it Wrong: Handling Incorrect Responses without Intimidating the Learner Discussion” were great examples of the fact that there really isn’t one right way to address any teaching question. The following are just a few “pearls” from the list.
- It is important to build a safe learning environment so that learners are willing to ask and answer questions.
- If the learner is more advanced and seems certain of an incorrect fact, ask a follow-up question concerning their source. If no one has supporting evidence send the individual or group out to find the correct response.
- Look for a “kernel of truth” in the response and work from there.
- For early learners, ask questions in a form that doesn’t require “one right answer”.
- When asking questions, know the difference between “wrong” and “not my way” and respond accordingly.
- Try to avoid “what am I thinking” questions
- Respectfully correct the response and “move on”
What our faculty “bloggers” were telling us on this issue is that their solutions depend on the context. In this case “time” was sometimes a factor. Another factor was “importance of the answer to “good practice”. Another factor was the existing relationship you have with the learner group. Teaching, like medicine and to a lesser degree science, is an "it depends" profession!
Thursday, July 10, 2008
WHEN LEARNERS GET IT WRONG
When doing observations of teaching in the classroom and clinics, I often pay special attention to how faculty handle incorrect responses. Some teachers use the incorrect response as a springboard for teaching. Others -move on- asking another student or resident to help out. Another group answers the question themselves while still another group (unfortunately) ridicules or makes fun of the incorrect response. While we all can agree that the last strategy is probably not the best, is there one best way to make sure the learner and the rest of the group are clear about the correct answer while not shutting down that learner or the others that are in the group?
What works for you? Is there one best way? Is there clearly a wrong way? Do we worry too much about hurting our learners feelings?
Monday, June 30, 2008
June Summary
The responses to the June Question, “How Do You Effectively Teach Multi Level Learner Groups?” were great examples of expertise in teaching. If you haven’t already read through the comments be sure to click on the Archives for June to read each great idea.
Our faculty came through with 13 excellent suggestions. The following are just a few “pearls” from the list. The advice from the faculty was given primarily in the context of “teaching rounds” :
- Set expectations for teaching rounds. Give each level learner a specific role. Three of our responders suggested giving the student the first question and asking the more senior learners to “build on” the student response. Another approach was to start with the student and a pathophysiology question, then move on to interns for signs and symptoms and differential while saving the management questions for the resident.
- Give opportunities for senior residents to teach. This can be planned (where the senior and the team know that the senior will be “running the show” for a certain number of cases) or impromptu where you ask the senior for their opinion and direct the student questions to them for response. In both instances, give the senior feedback on their teaching
Friday, June 6, 2008
Hopscotch Teaching.. or Teaching to Multi-level Groups
Have you ever faced this situation before? If so, how did you handle it?
Saturday, May 31, 2008
May Summary
Our faculty came through with six excellent suggestions. The advice from the faculty was to:
- Set expectations or standards early in the process; this way students and residents will know how to prepare and won’t feel “ambushed”
- Use the ASK-TELL-ASK approach to giving feedback, always starting with the learners’ perspective, using their concerns as a springboard for teaching
- Model the behavior you expect from your learners
Two other comments reflected on the difficulties young clinical teachers face as they transition from resident or fellow to attending and develop their own teaching persona. Anecdotally, new faculty have described difficulties especially when joining the faculty at the institution in which they trained, citing evaluating past peers as the most difficult. I reviewed the literature and could find nothing helpful concerning this transition. Perhaps this is an open area for educational research!!
Monday, May 12, 2008
Task Master or Pushover Dilemma
Young teachers have often come to me with this dilemma. They in particular feel "singled out" by students and residents as being "too harsh" if they attempt to hold high standards.
Have you shared this experience?, or have some ideas to contribute? Join the discussion. We want to hear from you!