By: Sheryl Nussbaum-Beach
Dean Shareski is a community leader with PLP. He asks some interesting questions in his building of community within our cohorts. He does the same on his own blog. Today he asked:
In the effort to be fiscally responsible and focus our attention on what truly matters, we hear this question asked almost everyday as we make choices on how to support our school division: “Will it improve student learning?” That’s a simple and yet very complicated question. It’s pretty easy to suggest that almost anything you do will improve student learning but not everything will translate into the classroom and impact student learning immediately or directly.
Here’s what I want to know:
1. How do you measure the effectiveness of professional learning?
2. Is there a time frame in which the professional learning translates into student learning?
I’m not sure I’m articulating myself particularly well here but am searching for some ideas that will help me solidify my own beliefs. I’m really curious to hear your thoughts on this one. Thanks in advance.
I responded and since I have to wait for him to approve my comment I decided to share my thoughts here. (I am not very patient–working on it).
My response to Dean’s questions …..
The obvious answer is the effectiveness has to be measured first on how well the PD met the objectives it set out to accomplish. Having clear cut objectives – intentional direction – is a hallmark of PD that results in prof. learning. If the goal of the PD is to teach teachers how to be more effective math teachers, what are the specific objectives that will help them become more effective? It can’t be all theoretical, compelling case for improving hype. There needs to be specifics in terms of measurable change.
First you set the goal. Then you set the specific measurable objectives. Then you actually follow-up in ways that are not just self reported data (maybe classroom observation, focus group with students, looking at student work, etc.) For example, if an objective was: all learners, as a result of the PD, will be able to teach specific tested concepts maybe… quadratic equations by using a 21st Century strategy -let’s say the TPACK method.
Then there needs to be both formative and summative evaluation for the learners (teachers) who participated in the PD. So the first thing you do is embed lots of process pieces that result in created artifacts that show whether teachers mastered the concepts being presented. Mastery needs to take place at all levels of Bloom,s or some other cognitive measure. Are there examples of mastery through knowledge, comprehension, synthesis or analysis? Can they evaluate their own product in terms of the objective-how about others work? You provide places for them to metacognate about what they are learning and to hear each other explain what the learning means. Collaboratively you look at examples of best practice and then they create something that will show they mastered the concept. You ask lots of questions, have your learners do most of the talking, and generalize to authentic examples.
Here is where you measure for student learning and it occurs immediately-3 months-6 months- 1 year out. After the PD is over you visit classrooms to see how the new professional learning is going. You use observation check lists that look for specific use in relations to your intended objectives. You look for scale- how are the concepts being used in generative ways you hadn’t considered
in your PD. You talk to kids and ask, “What are you doing? What are you suppose to be learning? Explain to me how to work that equation. What is TPACK?” “What can you do differently now that you couldn’t do before in terms of your own personal learning and understanding of this concept?” You record the answers so you can share with others in the school and in the blogosphere. You talk to the teacher and ask them to share what’s working from the PD, what’s not, lessons learned. You ask them, “What could I have done differently in my PD offering to have helped you grasp this concept better?” “What did I do that really worked?” “What do you need from me now?” “What professional learning goal can I help you achieve- one you are interested in achieving, not one I mandate, that is related to this concept?”
The effectiveness of PD, the kind that results in professional learning- is dependent on more than the teacher getting it when you are presenting the content. It starts with the PD provider’s planning and ends with follow-through in the classroom. Ongoing authentic assessment of how well the PD was delivered and then follow through to help the individual teacher with what they need to be successful or even what they are passionate about learning as an extension of the PD is what makes PD effective.
The less obvious is that the effectiveness of professional learning is not always measurable. Value add is a tough thing to measure empirically. For example, I was told a story yesterday by a teacher who said that for years she had been trying to get her principal and teachers to buy into the reasons and ways to bring about 21st Century reform and transformation in to her school. She felt she was banging her head against the wall. She said after her principal had heard me speak about learning communities as a PD means- something clicked. She finally got it and has been implementing sound 21st Century change since.
The point I am trying to make isn’t oh look I am great. Rather, that keynote was delivered over a year ago and I left having no idea of how effective I really was. I mean I had my objectives for the audience. I knew what I wanted to convey and what I wanted them to walk away with and how I was going to embed process into my keynote to make that happen, but I never knew the value add I had given that principal. It wasn’t measurable then. Make sense?
One of the reasons I love what we do together in PLP is that we are developing PD in an ongoing, job embedded capacity. Remember, it isn’t just about the learners- it is about you as a learner. And not everything that is of value can be measured.
Hope this helps. I am very interested in what others have to say.
Photo credit: http://jperk30.edublogs.org/