I just saw a post from someone in a Facebook group I'm in that asked the following.
What questions could I ask in a survey among students, who have gone through my "AI for managers" course to try to measure effectiveness? Any tips and ideas? What would you ask? Or maybe someone already did such a survey?
I was about to answer but then realized that my answer was going to be way too long for Facebook and deserved some serious writing.
So here goes.
Sergey
I guess it all depends on what you mean by 'effectiveness'.
Traditionally, based on the work of the late great Don Kirkpatrick, there are 4 levels of measurement we use to evaluate learning.
- Reaction
- Learning
- Behavior
- Business Impact
I ran a workshop at the AIN conference in Oxford a few years back about how you can design a workshop for Business Impact. Read about that here
I hope you got some clear instructions from your client as to why you were running that course. In other words, what was the Business Impact that they were looking for, and what changes in behavior did you agree would bring about that change?
If you did then try something like this
Can you give any examples of the way your behavior changed as a result of something you learned on the course
If you didn't then the best advice I can offer you is to approach this by trying to backfill that now?
So a couple of great questions might be:
On a scale of 1-10, how effective were you as a manager BEFORE you attended the course?
On a scale of 1-10, how effective were you as a manager AFTER you attended the course?
If these are different, what did you do differently that you learned about on the course that made that difference?
Hope that helps
