The MTP Business Learning Blog

This blog is produced by MTP for senior professionals highlighting relevant and interesting books and articles on business, finance and strategy, and the opportunity to comment on them. It also contains news of MTP and its clients and, from time to time, extracts from MTP publications.

Tuesday 15 July 2014

Donald Kirkpatrick (1924 – 2014)

'Donald Kirkpatrick (1924 – 2014)' by Richard Griffin, Training Journal, July 2014

It was through this article that I learnt that Donald Kirkpatrick died in May and I decided to review this summary of his life and work.  Unlike some other areas of management, there are not too many generally accepted frameworks that can be used to discuss learning issues and this made Kirkpatrick almost a ‘household name’ to Learning & Development professionals.
I remember early on in my career that it was a safe haven whenever the tricky issue of course valuation was raised.  ‘Which level are you looking for?’ was - and still is - an effective and valid response to questions about evaluation methods.

The article tells us that Kirkpatrick developed his four level framework over fifty years ago, which says something about its relevance and longevity.  The author points out that most other attempts to develop new concepts and frameworks have proved to be adaptations of Kirkpatrick;  he mentions as an example the framework developed by Jack Philips some years ago which merely added a fifth level that requires a calculation of Return on Investment.  At MTP we looked at this at the time and decided that it was no real improvement on Kirkpatrick and could raise false expectations about the ability to carry out quantified evaluations.

The article reminds us that it was fashionable in the 1980s and 1990s to criticise Kirkpatrick as being too simplistic, allowing Learning & Development professionals to be satisfied with level one ‘happy sheets’.  The criticism was based on the assumption that he suggested a progressive correlation between the levels; that the immediate satisfaction of level 1 would lead to the learning achieved at level 2 and then to improved performance at level 3.  If anyone thought that this was Kirkpatrick’s message, they would be right to criticise but we have never seen it that way or encouraged others to do so.

The message that Kirkpatrick tried to put over is quite different; he said that each level should be addressed independently.  At MTP we agree with this point but also believe that, while all four levels are possible, it becomes increasingly difficult and time/cost intensive as you move upwards.  But the pay-off can be worthwhile if you are able to prove the lack of correlation, for instance that the popular course with the charismatic presenter is great at level one but fails at the other three levels.  The choice of whether to go to higher levels is for each group of stakeholders to make, based on the importance and scale of the programme and the resources available to carry out the evaluations.

The article reveals some personal information about Kirkpatrick that was new to me.  Firstly that his son is carrying on the family consulting business and seems to have the same practical approach; he describes the four levels as – Reaction, Learning, Behaviour and Results.  The other information is that Kirkpatrick had senior level HR experience before entering academia at the University of Wisconsin and this period of practical experience led him to be more realistic and pragmatic than other contemporary academics.  He was apparently also a song writer and musical performer, which he much preferred in his later years.

Not many academics in the area of business management can be said to have created a new language and influenced the way we think quite like Donald Kirkpatrick.  His four levels may not be rocket science but it has made many of us think more clearly and realistically about evaluation, which remains the most challenging of issues for Learning & Development professionals.

No comments:

Post a Comment