Last month we reviewed Survey Money and as part of this review we set up a survey on future elearning trends for our community to take part in. Whilst ours was just a small sample of a few hundred people from our community of readers we thought we would compare it to the original Elearning Guild survey from which we took our questions to see how things compared. We then also compared the findings to the latest CIPD survey on learning developments which highlighted the difficulty of analysing and interpreting surveys.
Elearning surveys - Lies, damn lies and statistics.
The questions we asked and the results were as follows:
How much will your organisation increase or decrease the following activities over the next 12 months. Will you increase significantly, increase, neither, decrease, decrease significantly (answers in order from left to right).
|Rapid elearning Design and Development||39||34||12||5||10|
|Use of elearning to train customers and partners||24||55||16||3||2|
|Elearning embedded in the learner's workflow||27||41||29||3||0|
|Elearning to support informal learning||29||53||15||0||3|
|Use of authoring tools||41||32||25||2||0|
|Use of content management systems||36||22||30||6||6|
|Online assessment of learners||37||34||20||6||3|
(Answers rounded to nearest percentage.)
We took these questions from the Elearning Guild survey so we could compare our results. We would emphasise though that the Elearning Guild survey is in our view the best and most thorough elearning survey. The Guild surveys over 20,000 of its members and provides very structured feedback by size, industry, etc. Ours was a smaller snapshot, mainly used to demonstrate Survey Monkey, but we thought it would be fun to compare.
Overall the findings were very similar, for example:
- In the 2006 Elearning Guild survey 77% said they would increase or significantly increase the use of elearning to train customers and partners. In our survey it was 79%.
- In the 2006 Elearning Guild survey 79% said they would increase or significantly increase the use rapid elearning. In our survey it was a little lower at 73.1%.
There were two questions where our results differed significantly, these were:
- Use of authoring tools - In our survey 73% said they would increase or significantly increase the use of authoring tools compared to 64% in the Guild survey. This might be due in part to the improvements that have been made in authoring tools, making it ever more possible to do great work in-house.
- Use of elearning to support informal learning - In our survey 80.2% said they would increase or significantly increase the use of e-learning to support informal learning compared to 69% in the Guild survey. This might be due in part to developments in informal learning and the increasing use of web 2.0 tools and technologies. In our follow up questions, serveral responses focused on how to bring these tools into the organisation and engage learners, so we can expect to see more in this area.
Could this be the sleeper trend of 2010?
One to watch: Use of elearning to train customers and partners: 53% expect moderate increase, 23% a significant increase
E-learning for channel partners is well established in the US, with many organisations focused on platforms for delivering and communicating with channel partners – LogicBay is a great example. In the UK it’s less well established, but has great potential to grow. One to certainly watch, especially if combined with some smart use of mobile learning / web 2.0 tools to keep sales and channel partners up to date. The growth of e-learning for customers is going to be interesting and another one to watch closely in the UK.
The latest CIPD Learning survey had us worried on first glance. It concluded that 'Few feel [elearning] is the most effective learning and development practice (7%)' and less than half are using more elearning. This would seem to contradict the findings of other surveys. However, when we looked at the sample we found 55% of the survey responses were from organisations with less than 1,000 staff. 77% were from organisations with less than 5,000 staff. It is not surprising that smaller organisations find elearning less effective. At Kineo we work with a lot of global corporates and elearning is very effective at delivering learning quickly and cost-effectively to a global audience. The most recent elearning programme we developed was in multiple languages for delivery to 150 different countries. It's an old truth but it's still accurate: elearning works on scale.
It would have been far more helpful if the CIPD had looked at the needs and responses of different organisations. To generalise the findings on elearning effectiveness seems a nonsense when over half of the respondents have less than 1,000 staff. Hopefully future reports will give us a better breakdown.
Also as Clive Shepherd recently commented "what sort of elearning are they talking about - self-paced, self-study lessons? live online events using virtual classrooms? collaborative online learning? It is impossible to have one measure for the effectiveness of all three, because they have almost nothing in common except for the fact that they are delivered using technology."
We all need to be careful of surveys or "Lies, damn lies and statistics" as Mark Twain once said. Almost 62% of people agreed with him at the time.