Whatever the learning initiatives you use, whether they be eLearning modules, micro learning, video, social learning, it is essential to know whether it achieves the learning objective and the identified business objective too. This will help justify the investments in learning and make your digital learning strategy an ongoing commitment within your organisation.
The first step is to decide on the key metrics that will help you determine the success of your digital learning strategy.
The first metric most organisations look to is the completion rate, however, in isolation this can often be seen as no more than a vanity metric. Just because your learners are completing the course, doesn’t mean the solution is truly effective or, that the learner will retain any of the great knowledge they have been given.
Thankfully, most Learning platforms allow you to delve deeper than completion rates when it comes to data collection.
If the majority of learners spend a disproportionate amount of time on a question or section, and most get that question wrong or do not retain the information, that’s an indicator that the question should be rephrased or removed. This may also uncover a wider implication for that topic and flags that this needs some attention.
The overall score tells you they passed, but what areas did they struggle in? By looking at each question separately, we can easily see which content the learners are having issues with. This could then ensure the content is evolved to cover these development areas. Think about “Adaptive Learning”. The type of digital learning module, where the learner completes a knowledge check at the start. They then complete the areas they NEED to focus on and don’t just experience a ‘one size fits all’ approach.
How many attempts did it take the learner to complete the module? Sometimes learners go straight to the questions and try guessing their way to success, this usually ends in numerous attempts before finally reaching the pass mark. Or maybe learners are all getting 100% on their first attempt, this could mean the assessment is too easy.
By building friction into learning solutions to ensure the learner has to consume the information we avoid the guessing approach above. By also adopting the adaptive solution approach we help those who are time-poor to reach their goals faster.
How often is the content viewed by an individual? This metric helps you to determine engagement levels. If the learners are revisiting the content it could be an indicator that the content is particularly useful to them.
If content is only being visited once, then please don’t see this as a success. This is a sign of low appetite for the module.
Learning solutions should be things that evolve and grow with your people and organisation. When working with our clients we first agree objectives and outcomes. The next thing is to then identify how we can make the solution sustainable and provide value, at a minimum, in the medium as well as short term.
Measuring various survey metrics - reactions, feedback, forms of evaluation learners can leave on the course and instructor evaluations – can greatly assist you in tailoring your digital experiences towards the needs of your target learning groups.
Make sure you arm yourself not only with data, but a blend of qualitative and quantitative outcomes to demonstrate value, advocate approaches or review successes and failures.