We build evaluation into all our projects, right from initial planning through to the end of the first year of the new system. Evaluation is so important it is treated as a separate workstream within the training project, with its own design, build and deploy phases.

We evaluate at three levels:

Reaction – giving learners the opportunity to tell us how useful they found our courses and documents. Instead of a standard 'happy sheet' we use customised online surveys to target specific elements of feedback that we have identified as key to the success of the project, as well as giving people the opportunity to tell us in their own words what they found useful.

Learning – learning checkpoints are built into all courses, whether classroom, virtual classroom or eLearning courses. Instructor-led courses may use consolidation exercises or class quizzes to check learning, and the instructor records the results on an individual basis. In eLearning courses, the learning checkpoints may take the form of quizzes or simulations, the results of which are recorded via SCORM outputs. Learning checkpoints allow us to know that our courses are enabling users to learn, and to take additional actions if learning is not happening.

Job application – right at the start of the project we identify what changes you need your users to make to the way they work in order for your organisation to realise the benefits of the new system. We map your solution design document to user roles and desired business process operation. We then design data collection activities to test whether, once the users have undertaken learning activities and have access to performance support tools, they are making those changes in their work. This also allows us to target ongoing training and communications to those areas where it is most needed.