Throughout the first four levels of the Phillips ROI Methodology, data helps identify reasons for positive or negative ROI in the resulting fifth level. This model suggests that the final ROI of the training program is a result of a series of events: Show
Assuming the program clears level 1, each next level evaluated under the Phillips ROI Model checks if the change was a result of the program or various external factors. To show the calculation of ROI under Jack Phillips’ model, let’s reiterate our previous example of 50 software developers receiving training on a new programming language. Let’s put the use case through the Phillips ROI model and see how to calculate the ROI of this training program. Consider these precautions before following the Phillips ROI Model for training evaluationThe Phillips Model presents a complex and sensitive process. Make sure the following conditions are met before you put the process to use:
Step 1 – Gather data before the training startsBefore software developers start their training, they fill out a questionnaire to assess any trends over 6 months until the start. The questionnaire also examines their pre-training knowledge in concepts related to the new programming language. This will help understand how the training program helped different types of learners. Step 2 – Gather data after the training endsPost-program data comes from performance records of the company and/or through follow-up questionnaires of the following types:
Collect this data for all levels of the model as required. Step 3 – Isolate effects of lessons from the training programThe Kirkpatrick Model assumes improvements come from the training program. The Phillips ROI Model attempts to find other causes for training results including the training impact. Some of the possible factors that contribute to improved post-training performance include:
To isolate the effect of the training program, some techniques include:
Step 4 – Extract monetary benefits of the program from the dataAfter filtering the data and isolating training program effects, the monetary dimension lets us move one step closer to ROI. In the example of training on a new programming language, we assume a profit of $5,800 per developer from the new project that employs 50 trained developers. This profit margin considers the effect of only the training program; overall profit figures may be higher due to other factors Total profit from the training program = $5,800 / developer X 50 developers = $2,90,000. Step 5 – Add up all program costsThis is a straightforward calculation that brings together all costs for the training program. The total program costs will be a summation of the following categories:
In the example of training on a new programming language, let’s assume the total program costs were $2,34,900. Step 6 – Calculate the return on investment (ROI)ROI (%) = (Net benefits of the training program / total program costs) X 100 = (($2,90,000 – $2,34,9000) / $2,34,900) X 100 = ($55,100 / $2,34,900) X 100 = 23.457% Step 7 – Find the intangiblesA training program will have more than monetary benefits alone. Such intangible benefits are often more valuable than the hard data coming out of the ROI calculation process. You can identify such abstract measures at any stage of the ROI calculation process through discussions with the project’s sponsors.
Each type of program will have its own type of intangible benefits. The table below mentions the common categories. Which training outcome measure is best?A pencil-and-paper test is the best means for measuring skill-based outcomes.
What relates to whether trainees are using training content back on the job?Behavior and skill-based outcome relate to whether trainees are using training content back on the job.
Which of the following statements is true about an effective discussion in a training program?Which of the following statements is true about an effective discussion in a training program? The trainer should convey the topics and time expectations to trainees before starting the discussion.
Which training outcomes related to trainees providing feedback about their satisfaction with a trainer?Which training outcome relates to trainees providing feedback about their satisfaction with a trainer? Appropriate training outcomes need to discriminate.
|