Issue Identification and Appraisal
Over the past few weeks the Blog has been about the development of Scoring Model best suited for the GAO’s Ten Best Practices. This week takes the subject one step further by applying our scoring model to the GAO’s Table 7: Best Practices Entailed in the Four Characteristics of a Reliable Schedule.
This week’s problem is, “How to apply the GAO’s 10 Best Practices scoring model to their Four Characteristics of a reliable schedule”.
The challenge is going to be determining how to take the results from the 10 Best Practices and “Roll Up” into the 4 Characteristics. This revisits old research with regards how to weight the information;
- equal weightings i.e. 25% for each characteristic,
- assign weightings based on criticality of the four characteristics, or
- use the 10 Best Practice weightings and roll these up. There are three alternatives to assess.
Develop the Outcomes for each
The table below shows the potential benefits for each weighting method.
Table 1: Benefits of each Alternative
Taking the benefit issue a step further, and demonstrating how the weightings will appear like in a table, gives the viewer a better idea of what to expect. Alternatives 1 and 3 are easy to depict, but alternative 2 the ‘Ranked weighting’ needs to be shown using potential ranges as these would be chosen by the assessor.
Table 2: Weightings of each Alternative
The selection criteria used was the Hybrid data set developed during Blogs 3 to 5. It has 82 scoring points all equally weighted (plus an additional 33 informational items, which assist in scoring the 82 items).
Table 3 Typical Scoring Sheet (showing BP 1)
Analysis and Comparison of the Alternatives
A simple analysis was performed using the same method that was adopted for the previous blogs, determining the priority scale for each of the 3 criteria’s then applying a score against each alternative. The analysis of the alternatives is shown below.
Table 4 Analysis results of Alternatives
Selection of Preferred Alternative
The preferred alternative is to use the weights from the Ten Best Practices scoring template and roll them up in each characteristic by using the GAO directive in which section gets assigned to each characteristic.
Monitoring Post Evaluation Performance
The roll-up of the Scoring Method from the Ten Best Practices to the Four Characteristics is now completed. So, the effective tools are available, but what will the acceptance criteria be? At what point can it be said that the schedule has passed, 70%, 75%, 80%, 90% or 100%. Bear in mind that a schedule is dynamic and projects need to forge ahead, I don’t think 100% is realistic. My thoughts would be somewhere in the region of 75% and upwards would be a good start point.
How do I feel this is a good start? If we demand too much we are not realistic and schedulers/planners build the schedules around the criteria and not the work; if we plan demand not enough then we are not using the GAO’s Best Practices in the spirit it was developed for.
We need to Plan, Assess, Learn, Re-evaluate, and continually refine as the need arises.
- GAO (United States Governance Accountability Office), 2015, GAO-16-89G Schedule Assessment Guide
- Guild of Project Controls. (2015, October). GUILD OF PROJECT CONTROLS COMPENDIUM and REFERENCE (CaR) | Project Controls – planning, scheduling, cost management and forensic analysis (Planning Planet). Retrieved June 14, 2017, from http://www.planningplanet.com/guild/gpccar/managing-change-the-owners-perspective
- Ishizaka, A., Nemery, P., & John Wiley & Sons. (2013). Multi-criteria decision analysis: Methods and software[Kindle].
- W04_SJP_ Development of a Scoring Model for the GAO Ten Best Practices – Achieving Guild of Project Controls / AACE Certification BLOG [Web log post]. (n.d.). Retrieved from https://js-pag-cert-2017.com/w04_sjp_Development of a Scoring Model for the GAO Ten Best Practices/
- W05_SJP_ Development of a Scoring Model for the GAO Ten Best Practices Part 2 – Achieving Guild of Project Controls / AACE Certification BLOG [Web log post]. (n.d.). Retrieved from https://js-pag-cert-2017.com/w05_sjp_Development of a Scoring Model for the GAO Ten Best Practices Part 2/