If you want to provoke an emotional reaction from a group of software development managers, ask them about their experience doing project cost estimation – WOW. I doubt you will find any of them who look forward to the task. Some of the managers may even become downright hostile. Estimating the cost of a software development for a contract or a proposal can be a punishing experience. And, almost every manager will admit that their estimate — especially for a complex project or one with a long duration — will be wrong (but hopefully not by much).
- Requirements change during development, which changes the level of effort and therefore the cost
- The operational environment is not, and cannot be, completely understood before work begins (Unless you have the Johnny Carson “Carnack the magnificent” genie)
- In order to create a “price to win” in competitive programs, senior management reduces estimated cost and then pushes the team to “work smarter” (HA – can I hear all the groans from project members!).
- There is a gremlin called “Murphy” who loves to show up on projects and create all kinds of problems*.
The History of Software Project Cost Estimation
In the beginning there was intuition and wishful thinking that drove software cost estimation. A project manager, often not a practitioner or software developer, reviewed high-level requirements and created a cost estimate from that – “I think this should take a couple months.” That approach did not always work well (:-).
In an effort to be more scientific in cost estimating, professionals developed many techniques over the years for performing estimates – historical analogous estimating, parametric estimating, three point estimating (PERT), expert judgment, etc. In fact, PMI has produced a book called “Practice Standard for Project Estimating”.
The software industry developed one costing method that assessed a cost per line of written code and then estimated how many lines of code would be required to build the software. The success of LOC estimation methods suffered from the reasons listed above as well as the obvious problem that not all lines of code are equal in difficulty. I once asked a senior software engineer, how many lines of code it would take to develop X functionality. He replied, “How many do you want it to take?” He was not being a smart aleck, he was only acknowledging the fact that there are many ways in software development to skin a cat and those options require different amounts of code.
LOC-based cost estimating was followed by function point cost estimation. A function point is an output, inquiry, input, an internal file, or an external interface. In simple terms, you develop a cost estimate by counting the number of function points in a proposed system, assigning a cost per point, and multiplying. More involved function point counting included values for difficulty and importance to the eventual system.
There were many other attempts to develop fast, cheap and simple software cost estimation methods. I could go on for a long time – However, I won’t bore you with the details. Let’s just say there is no magic book or formula for this critical process!
Cost Estimating in Scrum
Over the last few weeks, I have been writing about using the Scrum framework for software development. Scrum practitioners do not avoid cost estimating challenges, but they have methods to assess project cost that are consistent with Scrum’s approach to project execution. They do not, however, have the magic bullet, either.
All Scrum projects begin with a story (read “high level requirements” for the PMI crowd). What does the product owner want to be able to do when the project is complete? From that vision come the initial requirements. Scrum cost estimating methods use the wisdom of the team to generate estimated effort — acknowledging from the beginning that final cost and duration will vary as uncertainty and changing requirements are reflected in actual development.
When the Scrum team meets for its initial planning, the vision is laid out by the product owner. The team then considers how to create the desired functionality, which are called story points. Each story point is rated for relative difficulty.
Cristopher McSpiritt describes the process this way in “What is Planning Poker?”
- The product owner describes a user story/feature the team is estimating. The product owner may provide clarification on the feature in response to questions.
- Each team member chooses a development effort card from a deck of values to represent their relative estimate of level of effort. Cards are placed upside down on the table so that they do not influence others.
- After all estimates are on the table, the cards are flipped over.
- If there is a significant range among estimates, the team members who submitted the high and low values provide a rationale for their estimate.
- Once the discussion on the range has been conducted, steps 2 through 4 are repeated until a consensus is reached.
This team process has the advantage of sharing the vision, building the team and gaining buy-in from the Scrum team members who have to actually do the work.
In his book, Agile Estimating and Planning, Michael Cohn reports success using a Fibonacci sequence, such as 1, 2, 3, 5, and 8 … for a relative story point difficulty value scale. The team then considers how many story points it can accomplish during a sprint – called velocity. An experienced team can generate a useful sprint / project estimate from this process. However, an estimate is just that. During actual development (the Sprint), task difficulty and team velocity are routinely reviewed and modified. As (predictable) requirements changes are requested by the product owner through the product backlog, variations in the order of the product backlog (Requirements or features) can be accommodated over the life of the entire project without affecting the current estimates and sprint.
One of the big advantages of this method is that we don’t have to estimate the entire project in excruciating detail or even know the complete set of features at the beginning of the project – this is more real world than the traditional waterfall type of project planning and estimating.
I would love to hear your opinions and thoughts about estimating for projects, both traditional and Scrum.
* Capt. Edward A. Murphy is accepted as the reason for Murphy’s law http://www.murphys-laws.com/murphy/murphy-true.html
March 11, 2012 at 10:13 pm
[…] Bruce McGraw recounts the history of estimating project costs, and how it’s done these days on a project using Scrum. […]
March 15, 2012 at 3:27 pm
Thanks for the information. But I still don’t get how do they estimate the cost for the whole project. I mean I know that they use this methodology in Scrum to estimate the velocity for each sprint. But this estimation is only for one sprint scope. The customer pays for the whole product not per sprint. Each sprint may differ from other one as each backlog item might take different amount of time and energy. So how is the estimation for the cost of the whole project being done?
April 3, 2012 at 10:09 am
We have had to go through several iterations of estimating a whole project cost for projects executed using scrum methodology. In the end, we learned our lesson the had way (severely overbudget project), and came up with the following protocols moving forward:
1. Track your team’s time spent by story, evaluate and analyze performance each sprint to determine the error factor of points to hours. Average this number so that you have a typical conversion rate.
2. Hold a sprint planning meeting as described above. Be conservative,and use the higher numbers. Make sure to take note of how the team would break up the function into separate stories, any assumptions, and any development tricks that would be employed. This information will be important to pass on to the customer as part of the cost assumptions, and to the requirements author for documentation. If there is the possibility that the development team will change, the new developers will use these notes when building the stories.
3. Convert the points to hours using the number derived above, add a percent for contingency, and a percent for testing.
4. Add on documentation and project management/admin time.
This is how we arrived at a full project budget. Our projects are lump sum, so we can move money as needed between the roles. We just started executing the project estimated using the method above… let’s see how we do!
April 24, 2012 at 10:56 pm
Thank you Lisa, very informative.
January 15, 2013 at 1:43 pm
[…] while others offer serious, professional advice. The most popular of Bruce’s posts in 2012 covers project cost estimations in the software […]
July 18, 2014 at 12:28 am
Well said. Not all estimation is accurate. Estimation just an estimation. The real cost is when the project is up and running. however with the given scope of work at least it the cost estimation is out it still can be covered with some profit margin that had been allowed in. At least it not a total losing project.
July 5, 2017 at 2:52 am
Thanks for the information you’ve provided in this article. Estimation of the project value is a major way of establishing business justification. Estimating the project value helps the decision makers make the vital decision such as to continue with the existing project or not. Read more about this here at – https://www.scrumstudy.com/blog/how-to-estimate-project-value/. I hope sharing this would add to the information you’ve shared.