How to Estimate like an Adult – A Developer’s Guide

Part 1: How to Estimate like an Adolescent

Usefully estimating software projects is difficult, but not impossible.

A lack of understanding about why we estimate, what to estimate, and how to estimate leads to a breakdown of trust and communication between developers and managers.

Developers end up feeling guilty that they’re not meeting their estimates, and at the same time defensive: they were just estimates after all, right? Managers feel exasperated that everything is taking three times as long as it should. What are they doing all day?

This article is about fixing your estimates, and your estimation process. It’s split in to two parts – the part you’re reading, titled “How to Estimate like an Adolescent”, and the part you’re not yet reading, titled “How to Estimate like an Adult – What to Steal from Agile“.

As an aside, if you’re in a position where someone else is estimating work you’re doing, get out. The work will be late, you will be blamed, and you will be miserable. Programming is meant to be fun, and setting yourself up for accusations of professional incompetence and the niggling feeling that maybe you are incompetent is the antithesis of fun. Seriously, get out.

Estimates are not the same as deadlines (which someone else will be setting), largely because deadlines are the business’s problem, not yours.

Why We Estimate

What does a business do? It turns money in to more money (usually).

It spends money on your time, a computer for you to use, and a (hopefully) endless supply of second-rate coffee. In exchange, it wants you to write software, which it will use to obtain more money.

Fine, and so far, so obvious. So why does a business need estimates from developers?

Firstly, so they can plan more effectively – so that those funny Gantt chart things line up in the right places. This means the marketing department know exactly when to make sure their diaries are free for wining and dining journalists, and this means the CEO’s secretary can make sure he’s not off hiking the Appalachian Trail around product launch.

Secondly, so they can estimate resource allocation properly. Remember when I said estimates aren’t the same as deadlines? If the estimates bubbling up at the start of the project show there’s no way two developers can deliver the electric eggbeater calibration software by the deadline, then at this point, the business can do anything about it; it’s still the business’s problem to solve.

And of course, if it only becomes apparent towards the end, that’s when people start monitoring your Facebook usage. There is a way to solve this, and you should keep reading.

That’s Economics 101 out the way.

What a Project Manager Does All Day

Project Managers spend all their days getting Agile Certification Scrum Master Training, but in the brief moments when they’re not doing that, their job is to monitor progress on the project, and communicate that upward, updating their Gantt charts so the CEO can rebook his holiday to Argentina.

At the same time, their responsibility is to make sure resources aren’t being wasted. That can involve anything from procuring software, arranging meetings with suppliers, and shouting at you for spending all day updating your LinkedIn profile.

The earlier and more accurately the Project Manager can communicate changes in the project status to the people they report to, the easier their life is, and the nicer they are to developers.

The more meetings they go to where the project has slipped, and they can’t produce a good reason for that, the harder their life becomes, and the more chance there is of a poisoned donut among the decreasingly common Krispy Kremes.

What to Estimate

Any software you write, ever, will have some degree of hidden complexity. Whether this is the piece of open-source software you were hoping to rely on being riddled with bugs, or whether this is working with your coworker’s poor grasp of service architecture, or whether this is that line in the specification that no-one thought about too hard that triples the workload, there are nasty surprises lurking everywhere.

When you’re in your first job out of school, you’re allowed to be bewildered and surprised by this. You’re allowed to go home and cry in to your KFC Famous Bowl while Great Gig in the Sky plays, angry that you spent the 2 days you were meant to be setting up the AMQ Server trying instead to configure Entourage 2008 to talk to Exchange 2011.

But once you’re an adult, this should no longer surprise you.

Not only should this no longer surprise you, but you should start getting an eye for which sorts of stories these situations are most likely to occur in. This is complexity. And this is what you, a software engineering adult, should be estimating (and what we’ll get on to in Part 2).

There’s Still an Easy Way Out

Before we go any further down the Agile Velocity rabbit hole (and we’re going all the way down in Part 2), we’re going to look at the easy way out here. That’s because the easy way out usually works well enough, and it’s important to look at why it works.

Here is the easy way out for estimating a development task/story:

Break your task in to smaller components

The more you break your task in to components, the more you’ll think about how you need to approach it, the better understanding you’ll gain of the issue.

Estimate those components optimistically, and then triple those estimates

As above, every software project has hidden complexity. Over the aggregate of software tasks, the degree of extra complexity (ie: the multiplier effect) tends to be constant. This is hugely important, and this aggregation effect is the key to estimating like an adult.

Why triple? That number was pulled from the air, by which I mean over a decade of software development experience.

Any time someone gives you anything extra to do (extra functionality, something that takes you away from the project), tell your Project Manager to make a note of it, and increase the estimate

Your Project Manager is responsible for your time being used effectively. If they’re unaware, or forget (or just as often, you forget), where your time is being diverted, they can’t do anything about it, and you end up looking like a slacker for not delivering on time.

This is the single biggest area of communication breakdown. Keep a note of when the scope is being added to, or your time is being diverted, and make sure your Project Manager is informed early, and often.

Give your Project Manager daily updates of the percentage progress you’ve made through the task

If you’ve tripled your optimistic estimates, some days you will be zooming through, and some days you will be moving slowly, but the overall completion of the task will probably come in on time. Cut to a shot of Gantt charts and a smiling CEO.

If you stick to this religiously, you will have a mostly easy life. You may initially get pushback from other developers. Any developer dumb enough to push back on such an estimate should have attention drawn to their previous estimation efforts vs elapsed calendar time.

And you know what? You don’t have to wait until Part 2. We’ve covered the four most important points:

• Plan for the hidden complexity which will definitely show up, or you will consistently under estimate
• Estimates only have accuracy in aggregate
• Make a note of any extra features or work you’re asked to do, and increase the estimate accordingly
• Get in to the habit of giving your Project Manager frequent and accurate updates on your progress, or they can’t do their job properly. Don’t be tempted to hide slow progress and attempt to make it up later – you’ll just screw up their Gantt charts, and then everyone loses

What to Look Forward to in Part 2

In Part 2, we’ll be looking at how Agile solves all your problems ever. Or, more accurately, how this whole Agile thing has a couple of really good ideas on estimation, how to use them, and how to avoid some gigantic pitfalls associated with them.

Until next week…