Why scrum? Why agile development?

Scrum and Agile development are simple methodologies intended to solve the problem of

  • long product development cycles; and
  • a mismatch between a product’s business requirement and the actual resulting implementation

This illustration explains such mismatched expectations, and the consequence of long development cycles.  For anyone who has been working in the software development industry for a while, you would probably have gone through the hell of the typical waterfall development approach.  With an outcome where everyone in the team is demoralized and where you end up with a bunch less-than-happy customers – an unfortunate, dysfunctional outcome.

mismatched_expectations

Agile product development has its roots from lean manufacturing (not to be confused with lean start-up) from Toyota; and is a general framework to guide small, empowered teams to execute on their product development work in an iterative fashion.  The Scrum Master course I attended in Feb talks about a specific practice in agile product development known as “Scrum“.

Shorter development cycles (called “sprints”) of 2 to 4 weeks and daily team meetings known as “scrums” allow the product team, the product owner and the customers/stakeholders to regularly review the incremental improvements made by the team in each sprint.  This narrows the expectations gap significantly and the increased communication level between the product team and the stakeholders reinforces a shared vision for each product increment made.

The ideal size of a product scrum team ranges from 3 to 9 (but 9 is already too big in my my opinion), comprising sales/marketing and design/product specialists in each team, with a typical ratio of 1-2 designers/marketers to 5 developers in each team.

The 2-4 weeks sprint cycle can be visualized with this diagram.

scrum-overview-mark-hoogveld

Some definitions:

Product Owner

In each team, there will be a “product owner”, also sometimes referred to as the “product manager”.  This is the person responsible for prioritizing product development features in each sprint and over the course of the entire product development (a product development process comprises of many many sprints, each sprint being 2 weeks to *maximum* 4 weeks).

The Product Owner is almost always the business stakeholder and is directly responsible for the financial well-being of the project, including profits/revenues when the product is launched to customers.

Scrum Master

For a team of 5-7, it is also the norm to have a Scrum Master.  Note that the roles of the Scrum Master and the Product Owner are completely different things.  The Scrum Master is a guide and a process-people-skills-resource facilitator.  The Scrum Master, however, *does not* set the product direction and is not the person to decide on product feature priorities.  It is the job of the Product Owner/Manager to decide on product feature priorities.

It is important for the roles of Scrum Master and Product Owner to be cleanly decoupled – two separate individuals.

Product Backlog

The team and the product owner comes together on the first day (at the start of a sprint cycle) for a 2-4 hours meeting to define the product vision and to list out all the product features that needs to be developed based on the product vision (also known as the product “hypothesis” per lean-start-up concepts).  The outcome of this 2-4 hours meeting is a long long laundry list of features that should be build that are hypothesized to serve the product vision/goal.  This laundry list is known as the “Product Backlog”.

Sprint Backlog

After the Product Backlog has been established, the next 2-4 hours is spent on planning for the *current* sprint (I will simplify things by saying that each sprint is 2 weeks, not 2-4 weeks).   Many of the Product Backlog items will be kicked out and only items that *The Team* can comfortably complete in the current sprint (2 weeks) will be placed into the “Sprint Backlog”.

Once the Sprint Backlog has been decided, the sprint commences on Day 2.  Notice that Day 1 is almost always spent on building team clarity and deciding on feature prioritization with *everyone* present and involved.

In an ideal scenario, it also makes sense to invite “Customers” and “Users” of the product that is being developed to participate in a limited way during this first day of planning.  This is where “Lean Start-up” practices meet “Scrum/Agile Product Development”.

Daily Scrum

Once the sprint begins proper, a 15 minutes session is allocated at a fixed time *EVERYDAY* for the team members, scrum master and product owner to do a stand-up meeting.  4 key points are covered by the product owner and the team in this 15 minutes.  Each member will summarize and share:

(1) Done: What has been done by him/her

(2) To Do: What needs to be done next by him/her

(3) Blockers: any issue (whether Technical or Administrative or Human-related) that is preventing him/her from achieving his/her personal tasks

Finally,

(4) Updates & Re-prioritization, if any:  The Product Owner can provide market updates/discussions with meetings with clients on the previous day etc to the team.  The Product Owner can also decide to *CHANGE PRIORITIES* of items that needs to be done.  When certain development item’s priorities get changed, it will – in all likelihood – result in existing features being de-prioritized.  The sprint timebox is strictly 2 weeks (for newer teams, it is preferable to work in 4-weeks time frame to factor in time for picking up new knowledge and getting to know how each other operates).  Which means like the “law of conservation of energy”, what gets added in implies something else gets kicked out (and thus, gets removed from the Sprint Backlog and placed back into the Product Backlog).

Benefits

There are a few advantages for having a daily scrum.  For example, good development work requires engineers to be in the zone when they are working.  Instead of “interrupting” a developer who is deep in his/her code and working through his/her current task, by having a fixed timing for the 15 minutes daily team update,  Product Owner and Scrum Master do not “break the developers’ zone”.  Breaking the zone is a huge source of lowered productivity and causes increased mistakes in software development.

On the other hand, *not* having regular communications between the product owner and the team will result in mismatched expectations and poor implementation prioritization.  So having this regular 15-minutes communication on a daily basis is the basis for team to collaborate optimally.  Market/customer updates brought in by the marketing specialist or Product Owner during this 15-minutes scrum meeting is critical for ensuring that everyone is “in-sync” with and “re-synced” to what needs to be delivered.

Scrum” is simply a formalized term to describe a set of practices for a professional product development team to work well together.  The focus is on keeping collaboration processes simple and organized. It is not a “magical” cure-all solution.  It still requires that the company hires the right people with the right aptitude and attitude for the team, and that the team uses common sense to work with each other, and more importantly, that the product we are developing finds the right product-market fit (lean start-up).  A product team can be top notch, but if the product fails to gain market acceptance, we are still doomed.

For a start-up product (or more generally, software project) to be successful, it needs to have BOTH market traction and excellent product execution, product execution using “Scrum” and the agile development methodology as explained in this post.  And market traction, as a completely separate topic and as a story for another time, depends on the ability of the product owner and founders of the start-up to determine market size and the market need for their start-up product.

  • Hou GuoChen

    love this summary calvin! was wondering if you have an equivalent git workflow to supplement Scrum?

    • Sounds good @guochen. Will make a post on that soon.