A Product Manager’s Place
In a DevOps World
DAVE MEYER | SENIOR PRODUCT MANAGER | ATLASSIAN | @D_MEYER
What does a product
manager do?
BIG HAIRY QUESTION
Tech. Sgt. Brad Fallin, U.S. Air Force; Source (https://commons.wikimedia.org/wiki/File:F-15C.jpg)
National Aeronautics and Space Administration (NASA); Source (https://commons.wikimedia.org/wiki/File:STSCPanel.jpg)
Gus Pasquarella; Source (https://commons.wikimedia.org/wiki/File:Hindenburg_burning,_1937.jpg)
What does a product
manager care about?
BIG HAIRY QUESTION #2
Looking good
BIG HAIRY QUESTION #2
Customers
How do you
evolve?
Lasse Fuss; Source (https://commons.wikimedia.org/wiki/File:Lufthansa_A380_D-AIMA-1.jpg)
DevOps
Collaboration between dev
and IT
SRE
Site Reliability Engineering
DevOps vs SRE
BEN TRAYNOR, GOOGLE
SRE is what happens when a
software engineer is tasked
with operations
“Keys to SRE”
All product teams are ops teams now
Keep the
thing
running
SHIP FEATURES
PM DEV TEAM
GET FEEDBACK
SHIP MORE FEATURES
(ship features)
(Re)align your priorities
Source (https://commons.wikimedia.org/wiki/File:KC-97G_Illinois_ANG_refueling_F-100C_DC_ANG_1964.jpg)
Your tactics
Reliability as a feature
Support the culture
Managing incidents
You own features all the
way to release, then
past release, then
forever.
Nessy-Pic; Source (https://commons.wikimedia.org/wiki/File:Caernarfon_Castle_Walls.jpg)
If you can’t measure it, you
can’t improve it it’s probably
broken and your customers
are tweeting about it.
Error rates
Is there a new
problem in the
system?
What dev teams measure in production
Performance
Is the system running
at the same speed?
Behavior
Are the things we
expect users to do
happening?
Behavior
Are the things we
expect users to do
happening?
Error rates
Is there a new
problem in the
system?
Performance
Is the system running
at the same speed?
Alerting
Do you know about
it?
What dev teams measure in production
Something bad
403 errors in project creation have
spiked!
Rewiring your brain
React in minutes
MTTR is the key to happy customers
Wait for support
Support response time is the key to
happy customers
RELIABILITY AS A FEATURE: PERFORMANCE
How Apdex
changed
JIRA Cloud
What is Apdex?
GOOD REQUESTS 0.5(OK REQUESTS)
TOTAL REQUESTS
0 - 1
RUF breakdown 🐶
0
0.125
0.25
0.375
0.5
January 15 Feb Mar Apr May Jun July Aug Sep Oct Nov Dec Jan 16
33.8%
31.3% 31.1%
32.8%
30.3% 31.5%
34.5% 33.5% 32.8%
28.8%
19.2%
16.7% 16.8%
41.7% 41% 41.8%
43.7%
40%
43.9% 43.1% 42.1%
43.7%
39.7%
43.1% 43.9% 42.8%
20.3%
21.8% 21%
19.5% 20.4% 19.5%
18%
20%
15.8% 15.4%
9.5% 8.1% 7.9%
Reliability Usability Functionality
Performance Mentions vs Apdex
0
0.175
0.35
0.525
0.7
4.5%
9%
13.5%
18%
January 15 Feb Mar Apr May Jun July Aug Sep Oct Nov Dec Jan 16
% Mention Apdex
JIRA Cloud performance is
now reasonable instead of
feeling like grandmother’s
old laptop.
JIRA CLOUD CUSTOMER
NPS ++
RELIABILITY AS A FEATURE: PERFORMANCE
RELIABILITY AS A FEATURE
Balancing your
roadmap
Your tactics
Reliability as a feature
Support the culture
Managing incidents
Release
Roll-out
End-to-end involvement
Post-release
Incident management
Pre-release
Operational readiness
Have a checklist
Processes build confidence
Pair with an expert
Discuss impact of features on performance and
error rates with SRE
Document your decisions
Make sure nobody is in the dark
Are you
ready to
release?
Operational
Readiness: Credo
We automatically clone
this template for every
new service at
Atlassian.
We made PMs become service
owners, otherwise they just pay
lip service to operational
excellence.
PAUL SLADE, ATLASSIAN IDENTITY HEAD OF ENGINEERING
Tomorrow
Checklist-zero
Today
Checklists are better than prayers
Feature flags
Separating “deploying the code” from
“reeleasing the change”
Allow quick iteration

Encourage PMs to plan iterative rollouts
Have a checklist
Processes build confidence
Pair with an expert
Discuss impact of features on performance and
error rates with SRE
Document your decisions
Make sure nobody is in the dark
Are you
ready to
release?
Have a checklist
Processes build confidence
Pair with an expert
Discuss impact of features on performance and
error rates with SRE
Document your decisions
Make sure nobody is in the dark
Are you
ready to
release?
go.atlassian.com/daci
Your tactics
Reliability as a feature
Support the culture
Managing incidents
An event which causes
disruption to or a reduction in
the quality of services and
customer productivity.
WHAT IS AN INCIDENT?
If it affects customers, it’s
your problem.
WHY DO YOU CARE?
Know your role.
INCIDENT MANAGEMENT FOR PRODUCT MANAGERS
Your job is
not to fix it.
You own the
customer
relationship.
Assess
Help dev and SRE
understand impact
Communicate
Own customer
communications
A PM during an incident
Responsible
Even when it’s not
your fault, it’s your
fault.
Clear
No BS
Active
What are you doing
about it?
Empathetic
Respect the
customer
Great customer communication
Preventing
the next one
What a successful
PIR looks like
Summary
Tell me what happened.
Root cause
Tell me exactly why it
happened.
Actions
Tell me how you’re going to
make sure it doesn’t happen
again.
What a successful PIR looks like
“Business value”
is so much more
than features
THE PM IN THE DEVOPS WORLD
DAVE MEYER | SENIOR PRODUCT MANAGER | ATLASSIAN | @D_MEYER
🎊Thanks🎊

A Product Manager's Place in a DevOps World