Industry Voice: 6 key tips for measuring DevOps performance

Does measuring slow you down?

Yes, but so does stopping to look at a map, I assume I don't need to expand on that metaphor? If you think of measuring purely as an activity, it will always be seen as an overhead, because it takes time and doesn't directly relate to the work at hand. However, if you want to measure progress towards an outcome or a goal, then you will generally progress faster with periodic measurements because you can course-correct.

Think of it as the difference between running in any direction vs. running perhaps slightly more slowly, but always towards the goal. In the long run, it's going to save you both money and time.

How do you measure trust and cultural aspects in general?

Maybe you can't measure culture directly, but you can measure it indirectly. Start by looking at things you would only find in a high trust culture. Things such as high levels of autonomy, low levels of bureaucracy and process. Perhaps one method that is slightly harder to measure, but worth noting, is observing attitudes to failure, people will be less scared to fail in a high trust environment or a genuine ‘no blame' culture. You'll see people focussed on solving the problem or achieving the outcome rather than expending energy assigning and avoiding blame.

What are the most common mistakes you see?

Adopting the tools and processes without investing in changing the underlying mindset and habits. That is by far the most common. This is mostly in large companies, I think because it's much harder to affect cultural change in a large organisation, so much so that people often avoid it and focus on what they're more comfortable with (e.g. tooling).

How do you manage too few staff?

The most common response to any resource shortage is centralisation and rationing. This can go against a core principle underpinning DevOps where every team has everything they need (including DevOps skills) to deliver value within said team. Despite this, in most cases, scarcity forces what is often called a ‘liaison model' with a central DevOps team managed like a shared service.

However, rationing is a tactical response.  An alternative for the more long-sighted is to pair tactics with a more strategic approach which involves growing your own talent. We did this ourselves with our AL DevOps Academy because we understand first-hand how scarce the talent is. So, either an Academy model and/or a focus on upskilling your existing talent by partnering with companies like ours can ensure that you are always building your internal capability.

How do you change the culture from an IT concern to a business concern?

The most enduring way to achieve that shift is to change how you organise yourselves, and that is fundamentally what DevOps is, an organisational model designed to connect a team with a business goal, usually through a product or service. Start on a small scale (with one team) and grow it out, that's one of the great things about DevOps, it scales very easily.

How do you take the next step to tackle the larger aspects of legacy infrastructure?

The first step in scaling anything is to systematise it and to do that, you need a framework. The only thing I would add to that is that even with a framework, you can only be as effective as your most senior stakeholder. In order to move beyond experimentation and effect the necessary organisational changes that are required to scale, generally requires senior management support. That's senior management from the whole business, not just from those focussed on IT, it has to be the whole leadership team getting involved. 

Head to Automation Logic's dedicated benchmarking site DevOps Advance, where you can gain a better understanding of your DevOps performance today, across technology, process, and people, and how to take it to the next level. Get the results you need to:

- assess capabilities

- identify weaknesses

- adopt best practices

- accelerate speed, agility and quality of delivery

Take the digital assessment today to discover how you fare, what might be holding you back and, ultimately, where to focus to improve your DevOps performance.

Take the assessment