Industry Voice: 6 key tips for measuring DevOps performance

clock • 3 min read

Automation Logic Partner and Co-Founder Kris Saxton tackles some of the most common questions and misconceptions when it comes to measuring how your DevOps processes are performing.

Does measuring slow you down?

Yes, but so does stopping to look at a map, I assume I don't need to expand on that metaphor? If you think of measuring purely as an activity, it will always be seen as an overhead, because it takes time and doesn't directly relate to the work at hand. However, if you want to measure progress towards an outcome or a goal, then you will generally progress faster with periodic measurements because you can course-correct.

Think of it as the difference between running in any direction vs. running perhaps slightly more slowly, but always towards the goal. In the long run, it's going to save you both money and time.

How do you measure trust and cultural aspects in general?

Maybe you can't measure culture directly, but you can measure it indirectly. Start by looking at things you would only find in a high trust culture. Things such as high levels of autonomy, low levels of bureaucracy and process. Perhaps one method that is slightly harder to measure, but worth noting, is observing attitudes to failure, people will be less scared to fail in a high trust environment or a genuine ‘no blame' culture. You'll see people focussed on solving the problem or achieving the outcome rather than expending energy assigning and avoiding blame.

What are the most common mistakes you see?

Adopting the tools and processes without investing in changing the underlying mindset and habits. That is by far the most common. This is mostly in large companies, I think because it's much harder to affect cultural change in a large organisation, so much so that people often avoid it and focus on what they're more comfortable with (e.g. tooling).

How do you manage too few staff?

The most common response to any resource shortage is centralisation and rationing. This can go against a core principle underpinning DevOps where every team has everything they need (including DevOps skills) to deliver value within said team. Despite this, in most cases, scarcity forces what is often called a ‘liaison model' with a central DevOps team managed like a shared service.

However, rationing is a tactical response.  An alternative for the more long-sighted is to pair tactics with a more strategic approach which involves growing your own talent. We did this ourselves with our AL DevOps Academy because we understand first-hand how scarce the talent is. So, either an Academy model and/or a focus on upskilling your existing talent by partnering with companies like ours can ensure that you are always building your internal capability.

How do you change the culture from an IT concern to a business concern?

The most enduring way to achieve that shift is to change how you organise yourselves, and that is fundamentally what DevOps is, an organisational model designed to connect a team with a business goal, usually through a product or service. Start on a small scale (with one team) and grow it out, that's one of the great things about DevOps, it scales very easily.

How do you take the next step to tackle the larger aspects of legacy infrastructure?

The first step in scaling anything is to systematise it and to do that, you need a framework. The only thing I would add to that is that even with a framework, you can only be as effective as your most senior stakeholder. In order to move beyond experimentation and effect the necessary organisational changes that are required to scale, generally requires senior management support. That's senior management from the whole business, not just from those focussed on IT, it has to be the whole leadership team getting involved. 

Head to Automation Logic's dedicated benchmarking site DevOps Advance, where you can gain a better understanding of your DevOps performance today, across technology, process, and people, and how to take it to the next level. Get the results you need to:

- assess capabilities

- identify weaknesses

- adopt best practices

- accelerate speed, agility and quality of delivery

Take the digital assessment today to discover how you fare, what might be holding you back and, ultimately, where to focus to improve your DevOps performance.

You may also like
DevOps Excellence Awards shortlist revealed: Recognising achievement across the industry


Leading entrants recognised for driving innovation and excellence in the field of DevOps

clock 26 January 2023 • 5 min read
Interview: Automation Logic, Digital Technology Leaders Awards finalist


"At Automation Logic, we help our clients unlock the value of business transformation through cloud adoption"

clock 27 June 2022 • 4 min read
DevOps: Start large or start small, but never forget about communication


Whether you specialise or try to learn the entire tech stack, remember the three Cs of DevOps: concepts, communication and conflict resolution

clock 13 December 2021 • 5 min read

Sign up to our newsletter

The best news, stories, features and photos from the day in one perfectly formed email.

More on DevOps

DevOps Excellence Awards 2024 - in pictures

DevOps Excellence Awards 2024 - in pictures

clock 18 March 2024 • 1 min read
Winners announced at the DevOps Excellence Awards 2024

Winners announced at the DevOps Excellence Awards 2024

The most outstanding people, projects and companies in DevOps

clock 15 March 2024 • 2 min read
DevOps on mainframe at HSBC, DevOps Excellence Awards finalist

DevOps on mainframe at HSBC, DevOps Excellence Awards finalist

The benefits far outweigh the complexities

Mike Thompson
clock 13 March 2024 • 3 min read