LF

Test Environment Metrics – Measure and Continually Improve your Operations

22

AUGUST, 2017

by Niall Crawford

Metrics for your Non Production and Test Environments

Ever wondered how you should measure your Test Environment capability? Well it can be hard without a platform like Enov8 Ecosystem, a solution that allows you to bring all your Test Environment and Operations together.

Here is a list, compiled by Enov8 and our friends at TEM (dot) Com, to help you. If you have more ideas, then please let us know as we are always looking to obtain knowledge and improve our own dashboard reports using the EcoSystem extensible engine.

TEM METRICS

Preamble: A key component of Test Environment Management is the ongoing measurement and optimization of your TEM practices. Below, is a list of metrics that should be captured as part of establishing Test Environment Management capability.

Note: These are not exhaustive, however capturing this information will set you on your way to implementing a successful TEM services organisation.

Environment Coverage

  • % of Test Environment Systems (Instances) under management (within CMDB)
  • % of Test Environment Systems (Instances) with rich knowledge (IP) attached

Environment Usage

  • Historical Usage of Test Environment Systems (Instances)
  • Future (Planned) Usage of Test Environment Systems (Instances)

Environment Agility

  • Time to Set Up an E2E Environment
  • Time to Setup Systems (Instances)

Environment Availability

  • Availability of Environment
  • Availability of Systems (Instances)

Operational Metrics – Change

  • Number of System Changes
  • Outage caused by Change
  • % of Failed vs Successful Changes
  • % of Tasks Automated vs Manual

Operational Metrics – Release

  • Number of System Releases
  • Outage caused by Release
  • % of Failed vs Successful Releases
  • % of Tasks Automated vs Manual

Operational Metrics – Data Refresh

  • Number of System Data Refreshes
  • Time to do a Data Refresh
  • % of Failed vs Successful Data Refresh’s
  • % of Tasks Automated vs Manual

Any further suggestions: Send us an email via our contact form.

About EcoSystem: Enov8 EcoSystem is the worlds leading Test Environment management platform. If you are interested in improving test / non-production environment resilience, streamlining DevOps & environment operations, reducing time to complete your IT projects and optimize and reduce your IT costs, then let us know.

 

Relevant Articles

The Test Environment Management Plan Template

13 AUGUST, 2019 by Jane Temov So, you’ve been asked to write a “Test Environment Management Plan”? Or perhaps you just want to write a plan to baseline your current non-production processes, outline future test environment strategy and/or educate those around you. *...

Five Reasons You Need Enterprise Configuration Management

02 AUGUST, 2019 by Eric Olsson Preamble Software is buggy. It's a bold claim, I know. Sarcasm aside, the battle to keep your applications up and running is ongoing. Wouldn't it be nice if you had a way to eliminate an entire class of bugs from your application?...

Software Testing Anti Patterns

15 JULY, 2019 by Peter Morlion Martin Fowler AntiPattern "An antipattern is a solution that initially looks like an attractive road lined with flowers... but further on leads you into a maze filled with monsters."   Since the dawn of computers, we’ve always had to...

A Brief History of Configuration Management

26 June, 2019 by Justin Reynolds Gone are the days of monolithic software applications. In today’s microservices-and-continuous-integration driven world, where apps run in hybrid cloud environments and users engage with them on any device and on any underlying...

5 Red Flags DevOps Is Failing

03 JULY, 2019 by Justin Reynolds Even since the agile manifesto was published in 2001, software development has never been the same. In a pre-agile world, software was released in monolithic packages every year or every two years. The agile approach to development...

5 Red Flags Deployment Management Is Failing

20 MAY, 2019 by Mark Henke It’s a great step when teams deliberately manage their deployments instead of treating them as second-class citizens to writing code. But there are many pitfalls to managing deployments effectively. Many things lurk, waiting to trip us up....