LF

Test Environment Metrics – Measure and Continually Improve your Operations

22

AUGUST, 2017

by Niall Crawford

Metrics for your Non Production and Test Environments

Ever wondered how you should measure your Test Environment capability? Well it can be hard without a platform like Enov8 Ecosystem, a solution that allows you to bring all your Test Environment and Operations together.

Here is a list, compiled by Enov8 and our friends at TEM (dot) Com, to help you. If you have more ideas, then please let us know as we are always looking to obtain knowledge and improve our own dashboard reports using the EcoSystem extensible engine.

TEM METRICS

Preamble: A key component of Test Environment Management is the ongoing measurement and optimization of your TEM practices. Below, is a list of metrics that should be captured as part of establishing Test Environment Management capability.

Note: These are not exhaustive, however capturing this information will set you on your way to implementing a successful TEM services organisation.

Environment Coverage

  • % of Test Environment Systems (Instances) under management (within CMDB)
  • % of Test Environment Systems (Instances) with rich knowledge (IP) attached

Environment Usage

  • Historical Usage of Test Environment Systems (Instances)
  • Future (Planned) Usage of Test Environment Systems (Instances)

Environment Agility

  • Time to Set Up an E2E Environment
  • Time to Setup Systems (Instances)

Environment Availability

  • Availability of Environment
  • Availability of Systems (Instances)

Operational Metrics – Change

  • Number of System Changes
  • Outage caused by Change
  • % of Failed vs Successful Changes
  • % of Tasks Automated vs Manual

Operational Metrics – Release

  • Number of System Releases
  • Outage caused by Release
  • % of Failed vs Successful Releases
  • % of Tasks Automated vs Manual

Operational Metrics – Data Refresh

  • Number of System Data Refreshes
  • Time to do a Data Refresh
  • % of Failed vs Successful Data Refresh’s
  • % of Tasks Automated vs Manual

Any further suggestions: Send us an email via our contact form.

About EcoSystem: Enov8 EcoSystem is the worlds leading Test Environment management platform. If you are interested in improving test / non-production environment resilience, streamlining DevOps & environment operations, reducing time to complete your IT projects and optimize and reduce your IT costs, then let us know.

 

Relevant Articles

IT Environments – Top 5 Deployment Metrics

03 February, 2019 By Christian Meléndez. Preamble: Following on from our previous blog on Enterprise Release Management bench-marking, Christian talks about the “sister disciple” of deployment management and more specifically the top 5 metrics one could use to better...

IT & Test Environment Management Anti Patterns #2 – Containers

29 JANUARY, 2019 By Sylvia Fronczak.   Anti-patterns often arise when developers find creative or outside-the-box uses for a technology - or when they find workarounds for limitations that were specifically put in place by the creators of the technology to prevent...

IT Environments – Why Use Microservices?

08 JANUARY, 2019 By Eric Goebelbecker. New technologies and new ways of doing things are continually impacting the way our IT Environments evolve and how we do things. One area of growing popularity is Microservices.   Why Use Microservices? Why should you start using...

Why DevOps Fails: A Closer Look

09 DECEMBER, 2018 by Sylvia Fronczak DevOps promises greater innovation, speed, and automation—along with a more engaged and motivated team. With this list of benefits, many organizations are working to bring DevOps to their teams. However, with all the companies...

Test Environments – Why Containers?

22 OCTOBER, 2018 by Eric Goebelbecker Containers are nothing new. Depending on how you look at it, you can make a case for them being around at least since 1982. But since the introduction of Docker in 2013, they’ve enjoyed a surge of popularity. Why? In just a few...

Why Cloud “Server” Tagging Strategies Are Important

15 OCTOBER, 2018 by Christian Meléndez Preamble A key part of Enterprise IT Intelligence is understanding you Cloud Resources. And where better to start than using the "elegant" concept of Tagging. A concept used across the various cloud and infrastructure management...