LF

Test Environment Metrics – Measure and Continually Improve your Operations

22

AUGUST, 2017

by Niall Crawford

Metrics for your Non Production and Test Environments

Ever wondered how you should measure your Test Environment capability? Well it can be hard without a platform like Enov8 Ecosystem, a solution that allows you to bring all your Test Environment and Operations together.

Here is a list, compiled by Enov8 and our friends at TEM (dot) Com, to help you. If you have more ideas, then please let us know as we are always looking to obtain knowledge and improve our own dashboard reports using the EcoSystem extensible engine.

TEM METRICS

Preamble: A key component of Test Environment Management is the ongoing measurement and optimization of your TEM practices. Below, is a list of metrics that should be captured as part of establishing Test Environment Management capability.

Note: These are not exhaustive, however capturing this information will set you on your way to implementing a successful TEM services organisation.

Environment Coverage

  • % of Test Environment Systems (Instances) under management (within CMDB)
  • % of Test Environment Systems (Instances) with rich knowledge (IP) attached

Environment Usage

  • Historical Usage of Test Environment Systems (Instances)
  • Future (Planned) Usage of Test Environment Systems (Instances)

Environment Agility

  • Time to Set Up an E2E Environment
  • Time to Setup Systems (Instances)

Environment Availability

  • Availability of Environment
  • Availability of Systems (Instances)

Operational Metrics – Change

  • Number of System Changes
  • Outage caused by Change
  • % of Failed vs Successful Changes
  • % of Tasks Automated vs Manual

Operational Metrics – Release

  • Number of System Releases
  • Outage caused by Release
  • % of Failed vs Successful Releases
  • % of Tasks Automated vs Manual

Operational Metrics – Data Refresh

  • Number of System Data Refreshes
  • Time to do a Data Refresh
  • % of Failed vs Successful Data Refresh’s
  • % of Tasks Automated vs Manual

Any further suggestions: Send us an email via our contact form.

About EcoSystem: Enov8 EcoSystem is the worlds leading Test Environment management platform. If you are interested in improving test / non-production environment resilience, streamlining DevOps & environment operations, reducing time to complete your IT projects and optimize and reduce your IT costs, then let us know.

 

Relevant Articles

Pitfalls with DevOps at Scale

12JUNE, 2018 by Christian Meléndez Let's get started by defining what DevOps is. I know, I know; there are tons of definitions. But the one I like most is from Gene Kim: DevOps is those set of cultural norms and technology practices that enable the fast flow of...

Agile Release Train Smells – The Most Common Mistakes

Whether your organization is starting an agile transformation now or is well on its way, there are always pitfalls. Scaled Agile Framework (SAFe) is a big leap for most organizations. After all, even if some of your development teams…

The Hats of Release Management

The roles of governing Enterprise Release Management and the Deployment Management are complementary, yet involve various different functions (or sets of many hats)…

What is Enterprise IT Intelligence?

We have all heard of the term Business Intelligence (BI), coined in 1865 and described more recently by Gartner as “an umbrella term that includes the applications,…

The Online EMMi Assessment

    10   MAY, 2018 by Niall Crawford Ever wondered how mature your IT & Test Environment Management practices are? Well here at Enov8, over the last few years, we have been building a model called the EMMi (the Environment Management Maturity Index)   Originally...