LF

Test Environment Metrics – Measure and Continually Improve your Operations

22

AUGUST, 2017

by Niall Crawford

Metrics for your Non Production and Test Environments

Ever wondered how you should measure your Test Environment capability? Well it can be hard without a platform like Enov8 Ecosystem, a solution that allows you to bring all your Test Environment and Operations together.

Here is a list, compiled by Enov8 and our friends at TEM (dot) Com, to help you. If you have more ideas, then please let us know as we are always looking to obtain knowledge and improve our own dashboard reports using the EcoSystem extensible engine.

TEM METRICS

Preamble: A key component of Test Environment Management is the ongoing measurement and optimization of your TEM practices. Below, is a list of metrics that should be captured as part of establishing Test Environment Management capability.

Note: These are not exhaustive, however capturing this information will set you on your way to implementing a successful TEM services organisation.

Environment Coverage

  • % of Test Environment Systems (Instances) under management (within CMDB)
  • % of Test Environment Systems (Instances) with rich knowledge (IP) attached

Environment Usage

  • Historical Usage of Test Environment Systems (Instances)
  • Future (Planned) Usage of Test Environment Systems (Instances)

Environment Agility

  • Time to Set Up an E2E Environment
  • Time to Setup Systems (Instances)

Environment Availability

  • Availability of Environment
  • Availability of Systems (Instances)

Operational Metrics – Change

  • Number of System Changes
  • Outage caused by Change
  • % of Failed vs Successful Changes
  • % of Tasks Automated vs Manual

Operational Metrics – Release

  • Number of System Releases
  • Outage caused by Release
  • % of Failed vs Successful Releases
  • % of Tasks Automated vs Manual

Operational Metrics – Data Refresh

  • Number of System Data Refreshes
  • Time to do a Data Refresh
  • % of Failed vs Successful Data Refresh’s
  • % of Tasks Automated vs Manual

Any further suggestions: Send us an email via our contact form.

About EcoSystem: Enov8 EcoSystem is the worlds leading Test Environment management platform. If you are interested in improving test / non-production environment resilience, streamlining DevOps & environment operations, reducing time to complete your IT projects and optimize and reduce your IT costs, then let us know.

 

Relevant Articles

100% Agile within a Year – The DevOps Cube

How could a large company, like a bank, be 100% agile? And how could they prove it?
I see two fundamental challenges or truisms: 1. Companies are federated 2. Measuring Agile is Difficult

Test Environment Anti-Patterns

Test Environments Anti Patterns
A common term used in the world of Software Development is the concept of Anti-Patterns. An Anti-Pattern is basically a commonly occurring approach to a problem or task that generates decidedly negative consequences…

How Enov8 Can Help you Achieve True DevOps

DevOps is a set of practices that automates the processes between software development and IT teams, allowing them to build, test, and release software faster and more reliably. The concept of DevOps is based on collaboration between teams that historically functioned in relative silos…

How to Reduce Environment Downtime

Reduce Test Environment Downtime – In this blog article, we will discuss about how test environment managers can minimise environment downtime and how enov8 can help in achieving this dream.

Why do we need Release Gates?

Before starting this topic on importance of Release Gates, lets understand – what is a release gate?
A Release Gate can be defined as a milestone or health indicator of a release at that very point in time…