LF

Test Environment Metrics – Measure and Continually Improve your Operations

22

AUGUST, 2017

by Niall Crawford

Metrics for your Non Production and Test Environments

Ever wondered how you should measure your Test Environment capability? Well it can be hard without a platform like Enov8 Ecosystem, a solution that allows you to bring all your Test Environment and Operations together.

Here is a list, compiled by Enov8 and our friends at TEM (dot) Com, to help you. If you have more ideas, then please let us know as we are always looking to obtain knowledge and improve our own dashboard reports using the EcoSystem extensible engine.

TEM METRICS

Preamble: A key component of Test Environment Management is the ongoing measurement and optimization of your TEM practices. Below, is a list of metrics that should be captured as part of establishing Test Environment Management capability.

Note: These are not exhaustive, however capturing this information will set you on your way to implementing a successful TEM services organisation.

Environment Coverage

  • % of Test Environment Systems (Instances) under management (within CMDB)
  • % of Test Environment Systems (Instances) with rich knowledge (IP) attached

Environment Usage

  • Historical Usage of Test Environment Systems (Instances)
  • Future (Planned) Usage of Test Environment Systems (Instances)

Environment Agility

  • Time to Set Up an E2E Environment
  • Time to Setup Systems (Instances)

Environment Availability

  • Availability of Environment
  • Availability of Systems (Instances)

Operational Metrics – Change

  • Number of System Changes
  • Outage caused by Change
  • % of Failed vs Successful Changes
  • % of Tasks Automated vs Manual

Operational Metrics – Release

  • Number of System Releases
  • Outage caused by Release
  • % of Failed vs Successful Releases
  • % of Tasks Automated vs Manual

Operational Metrics – Data Refresh

  • Number of System Data Refreshes
  • Time to do a Data Refresh
  • % of Failed vs Successful Data Refresh’s
  • % of Tasks Automated vs Manual

Any further suggestions: Send us an email via our contact form.

About EcoSystem: Enov8 EcoSystem is the worlds leading Test Environment management platform. If you are interested in improving test / non-production environment resilience, streamlining DevOps & environment operations, reducing time to complete your IT projects and optimize and reduce your IT costs, then let us know.

 

Relevant Articles

How Data Breaches Happen?

08 OCTOBER, 2019 by Michiel Mulders Preamble You’ve probably seen some recent articles asserting that the world’s most valuable resource is no longer oil—it’s data. New internet titans like Google, Amazon, Apple, Facebook, and Microsoft look unstoppable. In fact,...

DevOps and TEM Go Hand in Glove

25 SEPTEMBER, 2019 by Mark Henke DevOps is overall a healthy practice for most development teams, but it doesn’t come for free. Enterprises are eager to adopt the practice but their tools often lag behind DevOps practices. This is a bit like walking out into the...

Data Security (Scale and Bees)

25 AUGUST, 2019 by Jane Temov Data security, The problem is scale & a lack of bees One of the biggest challenges of securing one’s enterprise data is the sheer volume. Think about it. Hundred (perhaps Thousands) of Applications, Thousands (perhaps Tens of Thousands)...

The Test Environment Management Plan Template

13 AUGUST, 2019 by Jane Temov So, you’ve been asked to write a “Test Environment Management Plan”? Or perhaps you just want to write a plan to baseline your current non-production processes, outline future test environment strategy and/or educate those around you. *...

Five Reasons You Need Enterprise Configuration Management

02 AUGUST, 2019 by Eric Olsson Preamble Software is buggy. It's a bold claim, I know. Sarcasm aside, the battle to keep your applications up and running is ongoing. Wouldn't it be nice if you had a way to eliminate an entire class of bugs from your application?...

Software Testing Anti Patterns

15 JULY, 2019 by Peter Morlion Martin Fowler AntiPattern "An antipattern is a solution that initially looks like an attractive road lined with flowers... but further on leads you into a maze filled with monsters."   Since the dawn of computers, we’ve always had to...