Test Environments – The Tracks for Agile Release Trains
by Niall Crawford
Definition: An Agile Release Train is basically a number of teams (a portfolio) responsible for the regular release of features and business benefits. All the teams are bound by a common set of goals, a program backlog, and a roadmap. ART is central to understanding and implementing a Scaled Agile Framework.
And why not? An Agile Release Train (or Enterprise Release Management) methodology is usually much better than the alternative chaos of different project teams running off in different directions (as “fast” as they can), competing for shared resources (service & systems), misaligning group priorities and ultimately causing collective delivery delays due to mismanaged dependencies & relationships with other teams.
If implemented correctly ART will help IT deliver on the necessary IT business transformations as quickly and safely as possible, and ultimately deliver timely solutions into production and to the end-customers.
Key Benefits of the Agile Release Train
- Increased Collaboration
- Improved Change (Feature) Throughput
- Controlled Velocity
- Cross Team Productivity
- Risk Cognizance / Awareness
- Circumvent Release Failure
- Delivery Streamlining
So, we get started by each team loading up the train carriages with Features & Change.
And we collectively commence out journey towards production.
Then the proverbial “wheels fall off”.
Delays in Development, System Test, Integration, UAT & Staging due to:
- Test environment unreadiness (i.e. engineering team is still building it)
- Test environment contention (i.e. BAU Team currently has it)
- Test environment instability due to too much unplanned change
- Test environment systems are not fit for purpose e.g. wrong scale or version or integrations
And the risk of overspend, for example:
- Need for more systems (infrastructure & licensing) to address contention
- Need for more support (services) to accelerate tasks & remediate
And suddenly our ART suddenly looks like something out of “Thomas the Tank Engine”.
The problem with trains, whether real or agile, is they must follow a rail track and delays & collisions will be inevitable if tracks (or the stations) are inappropriately sized, incorrectly built, mismanaged and not kept clear.
In the case of your Agile Release Trains, imagine the train stations as your lifecycle. The ART will travel through each station (Development, System Test, Integration, UAT & Staging) to allow the necessary on-boarding of fixes (good commuters) & offboarding of defects (bad commuters).
Oiling the Track
In IT, preparing the rail track is analogous to the task of IT & Test Environment Management. A multi-faceted set of discipline – refer to the EMMI (Environment Management Maturity Index) – that ensures appropriate:
- Understanding, Mapping & Modelling of Environments & Systems
- Capturing of Demand & Managing of Contention
- Planning & Coordination of Preparation Activities
- Lean Service Management
- Standardised & Repeatable Operations
e.g. Application Deployment & Configuration Activities, Data Masking etc.
- And Continual Analysis & Reporting for Improvement
Benefits to ART of implementing effective Test Environments Management
After bad requirements management, Test Environments are the number one reason for Project delays. Hardly surprising when you consider that is where Projects (and I guess the Agile Release Trains) spends 95% of their time.
By implementing a proper TEM framework (tracks), you ensure:
- Environments Readiness (systems prepared in advance)
- Environments Suitability (systems fit for purpose)
- Environment Stability (disruption/outage avoidance)
- Release Team Productivity (more time to Develop & Test)
- Release Streamlining (Maglev style) &
- Reduced IT Costs through better project sharing & post release housekeeping
So next time someone mentions the ART, ask them about the readiness of the tracks. As trains don’t go too far without them.
Learn More, or Share Ideas
If you’d like to learn more about Release or Environment Management or perhaps just share your own ideas, then feel free to contact the enov8 team. Enov8 provides a complete platform for addressing organisations “DevOps at Scale” requirements. Providing advanced “out of the box” IT & Test Environment Management, Release Management and Holistic Data Management capabilities.
Niall is the Co-Founder and CIO of Enov8. He has 25 years of experience working across the IT industry from Software Engineering, Architecture, IT & Test Environment Management and Executive Leadership. Niall has worked with, and advised, many global organisations covering verticals like Banking, Defence, Telecom and Information Technology Services.
Do you ever wonder why the environment preparation or releases take so long? After all, the company just invested “zillions” on a whole bunch of great tools and a cloud framework.
It goes without saying, that the backbone of all organizations today is digital and independent of the end-products you provide, there is an inherent need to drive your features and solutions from conception to production…
I am continually ‘un-amazed’ when I go into large organizations and look at their ‘DevOps’ strategy. At a team level, it’s invariably no different to what we were doing back in the late 90’s…
The intention of environment synthetics is to provide ‘high-level of confidence’ applications (your system instances e.g. UAT Home Loan System) and their underlying component services…
DevOps & DevOps at Scale is little a bit like comparing the building of Sand Castles on a Beach to Town Planning. Here are 5 practices to promote as a way of preparing for a DevOps at scale capability…
This year’s world quality report (2018) has once again identified Test Environment Management as a major challenge for Agile Development & Testing. Key statistical insights from this report included…