What Is Data Fabrication in TDM
by Carlos Schults
In today’s post, we’ll answer what looks like a simple question: what is data fabrication in TDM? That’s such an unimposing question, but it contains a lot for us to unpack.
What is TDM to begin with? Isn’t data fabrication a bad thing? The answer to the last question is no, not in our context. And what about TDM? Well, it stands for Test Data Management, and it’s the process of providing quality data for your software testing process.
The problem is that providing quality data for your software testing process is way trickier than it sounds. And one of the trickiest parts of this already tricky process is obtaining the data itself. This post is all about one of the various techniques you can use to get test data. By the end of the post, you’ll know:
- what TDM is in detail and why it’s so important
- the shortcomings of different approaches to obtain test data
- how data fabrication can solve them
Sounds good? Then let’s dig in.
Let’s start with some basics on test data management. We’ll define TDM and explain why it’s essential. Feel free to skip this section if you’re already familiar with TDM. Otherwise, keep reading.
What Is Test Data Management in Software Testing?
I’ve already talked about the what, why, and how of TDM at length before. In that post, I offered the following definition:
Test data management (TDM) is the process of obtaining and administrating the data needed for test automation processes, with minimal human intervention. TDM must ensure not only the quality of the data but also its availability.
That is, TDM must ensure that the test data exists and that it’s available to test cases when needed. And all of that, preferably, in an automated way. But let’s now take a step back and examine the need for quality when it comes to testing data.
Garbage In, Garbage Out: The Importance of High-Quality Test Data
Is quality really so important to software testing? After all, this isn’t real data used by real customers. Why care so much about it?
The answer to that can be summarized with the saying “garbage in, garbage out.” No matter what you’re doing, the quality of input matters a lot. If you give awful ingredients to a five-star chef and expect a great meal, you’re in for some disappointment.
The same reasoning applies to test data. Your test processes might be the best in the world, but if you feed bad data into your tests, you won’t get adequate results.
Data Fabrication in TDM: Why Do You Need It?
Before we get to the meat of the post where we’ll explain what data fabrication is and why you need it, we’ll take a step back and analyze the kind of problem that data fabrication solves.
Production Cloning and Why It’s Painful
One of the most-used techniques people use to obtain realistic test data is copying from production. It solves some crucial challenges related to the realism and availability of test data. You can’t get more real than the real thing.
However, production cloning comes with some problems of its own. One of them is that you can’t just copy real user data and use it as is. For security and privacy reasons, you have to obfuscate the data using techniques like data masking. Employing data masking adds another layer of complexity to the process.
Another production cloning–related challenge is the high cost, especially when it comes to infrastructure. If you need to copy 100 percent of your test data into your test environment, you’ll incur high storage and infrastructure costs. And it doesn’t stop there: nowadays it is common for organizations to have multiple test environments. So you’d be paying this enormous cost over and over again.
Data Fabrication Can Help You
We’ll now cover what data fabrication is and how it can help you. First, a disclaimer: data fabrication has another meaning, as in “creating false data to support a predetermined conclusion in scientific experiments.” Rest assured that this is certainly not what we’re talking about here!
Our data fabrication is also called synthetic data generation or simply data generation. And it is precisely what its name suggests: a technique to provide test data for test cases by generating it.
Data fabrication presents a number of benefits when compared to alternative techniques to obtain test data, particularly production cloning. That’s what we’ll cover next.
Data Fabrication Benefits
If you already have high-quality test data at your fingertips in the form of real data, why would you want to use data fabrication? That’s what we’ll see now: the main reasons why data fabrication might be the best solution.
It Doesn’t Require Masking or Other Obfuscation Techniques
The first big pro of data fabrication or data generation is that you don’t run the risk of exposing or leaking real user data. Since the generated data will be 100 percent synthetic, you won’t need to use techniques such as data masking to protect users’ privacy and security.
That’s one step less in the “obtaining data” phase of your TDM process. The whole process becomes easier, faster, and cheaper. As a bonus, you’ll sleep better at night knowing that you don’t run the risk of violating GDPR or other similar regulations.
It Doesn’t Require Data Subsetting
Data subsetting is the process of getting a smaller portion, a subset, of a production database and moving it somewhere else. When doing production cloning, organizations typically perform data subsetting instead of getting all the data. Since you don’t usually need the same amount of data as you have in production, data subsetting helps you keep your test environment costs down.
However, data subsetting is yet another additional step in your TDM pipeline. Getting rid of it helps you streamline your process, making it simpler, faster, and easier to manage. And leveraging data fabrication allows you to do just that; since you’re creating the test data, you can generate just the amount you need.
It Allows for Different Kinds of Tests
The fact that production cloning gives you real data might seem like a blessing, but it can often be a curse.
You might find yourself in a scenario where what you need is wrong or invalid data. For instance, let’s say you need to perform negative testing in order to see how the system behaves when fed with bad data. Well, in that situation, you do want bad data to emulate unwanted user input or invalid data coming from a third-party system (like a REST API.) While production cloning will only give you the real deal when it comes to data generation, you can generate anything you want, include faulty data.
Test Data: Fabricate It Till You Make It!
Obtaining high-quality test data is essential if you want your organization to have a healthy QA strategy. Some things are easier said than done, though, and acquiring great test data is one of those things.
There are several strategies an organization can use to come up with realistic test data. Production cloning is likely the most popular of said strategies. Another well-known approach is data fabrication, aka synthetic data generation, and that was what today’s post was all about. You now understand not only what data fabrication is but also why you need it in the first place. You also know some of the benefits it provides when compared with other techniques such as production cloning.
Keep in mind that while production cloning isn’t a silver bullet, data fabrication isn’t either. Both are tools that are worth keeping in your toolbelt. When the need arises, you can then make an informed decision about the solution that best suits your organization’s needs.
This post was written by Carlos Schults. Carlos is a .NET software developer with experience in both desktop and web development, and he’s now trying his hand at mobile. He has a passion for writing clean and concise code, and he’s interested in practices that help you improve app health, such as code review, automated testing, and continuous build.
21APRIL, 2021 by Zulaikha GreerWhat Is Privacy by Design? Millions of dollars go into securing the data and privacy of an organization. Still, malicious attacks, unnecessary third-party access, and other data security issues still prevail. While there is no definite...
31MARCH, 2021 by Ukpai UgochiSo, As the leader of a DevOps or agile team at a rising software company, how do you ensure that users' sensitive information is properly secured? Users are on the internet on a daily basis for communication, business, and so on. While...
24MARCH, 2021 by Taurai MutimutemaKnowledge is more important than ever in businesses of all types. Each time an engineer makes a decision, the quality of outcomes (always) hangs on how current and thorough the data that brought about their knowledge is. This...
19 FFEBRUARY, 2021 by Carlos Schults "You can't improve what you don't measure." I'm sure you're familiar with at least some variation of this phrase. The saying, often attributed to Peter Drucker, speaks to the importance of metrics as fundamental tools to enrich and...
08 FEBRUARY, 2021 by Zulaikha Greer Data is the word of the 21st century. The demand for data analysis skills has skyrocketed in the past decade. There exists an abundance of data, mostly unstructured, paired with a lack of skilled professionals and effective tools to...
04 JANUARY, 2021 by Ukpai Ugochi Have you ever wondered what would happen if you mistakenly added bugs to your codes and shipped them to users? For instance, let's say an IT firm has its primary work tree on GitHub, and a team member pushes codes with bugs to the...