Storage Testing : Getting Started!

-

Testing Network Attached Storage (NAS) and Storage Attached Network (SAN) are complex yet interesting topics. Although there are various vendors and products available in this space, at the core of the testing stack it all boils down to validating following things –
1           
  •     Protocols
  •     Filesystem
  •     Network
  •     Security
  •     Manageability
  •     Proprietary features


This article will mostly cover things at a high level that you may want to include in NAS testing and can be used as a point of reference for developing test plans and creating test cases.

First things first!

As with any other product testing, the Storage testing begins with requirements gathering and understanding the product under test. By doing requirements gathering you would be able to collect all the necessary information to scope out your QA effort and carry out your test cycle. From the testing point of view, following things would be of a high importance to know –
·         What type of Storage Array is it? Disk-based, All-Flash, Software-Defined? Your test strategy needs to be altered depending on the type of storage.
·         What type of testing need to be performed? Functional, System, Security, Regression?
·         Is it going to be an all manual effort or automated?
·         What is the targeted industry for the product?
·         The product is likely to be undergoing what types of workload?
·         Is there a possibility that a product will be deployed in a multi-application workload scenario?
·         What are the product’s limits, such as scalability (number of manageable files, raw and available storage capacity, maximum sustainable IOPs and Throughput, maximum number of supported objects)?
·         Is the storage unified? File and block in same box? Does it support Multi-protocol?
·         The versions of protocols that the product supports, ex. NFS v4 and SMB 3.0?

Plan you’re testing

Once you have collected answers to all the questions from the above section, it’s time to prepare for product testing. Typically Storage systems are best tested when they are under workload. The only exception is, when you are testing the product’s accessibility interfaces such as GUI, CLI and APIs. The reason why you should have test system under load is, that’s how they will be used in actual, production environment for which they are destined to. So if you test these systems in a similar way, your testing will possibly yield bugs much early in the product’s life-cycle. There are bunch of IO generator tools, synthetic or application specific available in both proprietary and open-source domains. Few examples are IOMeter, FIO, Workbench, VDBench, JetStress etc. You need to choose the tool based on your requirements and the type of workload you wish to test with.
For creating quality test cases, the answers that you gathered earlier will provide good pointers. Additionally read and understand product specifications, design specifications/limitations, recent customer escalations and supported features. Your test plan must cover extensive coverage for these things and your attempt should be to leave no corner untouched.

How do you think about storage testing? Please post your comments…


Happy testing!

Comments

Post a Comment

Popular posts from this blog

Docker: What is it? How can it be used in Testing?

-
Everyone's talking about Docker now a days! There are plenty of use cases it has in various different areas of technology domain. First let's get to know what Docker is! Docker is a container virtualization technology, which does not require any hypervisor to run it. Strange, isn't it? Well, not really… here is how it works! Docker relies on Linux Containers (a.k.a. LXC), which is a pretty old implementation of container technology. LXC uses two of the Linux Kernel capabilities: i) Cgroups ii) Namespaces Cgroups enables the system resource allocation, isolation; such as Memory and CPU etc. while Namespaces let each of the container to run in an isolated space with its process isolation capability, without interfering with other containers on the same system. The result - You can run large number of containers on your system. The only limiting factor will be your host system's resources! Now what makes Container Virtualization differ from Virt...
Read more

Smart Testing – In the age of Machine Learning!

-
Image
                 Artificial Intelligence and Machine Learning are becoming wide spread across various industries. It plays a vital role in developing sci-fi sounding stuff such as Self driving cars and more practical things that touch human lives almost every day, like Voice assistants, Chatbots, Smart power grids etc.   In Software testing, transition from traditional approach to CI/CD driven DevTestOps model is essential to cope up with increased release cadence. Test automation has helped keeping up with the required delivery speed, however adapting AI/ML capabilities in test automation will be a go-forward approach.   Evolution of Software testing To begin with, let’s review how Software testing has evolved over past few years.   As testing evolved, so does the tools & techniques. However to keep up with the pace of change in the technology, testing strategies must reinvent and bring in required change.  ...
Read more

What DevOps mean to QA/Test?

-
DevOps - as it stands for "Development" + "Operations" is a buzz word these days and everyone is trying to get some insight into it. As exciting it may sound, many in the test department has a common question - "Where do they stand in the whole premise of DevOps?". The question is very valid and it needs to be dissected thoroughly to know what really is there in store for QA engineers. Traditionally QA has been divided into two categories - 1) Manual 2) Automation. While large population of the QA fraternity was involved in manual work initially, many started doing automation in their respective domains. Whether to do manual testing or automation is largely dependent on type of technology being used and other factors such as available skills within the test organisation, budget and most importantly organisational culture; in this case, how well the innovation is promoted. Now going back to our original question; Test Automation certainly has a very ...
Read more