By using this site, you agree to the IDC Privacy Policy

Feb 2018 - IDC MarketScape - Doc # US41601017

IDC MarketScape: Worldwide Cloud Testing and ASQ SaaS 2017-2018 Vendor Assessment — Enabling Quality in and on the Cloud

Author: Melinda-Carol Ballou
Research Director, Agile ALM, Quality & Portfolio Strategies


This IDC study uses the IDC MarketScape model to provide an assessment for cloud testing and ASQ SaaS, evaluating automated tools capabilities for enabling virtual testing infrastructure in the cloud, service virtualization, and testing of cloud applications as one of four key assessments of the IDC MarketScape for ASQ to provide a comprehensive view across key areas of the market — enterprise ASQ/DevOps, quality/security with software quality analysis and measurement, and mobile testing and digital quality. Organizations seeking process, services, and product automation capabilities for ASQ come to their decision making with varying levels of maturity, differing pain points, and challenges. This is even more the case in a volatile global economy as companies continue to struggle with constrained and complex sourcing, limited QA resources, and varying levels of flexibility to meet business and competitive pressures. The intent with IDC's cloud testing ASQ criteria and our four-document report series is to demonstrate weighting approaches for the areas of greatest importance that come up for users making high-end ASQ selections currently with transformative demands for mobile, cloud, IoT, and other areas. Too frequently, users and vendors see "one" sample market assessment diagram and assume that a single model for the market will directly address all their needs (with no context for user-specific challenges or variegated maturity levels). We believe that in-context weighting and analysis is optimal to enable pragmatic insight for users making decisions in a dynamic, increasingly chaotic, complex global competitive environment. Additional weighting and visibility are available individually — yet publishing multiple IDC MarketScapes for ASQ can enable decision makers to "see" varying approaches based on their peers' experiences, as they assess IDC's analysis.

"IDC has seen a dramatic increase in multimodal development and complex sourcing for software projects. This continues the existing trend for combining internal resources with contractors, onshore/offshore providers, and use of open source. With Continuous Integration and agile DevOps approaches along with the need for DevSecOps, the demand for effective quality has increased geometrically," said Melinda Ballou, program director for IDC's Application Life-Cycle Management and Executive Strategies service. "Creating strategies that enable cloud testing with virtual infrastructure and service virtualization as well as testing of cloud applications for visibility into their health enable broader portfolio coordination with ALM and capabilities for emerging platforms with mobile, cloud, IoT, and other areas. It is in part due to this increase in vulnerabilities and complexity for software development and deployment projects that IDC has chosen to prioritize combined capabilities for ASQ with additional life-cycle areas. Cloud testing solutions in this context can provide a basis for collaboration to enable continuous quality as part of end-to-end DevOps. While this IDC MarketScape focuses on cloud testing and ASQ SaaS, IDC has chosen the context of three additional sample weighting strategies that have currency in 2018 and are frequently requested by users speaking with us — mobile testing and digital quality, software quality analysis and measurement, and enterprise ASQ. Global organizations seeking to coordinate continuous DevOps and other areas demand high levels of functionality, scalability, and maturity overall to execute well."


Referencing Documents

Related Links