Garousi, Vahid

Context: Software testing practices and processes in many companies are far from being mature and are usually conducted in ad-hoc fashions. Such immature practices lead to various negative outcomes, e.g., ineffectiveness of testing practices in detecting all the defects, and cost and schedule overruns of testing activities. To conduct test maturity assessment (TMA) and test process improvement (TPI) in a systematic manner, various TMA/TPI models and approaches have been proposed. Objective: It is important to identify the state-of-the-art and the-practice in this area to consolidate the list of all various test maturity models proposed by practitioners and researchers, the drivers of TMA/TPI, the associated challenges and the benefits and results of TMA/TPI. Our article aims to benefit the readers (both practitioners and researchers) by providing the most comprehensive survey of the area, to this date, in assessing and improving the maturity of test processes. Method: To achieve the above objective, we have performed a Multivocal Literature Review (MLR) study to find out what we know about TMA/TPI. A MLR is a form of a Systematic Literature Review (SLR) which includes the grey literature (e.g., blog posts and white papers) in addition to the published (formal) literature (e.g., journal and conference papers). We searched the academic literature using the Google Scholar and the grey literature using the regular Google search engine. Results: Our MLR and its results are based on 181 sources, 51 (29%) of which were grey literature and 130 (71%) were formally published sources. By summarizing what we know about TMA/TPI, our review identified 58 different test maturity models and a large number of sources with varying degrees of empirical evidence on this topic. We also conducted qualitative analysis (coding) to synthesize the drivers, challenges and benefits of TMA/TPI from the primary sources. Conclusion: We show that current maturity models and techniques in TMA/TPI provides reasonable advice for industry and the research community. We suggest directions for follow-up work, e.g., using the findings of this MLR in industry-academia collaborative projects and empirical evaluation of models and techniques in the area of TMA/TPI as reported in this article. (C) 2017 Elsevier B.V. All rights reserved.

Journal	Count
Journal of Systems and Software	4
Information and Software Technology	3
ACM International Conference Proceeding Series -- 2014 International Conference on Software and Systems Process, ICSSP 2014 -- 26 May 2014 through 28 May 2014 -- Nanjing -- 105608	1
CEUR Workshop Proceedings -- 9th Turkish National Software Engineering Symposium, UYMS 2015 -- 9 September 2015 through 11 September 2015 -- Izmir -- 117665	1
17th International Conference on Evaluation and Assessment in software Engineering -- APR 14-16, 2013 -- Porto de Galinhas, BRAZIL	1

Garousi, Vahid

Profile URL

Name Variants

Job Title

Email Address

Main Affiliation

Status

Website

ORCID ID

Scopus Author ID

Turkish CoHE Profile ID

Google Scholar ID

WoS Researcher ID

Sustainable Development Goals

SDG data is not available

This researcher does not have a Scopus ID.

This researcher does not have a WoS ID.

Scholarly Output

13

Articles

9

Views / Downloads

1/0

Supervised MSc Theses

0

Supervised PhD Theses

0

WoS Citation Count

611

Scopus Citation Count

788

WoS h-index

10

Scopus h-index

11

Patents

0

Projects

0

WoS Citations per Publication

47.00

Scopus Citations per Publication

60.62

Open Access Source

3

Supervised Theses

0

Google Analytics Visitor Traffic

Scopus Quartile Distribution

Competency Cloud

Filters

Settings

Sort By

Results per page

Scholarly Output Search Results