Software complexity and testing effectiveness: An empirical study

Name: Work Video:
Duration: 3 min 30 s
Kostas Kevrekidis; Stijn Albers; P.J.M. Sonnemans; Guillaume M. Stollman
{'id': 'https://openalex.org/W2140677443', 'doi': 'https://doi.org/10.1109/rams.2009.4914733', 'title': 'Software complexity and testing effectiveness: An empirical study', 'display_name': 'Software complexity and testing effectiveness: An empirical study', 'publication_year': 2009, 'publication_date': '2009-01-01', 'ids': {'openalex': 'https://openalex.org/W2140677443', 'doi': 'https://doi.org/10.1109/rams.2009.4914733', 'mag': '2140677443'}, 'language': 'en', 'primary_location': {'is_oa': False, 'landing_page_url': 'https://doi.org/10.1109/rams.2009.4914733', 'pdf_url': None, 'source': {'id': 'https://openalex.org/S4210171523', 'display_name': 'Proceedings, annual Reliability and Maintainability Symposium/Proceedings. Annual Reliability and Maintainability Symposium', 'issn_l': '0149-144X', 'issn': ['0149-144X', '2577-0993'], 'is_oa': False, 'is_in_doaj': False, 'is_core': True, 'host_organization': 'https://openalex.org/P4310319808', 'host_organization_name': 'Institute of Electrical and Electronics Engineers', 'host_organization_lineage': ['https://openalex.org/P4310319808'], 'host_organization_lineage_names': ['Institute of Electrical and Electronics Engineers'], 'type': 'journal'}, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}, 'type': 'article', 'type_crossref': 'proceedings-article', 'indexed_in': ['crossref'], 'open_access': {'is_oa': False, 'oa_status': 'closed', 'oa_url': None, 'any_repository_has_fulltext': False}, 'authorships': [{'author_position': 'first', 'author': {'id': 'https://openalex.org/A5027193681', 'display_name': 'Kostas Kevrekidis', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I83019370', 'display_name': 'Eindhoven University of Technology', 'ror': 'https://ror.org/02c2kyt77', 'country_code': 'NL', 'type': 'education', 'lineage': ['https://openalex.org/I83019370']}], 'countries': ['NL'], 'is_corresponding': False, 'raw_author_name': 'Kostas Kevrekidis', 'raw_affiliation_strings': ['Technische Universiteit Eindhoven (The Netherlands)'], 'affiliations': [{'raw_affiliation_string': 'Technische Universiteit Eindhoven (The Netherlands)', 'institution_ids': ['https://openalex.org/I83019370']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5077721765', 'display_name': 'Stijn Albers', 'orcid': 'https://orcid.org/0000-0002-7404-2532'}, 'institutions': [{'id': 'https://openalex.org/I83019370', 'display_name': 'Eindhoven University of Technology', 'ror': 'https://ror.org/02c2kyt77', 'country_code': 'NL', 'type': 'education', 'lineage': ['https://openalex.org/I83019370']}], 'countries': ['NL'], 'is_corresponding': False, 'raw_author_name': 'Stijn Albers', 'raw_affiliation_strings': ['Technische Universiteit Eindhoven (The Netherlands)'], 'affiliations': [{'raw_affiliation_string': 'Technische Universiteit Eindhoven (The Netherlands)', 'institution_ids': ['https://openalex.org/I83019370']}]}, {'author_position': 'middle', 'author': {'id': 'https://openalex.org/A5111785521', 'display_name': 'P.J.M. Sonnemans', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I83019370', 'display_name': 'Eindhoven University of Technology', 'ror': 'https://ror.org/02c2kyt77', 'country_code': 'NL', 'type': 'education', 'lineage': ['https://openalex.org/I83019370']}], 'countries': ['NL'], 'is_corresponding': False, 'raw_author_name': 'Peter J. M. Sonnemans', 'raw_affiliation_strings': ['Technische Universiteit Eindhoven (The Netherlands)'], 'affiliations': [{'raw_affiliation_string': 'Technische Universiteit Eindhoven (The Netherlands)', 'institution_ids': ['https://openalex.org/I83019370']}]}, {'author_position': 'last', 'author': {'id': 'https://openalex.org/A5063265742', 'display_name': 'Guillaume M. Stollman', 'orcid': None}, 'institutions': [{'id': 'https://openalex.org/I1329325741', 'display_name': 'Philips (Finland)', 'ror': 'https://ror.org/01g4jev56', 'country_code': 'FI', 'type': 'company', 'lineage': ['https://openalex.org/I1329325741', 'https://openalex.org/I4210122849']}], 'countries': ['FI'], 'is_corresponding': False, 'raw_author_name': 'Guillaume M. Stollman', 'raw_affiliation_strings': ['Philips Healthcare BU Cardio Vascular, The Netherlands'], 'affiliations': [{'raw_affiliation_string': 'Philips Healthcare BU Cardio Vascular, The Netherlands', 'institution_ids': ['https://openalex.org/I1329325741']}]}], 'institution_assertions': [], 'countries_distinct_count': 2, 'institutions_distinct_count': 2, 'corresponding_author_ids': [], 'corresponding_institution_ids': [], 'apc_list': None, 'apc_paid': None, 'fwci': 0.523, 'has_fulltext': True, 'fulltext_origin': 'ngrams', 'cited_by_count': 11, 'citation_normalized_percentile': {'value': 0.847754, 'is_in_top_1_percent': False, 'is_in_top_10_percent': False}, 'cited_by_percentile_year': {'min': 84, 'max': 85}, 'biblio': {'volume': '16', 'issue': None, 'first_page': '539', 'last_page': '543'}, 'is_retracted': False, 'is_paratext': False, 'primary_topic': {'id': 'https://openalex.org/T12423', 'display_name': 'Software Reliability and Analysis Research', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1712', 'display_name': 'Software'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, 'topics': [{'id': 'https://openalex.org/T12423', 'display_name': 'Software Reliability and Analysis Research', 'score': 0.9999, 'subfield': {'id': 'https://openalex.org/subfields/1712', 'display_name': 'Software'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10260', 'display_name': 'Software Engineering Research', 'score': 0.9994, 'subfield': {'id': 'https://openalex.org/subfields/1710', 'display_name': 'Information Systems'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}, {'id': 'https://openalex.org/T10639', 'display_name': 'Advanced Software Engineering Methodologies', 'score': 0.9873, 'subfield': {'id': 'https://openalex.org/subfields/1702', 'display_name': 'Artificial Intelligence'}, 'field': {'id': 'https://openalex.org/fields/17', 'display_name': 'Computer Science'}, 'domain': {'id': 'https://openalex.org/domains/3', 'display_name': 'Physical Sciences'}}], 'keywords': [{'id': 'https://openalex.org/keywords/software-reliability-testing', 'display_name': 'Software reliability testing', 'score': 0.80716753}, {'id': 'https://openalex.org/keywords/software-metric', 'display_name': 'Software metric', 'score': 0.68836534}, {'id': 'https://openalex.org/keywords/software-sizing', 'display_name': 'Software sizing', 'score': 0.6876058}, {'id': 'https://openalex.org/keywords/programming-complexity', 'display_name': 'Programming complexity', 'score': 0.6098017}, {'id': 'https://openalex.org/keywords/regression-testing', 'display_name': 'Regression testing', 'score': 0.59243405}, {'id': 'https://openalex.org/keywords/software-measurement', 'display_name': 'Software measurement', 'score': 0.52562445}, {'id': 'https://openalex.org/keywords/system-integration-testing', 'display_name': 'System integration testing', 'score': 0.44603825}], 'concepts': [{'id': 'https://openalex.org/C52928878', 'wikidata': 'https://www.wikidata.org/wiki/Q7554226', 'display_name': 'Software reliability testing', 'level': 5, 'score': 0.80716753}, {'id': 'https://openalex.org/C186846655', 'wikidata': 'https://www.wikidata.org/wiki/Q3398377', 'display_name': 'Software construction', 'level': 4, 'score': 0.73535424}, {'id': 'https://openalex.org/C41008148', 'wikidata': 'https://www.wikidata.org/wiki/Q21198', 'display_name': 'Computer science', 'level': 0, 'score': 0.73198646}, {'id': 'https://openalex.org/C82214349', 'wikidata': 'https://www.wikidata.org/wiki/Q657339', 'display_name': 'Software metric', 'level': 5, 'score': 0.68836534}, {'id': 'https://openalex.org/C201515116', 'wikidata': 'https://www.wikidata.org/wiki/Q7554363', 'display_name': 'Software sizing', 'level': 5, 'score': 0.6876058}, {'id': 'https://openalex.org/C66429209', 'wikidata': 'https://www.wikidata.org/wiki/Q7248499', 'display_name': 'Programming complexity', 'level': 5, 'score': 0.6098017}, {'id': 'https://openalex.org/C161821725', 'wikidata': 'https://www.wikidata.org/wiki/Q917415', 'display_name': 'Regression testing', 'level': 5, 'score': 0.59243405}, {'id': 'https://openalex.org/C48002344', 'wikidata': 'https://www.wikidata.org/wiki/Q2919644', 'display_name': 'Verification and validation', 'level': 2, 'score': 0.5911718}, {'id': 'https://openalex.org/C117447612', 'wikidata': 'https://www.wikidata.org/wiki/Q1412670', 'display_name': 'Software quality', 'level': 4, 'score': 0.5702766}, {'id': 'https://openalex.org/C200601418', 'wikidata': 'https://www.wikidata.org/wiki/Q2193887', 'display_name': 'Reliability engineering', 'level': 1, 'score': 0.5377109}, {'id': 'https://openalex.org/C89567784', 'wikidata': 'https://www.wikidata.org/wiki/Q7554325', 'display_name': 'Software measurement', 'level': 5, 'score': 0.52562445}, {'id': 'https://openalex.org/C149091818', 'wikidata': 'https://www.wikidata.org/wiki/Q2429814', 'display_name': 'Software system', 'level': 3, 'score': 0.51863855}, {'id': 'https://openalex.org/C529173508', 'wikidata': 'https://www.wikidata.org/wiki/Q638608', 'display_name': 'Software development', 'level': 3, 'score': 0.48481336}, {'id': 'https://openalex.org/C115903868', 'wikidata': 'https://www.wikidata.org/wiki/Q80993', 'display_name': 'Software engineering', 'level': 1, 'score': 0.45849574}, {'id': 'https://openalex.org/C111524372', 'wikidata': 'https://www.wikidata.org/wiki/Q7663718', 'display_name': 'System integration testing', 'level': 5, 'score': 0.44603825}, {'id': 'https://openalex.org/C2777904410', 'wikidata': 'https://www.wikidata.org/wiki/Q7397', 'display_name': 'Software', 'level': 2, 'score': 0.42038116}, {'id': 'https://openalex.org/C199360897', 'wikidata': 'https://www.wikidata.org/wiki/Q9143', 'display_name': 'Programming language', 'level': 1, 'score': 0.15542465}, {'id': 'https://openalex.org/C105795698', 'wikidata': 'https://www.wikidata.org/wiki/Q12483', 'display_name': 'Statistics', 'level': 1, 'score': 0.12294471}, {'id': 'https://openalex.org/C127413603', 'wikidata': 'https://www.wikidata.org/wiki/Q11023', 'display_name': 'Engineering', 'level': 0, 'score': 0.09558147}, {'id': 'https://openalex.org/C33923547', 'wikidata': 'https://www.wikidata.org/wiki/Q395', 'display_name': 'Mathematics', 'level': 0, 'score': 0.06575346}], 'mesh': [], 'locations_count': 1, 'locations': [{'is_oa': False, 'landing_page_url': 'https://doi.org/10.1109/rams.2009.4914733', 'pdf_url': None, 'source': {'id': 'https://openalex.org/S4210171523', 'display_name': 'Proceedings, annual Reliability and Maintainability Symposium/Proceedings. Annual Reliability and Maintainability Symposium', 'issn_l': '0149-144X', 'issn': ['0149-144X', '2577-0993'], 'is_oa': False, 'is_in_doaj': False, 'is_core': True, 'host_organization': 'https://openalex.org/P4310319808', 'host_organization_name': 'Institute of Electrical and Electronics Engineers', 'host_organization_lineage': ['https://openalex.org/P4310319808'], 'host_organization_lineage_names': ['Institute of Electrical and Electronics Engineers'], 'type': 'journal'}, 'license': None, 'license_id': None, 'version': None, 'is_accepted': False, 'is_published': False}], 'best_oa_location': None, 'sustainable_development_goals': [], 'grants': [], 'datasets': [], 'versions': [], 'referenced_works_count': 23, 'referenced_works': ['https://openalex.org/W1505648523', 'https://openalex.org/W151714835', 'https://openalex.org/W1591311008', 'https://openalex.org/W1964962870', 'https://openalex.org/W1988141329', 'https://openalex.org/W1999667809', 'https://openalex.org/W2010367312', 'https://openalex.org/W2010453024', 'https://openalex.org/W2024889894', 'https://openalex.org/W2025043404', 'https://openalex.org/W2056878746', 'https://openalex.org/W2066459581', 'https://openalex.org/W2082922085', 'https://openalex.org/W2091351614', 'https://openalex.org/W2097255953', 'https://openalex.org/W2097655789', 'https://openalex.org/W2111599126', 'https://openalex.org/W2128188276', 'https://openalex.org/W2156205360', 'https://openalex.org/W2170555940', 'https://openalex.org/W2171955286', 'https://openalex.org/W3015634246', 'https://openalex.org/W4661852'], 'related_works': ['https://openalex.org/W3146691014', 'https://openalex.org/W2536936637', 'https://openalex.org/W2390957412', 'https://openalex.org/W2163919897', 'https://openalex.org/W2144001881', 'https://openalex.org/W2114733359', 'https://openalex.org/W2084271704', 'https://openalex.org/W2069032632', 'https://openalex.org/W2068483578', 'https://openalex.org/W1504590823'], 'abstract_inverted_index': {'This': [0], 'paper': [1], 'presents': [2], 'a': [3], 'simple': [4], 'method': [5], 'for': [6, 34, 68, 86, 101], 'evaluating': [7], 'the': [8, 15, 29, 64, 88, 93, 105, 110, 122, 135], 'effectiveness': [9], 'of': [10, 26, 43, 49, 60, 92, 109, 124], 'testing': [11, 84], 'strategies': [12], 'by': [13], 'using': [14], 'relation': [16], 'between': [17], 'software': [18, 21, 41, 44, 55, 72, 77, 102, 115, 131, 146, 153, 161], 'reliability': [19, 103, 133], 'and': [20, 57], 'complexity.': [22, 73], 'A': [23], 'wide': [24], 'range': [25], 'metrics': [27, 148], 'from': [28, 54, 63], 'literature': [30], 'are': [31, 66], 'being': [32], 'tested': [33], 'their': [35, 69], 'suitability': [36], 'in': [37, 40, 104], 'measuring': [38], 'changes': [39], 'complexity': [42, 89, 116, 147], 'code': [45, 136], 'at': [46], 'different': [47], 'levels': [48], 'system': [50], 'partitioning.': [51], 'Reliability': [52], 'data': [53, 59], 'tests': [56], 'operational': [58], 'professional': [61], 'systems': [62], 'field': [65, 132], 'examined': [67], 'dependency': [70], 'on': [71], 'Does': [74], 'more': [75, 79], 'complex': [76], 'require': [78], 'rigorous': [80], 'testing?': [81], 'Is': [82], 'current': [83], 'adequate': [85], 'taking': [87], 'factor': [90], 'out': [91], 'equation': [94], 'or': [95], 'does': [96, 128], 'it': [97, 142], 'still': [98], 'remain': [99], 'relevant': [100, 118], 'field?': [106], 'The': [107], 'results': [108], 'statistical': [111], 'analysis': [112], 'show': [113], 'that': [114, 145], 'is': [117, 143], 'during': [119], 'testing,': [120], 'affecting': [121], 'amount': [123], 'discovered': [125], 'errors.': [126], 'It': [127], 'not': [129], 'affect': [130], 'once': [134], 'has': [137], 'been': [138], 'debugged.': [139], 'In': [140], 'addition': [141], 'suggested': [144], 'when': [149], 'used': [150], 'to': [151, 158], 'measure': [152], 'changes,': [154], 'should': [155], 'be': [156], 'applied': [157], 'low': [159], 'level': [160], 'partitioning': [162], 'before': [163], 'integration.': [164]}, 'cited_by_api_url': 'https://api.openalex.org/works?filter=cites:W2140677443', 'counts_by_year': [{'year': 2020, 'cited_by_count': 2}, {'year': 2019, 'cited_by_count': 3}, {'year': 2018, 'cited_by_count': 2}, {'year': 2016, 'cited_by_count': 2}, {'year': 2013, 'cited_by_count': 1}, {'year': 2012, 'cited_by_count': 1}], 'updated_date': '2024-12-10T09:03:36.111619', 'created_date': '2016-06-24'}
Publication Information

Basic Information

Access and Citation

AI Researcher Chatbot

Primary Location

Authors

Topics

Keywords

Related Works
