Engineering Model-Based Software Testing of WIMP Interactive Applications: A Process based on Formal Models and the SQUAMATA Tool

The goal of software testing is to detect defects with the objective of removing them at a later stage in the development process. Interactive software development follows the User Centered Design approach that promotes continuous involvement of users both at design and evaluation phases. This proce...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings of the ACM on human-computer interaction 2021-05, Vol.5 (EICS), p.1-30
Main Authors: Canny, Alexandre, Martinie, Célia, Navarre, David, Palanque, Philippe, Barboni, Eric, Gris, Christine
Format: Article
Language:English
Subjects:
Computer Science
Human-Computer Interaction
Modeling and Simulation
Software Engineering
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by
cites cdi_FETCH-LOGICAL-c661-8b086bcbe3a8452ba6d429c176e81b375ad8105c4fc6f9e0b67f1373c00677273
container_end_page 30
container_issue EICS
container_start_page 1
container_title Proceedings of the ACM on human-computer interaction
container_volume 5
creator Canny, Alexandre
Martinie, Célia
Navarre, David
Palanque, Philippe
Barboni, Eric
Gris, Christine
description The goal of software testing is to detect defects with the objective of removing them at a later stage in the development process. Interactive software development follows the User Centered Design approach that promotes continuous involvement of users both at design and evaluation phases. This process is meant to produce usable interactive software by gathering functional and non-functional requirements related to both user needs and context of use. However, taking into account these potentially very-complex-to-implement requirements increases the complexity of the software that is likely, without appropriate methods and tools, to encompass a large number of defects. One of the limitations of UCD approaches is that it provides no guidance on the engineering of the interactive application, which thus usually embeds numerous defects resulting in failures at the origin of user frustrations and performance drops. Even though a classification of interactive application defects has been proposed, interactive application testers remain only superficially supported in detecting them. This paper defines a model-based approach to engineer the testing activity for interactive applications. It proposes a process that bridges the gap between UCD artefacts and interactive software implementation by the production of a dedicated formal model exploited for testing purposes only. The application of the process is demonstrated on an interactive cockpit WIMP application. Finally, threats to validity (capability of the approach to detect defects and to ensure an acceptable coverage testing of the interactive application) are addressed by a longitudinal study on 61 variants of a simple application developed by 61 different developers. ?
doi_str_mv 10.1145/3461729
format article
fullrecord <record><control><sourceid>hal_cross</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_03376229v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>oai_HAL_hal_03376229v1</sourcerecordid><originalsourceid>FETCH-LOGICAL-c661-8b086bcbe3a8452ba6d429c176e81b375ad8105c4fc6f9e0b67f1373c00677273</originalsourceid><addsrcrecordid>eNpNUF1LwzAUDaLgmMO_0DfxoXpv0iTt4xzTFToUHPhY0vRmRmo7kjLx3-vYEJ_O4Xw9HMauEe4QM3kvMoWaF2dswqUWKWDGz__xSzaL8QMAMJcgCz5h5bLf-p4o-H6brIeWuvTBRGqT18GNXyZQsqE4HszBJW_l-iUp-5GCsaPfUzLf7TpvzeiHPl6xC2e6SLMTTtnmcblZrNLq-alczKvUKoVp3kCuGtuQMHkmeWNUm_HColaUYyO0NG2OIG3mrHIFQaO0Q6GFBVBacy2m7PY4-266ehf8pwnf9WB8vZpX9UEDIbTivNjjb_bmmLVhiDGQ-ysg1Ie_6tNf4geBH1pB</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Engineering Model-Based Software Testing of WIMP Interactive Applications: A Process based on Formal Models and the SQUAMATA Tool</title><source>Association for Computing Machinery:Jisc Collections:ACM OPEN Journals 2023-2025 (reading list)</source><creator>Canny, Alexandre ; Martinie, Célia ; Navarre, David ; Palanque, Philippe ; Barboni, Eric ; Gris, Christine</creator><creatorcontrib>Canny, Alexandre ; Martinie, Célia ; Navarre, David ; Palanque, Philippe ; Barboni, Eric ; Gris, Christine</creatorcontrib><description>The goal of software testing is to detect defects with the objective of removing them at a later stage in the development process. Interactive software development follows the User Centered Design approach that promotes continuous involvement of users both at design and evaluation phases. This process is meant to produce usable interactive software by gathering functional and non-functional requirements related to both user needs and context of use. However, taking into account these potentially very-complex-to-implement requirements increases the complexity of the software that is likely, without appropriate methods and tools, to encompass a large number of defects. One of the limitations of UCD approaches is that it provides no guidance on the engineering of the interactive application, which thus usually embeds numerous defects resulting in failures at the origin of user frustrations and performance drops. Even though a classification of interactive application defects has been proposed, interactive application testers remain only superficially supported in detecting them. This paper defines a model-based approach to engineer the testing activity for interactive applications. It proposes a process that bridges the gap between UCD artefacts and interactive software implementation by the production of a dedicated formal model exploited for testing purposes only. The application of the process is demonstrated on an interactive cockpit WIMP application. Finally, threats to validity (capability of the approach to detect defects and to ensure an acceptable coverage testing of the interactive application) are addressed by a longitudinal study on 61 variants of a simple application developed by 61 different developers. ?</description><identifier>ISSN: 2573-0142</identifier><identifier>EISSN: 2573-0142</identifier><identifier>DOI: 10.1145/3461729</identifier><language>eng</language><publisher>Association for Computing Machinery (ACM)</publisher><subject>Computer Science ; Human-Computer Interaction ; Modeling and Simulation ; Software Engineering</subject><ispartof>Proceedings of the ACM on human-computer interaction, 2021-05, Vol.5 (EICS), p.1-30</ispartof><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c661-8b086bcbe3a8452ba6d429c176e81b375ad8105c4fc6f9e0b67f1373c00677273</cites><orcidid>0000-0001-7907-3170 ; 0000-0002-4235-9543 ; 0000-0002-5381-971X ; 0000-0002-2900-2056</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,315,786,790,891,27957,27958</link.rule.ids><backlink>$$Uhttps://hal.science/hal-03376229$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Canny, Alexandre</creatorcontrib><creatorcontrib>Martinie, Célia</creatorcontrib><creatorcontrib>Navarre, David</creatorcontrib><creatorcontrib>Palanque, Philippe</creatorcontrib><creatorcontrib>Barboni, Eric</creatorcontrib><creatorcontrib>Gris, Christine</creatorcontrib><title>Engineering Model-Based Software Testing of WIMP Interactive Applications: A Process based on Formal Models and the SQUAMATA Tool</title><title>Proceedings of the ACM on human-computer interaction</title><description>The goal of software testing is to detect defects with the objective of removing them at a later stage in the development process. Interactive software development follows the User Centered Design approach that promotes continuous involvement of users both at design and evaluation phases. This process is meant to produce usable interactive software by gathering functional and non-functional requirements related to both user needs and context of use. However, taking into account these potentially very-complex-to-implement requirements increases the complexity of the software that is likely, without appropriate methods and tools, to encompass a large number of defects. One of the limitations of UCD approaches is that it provides no guidance on the engineering of the interactive application, which thus usually embeds numerous defects resulting in failures at the origin of user frustrations and performance drops. Even though a classification of interactive application defects has been proposed, interactive application testers remain only superficially supported in detecting them. This paper defines a model-based approach to engineer the testing activity for interactive applications. It proposes a process that bridges the gap between UCD artefacts and interactive software implementation by the production of a dedicated formal model exploited for testing purposes only. The application of the process is demonstrated on an interactive cockpit WIMP application. Finally, threats to validity (capability of the approach to detect defects and to ensure an acceptable coverage testing of the interactive application) are addressed by a longitudinal study on 61 variants of a simple application developed by 61 different developers. ?</description><subject>Computer Science</subject><subject>Human-Computer Interaction</subject><subject>Modeling and Simulation</subject><subject>Software Engineering</subject><issn>2573-0142</issn><issn>2573-0142</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNpNUF1LwzAUDaLgmMO_0DfxoXpv0iTt4xzTFToUHPhY0vRmRmo7kjLx3-vYEJ_O4Xw9HMauEe4QM3kvMoWaF2dswqUWKWDGz__xSzaL8QMAMJcgCz5h5bLf-p4o-H6brIeWuvTBRGqT18GNXyZQsqE4HszBJW_l-iUp-5GCsaPfUzLf7TpvzeiHPl6xC2e6SLMTTtnmcblZrNLq-alczKvUKoVp3kCuGtuQMHkmeWNUm_HColaUYyO0NG2OIG3mrHIFQaO0Q6GFBVBacy2m7PY4-266ehf8pwnf9WB8vZpX9UEDIbTivNjjb_bmmLVhiDGQ-ysg1Ie_6tNf4geBH1pB</recordid><startdate>20210527</startdate><enddate>20210527</enddate><creator>Canny, Alexandre</creator><creator>Martinie, Célia</creator><creator>Navarre, David</creator><creator>Palanque, Philippe</creator><creator>Barboni, Eric</creator><creator>Gris, Christine</creator><general>Association for Computing Machinery (ACM)</general><scope>AAYXX</scope><scope>CITATION</scope><scope>1XC</scope><orcidid>https://orcid.org/0000-0001-7907-3170</orcidid><orcidid>https://orcid.org/0000-0002-4235-9543</orcidid><orcidid>https://orcid.org/0000-0002-5381-971X</orcidid><orcidid>https://orcid.org/0000-0002-2900-2056</orcidid></search><sort><creationdate>20210527</creationdate><title>Engineering Model-Based Software Testing of WIMP Interactive Applications</title><author>Canny, Alexandre ; Martinie, Célia ; Navarre, David ; Palanque, Philippe ; Barboni, Eric ; Gris, Christine</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c661-8b086bcbe3a8452ba6d429c176e81b375ad8105c4fc6f9e0b67f1373c00677273</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Computer Science</topic><topic>Human-Computer Interaction</topic><topic>Modeling and Simulation</topic><topic>Software Engineering</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Canny, Alexandre</creatorcontrib><creatorcontrib>Martinie, Célia</creatorcontrib><creatorcontrib>Navarre, David</creatorcontrib><creatorcontrib>Palanque, Philippe</creatorcontrib><creatorcontrib>Barboni, Eric</creatorcontrib><creatorcontrib>Gris, Christine</creatorcontrib><collection>CrossRef</collection><collection>Hyper Article en Ligne (HAL)</collection><jtitle>Proceedings of the ACM on human-computer interaction</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Canny, Alexandre</au><au>Martinie, Célia</au><au>Navarre, David</au><au>Palanque, Philippe</au><au>Barboni, Eric</au><au>Gris, Christine</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Engineering Model-Based Software Testing of WIMP Interactive Applications: A Process based on Formal Models and the SQUAMATA Tool</atitle><jtitle>Proceedings of the ACM on human-computer interaction</jtitle><date>2021-05-27</date><risdate>2021</risdate><volume>5</volume><issue>EICS</issue><spage>1</spage><epage>30</epage><pages>1-30</pages><issn>2573-0142</issn><eissn>2573-0142</eissn><abstract>The goal of software testing is to detect defects with the objective of removing them at a later stage in the development process. Interactive software development follows the User Centered Design approach that promotes continuous involvement of users both at design and evaluation phases. This process is meant to produce usable interactive software by gathering functional and non-functional requirements related to both user needs and context of use. However, taking into account these potentially very-complex-to-implement requirements increases the complexity of the software that is likely, without appropriate methods and tools, to encompass a large number of defects. One of the limitations of UCD approaches is that it provides no guidance on the engineering of the interactive application, which thus usually embeds numerous defects resulting in failures at the origin of user frustrations and performance drops. Even though a classification of interactive application defects has been proposed, interactive application testers remain only superficially supported in detecting them. This paper defines a model-based approach to engineer the testing activity for interactive applications. It proposes a process that bridges the gap between UCD artefacts and interactive software implementation by the production of a dedicated formal model exploited for testing purposes only. The application of the process is demonstrated on an interactive cockpit WIMP application. Finally, threats to validity (capability of the approach to detect defects and to ensure an acceptable coverage testing of the interactive application) are addressed by a longitudinal study on 61 variants of a simple application developed by 61 different developers. ?</abstract><pub>Association for Computing Machinery (ACM)</pub><doi>10.1145/3461729</doi><tpages>30</tpages><orcidid>https://orcid.org/0000-0001-7907-3170</orcidid><orcidid>https://orcid.org/0000-0002-4235-9543</orcidid><orcidid>https://orcid.org/0000-0002-5381-971X</orcidid><orcidid>https://orcid.org/0000-0002-2900-2056</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 2573-0142
ispartof Proceedings of the ACM on human-computer interaction, 2021-05, Vol.5 (EICS), p.1-30
issn 2573-0142
2573-0142
language eng
recordid cdi_hal_primary_oai_HAL_hal_03376229v1
source Association for Computing Machinery:Jisc Collections:ACM OPEN Journals 2023-2025 (reading list)
subjects Computer Science
Human-Computer Interaction
Modeling and Simulation
Software Engineering
title Engineering Model-Based Software Testing of WIMP Interactive Applications: A Process based on Formal Models and the SQUAMATA Tool
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-22T10%3A21%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-hal_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Engineering%20Model-Based%20Software%20Testing%20of%20WIMP%20Interactive%20Applications:%20A%20Process%20based%20on%20Formal%20Models%20and%20the%20SQUAMATA%20Tool&rft.jtitle=Proceedings%20of%20the%20ACM%20on%20human-computer%20interaction&rft.au=Canny,%20Alexandre&rft.date=2021-05-27&rft.volume=5&rft.issue=EICS&rft.spage=1&rft.epage=30&rft.pages=1-30&rft.issn=2573-0142&rft.eissn=2573-0142&rft_id=info:doi/10.1145/3461729&rft_dat=%3Chal_cross%3Eoai_HAL_hal_03376229v1%3C/hal_cross%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c661-8b086bcbe3a8452ba6d429c176e81b375ad8105c4fc6f9e0b67f1373c00677273%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true