Exploring the Socio-Technical Motivations Behind the Adoption and Migration of Web GUI Testing Frameworks
Authors: Giuseppe Di Martino, Sergio Di Meglio, Valeria Pontillo, and Luigi Libero Lucio Starace
This repository contains the replication package of the paper "Exploring the Socio-Technical Motivations Behind the Adoption and Migration of Web GUI Testing Frameworks".
Web Graphical User Interface (GUI) testing frameworks such as Selenium or Playwright are widely used to automate end-to-end testing of modern web applications. While prior research has compared these frameworks in terms of performance and technical features, limited attention has been directed to the socio-technical motivations that drive their adoption and migration in practice. To address this gap, this paper explores the socio-technical motivations behind the adoption and migration of web GUI testing frameworks through a repository-based study of open-source projects using web GUI testing. Specifically, we analyzed commit messages and issue discussions associated with web GUI testing framework adoption and migration events, and manually identified explicit rationale statements. This process yielded 72 relevant messages supporting 52 justified events, from which we inductively derived a taxonomy of eight socio-technical motivation categories. Our results indicate that initial adoption is primarily shaped by usability and integration considerations, whereas migration is more strongly associated with reliability, performance, and ecosystem alignment, providing empirical evidence that the criteria guiding framework decisions evolve over the lifecycle of web GUI testing infrastructure.
Keywords: Web GUI testing, Adoption, Migration, Socio-technical factors, End-to-end testing
- Data: Contains all the data used in the study. (See the README inside for a detailed data dictionary).
- Software: Contains the code for data retrieval, filtering, manual labeling, and database integration. (See the README inside for setup instructions).
- Appendix A: Filtering Keywords - This document contains the complete list of keywords used for filtering commits and issues in the study.
To reproduce the study, please refer to the Software README. It contains step-by-step instructions on how to install the required dependencies and execute the scripts.
If you use this dataset or code in your research, please cite our paper:
Submitted to SEAA 2026