Masterarbeit
Integration of Pytest test results into Azure DevOps
Completion
2025/03
Research Area
Students
Het Modha
Advisers
Dr.-Ing. Sebastian Heil
Description
For a system test automation as well as software testing in general, it is important to have visibility on all test results and its details. The framework or tools used for testing differs, but the goal is same i.e. to deliver high quality products or services. In the context of test automation using Pytest with the Azure DevOps platform, the visibility aspect of test result is lower than for manual tests provided by the native features of Azure. The features available in Azure for manual tests comprise of traceable objects such as work-items as a bug, test case, feature, task, product backlog item, etc. and provide visibility across multiple areas of Azure. However, these functionalities are not available for automated tests using Pytest. This creates a need to increase the visibility of test results for stakeholders like Product Owners, Developers, Testers and Scrum Masters especially in a cross-functional teams.
Currently, there is no native integration tool that can bridge this gap. To achieve this goal, this thesis focuses on enabling the visibility of automated Pytest test results in the Azure DevOps platform. It investigates several possible solutions considering various existing test result formats and outputs and different mapping strategies between the test results and Azure DevOps.
The objective of this thesis is the creation of a solution or the combination of existing techniques to solve the problem of limited support for automated Pytest tests in Azure DevOps through an integration as described above. This comprises the analysis of the state of the art of mapping approaches and test result integrations as well as the demonstration of the solution by implementation and a suitable experimental evaluation focusing on the applicability of the solution with real test cases and its usability using suitable measurement instruments.
