Test Case Prioritization Using User Observability Data and Production Failure History
Test Case Prioritization; Observability; CI/CD; Regression Testing.
Modern Software Engineering faces the challenge of maintaining quality in complex
systems without compromising the agility of Continuous Integration and Continuous
Delivery (CI/CD) cycles. The exponential growth of automated test suites can result
in increased execution time and operational costs, making exhaustive testing unfeasible
in high-frequency integration scenarios. This paper proposes a Test Case Prioritization
(TCP) strategy based on a hybrid approach that integrates user and system failure history.
The methodology is based on the correlation between business value—measured by
the frequency of feature usage—and technical risk, identified through failure history and
stack trace analysis. The proposed solution consists of an automated flow for telemetry
collection and the mapping of test cases via Custom Tags in the Cypress framework. A
scoring algorithm processes this data to dynamically reorder the execution queue, ensuring
that critical scenarios are validated with priority.