A theoretical analysis of the risk evaluation formulas for spectrum based fault localization
- Paper Notes
Existing approaches mostly select the best SBFL techniques using empirical methods. However, no matter how the researchers standardize their experimental setup or vary the setup choices, their investigations could never be considered as sufficiently comprehensive.
Some researchers have conducted theoretical analysis. Naish et al. propose two best formulas with theoretical proof, but they did not use the commonly used evaluation measurement.
This work proposes an innovative framework to analyze SBFL techniques theoretically, which considers the number of statements with higher risk values than the faulty ones.
Based on which, this work analyzed 30 risk evaluation formulas.
This work assumes there is only one faulty program element (e.g., statement).
EXAM score: the percentage of program elements that need to be examined before the faulty ones.
Since tie-breaking schemes solve a problem that risk evaluation formulas cannot solve. It is reasonable to assume that the tie-breaking scheme in our analysis is consistent in all risk evaluation formulas
Two formulas are equivalent if and only if they have the same number of statements preceding the faulty statement in the ranking lists, that is, they produce the same EXAM score
Created : February 14, 2023