| |
| |
| ### adding_test |
| Test case Improve/regress? Factor change Mean before Mean after |
| ------------------- ---------------- ------------- ----------- ----------- |
| ClockGetTimeExample no_sig_diff 0.949-1.054 991 +/- 26 991 +/- 26 |
| SecondExample added - - 1975 +/- 78 |
| |
| |
| ### comparison_improvement |
| Test case Improve/regress? Factor change Mean before Mean after |
| ------------------- ---------------- ------------- ----------- ----------- |
| ClockGetTimeExample faster 0.900-0.967 1491 +/- 26 1391 +/- 26 |
| SecondExample no_sig_diff 0.924-1.083 1975 +/- 78 1975 +/- 78 |
| |
| |
| ### comparison_improvement_small |
| Test case Improve/regress? Factor change Mean before Mean after |
| ------------------- ---------------- ------------- ----------- ----------- |
| ClockGetTimeExample no_sig_diff 0.933-1.002 1491 +/- 26 1441 +/- 26 |
| SecondExample no_sig_diff 0.924-1.083 1975 +/- 78 1975 +/- 78 |
| |
| |
| ### comparison_no_change |
| Test case Improve/regress? Factor change Mean before Mean after |
| ------------------- ---------------- ------------- ----------- ----------- |
| ClockGetTimeExample no_sig_diff 0.949-1.054 991 +/- 26 991 +/- 26 |
| SecondExample no_sig_diff 0.924-1.083 1975 +/- 78 1975 +/- 78 |
| |
| |
| ### comparison_regression |
| Test case Improve/regress? Factor change Mean before Mean after |
| ------------------- ---------------- ------------- ----------- ----------- |
| ClockGetTimeExample slower 1.031-1.104 1491 +/- 26 1591 +/- 26 |
| SecondExample no_sig_diff 0.924-1.083 1975 +/- 78 1975 +/- 78 |
| |
| |
| ### removing_test |
| Test case Improve/regress? Factor change Mean before Mean after |
| ------------------- ---------------- ------------- ----------- ---------- |
| ClockGetTimeExample no_sig_diff 0.949-1.054 991 +/- 26 991 +/- 26 |
| SecondExample removed - 1975 +/- 78 - |
| |
| |
| ### validate_perfcompare |
| Rate of mismatches (non-intersections) of confidence intervals for each test: |
| 0.526316 ClockGetTimeExample |
| 0.000000 SecondExample |
| |
| Mean mismatch rate: 0.263158 |
| Number of test cases: 2 |
| Number of result sets: 20 |
| Expected number of test cases with mismatches: 0.526316 |
