| commit | 009a9a61b2065e983e0679fa2a32d0fee3c6a3c1 | [log] [tgz] |
|---|---|---|
| author | Mark Seaborn <mseaborn@google.com> | Thu Apr 18 05:34:25 2019 +0000 |
| committer | CQ bot account: commit-bot@chromium.org <commit-bot@chromium.org> | Thu Apr 18 05:34:25 2019 +0000 |
| tree | bde47d4982ee235256b2f54b3fb6a9ac27619015 | |
| parent | 25b167abbb661c57289d0a6904c0df45626a73d5 [diff] |
[perfcompare] Do multiple launches of each test process instead of just one We've found that the mean running times of performance tests tend to vary between launches of the same process and between reboots. We want to calculate the mean across process launches and reboots, so we need to sample accordingly. This change implements sampling across process relaunches. Sampling across reboots will be done later. * Before: We launch the perftest process once, and (for each test case) do 1000 test runs in that process. We treat this as a sample of size 1000 when calculating confidence intervals. * After: We launch the perftest process 30 times, and (for each test case) do 100 test runs in each process. We treat this as a sample of size 30 when calculating confidence intervals. Bug: IN-646 Test: "python perfcompare_test.py" + perfcompare trybot Change-Id: Ic0176dcc394e87015302bbe3d8588a68408fca05
Pink + Purple == Fuchsia (a new operating system)
Fuchsia is a modular, capability-based operating system. Fuchsia runs on modern 64-bit Intel and ARM processors.
Fuchsia is an open source project with a code of conduct that we expect everyone who interacts with the project to respect.
See Getting Started.
See the documentation.