tree: e5b067678de4ecf498eec0519e70464857e72bdd [search]
  1. fake_root/
  2. lakeprof_measurements.py
  3. lakeprof_report_template.html
  4. lakeprof_report_upload.py
  5. lean_wrapper.py
  6. README.md
  7. run_bench.sh
tests/bench/build/README.md

The build benchmark

This benchmark executes a complete build of the stage3 stdlib from stage2 and collects global and per-module metrics. This is different from most other benchmarks, which benchmark the stage the bench suite is being executed in.

The following metrics are collected by a wrapper around the entire build process:

  • build//cycles
  • build//instructions
  • build//maxrss
  • build//task-clock
  • build//wall-clock

The following metrics are collected from leanc --profile and leanc --stat and summed across all modules:

  • build/profile/<name>//wall-clock
  • build/stat/<name>//amount
  • build/stat/<name>//bytes

The following metrics are collected from lakeprof report:

  • build/lakeprof/longest build path//wall-clock
  • build/lakeprof/longest rebuild path//wall-clock

The following metrics are collected from a combination of lakeprof report and the per-module instructions:

  • build/lakeprof/longest build path//instructions
  • build/lakeprof/longest rebuild path//instructions

The following metrics are collected individually for each module:

  • build/module/<name>//lines
  • build/module/<name>//cycles
  • build/module/<name>//instructions
  • build/module/<name>//bytes .ilean
  • build/module/<name>//bytes .olean
  • build/module/<name>//bytes .olean.server
  • build/module/<name>//bytes .olean.private

If the LAKEPROF_UPLOAD_URL environment variable is set, the lakeprof report will be uploaded to that URL prefix once the benchmark run concludes.