Google Git
Sign in
fuchsia / fuchsia / ce365daea8f24d2d7d66688e5b3f3745b1aaabf7 / . / build / rbe
tree: d367a17c19eee7246c9fed3673336ee0fcfabaee [path history] [tgz]
  1. proto/
  2. action_diff.sh ⇨ python_with_pb_test.sh
  3. action_diff_test.sh ⇨ python_with_pb_test.sh
  4. pb_message_util_test.sh ⇨ python_with_pb_test.sh
  5. reproxy_logs_test.sh ⇨ python_with_pb_test.sh
  6. upload_reproxy_logs.sh ⇨ python_with_pb_test.sh
  7. upload_reproxy_logs_test.sh ⇨ python_with_pb_test.sh
  8. action_diff.py
  9. action_diff_test.py
  10. BUILD.gn
  11. cl_utils.py
  12. cl_utils_test.py
  13. common-setup.sh
  14. cxx-remote-wrapper.sh
  15. cxx-swap-remote-compiler.sh
  16. cxx.py
  17. cxx_remote_wrapper.py
  18. cxx_remote_wrapper_test.py
  19. cxx_test.py
  20. depfile.py
  21. depfile_test.py
  22. detail-diff.sh
  23. dlwrap.py
  24. dlwrap_test.py
  25. fuchsia-rbe-action.sh
  26. fuchsia-reproxy-wrap.sh
  27. fuchsia-reproxy.cfg
  28. fuchsia-rewrapper.cfg
  29. fuchsia.py
  30. fuchsia_test.py
  31. log-it.sh
  32. output-scanner.sh
  33. output_leak_scanner.py
  34. output_leak_scanner_test.py
  35. pb_message_util.py
  36. pb_message_util_test.py
  37. prebuilt_tool_remote_wrapper.py
  38. prebuilt_tool_remote_wrapper_test.py
  39. python_with_pb_test.sh
  40. README.md
  41. relativize_args.py
  42. relativize_args_test.py
  43. remote_action.py
  44. remote_action_test.py
  45. remotetool.py
  46. remotetool.sh
  47. remotetool_test.py
  48. reproxy_logs.py
  49. reproxy_logs_test.py
  50. rustc-remote-wrapper.sh
  51. rustc.py
  52. rustc_remote_wrapper.py
  53. rustc_remote_wrapper_test.py
  54. rustc_test.py
  55. textpb.py
  56. textpb_test.py
  57. upload_reproxy_logs.py
  58. upload_reproxy_logs_test.py
build/rbe/README.md

This directory contains support for building the Fuchsia tree with build actions running on RBE (remote build execution).

Remote execution wrappers

The top-level remote execution wrappers are used as command prefixes:

  • cxx_remote_wrapper.py: prefix wrapper for remote compiling C++
  • rustc_remote_wrapper.py: prefix wrapper for remote compiling Rust
    • Detects and gathers all inputs and tools needed for remote compiling.
    • Detects extra outputs to download produced by remote compiling.
  • remote_action.py: prefix wrapper for generic remote actions
    • Exists as standalone wrapper and library.
    • Includes detailed diagnostics for certain error conditions.
    • Includes limited fault-tolerance and retries.
    • The C++ and Rust wrappers inherit all of the features of this generic script.
  • fuchsia-reproxy-wrap.sh: automatically start/shutdown reproxy (needed by rewrapper) around any command. Used by fx build.

More details can be found by running with --help.

Support scripts

  • cl_utils.py: generic command-line operation library
  • cxx.py: for understanding structure of C/C++ compile commands
  • fuchsia.py: Fuchsia-tree specific directory layouts and conventions. Parties interested in re-using wrapper scripts found here should expect to replace this file.
  • output_leak_scanner.py: Check that commands and outputs do not leak the name of the build output directory, for better caching outcomes.
  • relativize_args.py: Attempt to transform commands with absolute paths into equivalent commands with relative paths. This can be useful for build systems that insist on absolute paths, like cmake.
  • rustc.py: for understanding structure of rustc compile commands

Configurations

  • fuchsia-rewrapper.cfg: rewrapper configuration
  • fuchsia-reproxy.cfg: reproxy configuration

GN files

  • build/toolchain/rbe.gni: global args.gn variables for RBE

  • build/toolchain/clang_toolchain.gni: uses RBE wrappers depending on configuration

  • build/rust/rustc_*.gni: uses RBE wrappers depending on configuration

Metrics and logs

  • upload_reproxy_logs.py: pushes RBE metrics and detailed logs to BigQuery.

    • This can be enabled by fx build-metrics.

  • pb_message_util.py: library for translating protobufs to JSON