xref: /aosp_15_r20/external/cronet/build/docs/debugging_slow_builds.md (revision 6777b5387eb2ff775bb5750e3f5d96f37fb7352b)
1# Debugging Slow Builds
2
3Did you know that Ninja writes a log to disk after each build?
4
5To see what kinds of files took the longest for your previous build:
6
7```sh
8cd out/Default
9# Lives in depot_tools:
10post_build_ninja_summary.py
11```
12
13Because the build is highly parallelized the `elapsed time` values are usually
14not meaningful so the `weighted time` numbers are calculated to approximate
15the impact of build steps on wall-clock time.
16
17You can also set `NINJA_SUMMARIZE_BUILD=1` to have this command run
18after each `autoninja` invocation. Setting this environment variable also runs
19ninja with `-d stats` which causes it to print out internal information such
20as StartEdge times, which measures the times to create processes, and it
21modifies the `NINJA_STATUS` environment variable to add information such as how
22many processes are running at any given time - both are useful for detecting
23slow process creation. You can get this last benefit on its own by setting
24`NINJA_STATUS=[%r processes, %f/%t @ %o/s : %es ] ` (trailing space is
25intentional).
26
27To generate a Chrome trace of your most recent build:
28
29```sh
30git clone https://github.com/nico/ninjatracing
31ninjatracing/ninjatracing out/Default/.ninja_log > trace.json
32# Then open in https://ui.perfetto.dev/
33```
34
35If your build is stuck on a long-running build step you can see what it is by
36running `tools/buildstate.py`.
37
38## Slow Bot Builds
39
40Our bots run `ninjatracing` and `post_build_ninja_summary.py` as well.
41
42Find the trace at: `postprocess for reclient > gsutil upload ninja_log > ninja_log`:
43
44 * _".ninja_log in table format (full)"_ is for `post_build_ninja_summary.py`.
45 * _"trace viewer (sort_by_end)"_ is for `ninjatracing`.
46
47## Advanced(ish) Tips
48
49* Use `gn gen --tracelog trace.json` to create a trace for `gn gen`.
50* Many Android templates make use of
51  [`md5_check.py`](https://cs.chromium.org/chromium/src/build/android/gyp/util/md5_check.py)
52  to optimize incremental builds.
53  * Set `PRINT_BUILD_EXPLANATIONS=1` to have these commands log which inputs
54    changed.
55* If you suspect files are being rebuilt unnecessarily during incremental
56  builds:
57  * Use `ninja -n -d explain` to figure out why ninja thinks a target is dirty.
58  * Ensure actions are taking advantage of ninja's `restat=1` feature by not
59    updating timestamps on outputs when their contents do not change.
60    * E.g. by using [`build_utils.AtomicOutput()`]
61
62[`build_utils.AtomicOutput()`]: https://source.chromium.org/search?q=symbol:AtomicOutput%20f:build
63