tbV2: fix data loss on re-admit of scraped+evicted chunks

On RING_BUFFER buffers with a slow consumer (e.g. write_into_file with a
multi-minute file_write_period_ms), a scraped chunk can be evicted by the
wrap before any reader has touched it. When the producer later commits the
same chunk_id with chunk_complete=true and more data, CopyChunkUntrusted
takes the re-admit branch.

The re-admit was using last_chunk_consumed.payload_size as the "bytes the
consumer already saw" cursor and skipping them on the resubmitted chunk.
But EraseCurrentChunk wrote that field to the chunk's total payload
regardless of how the chunk left the buffer, so any bytes that were
overwritten without ever being read got skipped on re-admit too. The
producer resubmitted them and the buffer threw them away anyway.

Fix:

ChunkSeqReader tracks bytes_overwritten_in_chunk_, reset on every chunk
transition and incremented in ConsumeFragment when mode_ == kEraseMode.
EraseCurrentChunk records payload_read = payload_size - bytes_overwritten
on last_chunk_consumed. The field was previously called payload_size; it
is now payload_read to match what it actually stores. CopyChunkUntrusted's
re-admit branch uses payload_read for both the acceptance check and the
skip count.

A second source of loss is detected even when the chunk_ids stay
contiguous: eviction advances last_chunk_consumed.chunk_id, so a chunk
overwritten with unread packets would look like a clean successor. We
record had_unread_on_evict on the erased chunk and turn it into a data
loss in ChunkSeqReader's ctor, unless the same chunk_id is re-admitted.

ConsumeFragment only attributes bytes to bytes_overwritten_in_chunk_ for
iter_, the chunk being erased. Fragment reassembly also consumes
continuation fragments out of later chunks, and charging those to the
current chunk would overshoot its payload_size (tripping the DCHECK in
EraseCurrentChunk and underflowing payload_read in release builds).
3 files changed
tree: 2e8341ac2910960969adc762219bd24f31353214
  1. .github/
  2. ai/
  3. bazel/
  4. build_overrides/
  5. buildtools/
  6. contrib/
  7. docs/
  8. examples/
  9. gn/
  10. include/
  11. infra/
  12. protos/
  13. python/
  14. sdk/
  15. src/
  16. test/
  17. third_party/
  18. tools/
  19. ui/
  20. .bazelignore
  21. .bazelrc
  22. .bazelversion
  23. .clang-format
  24. .clang-tidy
  25. .git-blame-ignore-revs
  26. .gitallowed
  27. .gitattributes
  28. .gitignore
  29. .gn
  30. .style.yapf
  31. Android.bp
  32. Android.bp.extras
  33. BUILD
  34. BUILD.extras
  35. BUILD.gn
  36. CHANGELOG
  37. CONTRIBUTORS.txt
  38. DIR_METADATA
  39. heapprofd.rc
  40. LICENSE
  41. meson.build
  42. METADATA
  43. MODULE.bazel
  44. MODULE.bazel.lock
  45. MODULE_LICENSE_APACHE2
  46. OWNERS
  47. OWNERS.github
  48. perfetto.rc
  49. perfetto_flags.aconfig
  50. PerfettoIntegrationTests.xml
  51. persistent_cfg.pbtxt
  52. README.chromium
  53. README.md
  54. TEST_MAPPING
  55. traced_perf.rc
  56. WORKSPACE
README.md

Perfetto - System profiling, app tracing and trace analysis

Perfetto is an open-source suite of SDKs, daemons and tools which use tracing to help developers understand the behaviour of complex systems and root-cause functional and performance issues on client and embedded systems.

It is a production-grade tool that is the default tracing system for the Android operating system and the Chromium browser.

Core Components

Perfetto is not a single tool, but a collection of components that work together:

  • High-performance tracing daemons: For capturing tracing information from many processes on a single machine into a unified trace file.
  • Low-overhead tracing SDK: A C++17 library for direct userspace-to-userspace tracing of timings and state changes in your application.
  • Extensive OS-level probes: For capturing system-wide context on Android and Linux (e.g. scheduling states, CPU frequencies, memory profiling, callstack sampling).
  • Browser-based UI: A powerful, fully local UI for visualizing and exploring large, multi-GB traces on a timeline. It works in all major browsers, requires no installation, and can open traces from other tools.
  • SQL-based analysis library: A powerful engine that allows you to programmatically query traces using SQL to automate analysis and extract custom metrics.

Why Use Perfetto?

Perfetto was designed to be a versatile and powerful tracing system for a wide range of use cases.

  • For Android App & Platform Developers: Debug and root-cause functional and performance issues like slow startups, dropped frames (jank), animation glitches, low memory kills, and ANRs. Profile both Java/Kotlin and native C++ memory usage with heap dumps and profiles.
  • For C/C++ Developers (Linux, macOS, Windows): Use the Tracing SDK to instrument your application with custom trace points to understand its execution flow, find performance bottlenecks, and debug complex behavior. On Linux, you can also perform detailed CPU and native heap profiling.
  • For Linux Kernel & System Developers: Get deep insights into kernel behavior. Perfetto acts as an efficient userspace daemon for ftrace, allowing you to visualize scheduling, syscalls, interrupts, and custom kernel tracepoints on a timeline.
  • For Chromium Developers: Perfetto is the tracing backend for chrome://tracing. Use it to debug and root-cause issues in the browser, V8, and Blink.
  • For Performance Engineers & SREs: Analyze and visualize a wide range of profiling and tracing formats, not just Perfetto's. Use the powerful SQL interface to programmatically analyze traces from tools like Linux perf, macOS Instruments, Chrome JSON traces, and more.

Getting Started

We‘ve designed our documentation to guide you to the right information as quickly as possible, whether you’re a newcomer to performance analysis or an experienced developer.

  1. New to tracing? If you're unfamiliar with concepts like tracing and profiling, start here:

  2. Ready to dive in? Our “Getting Started” guide is the main entry point for all users. It will help you find the right tutorials and documentation for your specific needs:

  3. Want the full overview? For a comprehensive look at what Perfetto is, why it's useful, and who uses it, see our main documentation page:

Debian Distribution

For users interested in the Debian distribution of Perfetto, the official source of truth and packaging efforts are maintained at Debian Perfetto Salsa Repository

Community & Support

Have questions? Need help?

We follow Google's Open Source Community Guidelines.