perf: clear vfs audit_cache before each run When generating a stream clone, we spend a large amount of time auditing path. Before this changes, the first run was warming the vfs cache for the other runs, leading to a large runtime difference and a "faulty" reported timing for the operation. We now clear this important cache between run to get a more realistic timing. Below are some example of median time change when clearing these cases. The maximum time for a run did not changed significantly. ### data-env-vars.name = mozilla-central-2018-08-01-zstd-sparse-revlog # benchmark.name = hg.perf.exchange.stream.generate # bin-env-vars.hg.flavor = default # bin-env-vars.hg.py-re2-module = default # benchmark.variants.version = latest no-clearing: 17.289905 cache-clearing: 21.587965 (+24.86%, +4.30) ## data-env-vars.name = mozilla-central-2024-03-22-zstd-sparse-revlog no-clearing: 32.670748 cache-clearing: 40.467095 (+23.86%, +7.80) ## data-env-vars.name = mozilla-try-2019-02-18-zstd-sparse-revlog no-clearing: 37.838858 cache-clearing: 46.072749 (+21.76%, +8.23) ## data-env-vars.name = mozilla-unified-2024-03-22-zstd-sparse-revlog no-clearing: 32.969395 cache-clearing: 39.646209 (+20.25%, +6.68) In addition, this significantly reduce the timing difference between the performance command, from the perf extensions and a `real `hg bundle` call producing a stream bundle. Some significant differences remain especially on the "mozilla-try" repositories, but they are now smaller. Note that some of that difference will actually not be attributable to the stream generation (like maybe phases or branch map computation). Below are some benchmarks done on a currently draft changeset fixing some unrelated slowness in `hg bundle` (34a78972af409d1ff37c29e60f6ca811ad1a457d) ### data-env-vars.name = mozilla-central-2018-08-01-zstd-sparse-revlog # bin-env-vars.hg.flavor = default # bin-env-vars.hg.py-re2-module = default hg.perf.exchange.stream.generate: 21.587965 hg.command.bundle: 24.301799 (+12.57%, +2.71) ## data-env-vars.name = mozilla-central-2024-03-22-zstd-sparse-revlog hg.perf.exchange.stream.generate: 40.467095 hg.command.bundle: 44.831317 (+10.78%, +4.36) ## data-env-vars.name = mozilla-unified-2024-03-22-zstd-sparse-revlog hg.perf.exchange.stream.generate: 39.646209 hg.command.bundle: 45.395258 (+14.50%, +5.75) ## data-env-vars.name = mozilla-try-2019-02-18-zstd-sparse-revlog hg.perf.exchange.stream.generate: 46.072749 hg.command.bundle: 55.882608 (+21.29%, +9.81) ## data-env-vars.name = mozilla-try-2023-03-22-zlib-general-delta hg.perf.exchange.stream.generate: 334.716708 hg.command.bundle: 377.856767 (+12.89%, +43.14) ## data-env-vars.name = mozilla-try-2023-03-22-zstd-sparse-revlog hg.perf.exchange.stream.generate: 302.972301 hg.command.bundle: 326.098755 (+7.63%, +23.13)

     1

#require no-windows

     2

     3

  $ . "$TESTDIR/remotefilelog-library.sh"

     4

     5

  $ hg init master

     6

  $ cd master

     7

  $ cat >> .hg/hgrc <<EOF

     8

  > [remotefilelog]

     9

  > server=True

    10

  > EOF

    11

  $ echo x > x

    12

  $ hg commit -qAm x

    13

  $ echo y >> x

    14

  $ hg commit -qAm y

    15

  $ echo z >> x

    16

  $ hg commit -qAm z

    17

  $ hg update 1

    18

  1 files updated, 0 files merged, 0 files removed, 0 files unresolved

    19

  $ echo w >> x

    20

  $ hg commit -qAm w

    21

    22

  $ cd ..

    23

    24

Shallow clone and activate getflogheads testing extension

    25

    26

  $ hgcloneshallow ssh://user@dummy/master shallow --noupdate

    27

  streaming all changes

    28

  3 files to transfer, 908 bytes of data (no-rust !)

    29

  transferred 908 bytes in * seconds (*/sec) (glob) (no-rust !)

    30

  5 files to transfer, 1.01 KB of data (rust !)

    31

  transferred 1.01 KB in * seconds (* */sec) (glob) (rust !)

    32

  searching for changes

    33

  no changes found

    34

  $ cd shallow

    35

    36

  $ cat >> .hg/hgrc <<EOF

    37

  > [extensions]

    38

  > getflogheads=$TESTDIR/remotefilelog-getflogheads.py

    39

  > EOF

    40

    41

Get heads of a remotefilelog

    42

    43

  $ hg getflogheads x

    44

  2797809ca5e9c2f307d82b1345e832f655fb99a2

    45

  ca758b402ddc91e37e3113e1a97791b537e1b7bb

    46

    47

Get heads of a non-existing remotefilelog

    48

    49

  $ hg getflogheads y

    50

  EMPTY