Mercurial Mercurial > mercurial / annotate
summary | shortlog | changelog | graph | tags | bookmarks | branches | files | changeset | file | latest | revisions | annotate | diff | comparison | raw | help
Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
tests/test-remotefilelog-corrupt-cache.t
author Pulkit Goyal <pulkit@yandex-team.ru>
Mon, 01 Apr 2019 13:56:47 +0300
changeset 42121 6578654916ae
parent 40722 0800d9e6e216
child 47548 5830539c46be
permissions -rw-r--r--
branchcache: lazily validate nodes from the branchmap On my personal hg-repository with 365 entries in .hg/cache/branch2, following are the numbers for perfbranchmapload. Before this patch: ! wall 0.000866 comb 0.000000 user 0.000000 sys 0.000000 (best of 2680) ! wall 0.001525 comb 0.000000 user 0.000000 sys 0.000000 (max of 2680) ! wall 0.001107 comb 0.001097 user 0.001086 sys 0.000011 (avg of 2680) ! wall 0.001104 comb 0.000000 user 0.000000 sys 0.000000 (median of 2680) With this patch: ! wall 0.000530 comb 0.000000 user 0.000000 sys 0.000000 (best of 4240) ! wall 0.001078 comb 0.000000 user 0.000000 sys 0.000000 (max of 4240) ! wall 0.000696 comb 0.000693 user 0.000677 sys 0.000017 (avg of 4240) ! wall 0.000690 comb 0.000000 user 0.000000 sys 0.000000 (median of 4240) On our internal repository with ~20k entries in branchcache, I see improvement from 0.125 sec to 0.066 sec which is 47% speed up. The above are the numbers of perfbranchmapload which shows how much time we saved by not validating the nodes. But we need to validate some nodes. Following are timings of some mercurial operations which have speed up because of this lazy validation of nodes: No-op `hg update` on our internal repository (Avg on 4 runs): Before: 0.540 secs After: 0.430 secs Setting a branch name which already exists without --force (Avg of 4 runs): Before: 0.510 secs After: 0.250 secs I ran the ASV performance suite and was unable to see any improvements except there was improvement of perfdirstatewrite() on netbeans which I think was not related. I looked into the commit code, the command which I am trying to speedup, it looks like it uses revbranchcache to update the branchcache. Differential Revision: https://phab.mercurial-scm.org/D6208
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
40722
0800d9e6e216 tests: disable remotefilelog on Windows
Matt Harbison <matt_harbison@yahoo.com>
parents: 40572
diff changeset 
     1
 
#require no-windows
0800d9e6e216 tests: disable remotefilelog on Windows
Matt Harbison <matt_harbison@yahoo.com>
parents: 40572
diff changeset 
     2
 







40495






3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     3


  $ . "$TESTDIR/remotefilelog-library.sh"












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     4









40571






95a079ea1e19
tests: drop obsolete "hginit" alias in remotefilelog tests



Martin von Zweigbergk <martinvonz@google.com>


parents: 
40495

diff
changeset




     5


  $ hg init master







40495






3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     6


  $ cd master












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     7


  $ cat >> .hg/hgrc <<EOF












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     8


  > [remotefilelog]












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




     9


  > server=True












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    10


  > EOF












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    11


  $ echo x > x












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    12


  $ echo y > y












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    13


  $ echo z > z












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    14


  $ hg commit -qAm xy












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    15














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    16


  $ cd ..












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    17














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    18


  $ hgcloneshallow ssh://user@dummy/master shallow -q












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    19


  3 files fetched over 1 fetches - (3 misses, 0.00% hit ratio) over *s (glob)












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    20


  $ cd shallow












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    21














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    22


Verify corrupt cache handling repairs by default












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    23














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    24


  $ hg up -q null












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    25


  $ chmod u+w $CACHEDIR/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1406e74118627694268417491f018a4a883152f0












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    26


  $ echo x > $CACHEDIR/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1406e74118627694268417491f018a4a883152f0












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    27


  $ hg up tip












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    28


  3 files updated, 0 files merged, 0 files removed, 0 files unresolved












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    29


  1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over *s (glob)












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    30














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    31


Verify corrupt cache error message












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    32














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    33


  $ hg up -q null












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    34


  $ cat >> .hg/hgrc <<EOF












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    35


  > [remotefilelog]












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    36


  > validatecache=off












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    37


  > EOF












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    38


  $ chmod u+w $CACHEDIR/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1406e74118627694268417491f018a4a883152f0












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    39


  $ echo x > $CACHEDIR/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1406e74118627694268417491f018a4a883152f0












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    40


  $ hg up tip 2>&1 | egrep "^RuntimeError"












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    41


  RuntimeError: unexpected remotefilelog header: illegal format












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    42














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    43


Verify detection and remediation when remotefilelog.validatecachelog is set












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    44














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    45


  $ cat >> .hg/hgrc <<EOF












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    46


  > [remotefilelog]












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    47


  > validatecachelog=$PWD/.hg/remotefilelog_cache.log












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    48


  > validatecache=strict












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    49


  > EOF












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    50


  $ chmod u+w $CACHEDIR/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1406e74118627694268417491f018a4a883152f0












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    51


  $ echo x > $CACHEDIR/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1406e74118627694268417491f018a4a883152f0












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    52


  $ hg up tip












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    53


  3 files updated, 0 files merged, 0 files removed, 0 files unresolved












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    54


  1 files fetched over 1 fetches - (1 misses, 0.00% hit ratio) over *s (glob)












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    55


  $ cat .hg/remotefilelog_cache.log












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    56


  corrupt $TESTTMP/hgcache/master/11/f6ad8ec52a2984abaafd7c3b516503785c2072/1406e74118627694268417491f018a4a883152f0 during contains












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    57














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    58


Verify handling of corrupt server cache












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    59














3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    60


  $ rm -f ../master/.hg/remotefilelogcache/y/076f5e2225b3ff0400b98c92aa6cdf403ee24cca












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    61


  $ touch ../master/.hg/remotefilelogcache/y/076f5e2225b3ff0400b98c92aa6cdf403ee24cca












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    62


  $ clearcache












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    63


  $ hg prefetch -r .












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    64


  3 files fetched over 1 fetches - (3 misses, 0.00% hit ratio) over *s (glob)












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    65


  $ test -s ../master/.hg/remotefilelogcache/y/076f5e2225b3ff0400b98c92aa6cdf403ee24cca












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    66


  $ hg debugremotefilelog $CACHEDIR/master/95/cb0bfd2977c761298d9624e4b4d4c72a39974a/076f5e2225b3ff0400b98c92aa6cdf403ee24cca












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    67


  size: 2 bytes












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    68


  path: $TESTTMP/hgcache/master/95/cb0bfd2977c761298d9624e4b4d4c72a39974a/076f5e2225b3ff0400b98c92aa6cdf403ee24cca 












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    69


  key: 076f5e2225b3 












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    70


  












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    71


          node =>           p1            p2      linknode     copyfrom












3a333a582d7b
remotefilelog: import pruned-down remotefilelog extension from hg-experimental



Augie Fackler <augie@google.com>


parents: 

diff
changeset




    72


  076f5e2225b3 => 000000000000  000000000000  f3d0bb0d1e48  














mercurial