===================================

Test the persistent on-disk nodemap

===================================

  $ hg init test-repo

  $ cd test-repo

  $ cat << EOF >> .hg/hgrc

  > [experimental]

  > exp-persistent-nodemap=yes

  > [devel]

  > persistent-nodemap=yes

  > EOF

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5000

  data-unused: 0

  data-unused: 0.000%

  $ f --size .hg/store/00changelog.n

  .hg/store/00changelog.n: size=70

Simple lookup works

  $ ANYNODE=`hg log --template '{node|short}\n' --rev tip`

  $ hg log -r "$ANYNODE" --template '{rev}\n'

  5000

#if rust

  $ f --sha256 .hg/store/00changelog-*.nd

  $ hg debugnodemap --dump-new | f --sha256 --size

  $ hg debugnodemap --dump-disk | f --sha256 --bytes=256 --hexdump --size

#else

  $ f --sha256 .hg/store/00changelog-*.nd

  $ hg debugnodemap --dump-new | f --sha256 --size

  $ hg debugnodemap --dump-disk | f --sha256 --bytes=256 --hexdump --size

  0000: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff |................|

  0070: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff |................|

  00d0: ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff |................|

#endif

  $ hg debugnodemap --check

  revision in index:   5001

  revision in nodemap: 5001

add a new commit

  $ hg up

  $ echo foo > foo

  $ hg add foo

  $ hg ci -m 'foo'

#if no-pure no-rust

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5001

  data-unused: 0

  data-unused: 0.000%

#else

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5001

#endif

  $ f --size .hg/store/00changelog.n

  .hg/store/00changelog.n: size=70

(The pure code use the debug code that perform incremental update, the C code reencode from scratch)

#if pure

  $ f --sha256 .hg/store/00changelog-*.nd --size

#endif

#if rust

  $ f --sha256 .hg/store/00changelog-*.nd --size

#endif

#if no-pure no-rust

  $ f --sha256 .hg/store/00changelog-*.nd --size

#endif

  $ hg debugnodemap --check

  revision in index:   5002

  revision in nodemap: 5002

Test code path without mmap

---------------------------

  $ echo bar > bar

  $ hg add bar

  $ hg ci -m 'bar' --config experimental.exp-persistent-nodemap.mmap=no

  $ hg debugnodemap --check --config experimental.exp-persistent-nodemap.mmap=yes

  revision in index:   5003

  revision in nodemap: 5003

  $ hg debugnodemap --check --config experimental.exp-persistent-nodemap.mmap=no

  revision in index:   5003

  revision in nodemap: 5003

#if pure

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  $ f --sha256 .hg/store/00changelog-*.nd --size

#endif

#if rust

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  $ f --sha256 .hg/store/00changelog-*.nd --size

#endif

#if no-pure no-rust

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  data-unused: 0

  data-unused: 0.000%

  $ f --sha256 .hg/store/00changelog-*.nd --size

#endif

Test force warming the cache

  $ rm .hg/store/00changelog.n

  $ hg debugnodemap --metadata

  $ hg debugupdatecache

#if pure

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  data-unused: 0

  data-unused: 0.000%

#else

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  data-unused: 0

  data-unused: 0.000%

#endif

Check out of sync nodemap

=========================

First copy old data on the side.

  $ mkdir ../tmp-copies

  $ cp .hg/store/00changelog-????????????????.nd .hg/store/00changelog.n ../tmp-copies

Nodemap lagging behind

----------------------

make a new commit

  $ echo bar2 > bar

  $ hg ci -m 'bar2'

  $ NODE=`hg log -r tip -T '{node}\n'`

  $ hg log -r "$NODE" -T '{rev}\n'

  5003

If the nodemap is lagging behind, it can catch up fine

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5003

  data-unused: 0 (no-rust no-pure !)

  data-unused: 0.000% (no-rust no-pure !)

  $ cp -f ../tmp-copies/* .hg/store/

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  data-unused: 0

  data-unused: 0.000%

  $ hg log -r "$NODE" -T '{rev}\n'

  5003

changelog altered

-----------------

If the nodemap is not gated behind a requirements, an unaware client can alter

the repository so the revlog used to generate the nodemap is not longer

compatible with the persistent nodemap. We need to detect that.

  $ hg up "$NODE~5"

  $ echo bar > babar

  $ hg add babar

  $ hg ci -m 'babar'

  created new head

  $ OTHERNODE=`hg log -r tip -T '{node}\n'`

  $ hg log -r "$OTHERNODE" -T '{rev}\n'

  5004

  $ hg --config extensions.strip= strip --rev "$NODE~1" --no-backup

the nodemap should detect the changelog have been tampered with and recover.

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  data-unused: 448 (pure !)

  data-unused: 0 (rust !)

  data-unused: 0 (no-pure no-rust !)

  data-unused: 0.000% (rust !)

  data-unused: 0.000% (no-pure no-rust !)

  $ cp -f ../tmp-copies/* .hg/store/

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5002

  data-unused: 0

  data-unused: 0.000%

  $ hg log -r "$OTHERNODE" -T '{rev}\n'

  5002

Check transaction related property

==================================

An up to date nodemap should be available to shell hooks,

  $ echo dsljfl > a

  $ hg add a

  $ hg ci -m a

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5003

  data-unused: 0

  data-unused: 0.000%

  $ echo babar2 > babar

  $ hg ci -m 'babar2' --config "hooks.pretxnclose.nodemap-test=hg debugnodemap --metadata"

  uid: ???????????????? (glob)

  tip-rev: 5004

  data-unused: 192 (pure !)

  data-unused: 192 (rust !)

  data-unused: 0 (no-pure no-rust !)

  data-unused: 0.000% (no-pure no-rust !)

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5004

  data-unused: 192 (pure !)

  data-unused: 192 (rust !)

  data-unused: 0 (no-pure no-rust !)

  data-unused: 0.000% (no-pure no-rust !)

Another process does not see the pending nodemap content during run.

  $ PATH=$RUNTESTDIR/testlib/:$PATH

  $ echo qpoasp > a

  $ hg ci -m a2 \

  > --config "hooks.pretxnclose=wait-on-file 20 sync-repo-read sync-txn-pending" \

  > --config "hooks.txnclose=touch sync-txn-close" > output.txt 2>&1 &

(read the repository while the commit transaction is pending)

  $ wait-on-file 20 sync-txn-pending && \

  > hg debugnodemap --metadata && \

  > wait-on-file 20 sync-txn-close sync-repo-read

  uid: ???????????????? (glob)

  tip-rev: 5004

  data-unused: 192 (pure !)

  data-unused: 192 (rust !)

  data-unused: 0 (no-pure no-rust !)

  data-unused: 0.000% (no-pure no-rust !)

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5005

  data-unused: 448 (pure !)

  data-unused: 448 (rust !)

  data-unused: 0 (no-pure no-rust !)

  data-unused: 0.000% (no-pure no-rust !)

  $ cat output.txt

Check that a failing transaction will properly revert the data

  $ echo plakfe > a

  $ f --size --sha256 .hg/store/00changelog-*.nd

  $ hg ci -m a3 --config "extensions.abort=$RUNTESTDIR/testlib/crash_transaction_late.py"

  transaction abort!

  rollback completed

  abort: This is a late abort

  [255]

  $ hg debugnodemap --metadata

  uid: ???????????????? (glob)

  tip-rev: 5005

  data-unused: 448 (pure !)

  data-unused: 448 (rust !)

  data-unused: 0 (no-pure no-rust !)

  data-unused: 0.000% (no-pure no-rust !)

  $ f --size --sha256 .hg/store/00changelog-*.nd