#require serve

#testcases stream-legacy stream-bundle2

#if stream-bundle2

  $ cat << EOF >> $HGRCPATH

  > [experimental]

  > bundle2.stream = yes

  > EOF

#endif

Initialize repository

the status call is to check for issue5130

  $ hg init server

  $ cd server

  $ touch foo

  $ hg -q commit -A -m initial

  >>> for i in range(1024):

  ...     with open(str(i), 'wb') as fh:

  ...         fh.write(str(i))

  $ hg -q commit -A -m 'add a lot of files'

  $ hg st

  $ hg serve -p $HGPORT -d --pid-file=hg.pid

  $ cat hg.pid >> $DAEMON_PIDS

  $ cd ..

Basic clone

#if stream-legacy

  $ hg clone --stream -U http://localhost:$HGPORT clone1

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (*/sec) (glob)

  searching for changes

  no changes found

#endif

#if stream-bundle2

  $ hg clone --stream -U http://localhost:$HGPORT clone1

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (* */sec) (glob)

#endif

--uncompressed is an alias to --stream

#if stream-legacy

  $ hg clone --uncompressed -U http://localhost:$HGPORT clone1-uncompressed

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (*/sec) (glob)

  searching for changes

  no changes found

#endif

#if stream-bundle2

  $ hg clone --uncompressed -U http://localhost:$HGPORT clone1-uncompressed

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (* */sec) (glob)

#endif

Clone with background file closing enabled

#if stream-legacy

  $ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --stream -U http://localhost:$HGPORT clone-background | grep -v adding

  using http://localhost:$HGPORT/

  sending capabilities command

  sending branchmap command

  streaming all changes

  sending stream_out command

  1027 files to transfer, 96.3 KB of data

  starting 4 threads for background file closing

  transferred 96.3 KB in * seconds (*/sec) (glob)

  query 1; heads

  sending batch command

  searching for changes

  all remote heads known locally

  no changes found

  sending getbundle command

  bundle2-input-bundle: with-transaction

  bundle2-input-part: "listkeys" (params: 1 mandatory) supported

  bundle2-input-part: "phase-heads" supported

  bundle2-input-part: total payload size 24

  bundle2-input-bundle: 1 parts total

  checking for updated bookmarks

#endif

#if stream-bundle2

  $ hg --debug --config worker.backgroundclose=true --config worker.backgroundcloseminfilecount=1 clone --stream -U http://localhost:$HGPORT clone-background | grep -v adding

  using http://localhost:$HGPORT/

  sending capabilities command

  query 1; heads

  sending batch command

  streaming all changes

  sending getbundle command

  bundle2-input-bundle: with-transaction

  bundle2-input-part: "stream" (params: 4 mandatory) supported

  applying stream bundle

  1027 files to transfer, 96.3 KB of data

  starting 4 threads for background file closing

  transferred 96.3 KB in * seconds (* */sec) (glob)

  bundle2-input-part: total payload size 110887

  bundle2-input-part: "listkeys" (params: 1 mandatory) supported

  bundle2-input-part: "phase-heads" supported

  bundle2-input-part: total payload size 24

  bundle2-input-bundle: 2 parts total

  checking for updated bookmarks

#endif

Cannot stream clone when there are secret changesets

  $ hg -R server phase --force --secret -r tip

  $ hg clone --stream -U http://localhost:$HGPORT secret-denied

  warning: stream clone requested but server has them disabled

  requesting all changes

  adding changesets

  adding manifests

  adding file changes

  added 1 changesets with 1 changes to 1 files

  new changesets 96ee1d7354c4

  $ killdaemons.py

Streaming of secrets can be overridden by server config

  $ cd server

  $ hg serve --config server.uncompressedallowsecret=true -p $HGPORT -d --pid-file=hg.pid

  $ cat hg.pid > $DAEMON_PIDS

  $ cd ..

#if stream-legacy

  $ hg clone --stream -U http://localhost:$HGPORT secret-allowed

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (*/sec) (glob)

  searching for changes

  no changes found

#endif

#if stream-bundle2

  $ hg clone --stream -U http://localhost:$HGPORT secret-allowed

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (* */sec) (glob)

#endif

  $ killdaemons.py

Verify interaction between preferuncompressed and secret presence

  $ cd server

  $ hg serve --config server.preferuncompressed=true -p $HGPORT -d --pid-file=hg.pid

  $ cat hg.pid > $DAEMON_PIDS

  $ cd ..

  $ hg clone -U http://localhost:$HGPORT preferuncompressed-secret

  requesting all changes

  adding changesets

  adding manifests

  adding file changes

  added 1 changesets with 1 changes to 1 files

  new changesets 96ee1d7354c4

  $ killdaemons.py

Clone not allowed when full bundles disabled and can't serve secrets

  $ cd server

  $ hg serve --config server.disablefullbundle=true -p $HGPORT -d --pid-file=hg.pid

  $ cat hg.pid > $DAEMON_PIDS

  $ cd ..

  $ hg clone --stream http://localhost:$HGPORT secret-full-disabled

  warning: stream clone requested but server has them disabled

  requesting all changes

  remote: abort: server has pull-based clones disabled

  abort: pull failed on remote

  (remove --pull if specified or upgrade Mercurial)

  [255]

Local stream clone with secrets involved

(This is just a test over behavior: if you have access to the repo's files,

there is no security so it isn't important to prevent a clone here.)

  $ hg clone -U --stream server local-secret

  warning: stream clone requested but server has them disabled

  requesting all changes

  adding changesets

  adding manifests

  adding file changes

  added 1 changesets with 1 changes to 1 files

  new changesets 96ee1d7354c4

Stream clone while repo is changing:

  $ mkdir changing

  $ cd changing

extension for delaying the server process so we reliably can modify the repo

while cloning

  $ cat > delayer.py <<EOF

  > import time

  > from mercurial import extensions, vfs

  > def __call__(orig, self, path, *args, **kwargs):

  >     if path == 'data/f1.i':

  >         time.sleep(2)

  >     return orig(self, path, *args, **kwargs)

  > extensions.wrapfunction(vfs.vfs, '__call__', __call__)

  > EOF

prepare repo with small and big file to cover both code paths in emitrevlogdata

  $ hg init repo

  $ touch repo/f1

  $ $TESTDIR/seq.py 50000 > repo/f2

  $ hg -R repo ci -Aqm "0"

  $ hg serve -R repo -p $HGPORT1 -d --pid-file=hg.pid --config extensions.delayer=delayer.py

  $ cat hg.pid >> $DAEMON_PIDS

clone while modifying the repo between stating file with write lock and

actually serving file content

  $ hg clone -q --stream -U http://localhost:$HGPORT1 clone &

  $ sleep 1

  $ echo >> repo/f1

  $ echo >> repo/f2

  $ hg -R repo ci -m "1"

  $ wait

  $ hg -R clone id

  000000000000

  $ cd ..

Stream repository with bookmarks

--------------------------------

(revert introduction of secret changeset)

  $ hg -R server phase --draft 'secret()'

add a bookmark

  $ hg -R server bookmark -r tip some-bookmark

clone it

#if stream-legacy

  $ hg clone --stream http://localhost:$HGPORT with-bookmarks

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (*) (glob)

  searching for changes

  no changes found

  updating to branch default

  1025 files updated, 0 files merged, 0 files removed, 0 files unresolved

#endif

#if stream-bundle2

  $ hg clone --stream http://localhost:$HGPORT with-bookmarks

  streaming all changes

  1027 files to transfer, 96.3 KB of data

  transferred 96.3 KB in * seconds (* */sec) (glob)

  updating to branch default

  1025 files updated, 0 files merged, 0 files removed, 0 files unresolved

#endif

  $ hg -R with-bookmarks bookmarks

     some-bookmark             1:c17445101a72