This file tests the behavior of run-tests.py itself.

Avoid interference from actual test env:

  $ unset HGTEST_JOBS

  $ unset HGTEST_TIMEOUT

  $ unset HGTEST_PORT

  $ unset HGTEST_SHELL

Smoke test with install

============

  $ run-tests.py $HGTEST_RUN_TESTS_PURE -l

  # Ran 0 tests, 0 skipped, 0 warned, 0 failed.

Define a helper to avoid the install step

=============

  $ rt()

  > {

  >     run-tests.py --with-hg=`which hg` "$@"

  > }

error paths

#if symlink

  $ ln -s `which true` hg

  $ run-tests.py --with-hg=./hg

  warning: --with-hg should specify an hg script

  # Ran 0 tests, 0 skipped, 0 warned, 0 failed.

  $ rm hg

#endif

#if execbit

  $ touch hg

  $ run-tests.py --with-hg=./hg

  Usage: run-tests.py [options] [tests]

  run-tests.py: error: --with-hg must specify an executable hg script

  [2]

  $ rm hg

#endif

a succesful test

=======================

  $ cat > test-success.t << EOF

  >   $ echo babar

  >   babar

  >   $ echo xyzzy

  >   never happens (?)

  >   xyzzy

  >   nor this (?)

  > EOF

  $ rt

  .

  # Ran 1 tests, 0 skipped, 0 warned, 0 failed.

failing test

==================

  $ cat > test-failure.t << EOF

  >   $ echo babar

  >   rataxes

  > This is a noop statement so that

  > this test is still more bytes than success.

  > EOF

  >>> fh = open('test-failure-unicode.t', 'wb')

  >>> fh.write(u'  $ echo babar\u03b1\n'.encode('utf-8')) and None

  >>> fh.write(u'  l\u03b5\u03b5t\n'.encode('utf-8')) and None

  $ rt

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  ERROR: test-failure.t output changed

  !.

  --- $TESTTMP/test-failure-unicode.t

  +++ $TESTTMP/test-failure-unicode.t.err

  @@ -1,2 +1,2 @@

     $ echo babar\xce\xb1 (esc)

  -  l\xce\xb5\xce\xb5t (esc)

  +  babar\xce\xb1 (esc)

  ERROR: test-failure-unicode.t output changed

  !

  Failed test-failure.t: output changed

  Failed test-failure-unicode.t: output changed

  # Ran 3 tests, 0 skipped, 0 warned, 2 failed.

  python hash seed: * (glob)

  [1]

test --xunit support

  $ rt --xunit=xunit.xml

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  ERROR: test-failure.t output changed

  !.

  --- $TESTTMP/test-failure-unicode.t

  +++ $TESTTMP/test-failure-unicode.t.err

  @@ -1,2 +1,2 @@

     $ echo babar\xce\xb1 (esc)

  -  l\xce\xb5\xce\xb5t (esc)

  +  babar\xce\xb1 (esc)

  ERROR: test-failure-unicode.t output changed

  !

  Failed test-failure.t: output changed

  Failed test-failure-unicode.t: output changed

  # Ran 3 tests, 0 skipped, 0 warned, 2 failed.

  python hash seed: * (glob)

  [1]

  $ cat xunit.xml

  <?xml version="1.0" encoding="utf-8"?>

  <testsuite errors="0" failures="2" name="run-tests" skipped="0" tests="3">

    <testcase name="test-success.t" time="*"/> (glob)

    <testcase name="test-failure-unicode.t" time="*"> (glob)

  <![CDATA[--- $TESTTMP/test-failure-unicode.t

  +++ $TESTTMP/test-failure-unicode.t.err

  @@ -1,2 +1,2 @@

     $ echo babar\xce\xb1 (esc)

  -  l\xce\xb5\xce\xb5t (esc)

  +  babar\xce\xb1 (esc)

  ]]>  </testcase>

    <testcase name="test-failure.t" time="*"> (glob)

  <![CDATA[--- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  ]]>  </testcase>

  </testsuite>

  $ rm test-failure-unicode.t

test for --retest

====================

  $ rt --retest

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  ERROR: test-failure.t output changed

  !

  Failed test-failure.t: output changed

  # Ran 2 tests, 1 skipped, 0 warned, 1 failed.

  python hash seed: * (glob)

  [1]

Selecting Tests To Run

======================

successful

  $ rt test-success.t

  .

  # Ran 1 tests, 0 skipped, 0 warned, 0 failed.

success w/ keyword

  $ rt -k xyzzy

  .

  # Ran 2 tests, 1 skipped, 0 warned, 0 failed.

failed

  $ rt test-failure.t

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  ERROR: test-failure.t output changed

  !

  Failed test-failure.t: output changed

  # Ran 1 tests, 0 skipped, 0 warned, 1 failed.

  python hash seed: * (glob)

  [1]

failure w/ keyword

  $ rt -k rataxes

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  ERROR: test-failure.t output changed

  !

  Failed test-failure.t: output changed

  # Ran 2 tests, 1 skipped, 0 warned, 1 failed.

  python hash seed: * (glob)

  [1]

Verify that when a process fails to start we show a useful message

==================================================================

  $ cat > test-serve-fail.t <<EOF

  >   $ echo 'abort: child process failed to start blah'

  > EOF

  $ rt test-serve-fail.t

  ERROR: test-serve-fail.t output changed

  !

  Failed test-serve-fail.t: server failed to start (HGPORT=*) (glob)

  # Ran 1 tests, 0 skipped, 0 warned, 1 failed.

  python hash seed: * (glob)

  [1]

  $ rm test-serve-fail.t

Verify that we can try other ports

===================================

  $ hg init inuse

  $ hg serve -R inuse -p $HGPORT -d --pid-file=blocks.pid

  $ cat blocks.pid >> $DAEMON_PIDS

  $ cat > test-serve-inuse.t <<EOF

  >   $ hg serve -R `pwd`/inuse -p \$HGPORT -d --pid-file=hg.pid

  >   $ cat hg.pid >> \$DAEMON_PIDS

  > EOF

  $ rt test-serve-inuse.t

  .

  # Ran 1 tests, 0 skipped, 0 warned, 0 failed.

  $ rm test-serve-inuse.t

Running In Debug Mode

======================

  $ rt --debug 2>&1 | grep -v pwd

  + echo *SALT* 0 0 (glob)

  *SALT* 0 0 (glob)

  + echo babar

  babar

  *+ echo *SALT* 0 0 (glob)

  *SALT* 0 0 (glob)

  + echo babar

  babar

  + echo *SALT* 2 0 (glob)

  *SALT* 2 0 (glob)

  + echo xyzzy

  xyzzy

  + echo *SALT* 6 0 (glob)

  *SALT* 6 0 (glob)

  .

  # Ran 2 tests, 0 skipped, 0 warned, 0 failed.

Parallel runs

==============

(duplicate the failing test to get predictable output)

  $ cp test-failure.t test-failure-copy.t

  $ rt --jobs 2 test-failure*.t -n

  !!

  Failed test-failure*.t: output changed (glob)

  Failed test-failure*.t: output changed (glob)

  # Ran 2 tests, 0 skipped, 0 warned, 2 failed.

  python hash seed: * (glob)

  [1]

failures in parallel with --first should only print one failure

  >>> f = open('test-nothing.t', 'w')

  >>> f.write('foo\n' * 1024) and None

  >>> f.write('  $ sleep 1') and None

  $ rt --jobs 2 --first

  --- $TESTTMP/test-failure*.t (glob)

  +++ $TESTTMP/test-failure*.t.err (glob)

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  Failed test-failure*.t: output changed (glob)

  Failed test-nothing.t: output changed

  # Ran 2 tests, 0 skipped, 0 warned, 2 failed.

  python hash seed: * (glob)

  [1]

(delete the duplicated test file)

  $ rm test-failure-copy.t test-nothing.t

Interactive run

===============

(backup the failing test)

  $ cp test-failure.t backup

Refuse the fix

  $ echo 'n' | rt -i

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

  Accept this change? [n] 

  ERROR: test-failure.t output changed

  !.

  Failed test-failure.t: output changed

  # Ran 2 tests, 0 skipped, 0 warned, 1 failed.

  python hash seed: * (glob)

  [1]

  $ cat test-failure.t

    $ echo babar

    rataxes

  This is a noop statement so that

  this test is still more bytes than success.