This file tests the behavior of run-tests.py itself.

Avoid interference from actual test env:

  $ . "$TESTDIR/helper-runtests.sh"

Smoke test with install

============

  $ run-tests.py $HGTEST_RUN_TESTS_PURE -l

  # Ran 0 tests, 0 skipped, 0 failed.

Define a helper to avoid the install step

=============

  $ rt()

  > {

  >     run-tests.py --with-hg=`which hg` "$@"

  > }

error paths

#if symlink

  $ ln -s `which true` hg

  $ run-tests.py --with-hg=./hg

  warning: --with-hg should specify an hg script

  # Ran 0 tests, 0 skipped, 0 failed.

  $ rm hg

#endif

#if execbit

  $ touch hg

  $ run-tests.py --with-hg=./hg

  Usage: run-tests.py [options] [tests]

  run-tests.py: error: --with-hg must specify an executable hg script

  [2]

  $ rm hg

#endif

Features for testing optional lines

===================================

  $ cat > hghaveaddon.py <<EOF

  > import hghave

  > @hghave.check("custom", "custom hghave feature")

  > def has_custom():

  >     return True

  > @hghave.check("missing", "missing hghave feature")

  > def has_missing():

  >     return False

  > EOF

an empty test

=======================

  $ touch test-empty.t

  $ rt

  .

  # Ran 1 tests, 0 skipped, 0 failed.

  $ rm test-empty.t

a succesful test

=======================

  $ cat > test-success.t << EOF

  >   $ echo babar

  >   babar

  >   $ echo xyzzy

  >   dont_print (?)

  >   nothing[42]line (re) (?)

  >   never*happens (glob) (?)

  >   more_nothing (?)

  >   xyzzy

  >   nor this (?)

  >   $ printf 'abc\ndef\nxyz\n'

  >   123 (?)

  >   abc

  >   def (?)

  >   456 (?)

  >   xyz

  >   $ printf 'zyx\nwvu\ntsr\n'

  >   abc (?)

  >   zyx (custom !)

  >   wvu

  >   no_print (no-custom !)

  >   tsr (no-missing !)

  >   missing (missing !)

  > EOF

  $ rt

  .

  # Ran 1 tests, 0 skipped, 0 failed.

failing test

==================

test churn with globs

  $ cat > test-failure.t <<EOF

  >   $ echo "bar-baz"; echo "bar-bad"

  >   bar*bad (glob)

  >   bar*baz (glob)

  > EOF

  $ rt test-failure.t

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

  @@ -1,3 +1,3 @@

     $ echo "bar-baz"; echo "bar-bad"

  +  bar*baz (glob)

     bar*bad (glob)

  -  bar*baz (glob)

  ERROR: test-failure.t output changed

  !

  Failed test-failure.t: output changed

  # Ran 1 tests, 0 skipped, 1 failed.

  python hash seed: * (glob)

  [1]

basic failing test

  $ cat > test-failure.t << EOF

  >   $ echo babar

  >   rataxes

  > This is a noop statement so that

  > this test is still more bytes than success.

  > pad pad pad pad............................................................

  > pad pad pad pad............................................................

  > pad pad pad pad............................................................

  > pad pad pad pad............................................................

  > pad pad pad pad............................................................

  > pad pad pad pad............................................................

  > EOF

  >>> fh = open('test-failure-unicode.t', 'wb')

  >>> fh.write(u'  $ echo babar\u03b1\n'.encode('utf-8')) and None

  >>> fh.write(u'  l\u03b5\u03b5t\n'.encode('utf-8')) and None

  $ rt

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

  @@ -1,5 +1,5 @@

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

   pad pad pad pad............................................................

  ERROR: test-failure.t output changed

  !.

  --- $TESTTMP/test-failure-unicode.t

  +++ $TESTTMP/test-failure-unicode.t.err

  @@ -1,2 +1,2 @@

     $ echo babar\xce\xb1 (esc)

  -  l\xce\xb5\xce\xb5t (esc)

  +  babar\xce\xb1 (esc)

  ERROR: test-failure-unicode.t output changed

  !

  Failed test-failure.t: output changed

  Failed test-failure-unicode.t: output changed

  # Ran 3 tests, 0 skipped, 2 failed.

  python hash seed: * (glob)

  [1]

test --outputdir

  $ mkdir output

  $ rt --outputdir output

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/output/test-failure.t.err

  @@ -1,5 +1,5 @@

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

   pad pad pad pad............................................................

  ERROR: test-failure.t output changed

  !.

  --- $TESTTMP/test-failure-unicode.t

  +++ $TESTTMP/output/test-failure-unicode.t.err

  @@ -1,2 +1,2 @@

     $ echo babar\xce\xb1 (esc)

  -  l\xce\xb5\xce\xb5t (esc)

  +  babar\xce\xb1 (esc)

  ERROR: test-failure-unicode.t output changed

  !

  Failed test-failure.t: output changed

  Failed test-failure-unicode.t: output changed

  # Ran 3 tests, 0 skipped, 2 failed.

  python hash seed: * (glob)

  [1]

  $ ls -a output

  .

  ..

  .testtimes

  test-failure-unicode.t.err

  test-failure.t.err

test --xunit support

  $ rt --xunit=xunit.xml

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

  @@ -1,5 +1,5 @@

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

   pad pad pad pad............................................................

  ERROR: test-failure.t output changed

  !.

  --- $TESTTMP/test-failure-unicode.t

  +++ $TESTTMP/test-failure-unicode.t.err

  @@ -1,2 +1,2 @@

     $ echo babar\xce\xb1 (esc)

  -  l\xce\xb5\xce\xb5t (esc)

  +  babar\xce\xb1 (esc)

  ERROR: test-failure-unicode.t output changed

  !

  Failed test-failure.t: output changed

  Failed test-failure-unicode.t: output changed

  # Ran 3 tests, 0 skipped, 2 failed.

  python hash seed: * (glob)

  [1]

  $ cat xunit.xml

  <?xml version="1.0" encoding="utf-8"?>

  <testsuite errors="0" failures="2" name="run-tests" skipped="0" tests="3">

    <testcase name="test-success.t" time="*"/> (glob)

    <testcase name="test-failure-unicode.t" time="*"> (glob)

      <failure message="output changed" type="output-mismatch">

  <![CDATA[--- $TESTTMP/test-failure-unicode.t

  +++ $TESTTMP/test-failure-unicode.t.err

  @@ -1,2 +1,2 @@

     $ echo babar\xce\xb1 (esc)

  -  l\xce\xb5\xce\xb5t (esc)

  +  babar\xce\xb1 (esc)

  ]]>    </failure>

    </testcase>

    <testcase name="test-failure.t" time="*"> (glob)

      <failure message="output changed" type="output-mismatch">

  <![CDATA[--- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

  @@ -1,5 +1,5 @@

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

   pad pad pad pad............................................................

  ]]>    </failure>

    </testcase>

  </testsuite>

  $ cat .testtimes

  test-failure-unicode.t * (glob)

  test-failure.t * (glob)

  test-success.t * (glob)

  $ rt --list-tests

  test-failure-unicode.t

  test-failure.t

  test-success.t

  $ rt --list-tests --json

  test-failure-unicode.t

  test-failure.t

  test-success.t

  $ cat report.json

  testreport ={

      "test-failure-unicode.t": {

          "result": "success"

      },

      "test-failure.t": {

          "result": "success"

      },

      "test-success.t": {

          "result": "success"

      }

  } (no-eol)

  $ rt --list-tests --xunit=xunit.xml

  test-failure-unicode.t

  test-failure.t

  test-success.t

  $ cat xunit.xml

  <?xml version="1.0" encoding="utf-8"?>

  <testsuite errors="0" failures="0" name="run-tests" skipped="0" tests="0">

    <testcase name="test-failure-unicode.t"/>

    <testcase name="test-failure.t"/>

    <testcase name="test-success.t"/>

  </testsuite>

  $ rt --list-tests test-failure* --json --xunit=xunit.xml --outputdir output

  test-failure-unicode.t

  test-failure.t

  $ cat output/report.json

  testreport ={

      "test-failure-unicode.t": {

          "result": "success"

      },

      "test-failure.t": {

          "result": "success"

      }

  } (no-eol)

  $ cat xunit.xml

  <?xml version="1.0" encoding="utf-8"?>

  <testsuite errors="0" failures="0" name="run-tests" skipped="0" tests="0">

    <testcase name="test-failure-unicode.t"/>

    <testcase name="test-failure.t"/>

  </testsuite>

  $ rm test-failure-unicode.t

test for --retest

====================

  $ rt --retest

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/test-failure.t.err

  @@ -1,5 +1,5 @@

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

   pad pad pad pad............................................................

  ERROR: test-failure.t output changed

  !

  Failed test-failure.t: output changed

  # Ran 2 tests, 1 skipped, 1 failed.

  python hash seed: * (glob)

  [1]

--retest works with --outputdir

  $ rm -r output

  $ mkdir output

  $ mv test-failure.t.err output

  $ rt --retest --outputdir output

  --- $TESTTMP/test-failure.t

  +++ $TESTTMP/output/test-failure.t.err

  @@ -1,5 +1,5 @@

     $ echo babar

  -  rataxes

  +  babar

   This is a noop statement so that

   this test is still more bytes than success.

   pad pad pad pad............................................................

  ERROR: test-failure.t output changed

  !

  Failed test-failure.t: output changed

  # Ran 2 tests, 1 skipped, 1 failed.

  python hash seed: * (glob)