mercurial: tests/test-run-tests.t@bc04a7615c96 (annotated)

21732 b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	1	This file tests the behavior of run-tests.py itself.
b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	2
24960 65e8dac7b016 test-run-test: unset run-test specific environment variables Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	3	Avoid interference from actual test env:
65e8dac7b016 test-run-test: unset run-test specific environment variables Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	4
29220 054bcdad6042 tests: refactor run-tests helpers timeless <timeless@mozdev.org> parents: 29199 diff changeset	5	$ . "$TESTDIR/helper-runtests.sh"
24960 65e8dac7b016 test-run-test: unset run-test specific environment variables Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	6
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	7	Smoke test with install
21732 b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	8	============
39707 5abc47d4ca6b tests: quote PYTHON usage Matt Harbison <matt_harbison@yahoo.com> parents: 38824 diff changeset	9	$ "$PYTHON" $TESTDIR/run-tests.py $HGTEST_RUN_TESTS_PURE -l
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	10	running 0 tests using 0 parallel processes
21732 b6192ea7f7fd test: introduce test-run-tests.t Pierre-Yves David <pierre-yves.david@fb.com> parents: diff changeset	11
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	12	# Ran 0 tests, 0 skipped, 0 failed.
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	13
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	14	Define a helper to avoid the install step
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	15	=============
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	16	$ rt()
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	17	> {
47584 ee1fc8f970e6 run-tests: introduce a `HGTEST_REAL_HG` variable for test Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47583 diff changeset	18	> "$PYTHON" $TESTDIR/run-tests.py --with-hg=$HGTEST_REAL_HG -j1 "$@"
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	19	> }
0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	20
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	21	error paths
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	22
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	23	#if symlink
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	24	$ ln -s `which true` hg
39707 5abc47d4ca6b tests: quote PYTHON usage Matt Harbison <matt_harbison@yahoo.com> parents: 38824 diff changeset	25	$ "$PYTHON" $TESTDIR/run-tests.py --with-hg=./hg
48313 bc04a7615c96 tests: allow the true command to be provided by coreutils pacien <pacien.trangirard@pacien.net> parents: 47588 diff changeset	26	^warning: --with-hg should specify an hg script, not: (true\|coreutils)$ (re)
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	27	running 0 tests using 0 parallel processes
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	28
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	29	# Ran 0 tests, 0 skipped, 0 failed.
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	30	$ rm hg
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	31	#endif
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	32
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	33	#if execbit
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	34	$ touch hg
39707 5abc47d4ca6b tests: quote PYTHON usage Matt Harbison <matt_harbison@yahoo.com> parents: 38824 diff changeset	35	$ "$PYTHON" $TESTDIR/run-tests.py --with-hg=./hg
35187 b4b0aed7bfaf run-tests: convert to argparse Gregory Szorc <gregory.szorc@gmail.com> parents: 35155 diff changeset	36	usage: run-tests.py [options] [tests]
28037 54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	37	run-tests.py: error: --with-hg must specify an executable hg script
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	38	[2]
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	39	$ rm hg
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	40	#endif
54c896f8bb79 run-tests: warn about symlinks to non hg scripts timeless <timeless@mozdev.org> parents: 27927 diff changeset	41
31829 4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	42	Features for testing optional lines
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	43	===================================
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	44
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	45	$ cat > hghaveaddon.py <<EOF
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	46	> import hghave
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	47	> @hghave.check("custom", "custom hghave feature")
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	48	> def has_custom():
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	49	> return True
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	50	> @hghave.check("missing", "missing hghave feature")
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	51	> def has_missing():
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	52	> return False
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	53	> EOF
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	54
28812 f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	55	an empty test
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	56	=======================
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	57
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	58	$ touch test-empty.t
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	59	$ rt
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	60	running 1 tests using 1 parallel processes
28812 f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	61	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	62	# Ran 1 tests, 0 skipped, 0 failed.
28812 f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	63	$ rm test-empty.t
f1de5a612a74 run-tests: handle empty tests timeless <timeless@mozdev.org> parents: 28701 diff changeset	64
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	65	a succesful test
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	66	=======================
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	67
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	68	$ cat > test-success.t << EOF
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	69	> $ echo babar
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	70	> babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	71	> $ echo xyzzy
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31673 diff changeset	72	> dont_print (?)
220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31673 diff changeset	73	> nothing[42]line (re) (?)
28701 3bce3d2fd727 run-tests: make _processoutput picky about optional globs timeless <timeless@mozdev.org> parents: 28619 diff changeset	74	> never*happens (glob) (?)
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31673 diff changeset	75	> more_nothing (?)
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	76	> xyzzy
25388 6025cac3d02f tests: add (?) flag for optional lines Matt Mackall <mpm@selenic.com> parents: 25098 diff changeset	77	> nor this (?)
28317 8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	78	> $ printf 'abc\ndef\nxyz\n'
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	79	> 123 (?)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	80	> abc
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	81	> def (?)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	82	> 456 (?)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	83	> xyz
31829 4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	84	> $ printf 'zyx\nwvu\ntsr\n'
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	85	> abc (?)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	86	> zyx (custom !)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	87	> wvu
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	88	> no_print (no-custom !)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	89	> tsr (no-missing !)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	90	> missing (missing !)
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	91	> EOF
34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	92
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	93	$ rt
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	94	running 1 tests using 1 parallel processes
21734 34e0bd895afc test-run-tests.t: test running a passing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21732 diff changeset	95	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	96	# Ran 1 tests, 0 skipped, 0 failed.
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	97
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	98	failing test
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	99	==================
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	100
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	101	test churn with globs
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	102	$ cat > test-failure.t <<EOF
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	103	> $ echo "bar-baz"; echo "bar-bad"; echo foo
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	104	> bar*bad (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	105	> bar*baz (glob)
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	106	> \| fo (re)
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	107	> EOF
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	108	$ rt test-failure.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	109	running 1 tests using 1 parallel processes
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	110
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	111	--- $TESTTMP/test-failure.t
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	112	+++ $TESTTMP/test-failure.t.err
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	113	@@ -1,4 +1,4 @@
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	114	$ echo "bar-baz"; echo "bar-bad"; echo foo
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	115	+ bar*baz (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	116	bar*bad (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	117	- bar*baz (glob)
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	118	- \| fo (re)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	119	+ foo
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	120
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	121	ERROR: test-failure.t output changed
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	122	!
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	123	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	124	# Ran 1 tests, 0 skipped, 1 failed.
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	125	python hash seed: * (glob)
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	126	[1]
695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	127
38553 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	128	test how multiple globs gets matched with lines in output
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	129	$ cat > test-failure-globs.t <<EOF
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	130	> $ echo "context"; echo "context"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	131	> echo "key: 1"; echo "value: not a"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	132	> echo "key: 2"; echo "value: not b"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	133	> echo "key: 3"; echo "value: c"; \
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	134	> echo "key: 4"; echo "value: d"
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	135	> context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	136	> context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	137	> key: 1
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	138	> value: a
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	139	> key: 2
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	140	> value: b
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	141	> key: 3
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	142	> value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	143	> key: 4
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	144	> value: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	145	> EOF
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	146	$ rt test-failure-globs.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	147	running 1 tests using 1 parallel processes
38553 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	148
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	149	--- $TESTTMP/test-failure-globs.t
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	150	+++ $TESTTMP/test-failure-globs.t.err
38554 f83600efa1ca tests: don't allow reodering of glob/re lines across non-glob/re lines Martin von Zweigbergk <martinvonz@google.com> parents: 38553 diff changeset	151	@@ -2,9 +2,9 @@
38553 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	152	context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	153	context
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	154	key: 1
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	155	- value: a
38554 f83600efa1ca tests: don't allow reodering of glob/re lines across non-glob/re lines Martin von Zweigbergk <martinvonz@google.com> parents: 38553 diff changeset	156	+ value: not a
38553 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	157	key: 2
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	158	- value: b
38554 f83600efa1ca tests: don't allow reodering of glob/re lines across non-glob/re lines Martin von Zweigbergk <martinvonz@google.com> parents: 38553 diff changeset	159	+ value: not b
38553 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	160	key: 3
38554 f83600efa1ca tests: don't allow reodering of glob/re lines across non-glob/re lines Martin von Zweigbergk <martinvonz@google.com> parents: 38553 diff changeset	161	value: * (glob)
38553 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	162	key: 4
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	163
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	164	ERROR: test-failure-globs.t output changed
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	165	!
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	166	Failed test-failure-globs.t: output changed
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	167	# Ran 1 tests, 0 skipped, 1 failed.
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	168	python hash seed: * (glob)
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	169	[1]
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	170	$ rm test-failure-globs.t
3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	171
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	172	test diff colorisation
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	173
33552 754569f5e999 run-tests: make sure to check if pygments is installed before using it Pulkit Goyal <7895pulkit@gmail.com> parents: 33500 diff changeset	174	#if no-windows pygments
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	175	$ rt test-failure.t --color always
40333 d5ff54152636 tests: fix "running x tests using y ... " output in a few more places Martin von Zweigbergk <martinvonz@google.com> parents: 40245 diff changeset	176	running 1 tests using 1 parallel processes
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	177
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	178	\x1b[38;5;124m--- $TESTTMP/test-failure.t\x1b[39m (esc)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	179	\x1b[38;5;34m+++ $TESTTMP/test-failure.t.err\x1b[39m (esc)
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	180	\x1b[38;5;90;01m@@ -1,4 +1,4 @@\x1b[39;00m (esc)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	181	$ echo "bar-baz"; echo "bar-bad"; echo foo
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	182	\x1b[38;5;34m+ bar*baz (glob)\x1b[39m (esc)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	183	bar*bad (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	184	\x1b[38;5;124m- bar*baz (glob)\x1b[39m (esc)
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	185	\x1b[38;5;124m- \| fo (re)\x1b[39m (esc)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	186	\x1b[38;5;34m+ foo\x1b[39m (esc)
34842 8bce3e51b101 run-tests: move newline out of colorized message Martin von Zweigbergk <martinvonz@google.com> parents: 34263 diff changeset	187
33814 81b12f69ef5b run-tests: also color the summary messages (skipped, failed...) Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33696 diff changeset	188	\x1b[38;5;88mERROR: \x1b[39m\x1b[38;5;9mtest-failure.t\x1b[39m\x1b[38;5;88m output changed\x1b[39m (esc)
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	189	!
33814 81b12f69ef5b run-tests: also color the summary messages (skipped, failed...) Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 33696 diff changeset	190	\x1b[38;5;88mFailed \x1b[39m\x1b[38;5;9mtest-failure.t\x1b[39m\x1b[38;5;88m: output changed\x1b[39m (esc)
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	191	# Ran 1 tests, 0 skipped, 1 failed.
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	192	python hash seed: * (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	193	[1]
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	194
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	195	$ rt test-failure.t 2> tmp.log
40333 d5ff54152636 tests: fix "running x tests using y ... " output in a few more places Martin von Zweigbergk <martinvonz@google.com> parents: 40245 diff changeset	196	running 1 tests using 1 parallel processes
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	197	[1]
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	198	$ cat tmp.log
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	199
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	200	--- $TESTTMP/test-failure.t
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	201	+++ $TESTTMP/test-failure.t.err
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	202	@@ -1,4 +1,4 @@
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	203	$ echo "bar-baz"; echo "bar-bad"; echo foo
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	204	+ bar*baz (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	205	bar*bad (glob)
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	206	- bar*baz (glob)
35155 6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	207	- \| fo (re)
6d5718e39657 run-tests: make "\| foo (re)" not match everything Martin von Zweigbergk <martinvonz@google.com> parents: 35097 diff changeset	208	+ foo
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	209
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	210	ERROR: test-failure.t output changed
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	211	!
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	212	Failed test-failure.t: output changed
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	213	# Ran 1 tests, 0 skipped, 1 failed.
e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	214	python hash seed: * (glob)
33500 9c6e64911de0 run-tests: disable color on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 33420 diff changeset	215	#endif
33420 e80041832eec run-tests: add color to output if pygments is available Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 32982 diff changeset	216
33695 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	217	$ cat > test-failure.t << EOF
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	218	> $ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	219	> should go away (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	220	> $ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	221	> should stay (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	222	>
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	223	> Should remove first line, not second or third
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	224	> $ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	225	> baz*foo (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	226	> foobar*foo (glob) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	227	> te*ting (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	228	>
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	229	> Should keep first two lines, remove third and last
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	230	> $ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	231	> test.ng (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	232	> foo.ar (re) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	233	> b.r (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	234	> missing (?)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	235	> awol (true !)
33696 1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	236	>
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	237	> The "missing" line should stay, even though awol is dropped
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	238	> $ echo 'testing'
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	239	> test.ng (re) (true !)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	240	> foo.ar (?)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	241	> awol
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	242	> missing (?)
33695 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	243	> EOF
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	244	$ rt test-failure.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	245	running 1 tests using 1 parallel processes
33695 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	246
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	247	--- $TESTTMP/test-failure.t
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	248	+++ $TESTTMP/test-failure.t.err
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	249	@@ -1,11 +1,9 @@
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	250	$ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	251	- should go away (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	252	$ true
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	253	should stay (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	254
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	255	Should remove first line, not second or third
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	256	$ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	257	- baz*foo (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	258	foobar*foo (glob) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	259	te*ting (glob) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	260
33696 1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	261	foo.ar (re) (false !)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	262	missing (?)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	263	@@ -13,13 +11,10 @@
33695 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	264	$ echo 'testing'
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	265	test.ng (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	266	foo.ar (re) (false !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	267	- b.r (re) (true !)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	268	missing (?)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	269	- awol (true !)
33696 1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	270
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	271	The "missing" line should stay, even though awol is dropped
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	272	$ echo 'testing'
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	273	test.ng (re) (true !)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	274	foo.ar (?)
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	275	- awol
1fa6023240f4 run-tests: don't drop optional lines after a missing unconditional line Matt Harbison <matt_harbison@yahoo.com> parents: 33695 diff changeset	276	missing (?)
33695 eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	277
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	278	ERROR: test-failure.t output changed
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	279	!
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	280	Failed test-failure.t: output changed
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	281	# Ran 1 tests, 0 skipped, 1 failed.
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	282	python hash seed: * (glob)
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	283	[1]
eeed23508383 run-tests: drop required (feature !) style lines when the output is missing Matt Harbison <matt_harbison@yahoo.com> parents: 33552 diff changeset	284
28619 695c666f42ff tests: ensure run-tests handles multiple lines of churn timeless <timeless@mozdev.org> parents: 28616 diff changeset	285	basic failing test
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	286	$ cat > test-failure.t << EOF
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	287	> $ echo babar
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	288	> rataxes
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	289	> This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	290	> this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	291	> pad pad pad pad............................................................
c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	292	> pad pad pad pad............................................................
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	293	> pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	294	> pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	295	> pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	296	> pad pad pad pad............................................................
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	297	> EOF
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	298
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	299	>>> fh = open('test-failure-unicode.t', 'wb')
25054 af5a778f8e2e test-run-tests.t: work around file.write() returning an int Augie Fackler <augie@google.com> parents: 24990 diff changeset	300	>>> fh.write(u' $ echo babar\u03b1\n'.encode('utf-8')) and None
af5a778f8e2e test-run-tests.t: work around file.write() returning an int Augie Fackler <augie@google.com> parents: 24990 diff changeset	301	>>> fh.write(u' l\u03b5\u03b5t\n'.encode('utf-8')) and None
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	302
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	303	$ rt
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	304	running 3 tests using 1 parallel processes
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	305
23348 bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	306	--- $TESTTMP/test-failure.t
bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	307	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	308	@@ -1,5 +1,5 @@
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	309	$ echo babar
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	310	- rataxes
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	311	+ babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	312	This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	313	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	314	pad pad pad pad............................................................
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	315
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	316	ERROR: test-failure.t output changed
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	317	!.
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	318	--- $TESTTMP/test-failure-unicode.t
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	319	+++ $TESTTMP/test-failure-unicode.t.err
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	320	@@ -1,2 +1,2 @@
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	321	$ echo babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	322	- l\xce\xb5\xce\xb5t (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	323	+ babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	324
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	325	ERROR: test-failure-unicode.t output changed
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	326	!
41486 f9150901267c run-tests: sort the skip, failure and error lists in the final output Matt Harbison <matt_harbison@yahoo.com> parents: 41178 diff changeset	327	Failed test-failure-unicode.t: output changed
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	328	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	329	# Ran 3 tests, 0 skipped, 2 failed.
21738 7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	330	python hash seed: * (glob)
7ec3b32b98bb test-run-tests.t: test running a failing test Pierre-Yves David <pierre-yves.david@fb.com> parents: 21734 diff changeset	331	[1]
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	332
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	333	test --outputdir
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	334	$ mkdir output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	335	$ rt --outputdir output
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	336	running 3 tests using 1 parallel processes
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	337
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	338	--- $TESTTMP/test-failure.t
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	339	+++ $TESTTMP/output/test-failure.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	340	@@ -1,5 +1,5 @@
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	341	$ echo babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	342	- rataxes
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	343	+ babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	344	This is a noop statement so that
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	345	this test is still more bytes than success.
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	346	pad pad pad pad............................................................
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	347
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	348	ERROR: test-failure.t output changed
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	349	!.
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	350	--- $TESTTMP/test-failure-unicode.t
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	351	+++ $TESTTMP/output/test-failure-unicode.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	352	@@ -1,2 +1,2 @@
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	353	$ echo babar\xce\xb1 (esc)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	354	- l\xce\xb5\xce\xb5t (esc)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	355	+ babar\xce\xb1 (esc)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	356
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	357	ERROR: test-failure-unicode.t output changed
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	358	!
41486 f9150901267c run-tests: sort the skip, failure and error lists in the final output Matt Harbison <matt_harbison@yahoo.com> parents: 41178 diff changeset	359	Failed test-failure-unicode.t: output changed
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	360	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	361	# Ran 3 tests, 0 skipped, 2 failed.
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	362	python hash seed: * (glob)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	363	[1]
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	364	$ ls -a output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	365	.
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	366	..
32717 e5680cb1414f run-tests: write test times to output dir Siddharth Agarwal <sid0@fb.com> parents: 32716 diff changeset	367	.testtimes
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	368	test-failure-unicode.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	369	test-failure.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	370
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	371	test --xunit support
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	372	$ rt --xunit=xunit.xml
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	373	running 3 tests using 1 parallel processes
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	374
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	375	--- $TESTTMP/test-failure.t
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	376	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	377	@@ -1,5 +1,5 @@
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	378	$ echo babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	379	- rataxes
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	380	+ babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	381	This is a noop statement so that
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	382	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	383	pad pad pad pad............................................................
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	384
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	385	ERROR: test-failure.t output changed
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	386	!.
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	387	--- $TESTTMP/test-failure-unicode.t
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	388	+++ $TESTTMP/test-failure-unicode.t.err
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	389	@@ -1,2 +1,2 @@
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	390	$ echo babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	391	- l\xce\xb5\xce\xb5t (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	392	+ babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	393
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	394	ERROR: test-failure-unicode.t output changed
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	395	!
41486 f9150901267c run-tests: sort the skip, failure and error lists in the final output Matt Harbison <matt_harbison@yahoo.com> parents: 41178 diff changeset	396	Failed test-failure-unicode.t: output changed
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	397	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	398	# Ran 3 tests, 0 skipped, 2 failed.
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	399	python hash seed: * (glob)
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	400	[1]
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	401	$ cat xunit.xml
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	402	<?xml version="1.0" encoding="utf-8"?>
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	403	<testsuite errors="0" failures="2" name="run-tests" skipped="0" tests="3">
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	404	<testcase name="test-success.t" time="*"/> (glob)
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	405	<testcase name="test-failure-unicode.t" time="*"> (glob)
43070 1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	406	<failure message="output changed" type="output-mismatch"><![CDATA[--- $TESTTMP/test-failure-unicode.t (py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	407	<failure message="output changed" type="output-mismatch"> (no-py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	408	<![CDATA[--- $TESTTMP/test-failure-unicode.t (no-py38 !)
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	409	+++ $TESTTMP/test-failure-unicode.t.err
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	410	@@ -1,2 +1,2 @@
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	411	$ echo babar\xce\xb1 (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	412	- l\xce\xb5\xce\xb5t (esc)
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	413	+ babar\xce\xb1 (esc)
43070 1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	414	]]></failure> (py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	415	]]> </failure> (no-py38 !)
32714 ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32704 diff changeset	416	</testcase>
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	417	<testcase name="test-failure.t" time="*"> (glob)
43070 1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	418	<failure message="output changed" type="output-mismatch"><![CDATA[--- $TESTTMP/test-failure.t (py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	419	<failure message="output changed" type="output-mismatch"> (no-py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	420	<![CDATA[--- $TESTTMP/test-failure.t (no-py38 !)
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	421	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	422	@@ -1,5 +1,5 @@
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	423	$ echo babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	424	- rataxes
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	425	+ babar
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	426	This is a noop statement so that
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	427	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	428	pad pad pad pad............................................................
43070 1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	429	]]></failure> (py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	430	]]> </failure> (no-py38 !)
32714 ef8d24539612 run-tests: wrap failures in an XUnit 'failure' element Siddharth Agarwal <sid0@fb.com> parents: 32704 diff changeset	431	</testcase>
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	432	</testsuite>
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	433
29280 6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	434	$ cat .testtimes
35855 69d7fcd91696 testrunner: fix updating of .testtimes file Martin von Zweigbergk <martinvonz@google.com> parents: 35536 diff changeset	435	test-empty.t * (glob)
38553 3fb46734508d tests: add test showing puzzling test output with (glob) lines Martin von Zweigbergk <martinvonz@google.com> parents: 38290 diff changeset	436	test-failure-globs.t * (glob)
29280 6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	437	test-failure-unicode.t * (glob)
6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	438	test-failure.t * (glob)
6c97b9739f9d tests: add run-test .testtimes basic testing timeless <timeless@mozdev.org> parents: 29221 diff changeset	439	test-success.t * (glob)
32704 1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	440
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	441	$ rt --list-tests
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	442	test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	443	test-failure.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	444	test-success.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	445
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	446	$ rt --list-tests --json
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	447	test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	448	test-failure.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	449	test-success.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	450	$ cat report.json
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	451	testreport ={
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	452	"test-failure-unicode.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	453	"result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	454	},
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	455	"test-failure.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	456	"result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	457	},
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	458	"test-success.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	459	"result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	460	}
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	461	} (no-eol)
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	462
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	463	$ rt --list-tests --xunit=xunit.xml
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	464	test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	465	test-failure.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	466	test-success.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	467	$ cat xunit.xml
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	468	<?xml version="1.0" encoding="utf-8"?>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	469	<testsuite errors="0" failures="0" name="run-tests" skipped="0" tests="0">
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	470	<testcase name="test-failure-unicode.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	471	<testcase name="test-failure.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	472	<testcase name="test-success.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	473	</testsuite>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	474
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	475	$ rt --list-tests test-failure* --json --xunit=xunit.xml --outputdir output
32704 1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	476	test-failure-unicode.t
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	477	test-failure.t
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	478	$ cat output/report.json
32704 1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	479	testreport ={
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	480	"test-failure-unicode.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	481	"result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	482	},
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	483	"test-failure.t": {
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	484	"result": "success"
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	485	}
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	486	} (no-eol)
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	487	$ cat xunit.xml
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	488	<?xml version="1.0" encoding="utf-8"?>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	489	<testsuite errors="0" failures="0" name="run-tests" skipped="0" tests="0">
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	490	<testcase name="test-failure-unicode.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	491	<testcase name="test-failure.t"/>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	492	</testsuite>
1270b00a385d run-tests: add a way to list tests, with JSON and XUnit support Siddharth Agarwal <sid0@fb.com> parents: 32622 diff changeset	493
24500 7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	494	$ rm test-failure-unicode.t
7b0a20cd8c95 run-tests: explicitly handle unicode when writing xunit file Gregory Szorc <gregory.szorc@gmail.com> parents: 23935 diff changeset	495
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	496	test for --retest
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	497	====================
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	498
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	499	$ rt --retest
45407 de9ec12ee53c run-tests: refactor filtering logic for --retest flag Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45406 diff changeset	500	running 1 tests using 1 parallel processes
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	501
23348 bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	502	--- $TESTTMP/test-failure.t
bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	503	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	504	@@ -1,5 +1,5 @@
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	505	$ echo babar
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	506	- rataxes
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	507	+ babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	508	This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	509	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	510	pad pad pad pad............................................................
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	511
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	512	ERROR: test-failure.t output changed
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	513	!
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	514	Failed test-failure.t: output changed
45407 de9ec12ee53c run-tests: refactor filtering logic for --retest flag Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45406 diff changeset	515	# Ran 1 tests, 0 skipped, 1 failed.
21741 02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	516	python hash seed: * (glob)
02cd29156d5d test-run-tests.t: tests the --retest option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21738 diff changeset	517	[1]
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	518
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	519	--retest works with --outputdir
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	520	$ rm -r output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	521	$ mkdir output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	522	$ mv test-failure.t.err output
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	523	$ rt --retest --outputdir output
45407 de9ec12ee53c run-tests: refactor filtering logic for --retest flag Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45406 diff changeset	524	running 1 tests using 1 parallel processes
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	525
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	526	--- $TESTTMP/test-failure.t
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	527	+++ $TESTTMP/output/test-failure.t.err
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	528	@@ -1,5 +1,5 @@
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	529	$ echo babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	530	- rataxes
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	531	+ babar
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	532	This is a noop statement so that
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	533	this test is still more bytes than success.
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	534	pad pad pad pad............................................................
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	535
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	536	ERROR: test-failure.t output changed
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	537	!
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	538	Failed test-failure.t: output changed
45407 de9ec12ee53c run-tests: refactor filtering logic for --retest flag Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45406 diff changeset	539	# Ran 1 tests, 0 skipped, 1 failed.
32716 2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	540	python hash seed: * (glob)
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	541	[1]
2146f01a2577 run-tests: allow specifying an output dir to write .errs to Siddharth Agarwal <sid0@fb.com> parents: 32715 diff changeset	542
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	543	Selecting Tests To Run
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	544	======================
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	545
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	546	successful
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	547
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	548	$ rt test-success.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	549	running 1 tests using 1 parallel processes
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	550	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	551	# Ran 1 tests, 0 skipped, 0 failed.
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	552
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	553	success w/ keyword
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	554	$ rt -k xyzzy
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	555	running 2 tests using 1 parallel processes
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	556	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	557	# Ran 2 tests, 1 skipped, 0 failed.
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	558
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	559	failed
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	560
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	561	$ rt test-failure.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	562	running 1 tests using 1 parallel processes
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	563
23348 bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	564	--- $TESTTMP/test-failure.t
bbe56e07e07a tests: fix globs for Windows Matt Harbison <matt_harbison@yahoo.com> parents: 23245 diff changeset	565	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	566	@@ -1,5 +1,5 @@
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	567	$ echo babar
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	568	- rataxes
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	569	+ babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	570	This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	571	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	572	pad pad pad pad............................................................
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	573
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	574	ERROR: test-failure.t output changed
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	575	!
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	576	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	577	# Ran 1 tests, 0 skipped, 1 failed.
21742 66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	578	python hash seed: * (glob)
66f91859822b test-run-tests.t: test selection of testfile from the command line Pierre-Yves David <pierre-yves.david@fb.com> parents: 21741 diff changeset	579	[1]
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	580
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	581	failure w/ keyword
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	582	$ rt -k rataxes
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	583	running 2 tests using 1 parallel processes
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	584
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	585	--- $TESTTMP/test-failure.t
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	586	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	587	@@ -1,5 +1,5 @@
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	588	$ echo babar
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	589	- rataxes
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	590	+ babar
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	591	This is a noop statement so that
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	592	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	593	pad pad pad pad............................................................
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	594
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	595	ERROR: test-failure.t output changed
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	596	!
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	597	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	598	# Ran 2 tests, 1 skipped, 1 failed.
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	599	python hash seed: * (glob)
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	600	[1]
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	601
22840 ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	602	Verify that when a process fails to start we show a useful message
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	603	==================================================================
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	604
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	605	$ cat > test-serve-fail.t <<EOF
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	606	> $ echo 'abort: child process failed to start blah'
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	607	> EOF
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	608	$ rt test-serve-fail.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	609	running 1 tests using 1 parallel processes
36461 51a9f0246931 run-tests: resume raising an exception when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 36438 diff changeset	610
36438 93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35855 diff changeset	611	--- $TESTTMP/test-serve-fail.t
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35855 diff changeset	612	+++ $TESTTMP/test-serve-fail.t.err
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35855 diff changeset	613	@@ -1* +1,2 @@ (glob)
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35855 diff changeset	614	$ echo 'abort: child process failed to start blah'
93228b2a1fc0 run-tests: don't mask errors when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 35855 diff changeset	615	+ abort: child process failed to start blah
22840 ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	616
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	617	ERROR: test-serve-fail.t output changed
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	618	!
36461 51a9f0246931 run-tests: resume raising an exception when a server fails to start Matt Harbison <matt_harbison@yahoo.com> parents: 36438 diff changeset	619	Failed test-serve-fail.t: server failed to start (HGPORT=*) (glob)
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	620	# Ran 1 tests, 0 skipped, 1 failed.
22840 ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	621	python hash seed: * (glob)
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	622	[1]
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	623	$ rm test-serve-fail.t
ba5c635921e1 test-run-tests: add a test for detection of failure to start a server Augie Fackler <raf@durin42.com> parents: 22838 diff changeset	624
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	625	Verify that we can try other ports
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	626	===================================
37434 3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36677 diff changeset	627
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36677 diff changeset	628	Extensions aren't inherited by the invoked run-tests.py. An extension
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36677 diff changeset	629	introducing a repository requirement could cause this to fail. So we force
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36677 diff changeset	630	HGRCPATH to get a clean environment.
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36677 diff changeset	631
3fbd8b862d66 tests: work around potential repo incompatibility Gregory Szorc <gregory.szorc@gmail.com> parents: 36677 diff changeset	632	$ HGRCPATH= hg init inuse
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	633	$ hg serve -R inuse -p $HGPORT -d --pid-file=blocks.pid
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	634	$ cat blocks.pid >> $DAEMON_PIDS
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	635	$ cat > test-serve-inuse.t <<EOF
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	636	> $ hg serve -R `pwd`/inuse -p \$HGPORT -d --pid-file=hg.pid
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	637	> $ cat hg.pid >> \$DAEMON_PIDS
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	638	> EOF
67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	639	$ rt test-serve-inuse.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	640	running 1 tests using 1 parallel processes
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	641	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	642	# Ran 1 tests, 0 skipped, 0 failed.
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	643	$ rm test-serve-inuse.t
29221 73f58eb14684 test-run-tests: clean up inuse server eagerly timeless <timeless@mozdev.org> parents: 29220 diff changeset	644	$ killdaemons.py $DAEMON_PIDS
27602 67aa88e00fc7 run-tests: fix get port to try differing ports timeless <timeless@mozdev.org> parents: 27567 diff changeset	645
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	646	Running In Debug Mode
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	647	======================
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	648
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	649	$ rt --debug 2>&1 \| grep -v pwd
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	650	running 2 tests using 1 parallel processes
23676 e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	651	+ echo SALT 0 0 (glob)
e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	652	SALT 0 0 (glob)
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	653	+ echo babar
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	654	babar
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	655	+ echo SALT 10 0 (glob)
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	656	SALT 10 0 (glob)
27509 6ff90d618d72 test-run-tests: glob away a --debug run difference on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 27395 diff changeset	657	+ echo SALT* 0 0 (glob)
23676 e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	658	SALT 0 0 (glob)
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	659	+ echo babar
d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	660	babar
23676 e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	661	+ echo SALT 2 0 (glob)
e8b09f920fe6 tests: adapt glob pattern to fix test with NetBSD's sh(1) (issue4484) Thomas Klausner <tk@giga.or.at> parents: 23348 diff changeset	662	SALT 2 0 (glob)
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	663	+ echo xyzzy
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	664	xyzzy
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31673 diff changeset	665	+ echo SALT 9 0 (glob)
220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31673 diff changeset	666	SALT 9 0 (glob)
28317 8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	667	+ printf abc\ndef\nxyz\n (glob)
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	668	abc
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	669	def
8de70574be2c run-tests: defer leftover (?) cleanup until after all output is exhausted Matt Harbison <matt_harbison@yahoo.com> parents: 28316 diff changeset	670	xyz
31827 220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31673 diff changeset	671	+ echo SALT 15 0 (glob)
220d4bffd23e run-tests: prevent a (glob) declaration from reordering (?) lines Matt Harbison <matt_harbison@yahoo.com> parents: 31673 diff changeset	672	SALT 15 0 (glob)
31829 4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	673	+ printf zyx\nwvu\ntsr\n (glob)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	674	zyx
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	675	wvu
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	676	tsr
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	677	+ echo SALT 22 0 (glob)
4eec2f04a672 run-tests: support per-line conditional output in tests Matt Harbison <matt_harbison@yahoo.com> parents: 31828 diff changeset	678	SALT 22 0 (glob)
21743 d72bea858cbd test-run-tests.t: test --debug option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21742 diff changeset	679	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	680	# Ran 2 tests, 0 skipped, 0 failed.
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	681
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	682	Parallel runs
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	683	==============
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	684
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	685	(duplicate the failing test to get predictable output)
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	686	$ cp test-failure.t test-failure-copy.t
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	687
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	688	$ rt --jobs 2 test-failure*.t -n
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	689	running 2 tests using 2 parallel processes
23107 5459b30aa498 tests: silence output race in test-run-tests.t Matt Mackall <mpm@selenic.com> parents: 22840 diff changeset	690	!!
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	691	Failed test-failure*.t: output changed (glob)
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	692	Failed test-failure*.t: output changed (glob)
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	693	# Ran 2 tests, 0 skipped, 2 failed.
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	694	python hash seed: * (glob)
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	695	[1]
395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	696
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	697	failures in parallel with --first should only print one failure
34894 b63a7d839c33 tests: de-flake test-run-tests.t's "--jobs=2 --first" test Martin von Zweigbergk <martinvonz@google.com> parents: 34842 diff changeset	698	$ rt --jobs 2 --first test-failure*.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	699	running 2 tests using 2 parallel processes
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	700
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	701	--- $TESTTMP/test-failure*.t (glob)
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	702	+++ $TESTTMP/test-failure*.t.err (glob)
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	703	@@ -1,5 +1,5 @@
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	704	$ echo babar
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	705	- rataxes
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	706	+ babar
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	707	This is a noop statement so that
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	708	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	709	pad pad pad pad............................................................
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	710
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	711	Failed test-failure*.t: output changed (glob)
34894 b63a7d839c33 tests: de-flake test-run-tests.t's "--jobs=2 --first" test Martin von Zweigbergk <martinvonz@google.com> parents: 34842 diff changeset	712	Failed test-failure*.t: output changed (glob)
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	713	# Ran 2 tests, 0 skipped, 2 failed.
22838 9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	714	python hash seed: * (glob)
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	715	[1]
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	716
9a20f53e436f run-tests: handle --jobs and --first gracefully Augie Fackler <raf@durin42.com> parents: 22579 diff changeset	717
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	718	(delete the duplicated test file)
34894 b63a7d839c33 tests: de-flake test-run-tests.t's "--jobs=2 --first" test Martin von Zweigbergk <martinvonz@google.com> parents: 34842 diff changeset	719	$ rm test-failure-copy.t
21744 395e29928db2 test-run-tests.t: tests --jobs option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21743 diff changeset	720
41178 53327bfbf35d testrunner: make `-j100 --runs-per-test=100 test-foo.t` use 100 jobs Martin von Zweigbergk <martinvonz@google.com> parents: 40975 diff changeset	721	multiple runs per test should be parallelized
53327bfbf35d testrunner: make `-j100 --runs-per-test=100 test-foo.t` use 100 jobs Martin von Zweigbergk <martinvonz@google.com> parents: 40975 diff changeset	722
53327bfbf35d testrunner: make `-j100 --runs-per-test=100 test-foo.t` use 100 jobs Martin von Zweigbergk <martinvonz@google.com> parents: 40975 diff changeset	723	$ rt --jobs 2 --runs-per-test 2 test-success.t
53327bfbf35d testrunner: make `-j100 --runs-per-test=100 test-foo.t` use 100 jobs Martin von Zweigbergk <martinvonz@google.com> parents: 40975 diff changeset	724	running 2 tests using 2 parallel processes
53327bfbf35d testrunner: make `-j100 --runs-per-test=100 test-foo.t` use 100 jobs Martin von Zweigbergk <martinvonz@google.com> parents: 40975 diff changeset	725	..
53327bfbf35d testrunner: make `-j100 --runs-per-test=100 test-foo.t` use 100 jobs Martin von Zweigbergk <martinvonz@google.com> parents: 40975 diff changeset	726	# Ran 2 tests, 0 skipped, 0 failed.
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	727
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	728	Interactive run
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	729	===============
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	730
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	731	(backup the failing test)
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	732	$ cp test-failure.t backup
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	733
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	734	Refuse the fix
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	735
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	736	$ echo 'n' \| rt -i
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	737	running 2 tests using 1 parallel processes
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	738
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	739	--- $TESTTMP/test-failure.t
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	740	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	741	@@ -1,5 +1,5 @@
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	742	$ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	743	- rataxes
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	744	+ babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	745	This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	746	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	747	pad pad pad pad............................................................
44944 617cd3b1e9cd tests: make it clear what happen when no response entered Sushil khanchi <sushilkhanchi97@gmail.com> parents: 43070 diff changeset	748	Accept this change? [y/N]
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	749	ERROR: test-failure.t output changed
21763 84cd5ee787ed run-tests: hold iolock across diff/prompt when interactive Matt Mackall <mpm@selenic.com> parents: 21756 diff changeset	750	!.
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	751	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	752	# Ran 2 tests, 0 skipped, 1 failed.
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	753	python hash seed: * (glob)
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	754	[1]
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	755
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	756	$ cat test-failure.t
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	757	$ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	758	rataxes
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	759	This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	760	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	761	pad pad pad pad............................................................
c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	762	pad pad pad pad............................................................
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	763	pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	764	pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	765	pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	766	pad pad pad pad............................................................
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	767
22361 eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	768	Interactive with custom view
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	769
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	770	$ echo 'n' \| rt -i --view echo
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	771	running 2 tests using 1 parallel processes
35393 4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35391 diff changeset	772	$TESTTMP/test-failure.t $TESTTMP/test-failure.t.err
44944 617cd3b1e9cd tests: make it clear what happen when no response entered Sushil khanchi <sushilkhanchi97@gmail.com> parents: 43070 diff changeset	773	Accept this change? [y/N]* (glob)
22361 eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	774	ERROR: test-failure.t output changed
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	775	!.
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	776	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	777	# Ran 2 tests, 0 skipped, 1 failed.
22361 eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	778	python hash seed: * (glob)
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	779	[1]
eb6adf750954 run-tests: make --interactive work with --view Gregory Szorc <gregory.szorc@gmail.com> parents: 22292 diff changeset	780
22108 ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	781	View the fix
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	782
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	783	$ echo 'y' \| rt --view echo
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	784	running 2 tests using 1 parallel processes
35393 4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35391 diff changeset	785	$TESTTMP/test-failure.t $TESTTMP/test-failure.t.err
22108 ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	786
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	787	ERROR: test-failure.t output changed
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	788	!.
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	789	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	790	# Ran 2 tests, 0 skipped, 1 failed.
22108 ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	791	python hash seed: * (glob)
ccae572c5d09 test-run-tests: test --view Matt Mackall <mpm@selenic.com> parents: 22107 diff changeset	792	[1]
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	793
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	794	Accept the fix
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	795
35416 417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	796	$ cat >> test-failure.t <<EOF
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	797	> $ echo 'saved backup bundle to \$TESTTMP/foo.hg'
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	798	> saved backup bundle to \$TESTTMP/foo.hg
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	799	> $ echo 'saved backup bundle to \$TESTTMP/foo.hg'
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	800	> saved backup bundle to $TESTTMP\\foo.hg
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	801	> $ echo 'saved backup bundle to \$TESTTMP/foo.hg'
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	802	> saved backup bundle to \$TESTTMP/*.hg (glob)
417fa23017f9 tests: avoid echo with backslash escapes Martin von Zweigbergk <martinvonz@google.com> parents: 35393 diff changeset	803	> EOF
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	804	$ echo 'y' \| rt -i 2>&1
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	805	running 2 tests using 1 parallel processes
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	806
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	807	--- $TESTTMP/test-failure.t
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	808	+++ $TESTTMP/test-failure.t.err
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	809	@@ -1,5 +1,5 @@
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	810	$ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	811	- rataxes
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	812	+ babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	813	This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	814	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	815	pad pad pad pad............................................................
35391 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	816	@@ -11,6 +11,6 @@
0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	817	$ echo 'saved backup bundle to $TESTTMP/foo.hg'
0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	818	saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	819	$ echo 'saved backup bundle to $TESTTMP/foo.hg'
35391 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	820	- saved backup bundle to $TESTTMP\foo.hg
0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	821	+ saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	822	$ echo 'saved backup bundle to $TESTTMP/foo.hg'
35391 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	823	saved backup bundle to $TESTTMP/*.hg (glob)
44944 617cd3b1e9cd tests: make it clear what happen when no response entered Sushil khanchi <sushilkhanchi97@gmail.com> parents: 43070 diff changeset	824	Accept this change? [y/N] ..
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	825	# Ran 2 tests, 0 skipped, 0 failed.
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	826
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	827	$ sed -e 's,(glob)$,&<,g' test-failure.t
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	828	$ echo babar
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	829	babar
21995 20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	830	This is a noop statement so that
20bfcb484554 test-run-tests.t: add extra data to tests for keyword tests Augie Fackler <raf@durin42.com> parents: 21977 diff changeset	831	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	832	pad pad pad pad............................................................
c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	833	pad pad pad pad............................................................
31828 ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	834	pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	835	pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	836	pad pad pad pad............................................................
ff60498211f3 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 31827 diff changeset	837	pad pad pad pad............................................................
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	838	$ echo 'saved backup bundle to $TESTTMP/foo.hg'
35391 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	839	saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	840	$ echo 'saved backup bundle to $TESTTMP/foo.hg'
35391 0432e54f4dbe run-tests: stop automatically adding a (glob) for bundle backup lines Matt Harbison <matt_harbison@yahoo.com> parents: 35387 diff changeset	841	saved backup bundle to $TESTTMP/foo.hg
23728 31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	842	$ echo 'saved backup bundle to $TESTTMP/foo.hg'
31d3f973d079 run-tests: automatically add (glob) to "saved backup bundle to" lines Mads Kiilerich <madski@unity3d.com> parents: 23676 diff changeset	843	saved backup bundle to $TESTTMP/*.hg (glob)<
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	844
45405 601ec3faeb6b tests: remove a sub-test since we are done with it in test-run-tests.t Sushil khanchi <sushilkhanchi97@gmail.com> parents: 44944 diff changeset	845	$ rm test-failure.t
601ec3faeb6b tests: remove a sub-test since we are done with it in test-run-tests.t Sushil khanchi <sushilkhanchi97@gmail.com> parents: 44944 diff changeset	846
32980 8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	847	Race condition - test file was modified when test is running
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	848
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	849	$ TESTRACEDIR=`pwd`
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	850	$ export TESTRACEDIR
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	851	$ cat > test-race.t <<EOF
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	852	> $ echo 1
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	853	> $ echo "# a new line" >> $TESTRACEDIR/test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	854	> EOF
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	855
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	856	$ rt -i test-race.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	857	running 1 tests using 1 parallel processes
32980 8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	858
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	859	--- $TESTTMP/test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	860	+++ $TESTTMP/test-race.t.err
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	861	@@ -1,2 +1,3 @@
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	862	$ echo 1
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	863	+ 1
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	864	$ echo "# a new line" >> $TESTTMP/test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	865	Reference output has changed (run again to prompt changes)
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	866	ERROR: test-race.t output changed
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	867	!
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	868	Failed test-race.t: output changed
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	869	# Ran 1 tests, 0 skipped, 1 failed.
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	870	python hash seed: * (glob)
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	871	[1]
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	872
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	873	$ rm test-race.t
8dc62c97a665 run-tests: do not prompt changes (-i) if a race condition is detected Jun Wu <quark@fb.com> parents: 32942 diff changeset	874
32982 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	875	When "#testcases" is used in .t files
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	876
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	877	$ cat >> test-cases.t <<EOF
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	878	> #testcases a b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	879	> #if a
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	880	> $ echo 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	881	> #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	882	> #if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	883	> $ echo 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	884	> #endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	885	> EOF
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	886
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	887	$ cat <<EOF \| rt -i test-cases.t 2>&1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	888	> y
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	889	> y
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	890	> EOF
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	891	running 2 tests using 1 parallel processes
32982 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	892
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	893	--- $TESTTMP/test-cases.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	894	+++ $TESTTMP/test-cases.t#a.err
32982 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	895	@@ -1,6 +1,7 @@
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	896	#testcases a b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	897	#if a
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	898	$ echo 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	899	+ 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	900	#endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	901	#if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	902	$ echo 2
44944 617cd3b1e9cd tests: make it clear what happen when no response entered Sushil khanchi <sushilkhanchi97@gmail.com> parents: 43070 diff changeset	903	Accept this change? [y/N] .
32982 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	904	--- $TESTTMP/test-cases.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	905	+++ $TESTTMP/test-cases.t#b.err
32982 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	906	@@ -5,4 +5,5 @@
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	907	#endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	908	#if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	909	$ echo 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	910	+ 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	911	#endif
44944 617cd3b1e9cd tests: make it clear what happen when no response entered Sushil khanchi <sushilkhanchi97@gmail.com> parents: 43070 diff changeset	912	Accept this change? [y/N] .
32982 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	913	# Ran 2 tests, 0 skipped, 0 failed.
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	914
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	915	$ cat test-cases.t
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	916	#testcases a b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	917	#if a
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	918	$ echo 1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	919	1
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	920	#endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	921	#if b
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	922	$ echo 2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	923	2
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	924	#endif
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	925
33934 6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	926	$ cat >> test-cases.t <<'EOF'
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	927	> #if a
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	928	> $ NAME=A
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	929	> #else
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	930	> $ NAME=B
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	931	> #endif
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	932	> $ echo $NAME
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	933	> A (a !)
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	934	> B (b !)
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	935	> EOF
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	936	$ rt test-cases.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	937	running 2 tests using 1 parallel processes
33934 6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	938	..
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	939	# Ran 2 tests, 0 skipped, 0 failed.
6cc8f848b4c3 run-tests: make per-line condition support testcase names Jun Wu <quark@fb.com> parents: 33814 diff changeset	940
38824 3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	941	When using multiple dimensions of "#testcases" in .t files
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	942
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	943	$ cat > test-cases.t <<'EOF'
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	944	> #testcases a b
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	945	> #testcases c d
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	946	> #if a d
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	947	> $ echo $TESTCASE
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	948	> a#d
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	949	> #endif
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	950	> #if b c
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	951	> $ echo yes
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	952	> no
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	953	> #endif
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	954	> EOF
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	955	$ rt test-cases.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	956	running 4 tests using 1 parallel processes
38824 3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	957	..
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	958	--- $TESTTMP/test-cases.t
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	959	+++ $TESTTMP/test-cases.t#b#c.err
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	960	@@ -6,5 +6,5 @@
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	961	#endif
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	962	#if b c
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	963	$ echo yes
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	964	- no
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	965	+ yes
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	966	#endif
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	967
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	968	ERROR: test-cases.t#b#c output changed
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	969	!.
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	970	Failed test-cases.t#b#c: output changed
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	971	# Ran 4 tests, 0 skipped, 1 failed.
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	972	python hash seed: * (glob)
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	973	[1]
3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	974
45406 fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	975	$ rt --retest
45407 de9ec12ee53c run-tests: refactor filtering logic for --retest flag Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45406 diff changeset	976	running 1 tests using 1 parallel processes
45406 fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	977
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	978	--- $TESTTMP/test-cases.t
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	979	+++ $TESTTMP/test-cases.t#b#c.err
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	980	@@ -6,5 +6,5 @@
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	981	#endif
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	982	#if b c
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	983	$ echo yes
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	984	- no
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	985	+ yes
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	986	#endif
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	987
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	988	ERROR: test-cases.t#b#c output changed
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	989	!
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	990	Failed test-cases.t#b#c: output changed
45407 de9ec12ee53c run-tests: refactor filtering logic for --retest flag Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45406 diff changeset	991	# Ran 1 tests, 0 skipped, 1 failed.
45406 fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	992	python hash seed: * (glob)
fa1a5527f642 tests: add a --retest test to demonstrate a fix in next patch Sushil khanchi <sushilkhanchi97@gmail.com> parents: 45405 diff changeset	993	[1]
38824 3086a8627b29 testrunner: allow multiple #testcases Martin von Zweigbergk <martinvonz@google.com> parents: 38823 diff changeset	994	$ rm test-cases.t#b#c.err
32982 573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	995	$ rm test-cases.t
573baab2a797 run-tests: fix -i when "#testcases" is used in .t test Jun Wu <quark@fb.com> parents: 32980 diff changeset	996
21755 9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	997	(reinstall)
9e9288b9463a test-run-tests.t: test the --interactive option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21744 diff changeset	998	$ mv backup test-failure.t
21756 f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	999
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	1000	No Diff
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	1001	===============
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	1002
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1003	$ rt --nodiff
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1004	running 2 tests using 1 parallel processes
21756 f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	1005	!.
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	1006	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1007	# Ran 2 tests, 0 skipped, 1 failed.
21756 f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	1008	python hash seed: * (glob)
f5fd1580a649 test-run-tests.t: test the --nodiff option Pierre-Yves David <pierre-yves.david@fb.com> parents: 21755 diff changeset	1009	[1]
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1010
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	1011	test --tmpdir support
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1012	$ rt --tmpdir=$TESTTMP/keep test-success.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1013	running 1 tests using 1 parallel processes
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	1014
35393 4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35391 diff changeset	1015	Keeping testtmp dir: $TESTTMP/keep/child1/test-success.t
4441705b7111 tests: remove (glob) annotations that were only for '\' matches Matt Harbison <matt_harbison@yahoo.com> parents: 35391 diff changeset	1016	Keeping threadtmp dir: $TESTTMP/keep/child1
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	1017	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1018	# Ran 1 tests, 0 skipped, 0 failed.
26422 41436beaf463 run-tests: report paths saved by --keep-tmpdir timeless@mozdev.org parents: 26158 diff changeset	1019
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1020	timeouts
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1021	========
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1022	$ cat > test-timeout.t <<EOF
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1023	> $ sleep 2
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1024	> $ echo pass
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1025	> pass
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1026	> EOF
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1027	> echo '#require slow' > test-slow-timeout.t
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1028	> cat test-timeout.t >> test-slow-timeout.t
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1029	$ rt --timeout=1 --slowtimeout=3 test-timeout.t test-slow-timeout.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1030	running 2 tests using 1 parallel processes
27393 a40b623e6380 run-tests: report timeouts in a less alarming fashion Matt Mackall <mpm@selenic.com> parents: 27141 diff changeset	1031	st
32474 c2b7fb580794 tests: hint how to run slow tests when rejecting Kyle Lippincott <spectral@google.com> parents: 32316 diff changeset	1032	Skipped test-slow-timeout.t: missing feature: allow slow tests (use --allow-slow-tests)
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1033	Failed test-timeout.t: timed out
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1034	# Ran 1 tests, 1 skipped, 1 failed.
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1035	python hash seed: * (glob)
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1036	[1]
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1037	$ rt --timeout=1 --slowtimeout=3 \
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1038	> test-timeout.t test-slow-timeout.t --allow-slow-tests
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1039	running 2 tests using 1 parallel processes
27393 a40b623e6380 run-tests: report timeouts in a less alarming fashion Matt Mackall <mpm@selenic.com> parents: 27141 diff changeset	1040	.t
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1041	Failed test-timeout.t: timed out
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1042	# Ran 2 tests, 0 skipped, 1 failed.
27141 a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1043	python hash seed: * (glob)
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1044	[1]
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1045	$ rm test-timeout.t test-slow-timeout.t
a4e3dec3010e run-tests: add --slowtimeout and use it for slow tests timeless <timeless@mozdev.org> parents: 27057 diff changeset	1046
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1047	test for --time
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1048	==================
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1049
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1050	$ rt test-success.t --time
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1051	running 1 tests using 1 parallel processes
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1052	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1053	# Ran 1 tests, 0 skipped, 0 failed.
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1054	# Producing time report
25098 bf84ab53c2fd run-tests: include 'start' and 'end' in --time output Pierre-Yves David <pierre-yves.david@fb.com> parents: 25097 diff changeset	1055	start end cuser csys real Test
42713 2c1a484ce4d4 test: further fixes to matching for run-tests.py bug Pierre-Yves David <pierre-yves.david@octobus.net> parents: 42708 diff changeset	1056	\s[\d\.]{5,8} \s[\d\.]{5,8} \s[\d\.]{5,8} \s[\d\.]{5,8} \s*[\d\.]{5,8} test-success.t (re)
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1057
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1058	test for --time with --job enabled
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1059	====================================
4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1060
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1061	$ rt test-success.t --time --jobs 2
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1062	running 1 tests using 1 parallel processes
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1063	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1064	# Ran 1 tests, 0 skipped, 0 failed.
21977 4ca4e1572022 run-tests: '--time' option provide more details to Linux users anuraggoel <anurag.dsps@gmail.com> parents: 21926 diff changeset	1065	# Producing time report
25098 bf84ab53c2fd run-tests: include 'start' and 'end' in --time output Pierre-Yves David <pierre-yves.david@fb.com> parents: 25097 diff changeset	1066	start end cuser csys real Test
42713 2c1a484ce4d4 test: further fixes to matching for run-tests.py bug Pierre-Yves David <pierre-yves.david@octobus.net> parents: 42708 diff changeset	1067	\s[\d\.]{5,8} \s[\d\.]{5,8} \s[\d\.]{5,8} \s[\d\.]{5,8} \s*[\d\.]{5,8} test-success.t (re)
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1068
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1069	Skips
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1070	================
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1071	$ cat > test-skip.t <<EOF
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1072	> $ echo xyzzy
36677 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1073	> #if true
22045 769198c6a62d run-tests: add #require to abort full test Matt Mackall <mpm@selenic.com> parents: 22044 diff changeset	1074	> #require false
36677 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1075	> #end
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1076	> EOF
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1077	$ cat > test-noskip.t <<EOF
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1078	> #if false
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1079	> #require false
a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1080	> #endif
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1081	> EOF
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1082	$ rt --nodiff
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1083	running 4 tests using 1 parallel processes
36677 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1084	!.s.
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1085	Skipped test-skip.t: missing feature: nail clipper
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1086	Failed test-failure.t: output changed
36677 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1087	# Ran 3 tests, 1 skipped, 1 failed.
21996 947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1088	python hash seed: * (glob)
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1089	[1]
947553944e92 test-run-tests.t: add tests for skips Augie Fackler <raf@durin42.com> parents: 21995 diff changeset	1090
36677 a247a0e82e7d run-tests: allow #require inside #if Jun Wu <quark@fb.com> parents: 36461 diff changeset	1091	$ rm test-noskip.t
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1092	$ rt --keyword xyzzy
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1093	running 3 tests using 1 parallel processes
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	1094	.s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1095	Skipped test-skip.t: missing feature: nail clipper
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1096	# Ran 2 tests, 2 skipped, 0 failed.
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1097
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1098	Skips with xml
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1099	$ rt --keyword xyzzy \
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1100	> --xunit=xunit.xml
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1101	running 3 tests using 1 parallel processes
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	1102	.s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1103	Skipped test-skip.t: missing feature: nail clipper
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1104	# Ran 2 tests, 2 skipped, 0 failed.
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1105	$ cat xunit.xml
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1106	<?xml version="1.0" encoding="utf-8"?>
22107 3b5cf39ffcc4 run-tests: don't show 'i' for tests that don't match a keyword Matt Mackall <mpm@selenic.com> parents: 22045 diff changeset	1107	<testsuite errors="0" failures="0" name="run-tests" skipped="2" tests="2">
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1108	<testcase name="test-success.t" time="*"/> (glob)
32715 a4d0e816a672 run-tests: add information about skipped tests to XUnit output Siddharth Agarwal <sid0@fb.com> parents: 32714 diff changeset	1109	<testcase name="test-skip.t">
43070 1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	1110	<skipped><![CDATA[missing feature: nail clipper]]></skipped> (py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	1111	<skipped> (no-py38 !)
1d60a7825dcb tests: conditionalize test-run-tests.t for Python 3.8 Gregory Szorc <gregory.szorc@gmail.com> parents: 42713 diff changeset	1112	<![CDATA[missing feature: nail clipper]]> </skipped> (no-py38 !)
32715 a4d0e816a672 run-tests: add information about skipped tests to XUnit output Siddharth Agarwal <sid0@fb.com> parents: 32714 diff changeset	1113	</testcase>
22044 a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1114	</testsuite>
a06172e85fd4 run-tests: add support for xunit test reports Augie Fackler <raf@durin42.com> parents: 21997 diff changeset	1115
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1116	Missing skips or blacklisted skips don't count as executed:
47182 dff19fe2973c run-tests: fix whitelist/blacklist with directories on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 46091 diff changeset	1117	$ mkdir tests
dff19fe2973c run-tests: fix whitelist/blacklist with directories on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 46091 diff changeset	1118	$ echo tests/test-failure.t > blacklist
dff19fe2973c run-tests: fix whitelist/blacklist with directories on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 46091 diff changeset	1119	$ cp test-failure.t tests
27927 0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1120	$ rt --blacklist=blacklist --json\
47182 dff19fe2973c run-tests: fix whitelist/blacklist with directories on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 46091 diff changeset	1121	> tests/test-failure.t tests/test-bogus.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1122	running 2 tests using 1 parallel processes
21997 93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1123	ss
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1124	Skipped test-bogus.t: Doesn't exist
93c3b3f55d59 run-tests: fix test result counts with --keyword specified or skips occurring Augie Fackler <raf@durin42.com> parents: 21996 diff changeset	1125	Skipped test-failure.t: blacklisted
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1126	# Ran 0 tests, 2 skipped, 0 failed.
47182 dff19fe2973c run-tests: fix whitelist/blacklist with directories on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 46091 diff changeset	1127	$ cat tests/report.json
27927 0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1128	testreport ={
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1129	"test-bogus.t": {
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1130	"result": "skip"
29199 daff05dcd184 run-tests: handle json.dumps divergence timeless <timeless@mozdev.org> parents: 29173 diff changeset	1131	},
27927 0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1132	"test-failure.t": {
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1133	"result": "skip"
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1134	}
0de4dfc9af0c run-tests: fix crash when --json and --blacklist are both used (issue5050) Laurent Charignon <lcharignon@fb.com> parents: 27686 diff changeset	1135	} (no-eol)
47182 dff19fe2973c run-tests: fix whitelist/blacklist with directories on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 46091 diff changeset	1136	$ rm -r tests
dff19fe2973c run-tests: fix whitelist/blacklist with directories on Windows Matt Harbison <matt_harbison@yahoo.com> parents: 46091 diff changeset	1137	$ echo test-failure.t > blacklist
29173 fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1138
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1139	Whitelist trumps blacklist
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1140	$ echo test-failure.t > whitelist
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1141	$ rt --blacklist=blacklist --whitelist=whitelist --json\
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1142	> test-failure.t test-bogus.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1143	running 2 tests using 1 parallel processes
29173 fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1144	s
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1145	--- $TESTTMP/test-failure.t
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1146	+++ $TESTTMP/test-failure.t.err
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1147	@@ -1,5 +1,5 @@
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1148	$ echo babar
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1149	- rataxes
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1150	+ babar
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1151	This is a noop statement so that
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1152	this test is still more bytes than success.
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1153	pad pad pad pad............................................................
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1154
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1155	ERROR: test-failure.t output changed
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1156	!
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1157	Skipped test-bogus.t: Doesn't exist
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1158	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1159	# Ran 1 tests, 1 skipped, 1 failed.
29173 fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1160	python hash seed: * (glob)
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1161	[1]
fa9fae9a9372 tests: add coverage for run-tests.py --whitelist timeless <timeless@mozdev.org> parents: 28812 diff changeset	1162
34263 1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1163	Ensure that --test-list causes only the tests listed in that file to
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1164	be executed.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1165	$ echo test-success.t >> onlytest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1166	$ rt --test-list=onlytest
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1167	running 1 tests using 1 parallel processes
34263 1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1168	.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1169	# Ran 1 tests, 0 skipped, 0 failed.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1170	$ echo test-bogus.t >> anothertest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1171	$ rt --test-list=onlytest --test-list=anothertest
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1172	running 2 tests using 1 parallel processes
34263 1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1173	s.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1174	Skipped test-bogus.t: Doesn't exist
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1175	# Ran 1 tests, 1 skipped, 0 failed.
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1176	$ rm onlytest anothertest
1533371769b5 tests: add support for listing tests to run in a file Augie Fackler <augie@google.com> parents: 34041 diff changeset	1177
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1178	test for --json
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1179	==================
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1180
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1181	$ rt --json
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1182	running 3 tests using 1 parallel processes
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1183
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1184	--- $TESTTMP/test-failure.t
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1185	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1186	@@ -1,5 +1,5 @@
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1187	$ echo babar
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1188	- rataxes
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1189	+ babar
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1190	This is a noop statement so that
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1191	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1192	pad pad pad pad............................................................
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1193
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1194	ERROR: test-failure.t output changed
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1195	!.s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1196	Skipped test-skip.t: missing feature: nail clipper
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1197	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1198	# Ran 2 tests, 1 skipped, 1 failed.
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1199	python hash seed: * (glob)
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1200	[1]
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1201
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1202	$ cat report.json
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1203	testreport ={
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1204	"test-failure.t": [\{] (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1205	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1206	"cuser": "\s*\d+\.\d{3,4}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1207	"diff": "---.+\+\+\+.+", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1208	"end": "\s*\d+\.\d{3,4}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1209	"result": "failure", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1210	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1211	"time": "\s*\d+\.\d{3,4}" (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1212	}, ? (re)
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1213	"test-skip.t": {
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1214	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1215	"cuser": "\s*\d+\.\d{3,4}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1216	"diff": "", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1217	"end": "\s*\d+\.\d{3,4}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1218	"result": "skip", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1219	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1220	"time": "\s*\d+\.\d{3,4}" (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1221	}, ? (re)
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1222	"test-success.t": [\{] (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1223	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1224	"cuser": "\s*\d+\.\d{3,4}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1225	"diff": "", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1226	"end": "\s*\d+\.\d{3,4}", ? (re)
23245 d33a90cb2a32 test-run-tests: accept more levels of precision and trailing ws (issue4440) Augie Fackler <raf@durin42.com> parents: 23107 diff changeset	1227	"result": "success", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1228	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1229	"time": "\s*\d+\.\d{3,4}" (re)
22391 c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1230	}
c42e69268f5b run-tests: added '--json' functionality to store test result in json file anuraggoel <anurag.dsps@gmail.com> parents: 22361 diff changeset	1231	} (no-eol)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1232	--json with --outputdir
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1233
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1234	$ rm report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1235	$ rm -r output
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1236	$ mkdir output
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1237	$ rt --json --outputdir output
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1238	running 3 tests using 1 parallel processes
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1239
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1240	--- $TESTTMP/test-failure.t
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1241	+++ $TESTTMP/output/test-failure.t.err
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1242	@@ -1,5 +1,5 @@
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1243	$ echo babar
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1244	- rataxes
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1245	+ babar
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1246	This is a noop statement so that
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1247	this test is still more bytes than success.
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1248	pad pad pad pad............................................................
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1249
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1250	ERROR: test-failure.t output changed
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1251	!.s
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1252	Skipped test-skip.t: missing feature: nail clipper
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1253	Failed test-failure.t: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1254	# Ran 2 tests, 1 skipped, 1 failed.
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1255	python hash seed: * (glob)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1256	[1]
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1257	$ f report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1258	report.json: file not found
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1259	$ cat output/report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1260	testreport ={
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1261	"test-failure.t": [\{] (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1262	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1263	"cuser": "\s*\d+\.\d{3,4}", ? (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1264	"diff": "---.+\+\+\+.+", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1265	"end": "\s*\d+\.\d{3,4}", ? (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1266	"result": "failure", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1267	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1268	"time": "\s*\d+\.\d{3,4}" (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1269	}, ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1270	"test-skip.t": {
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1271	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1272	"cuser": "\s*\d+\.\d{3,4}", ? (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1273	"diff": "", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1274	"end": "\s*\d+\.\d{3,4}", ? (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1275	"result": "skip", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1276	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1277	"time": "\s*\d+\.\d{3,4}" (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1278	}, ? (re)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1279	"test-success.t": [\{] (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1280	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1281	"cuser": "\s*\d+\.\d{3,4}", ? (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1282	"diff": "", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1283	"end": "\s*\d+\.\d{3,4}", ? (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1284	"result": "success", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1285	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1286	"time": "\s*\d+\.\d{3,4}" (re)
32718 232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1287	}
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1288	} (no-eol)
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1289	$ ls -a output
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1290	.
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1291	..
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1292	.testtimes
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1293	report.json
232875623c27 run-tests: write JSON reports to output dir Siddharth Agarwal <sid0@fb.com> parents: 32717 diff changeset	1294	test-failure.t.err
22579 36a940d82f88 test: protect the run-tests.py --json test behind an hghave rule Pierre-Yves David <pierre-yves.david@fb.com> parents: 22486 diff changeset	1295
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1296	Test that failed test accepted through interactive are properly reported:
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1297
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1298	$ cp test-failure.t backup
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1299	$ echo y \| rt --json -i
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1300	running 3 tests using 1 parallel processes
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1301
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1302	--- $TESTTMP/test-failure.t
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1303	+++ $TESTTMP/test-failure.t.err
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1304	@@ -1,5 +1,5 @@
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1305	$ echo babar
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1306	- rataxes
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1307	+ babar
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1308	This is a noop statement so that
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1309	this test is still more bytes than success.
28316 c0cecc153d25 test-run-tests: pad the failure test to preserve the run order Matt Harbison <matt_harbison@yahoo.com> parents: 28180 diff changeset	1310	pad pad pad pad............................................................
44944 617cd3b1e9cd tests: make it clear what happen when no response entered Sushil khanchi <sushilkhanchi97@gmail.com> parents: 43070 diff changeset	1311	Accept this change? [y/N] ..s
27564 80b53082a353 run-tests: report missing feature for skipped tests timeless <timeless@mozdev.org> parents: 27509 diff changeset	1312	Skipped test-skip.t: missing feature: nail clipper
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1313	# Ran 2 tests, 1 skipped, 0 failed.
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1314
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1315	$ cat report.json
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1316	testreport ={
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1317	"test-failure.t": [\{] (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1318	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1319	"cuser": "\s*\d+\.\d{3,4}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1320	"diff": "", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1321	"end": "\s*\d+\.\d{3,4}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1322	"result": "success", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1323	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1324	"time": "\s*\d+\.\d{3,4}" (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1325	}, ? (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1326	"test-skip.t": {
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1327	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1328	"cuser": "\s*\d+\.\d{3,4}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1329	"diff": "", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1330	"end": "\s*\d+\.\d{3,4}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1331	"result": "skip", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1332	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1333	"time": "\s*\d+\.\d{3,4}" (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1334	}, ? (re)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1335	"test-success.t": [\{] (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1336	"csys": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1337	"cuser": "\s*\d+\.\d{3,4}", ? (re)
27686 df142b77b4c2 run-tests: add 'diff' entry in json report Laurent Charignon <lcharignon@fb.com> parents: 27602 diff changeset	1338	"diff": "", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1339	"end": "\s*\d+\.\d{3,4}", ? (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1340	"result": "success", ? (re)
41744 0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1341	"start": "\s*\d+\.\d{3,4}", ? (re)
0ae89ab3f025 test: stabilize test-run-tests.t output Boris Feld <boris.feld@octobus.net> parents: 41486 diff changeset	1342	"time": "\s*\d+\.\d{3,4}" (re)
24979 f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1343	}
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1344	} (no-eol)
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1345	$ mv backup test-failure.t
f44db7343be9 run-test: add a test for json output when -i is used Pierre-Yves David <pierre-yves.david@fb.com> parents: 24811 diff changeset	1346
24811 a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1347	backslash on end of line with glob matching is handled properly
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1348
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1349	$ cat > test-glob-backslash.t << EOF
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1350	> $ echo 'foo bar \\'
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1351	> foo * \ (glob)
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1352	> EOF
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1353
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1354	$ rt test-glob-backslash.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1355	running 1 tests using 1 parallel processes
24811 a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1356	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1357	# Ran 1 tests, 0 skipped, 0 failed.
24811 a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1358
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1359	$ rm -f test-glob-backslash.t
a2dcf460e141 run-tests: don't error when glob matched line ends with backslash Gregory Szorc <gregory.szorc@gmail.com> parents: 24507 diff changeset	1360
31673 6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1361	Test globbing of local IP addresses
29518 348b2b9da703 run-tests: add support for using 127.0.0.1 as a glob Augie Fackler <raf@durin42.com> parents: 29280 diff changeset	1362	$ echo 172.16.18.1
31673 6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1363	$LOCALIP (glob)
6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1364	$ echo dead:beef::1
6a2959acae1a runtests: change local IP glob pattern from "127.0.0.1" to "$LOCALIP" Jun Wu <quark@fb.com> parents: 29518 diff changeset	1365	$LOCALIP (glob)
29518 348b2b9da703 run-tests: add support for using 127.0.0.1 as a glob Augie Fackler <raf@durin42.com> parents: 29280 diff changeset	1366
38616 c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1367	Add support for external test formatter
c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1368	=======================================
c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1369
47584 ee1fc8f970e6 run-tests: introduce a `HGTEST_REAL_HG` variable for test Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47583 diff changeset	1370	$ CUSTOM_TEST_RESULT=basic_test_result "$PYTHON" $TESTDIR/run-tests.py --with-hg=$HGTEST_REAL_HG -j1 "$@" test-success.t test-failure.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1371	running 2 tests using 1 parallel processes
38616 c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1372
c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1373	# Ran 2 tests, 0 skipped, 0 failed.
38621 f4a214300957 run-tests: add missing life-cycle methods on the example custom test result Boris Feld <boris.feld@octobus.net> parents: 38616 diff changeset	1374	ON_START! <__main__.TestSuite tests=[<__main__.TTest testMethod=test-failure.t>, <__main__.TTest testMethod=test-success.t>]>
38616 c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1375	FAILURE! test-failure.t output changed
c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1376	SUCCESS! test-success.t
38621 f4a214300957 run-tests: add missing life-cycle methods on the example custom test result Boris Feld <boris.feld@octobus.net> parents: 38616 diff changeset	1377	ON_END!
38616 c44ae5997869 run-tests: add support for external test result Boris Feld <boris.feld@octobus.net> parents: 38554 diff changeset	1378
25728 905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1379	Test reusability for third party tools
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1380	======================================
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1381
47572 da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1382	$ THISTESTDIR="$TESTDIR"
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1383	$ export THISTESTDIR
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1384	$ THISTESTTMP="$TESTTMP"
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1385	$ export THISTESTTMP
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1386
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1387	#if windows
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1388
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1389	$ NEWTESTDIR="$THISTESTTMP"\\anothertests
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1390
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1391	#else
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1392
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1393	$ NEWTESTDIR="$THISTESTTMP"/anothertests
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1394
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1395	#endif
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1396
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1397	$ export NEWTESTDIR
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1398
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1399	$ echo creating some new test in: $NEWTESTDIR
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1400	creating some new test in: $TESTTMP\anothertests (windows !)
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1401	creating some new test in: $TESTTMP/anothertests (no-windows !)
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1402	$ mkdir "$NEWTESTDIR"
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1403	$ cd "$NEWTESTDIR"
25728 905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1404
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1405	test that `run-tests.py` can execute hghave, even if it runs not in
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1406	Mercurial source tree.
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1407
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1408	$ cat > test-hghave.t <<EOF
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1409	> #require true
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1410	> $ echo foo
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1411	> foo
905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1412	> EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1413	$ rt test-hghave.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1414	running 1 tests using 1 parallel processes
25728 905c32321cfb run-tests.py: execute hghave by the path relative to run-tests.py FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25472 diff changeset	1415	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1416	# Ran 1 tests, 0 skipped, 0 failed.
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1417
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1418	test that RUNTESTDIR refers the directory, in which `run-tests.py` now
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1419	running is placed.
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1420
47572 da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1421
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1422	$ cat > test-runtestdir.t <<EOF
47572 da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1423	> # \$THISTESTDIR, in which test-run-tests.t (this test file) is placed
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1424	> # \$THISTESTTMP, in which test-run-tests.t (this test file) is placed
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1425	> # \$TESTDIR, in which test-runtestdir.t is placed (expanded at runtime)
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1426	> # \$RUNTESTDIR, in which run-tests.py is placed (expanded at runtime)
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1427	>
47572 da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1428	> $ test "\$TESTDIR" = "\$NEWTESTDIR"
35387 c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35241 diff changeset	1429	> If this prints a path, that means RUNTESTDIR didn't equal
47572 da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1430	> THISTESTDIR as it should have.
da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1431	> $ test "\$RUNTESTDIR" = "\$THISTESTDIR" \|\| echo "\$RUNTESTDIR"
35387 c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35241 diff changeset	1432	> This should print the start of check-code. If this passes but the
c0c6df81c9bb tests: add some commentary and diagnostics to test-run-tests.t Augie Fackler <augie@google.com> parents: 35241 diff changeset	1433	> previous check failed, that means we found a copy of check-code at whatever
47572 da497189a93a test-run-test: use explicit variables to clarify paths Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47564 diff changeset	1434	> RUNTESTSDIR ended up containing, even though it doesn't match THISTESTDIR.
45830 c102b704edb5 global: use python3 in shebangs Gregory Szorc <gregory.szorc@gmail.com> parents: 45407 diff changeset	1435	> $ head -n 3 "\$RUNTESTDIR"/../contrib/check-code.py \| sed 's@.!.*python3@#!USRBINENVPY@'
32937 7fe1f9785c75 tests: sed away python #! in test-run-tests.t to avoid some upcoming insanity Augie Fackler <augie@google.com> parents: 32720 diff changeset	1436	> #!USRBINENVPY
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1437	> #
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1438	> # check-code - a style and portability checker for Mercurial
57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1439	> EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1440	$ rt test-runtestdir.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1441	running 1 tests using 1 parallel processes
25729 57dfadc4f46c run-tests.py: add RUNTESTDIR to refer `tests` of Mercurial FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25728 diff changeset	1442	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1443	# Ran 1 tests, 0 skipped, 0 failed.
25730 c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1444
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1445	#if execbit
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1446
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1447	test that TESTDIR is referred in PATH
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1448
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1449	$ cat > custom-command.sh <<EOF
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1450	> #!/bin/sh
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1451	> echo "hello world"
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1452	> EOF
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1453	$ chmod +x custom-command.sh
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1454	$ cat > test-testdir-path.t <<EOF
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1455	> $ custom-command.sh
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1456	> hello world
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1457	> EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1458	$ rt test-testdir-path.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1459	running 1 tests using 1 parallel processes
25730 c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1460	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1461	# Ran 1 tests, 0 skipped, 0 failed.
25730 c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1462
c380d5273e91 run-tests.py: add TESTDIR to PATH if it differs from RUNTESTDIR FUJIWARA Katsunori <foozy@lares.dti.ne.jp> parents: 25729 diff changeset	1463	#endif
26109 bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1464
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1465	test support for --allow-slow-tests
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1466	$ cat > test-very-slow-test.t <<EOF
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1467	> #require slow
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1468	> $ echo pass
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1469	> pass
bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1470	> EOF
28616 ca38d993b1b6 tests: remove obsolete uses of HGTEST_RUN_TESTS_PURE timeless <timeless@mozdev.org> parents: 28596 diff changeset	1471	$ rt test-very-slow-test.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1472	running 1 tests using 1 parallel processes
26109 bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1473	s
32474 c2b7fb580794 tests: hint how to run slow tests when rejecting Kyle Lippincott <spectral@google.com> parents: 32316 diff changeset	1474	Skipped test-very-slow-test.t: missing feature: allow slow tests (use --allow-slow-tests)
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1475	# Ran 0 tests, 1 skipped, 0 failed.
27395 0622d6e134fb tests: avoid duplicate install steps in test-run-tests Matt Mackall <mpm@selenic.com> parents: 27393 diff changeset	1476	$ rt $HGTEST_RUN_TESTS_PURE --allow-slow-tests test-very-slow-test.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1477	running 1 tests using 1 parallel processes
26109 bad09bd22b6a run-tests: add support for marking tests as very slow Augie Fackler <augie@google.com> parents: 25730 diff changeset	1478	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1479	# Ran 1 tests, 0 skipped, 0 failed.
28180 2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1480
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1481	support for running a test outside the current directory
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1482	$ mkdir nonlocal
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1483	$ cat > nonlocal/test-is-not-here.t << EOF
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1484	> $ echo pass
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1485	> pass
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1486	> EOF
2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1487	$ rt nonlocal/test-is-not-here.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1488	running 1 tests using 1 parallel processes
28180 2836a43c7722 run-tests: allow run-tests.py to run tests outside current directory David R. MacIver <david@drmaciver.com> parents: 28126 diff changeset	1489	.
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1490	# Ran 1 tests, 0 skipped, 0 failed.
28596 9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1491
34969 d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1492	support for automatically discovering test if arg is a folder
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1493	$ mkdir tmp && cd tmp
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1494
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1495	$ cat > test-uno.t << EOF
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1496	> $ echo line
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1497	> line
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1498	> EOF
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1499
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1500	$ cp test-uno.t test-dos.t
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1501	$ cd ..
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1502	$ cp -R tmp tmpp
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1503	$ cp tmp/test-uno.t test-solo.t
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1504
35241 2a99c5bfea47 test-run-tests: do not rebuild hg in the test Jun Wu <quark@fb.com> parents: 35189 diff changeset	1505	$ rt tmp/ test-solo.t tmpp
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1506	running 5 tests using 1 parallel processes
34969 d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1507	.....
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1508	# Ran 5 tests, 0 skipped, 0 failed.
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1509	$ rm -rf tmp tmpp
d600bda4a3e1 run-tests: allow automatic test discovery when providing folder as argument Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34962 diff changeset	1510
34962 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1511	support for running run-tests.py from another directory
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1512	$ mkdir tmp && cd tmp
35097 fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1513
34962 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1514	$ cat > useful-file.sh << EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1515	> important command
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1516	> EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1517
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1518	$ cat > test-folder.t << EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1519	> $ cat \$TESTDIR/useful-file.sh
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1520	> important command
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1521	> EOF
a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1522
35097 fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1523	$ cat > test-folder-fail.t << EOF
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1524	> $ cat \$TESTDIR/useful-file.sh
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1525	> important commando
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1526	> EOF
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1527
34962 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1528	$ cd ..
35241 2a99c5bfea47 test-run-tests: do not rebuild hg in the test Jun Wu <quark@fb.com> parents: 35189 diff changeset	1529	$ rt tmp/test-*.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1530	running 2 tests using 1 parallel processes
35097 fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1531
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1532	--- $TESTTMP/anothertests/tmp/test-folder-fail.t
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1533	+++ $TESTTMP/anothertests/tmp/test-folder-fail.t.err
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1534	@@ -1,2 +1,2 @@
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1535	$ cat $TESTDIR/useful-file.sh
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1536	- important commando
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1537	+ important command
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1538
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1539	ERROR: test-folder-fail.t output changed
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1540	!.
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1541	Failed test-folder-fail.t: output changed
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1542	# Ran 2 tests, 0 skipped, 1 failed.
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1543	python hash seed: * (glob)
fc0f3ed071fc run-tests: outputdir also has to be changed if $TESTDIR is not $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 35069 diff changeset	1544	[1]
34962 a18eef03d879 run-tests: $TESTDIR can be something else than $PWD Matthieu Laneuville <matthieu.laneuville@octobus.net> parents: 34894 diff changeset	1545
28596 9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1546	support for bisecting failed tests automatically
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1547	$ hg init bisect
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1548	$ cd bisect
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1549	$ cat >> test-bisect.t <<EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1550	> $ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1551	> pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1552	> EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1553	$ hg add test-bisect.t
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1554	$ hg ci -m 'good'
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1555	$ cat >> test-bisect.t <<EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1556	> $ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1557	> fail
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1558	> EOF
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1559	$ hg ci -m 'bad'
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1560	$ rt --known-good-rev=0 test-bisect.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1561	running 1 tests using 1 parallel processes
28596 9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1562
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1563	--- $TESTTMP/anothertests/bisect/test-bisect.t
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1564	+++ $TESTTMP/anothertests/bisect/test-bisect.t.err
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1565	@@ -1,4 +1,4 @@
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1566	$ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1567	pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1568	$ echo pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1569	- fail
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1570	+ pass
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1571
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1572	ERROR: test-bisect.t output changed
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1573	!
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1574	Failed test-bisect.t: output changed
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1575	test-bisect.t broken by 72cbf122d116 (bad)
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1576	# Ran 1 tests, 0 skipped, 1 failed.
28596 9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1577	python hash seed: * (glob)
9949950664cd run-tests: add support for automatically bisecting test failures Augie Fackler <augie@google.com> parents: 28317 diff changeset	1578	[1]
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1579
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1580	$ cd ..
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1581
34041 40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1582	support bisecting a separate repo
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1583
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1584	$ hg init bisect-dependent
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1585	$ cd bisect-dependent
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1586	$ cat > test-bisect-dependent.t <<EOF
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1587	> $ tail -1 \$TESTDIR/../bisect/test-bisect.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1588	> pass
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1589	> EOF
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1590	$ hg commit -Am dependent test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1591
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1592	$ rt --known-good-rev=0 test-bisect-dependent.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1593	running 1 tests using 1 parallel processes
34041 40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1594
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1595	--- $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1596	+++ $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t.err
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1597	@@ -1,2 +1,2 @@
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1598	$ tail -1 $TESTDIR/../bisect/test-bisect.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1599	- pass
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1600	+ fail
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1601
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1602	ERROR: test-bisect-dependent.t output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1603	!
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1604	Failed test-bisect-dependent.t: output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1605	Failed to identify failure point for test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1606	# Ran 1 tests, 0 skipped, 1 failed.
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1607	python hash seed: * (glob)
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1608	[1]
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1609
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1610	$ rt --bisect-repo=../test-bisect test-bisect-dependent.t
35187 b4b0aed7bfaf run-tests: convert to argparse Gregory Szorc <gregory.szorc@gmail.com> parents: 35155 diff changeset	1611	usage: run-tests.py [options] [tests]
34041 40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1612	run-tests.py: error: --bisect-repo cannot be used without --known-good-rev
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1613	[2]
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1614
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1615	$ rt --known-good-rev=0 --bisect-repo=../bisect test-bisect-dependent.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1616	running 1 tests using 1 parallel processes
34041 40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1617
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1618	--- $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1619	+++ $TESTTMP/anothertests/bisect-dependent/test-bisect-dependent.t.err
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1620	@@ -1,2 +1,2 @@
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1621	$ tail -1 $TESTDIR/../bisect/test-bisect.t
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1622	- pass
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1623	+ fail
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1624
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1625	ERROR: test-bisect-dependent.t output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1626	!
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1627	Failed test-bisect-dependent.t: output changed
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1628	test-bisect-dependent.t broken by 72cbf122d116 (bad)
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1629	# Ran 1 tests, 0 skipped, 1 failed.
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1630	python hash seed: * (glob)
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1631	[1]
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1632
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1633	$ cd ..
40313c63da87 run-tests: allow bisecting a different repo Jun Wu <quark@fb.com> parents: 33934 diff changeset	1634
32622 931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1635	Test a broken #if statement doesn't break run-tests threading.
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1636	==============================================================
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1637	$ mkdir broken
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1638	$ cd broken
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1639	$ cat > test-broken.t <<EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1640	> true
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1641	> #if notarealhghavefeature
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1642	> $ false
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1643	> #endif
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1644	> EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1645	$ for f in 1 2 3 4 ; do
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1646	> cat > test-works-$f.t <<EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1647	> This is test case $f
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1648	> $ sleep 1
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1649	> EOF
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1650	> done
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1651	$ rt -j 2
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1652	running 5 tests using 2 parallel processes
32622 931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1653	....
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1654	# Ran 5 tests, 0 skipped, 0 failed.
32622 931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1655	skipped: unknown feature: notarealhghavefeature
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1656
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1657	$ cd ..
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1658	$ rm -rf broken
931bb962e0eb tests: fix run-tests when there's a bad #if in a test Augie Fackler <augie@google.com> parents: 32474 diff changeset	1659
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1660	Test cases in .t files
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1661	======================
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1662	$ mkdir cases
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1663	$ cd cases
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1664	$ cat > test-cases-abc.t <<'EOF'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1665	> #testcases A B C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1666	> $ V=B
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1667	> #if A
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1668	> $ V=A
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1669	> #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1670	> #if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1671	> $ V=C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1672	> #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1673	> $ echo $V \| sed 's/A/C/'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1674	> C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1675	> #if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1676	> $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1677	> #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1678	> #if A
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1679	> $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1680	> [1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1681	> #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1682	> #if no-C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1683	> $ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1684	> [1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1685	> #endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1686	> $ [ $V = D ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1687	> [1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1688	> EOF
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1689	$ rt
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1690	running 3 tests using 1 parallel processes
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1691	.
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1692	--- $TESTTMP/anothertests/cases/test-cases-abc.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1693	+++ $TESTTMP/anothertests/cases/test-cases-abc.t#B.err
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1694	@@ -7,7 +7,7 @@
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1695	$ V=C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1696	#endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1697	$ echo $V \| sed 's/A/C/'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1698	- C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1699	+ B
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1700	#if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1701	$ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1702	#endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1703
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1704	ERROR: test-cases-abc.t#B output changed
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1705	!.
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1706	Failed test-cases-abc.t#B: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1707	# Ran 3 tests, 0 skipped, 1 failed.
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1708	python hash seed: * (glob)
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1709	[1]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1710
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1711	--restart works
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1712
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1713	$ rt --restart
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1714	running 2 tests using 1 parallel processes
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1715
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1716	--- $TESTTMP/anothertests/cases/test-cases-abc.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1717	+++ $TESTTMP/anothertests/cases/test-cases-abc.t#B.err
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1718	@@ -7,7 +7,7 @@
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1719	$ V=C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1720	#endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1721	$ echo $V \| sed 's/A/C/'
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1722	- C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1723	+ B
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1724	#if C
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1725	$ [ $V = C ]
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1726	#endif
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1727
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1728	ERROR: test-cases-abc.t#B output changed
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1729	!.
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1730	Failed test-cases-abc.t#B: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1731	# Ran 2 tests, 0 skipped, 1 failed.
32316 7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1732	python hash seed: * (glob)
7340465bd788 run-tests: support multiple cases in .t test Jun Wu <quark@fb.com> parents: 31829 diff changeset	1733	[1]
32720 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1734
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1735	--restart works with outputdir
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1736
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1737	$ mkdir output
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1738	$ mv test-cases-abc.t#B.err output
32720 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1739	$ rt --restart --outputdir output
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1740	running 2 tests using 1 parallel processes
32720 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1741
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1742	--- $TESTTMP/anothertests/cases/test-cases-abc.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1743	+++ $TESTTMP/anothertests/cases/output/test-cases-abc.t#B.err
32720 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1744	@@ -7,7 +7,7 @@
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1745	$ V=C
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1746	#endif
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1747	$ echo $V \| sed 's/A/C/'
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1748	- C
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1749	+ B
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1750	#if C
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1751	$ [ $V = C ]
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1752	#endif
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1753
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1754	ERROR: test-cases-abc.t#B output changed
32720 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1755	!.
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1756	Failed test-cases-abc.t#B: output changed
32942 5af78c524f34 tests: remove support for warned tests Gregory Szorc <gregory.szorc@gmail.com> parents: 32937 diff changeset	1757	# Ran 2 tests, 0 skipped, 1 failed.
32720 0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1758	python hash seed: * (glob)
0cd641bfbf57 run-tests: make --restart work with output dir Siddharth Agarwal <sid0@fb.com> parents: 32718 diff changeset	1759	[1]
35069 4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1760
35536 f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1761	Test TESTCASE variable
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1762
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1763	$ cat > test-cases-ab.t <<'EOF'
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1764	> $ dostuff() {
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1765	> > echo "In case $TESTCASE"
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1766	> > }
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1767	> #testcases A B
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1768	> #if A
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1769	> $ dostuff
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1770	> In case A
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1771	> #endif
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1772	> #if B
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1773	> $ dostuff
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1774	> In case B
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1775	> #endif
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1776	> EOF
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1777	$ rt test-cases-ab.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1778	running 2 tests using 1 parallel processes
35536 f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1779	..
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1780	# Ran 2 tests, 0 skipped, 0 failed.
f04d16bef2c7 tests: make #testcase available as env var in test Martin von Zweigbergk <martinvonz@google.com> parents: 35416 diff changeset	1781
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1782	Support running a specific test case
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1783
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1784	$ rt "test-cases-abc.t#B"
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1785	running 1 tests using 1 parallel processes
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1786
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1787	--- $TESTTMP/anothertests/cases/test-cases-abc.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1788	+++ $TESTTMP/anothertests/cases/test-cases-abc.t#B.err
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1789	@@ -7,7 +7,7 @@
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1790	$ V=C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1791	#endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1792	$ echo $V \| sed 's/A/C/'
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1793	- C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1794	+ B
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1795	#if C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1796	$ [ $V = C ]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1797	#endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1798
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1799	ERROR: test-cases-abc.t#B output changed
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1800	!
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1801	Failed test-cases-abc.t#B: output changed
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1802	# Ran 1 tests, 0 skipped, 1 failed.
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1803	python hash seed: * (glob)
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1804	[1]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1805
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1806	Support running multiple test cases in the same file
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1807
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1808	$ rt test-cases-abc.t#B test-cases-abc.t#C
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1809	running 2 tests using 1 parallel processes
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1810
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1811	--- $TESTTMP/anothertests/cases/test-cases-abc.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1812	+++ $TESTTMP/anothertests/cases/test-cases-abc.t#B.err
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1813	@@ -7,7 +7,7 @@
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1814	$ V=C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1815	#endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1816	$ echo $V \| sed 's/A/C/'
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1817	- C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1818	+ B
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1819	#if C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1820	$ [ $V = C ]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1821	#endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1822
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1823	ERROR: test-cases-abc.t#B output changed
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1824	!.
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1825	Failed test-cases-abc.t#B: output changed
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1826	# Ran 2 tests, 0 skipped, 1 failed.
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1827	python hash seed: * (glob)
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1828	[1]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1829
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1830	Support ignoring invalid test cases
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1831
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1832	$ rt test-cases-abc.t#B test-cases-abc.t#D
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1833	running 1 tests using 1 parallel processes
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1834
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1835	--- $TESTTMP/anothertests/cases/test-cases-abc.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1836	+++ $TESTTMP/anothertests/cases/test-cases-abc.t#B.err
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1837	@@ -7,7 +7,7 @@
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1838	$ V=C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1839	#endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1840	$ echo $V \| sed 's/A/C/'
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1841	- C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1842	+ B
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1843	#if C
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1844	$ [ $V = C ]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1845	#endif
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1846
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1847	ERROR: test-cases-abc.t#B output changed
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1848	!
38223 b865bba56db1 run-tests: update the test case name format Boris Feld <boris.feld@octobus.net> parents: 38222 diff changeset	1849	Failed test-cases-abc.t#B: output changed
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1850	# Ran 1 tests, 0 skipped, 1 failed.
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1851	python hash seed: * (glob)
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1852	[1]
507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1853
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1854	Support running complex test cases names
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1855
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1856	$ cat > test-cases-advanced-cases.t <<'EOF'
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1857	> #testcases simple case-with-dashes casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1858	> $ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1859	> simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1860	> EOF
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1861
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1862	$ cat test-cases-advanced-cases.t
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1863	#testcases simple case-with-dashes casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1864	$ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1865	simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1866
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1867	$ rt test-cases-advanced-cases.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1868	running 3 tests using 1 parallel processes
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1869
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1870	--- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1871	+++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t#case-with-dashes.err
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1872	@@ -1,3 +1,3 @@
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1873	#testcases simple case-with-dashes casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1874	$ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1875	- simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1876	+ case-with-dashes
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1877
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1878	ERROR: test-cases-advanced-cases.t#case-with-dashes output changed
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1879	!
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1880	--- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1881	+++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t#casewith_-.chars.err
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1882	@@ -1,3 +1,3 @@
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1883	#testcases simple case-with-dashes casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1884	$ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1885	- simple
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1886	+ casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1887
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1888	ERROR: test-cases-advanced-cases.t#casewith_-.chars output changed
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1889	!.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1890	Failed test-cases-advanced-cases.t#case-with-dashes: output changed
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1891	Failed test-cases-advanced-cases.t#casewith_-.chars: output changed
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1892	# Ran 3 tests, 0 skipped, 2 failed.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1893	python hash seed: * (glob)
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1894	[1]
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1895
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1896	$ rt "test-cases-advanced-cases.t#case-with-dashes"
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1897	running 1 tests using 1 parallel processes
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1898
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1899	--- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1900	+++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t#case-with-dashes.err
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1901	@@ -1,3 +1,3 @@
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1902	#testcases simple case-with-dashes casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1903	$ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1904	- simple
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1905	+ case-with-dashes
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1906
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1907	ERROR: test-cases-advanced-cases.t#case-with-dashes output changed
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1908	!
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1909	Failed test-cases-advanced-cases.t#case-with-dashes: output changed
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1910	# Ran 1 tests, 0 skipped, 1 failed.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1911	python hash seed: * (glob)
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1912	[1]
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1913
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1914	$ rt "test-cases-advanced-cases.t#casewith_-.chars"
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1915	running 1 tests using 1 parallel processes
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1916
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1917	--- $TESTTMP/anothertests/cases/test-cases-advanced-cases.t
38823 a9a4b0fc1e5d testrunner: use "#" for "test cases" suffix in .err filename too Martin von Zweigbergk <martinvonz@google.com> parents: 38621 diff changeset	1918	+++ $TESTTMP/anothertests/cases/test-cases-advanced-cases.t#casewith_-.chars.err
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1919	@@ -1,3 +1,3 @@
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1920	#testcases simple case-with-dashes casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1921	$ echo $TESTCASE
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1922	- simple
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1923	+ casewith_-.chars
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1924
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1925	ERROR: test-cases-advanced-cases.t#casewith_-.chars output changed
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1926	!
38290 b5651ae53127 run-tests: restrict the test cases allowed characters Boris Feld <boris.feld@octobus.net> parents: 38245 diff changeset	1927	Failed test-cases-advanced-cases.t#casewith_-.chars: output changed
38245 f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1928	# Ran 1 tests, 0 skipped, 1 failed.
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1929	python hash seed: * (glob)
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1930	[1]
f2e3196a34f9 run-tests: follow-up on the test-case format Boris Feld <boris.feld@octobus.net> parents: 38223 diff changeset	1931
35069 4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1932	Test automatic pattern replacement
38222 507bdc40bb17 run-tests: add support for running specific test cases Boris Feld <boris.feld@octobus.net> parents: 37846 diff changeset	1933	==================================
35069 4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1934
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1935	$ cat << EOF >> common-pattern.py
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1936	> substitutions = [
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1937	> (br'foo-(.*)\\b',
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1938	> br'\$XXX=\\1\$'),
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1939	> (br'bar\\n',
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1940	> br'\$YYY$\\n'),
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1941	> ]
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1942	> EOF
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1943
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1944	$ cat << EOF >> test-substitution.t
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1945	> $ echo foo-12
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1946	> \$XXX=12$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1947	> $ echo foo-42
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1948	> \$XXX=42$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1949	> $ echo bar prior
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1950	> bar prior
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1951	> $ echo lastbar
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1952	> last\$YYY$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1953	> $ echo foo-bar foo-baz
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1954	> EOF
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1955
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1956	$ rt test-substitution.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1957	running 1 tests using 1 parallel processes
35069 4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1958
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1959	--- $TESTTMP/anothertests/cases/test-substitution.t
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1960	+++ $TESTTMP/anothertests/cases/test-substitution.t.err
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1961	@@ -7,3 +7,4 @@
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1962	$ echo lastbar
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1963	last$YYY$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1964	$ echo foo-bar foo-baz
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1965	+ $XXX=bar foo-baz$
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1966
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1967	ERROR: test-substitution.t output changed
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1968	!
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1969	Failed test-substitution.t: output changed
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1970	# Ran 1 tests, 0 skipped, 1 failed.
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1971	python hash seed: * (glob)
4fb489a998c9 run-tests: allow to register any arbitrary pattern for replacement Boris Feld <boris.feld@octobus.net> parents: 34969 diff changeset	1972	[1]
35189 073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1973
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1974	--extra-config-opt works
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1975
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1976	$ cat << EOF >> test-config-opt.t
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1977	> $ hg init test-config-opt
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1978	> $ hg -R test-config-opt purge
46091 af3a6900f893 run-tests: fix `HGTESTEXTRAEXTENSIONS` with py3 Matt Harbison <matt_harbison@yahoo.com> parents: 45830 diff changeset	1979	> $ echo "HGTESTEXTRAEXTENSIONS: \$HGTESTEXTRAEXTENSIONS"
af3a6900f893 run-tests: fix `HGTESTEXTRAEXTENSIONS` with py3 Matt Harbison <matt_harbison@yahoo.com> parents: 45830 diff changeset	1980	> HGTESTEXTRAEXTENSIONS: purge
35189 073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1981	> EOF
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1982
46091 af3a6900f893 run-tests: fix `HGTESTEXTRAEXTENSIONS` with py3 Matt Harbison <matt_harbison@yahoo.com> parents: 45830 diff changeset	1983	$ rt --extra-config-opt extensions.purge= \
af3a6900f893 run-tests: fix `HGTESTEXTRAEXTENSIONS` with py3 Matt Harbison <matt_harbison@yahoo.com> parents: 45830 diff changeset	1984	> --extra-config-opt not.an.extension=True test-config-opt.t
40244 1039404c5e1d run-tests: print number of tests and parallel process count Gregory Szorc <gregory.szorc@gmail.com> parents: 39707 diff changeset	1985	running 1 tests using 1 parallel processes
35189 073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1986	.
073843b5e353 run-tests: make --extra-config-opt work with Python 3 Gregory Szorc <gregory.szorc@gmail.com> parents: 35187 diff changeset	1987	# Ran 1 tests, 0 skipped, 0 failed.
42505 c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1988
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1989	Test conditional output matching
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1990	================================
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1991
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1992	$ cat << EOF >> test-conditional-matching.t
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1993	> #testcases foo bar
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1994	> $ echo richtig
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1995	> richtig (true !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1996	> $ echo falsch
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1997	> falsch (false !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1998	> #if foo
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	1999	> $ echo arthur
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2000	> arthur (bar !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2001	> #endif
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2002	> $ echo celeste
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2003	> celeste (foo !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2004	> $ echo zephir
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2005	> zephir (bar !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2006	> EOF
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2007
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2008	$ rt test-conditional-matching.t
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2009	running 2 tests using 1 parallel processes
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2010
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2011	--- $TESTTMP/anothertests/cases/test-conditional-matching.t
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2012	+++ $TESTTMP/anothertests/cases/test-conditional-matching.t#bar.err
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2013	@@ -3,11 +3,13 @@
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2014	richtig (true !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2015	$ echo falsch
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2016	falsch (false !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2017	+ falsch
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2018	#if foo
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2019	$ echo arthur
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2020	arthur $bar !$ (re)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2021	#endif
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2022	$ echo celeste
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2023	celeste $foo !$ (re)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2024	+ celeste
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2025	$ echo zephir
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2026	zephir $bar !$ (re)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2027
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2028	ERROR: test-conditional-matching.t#bar output changed
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2029	!
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2030	--- $TESTTMP/anothertests/cases/test-conditional-matching.t
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2031	+++ $TESTTMP/anothertests/cases/test-conditional-matching.t#foo.err
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2032	@@ -3,11 +3,14 @@
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2033	richtig (true !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2034	$ echo falsch
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2035	falsch (false !)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2036	+ falsch
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2037	#if foo
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2038	$ echo arthur
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2039	arthur $bar !$ (re)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2040	+ arthur
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2041	#endif
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2042	$ echo celeste
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2043	celeste $foo !$ (re)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2044	$ echo zephir
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2045	zephir $bar !$ (re)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2046	+ zephir
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2047
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2048	ERROR: test-conditional-matching.t#foo output changed
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2049	!
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2050	Failed test-conditional-matching.t#bar: output changed
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2051	Failed test-conditional-matching.t#foo: output changed
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2052	# Ran 2 tests, 0 skipped, 2 failed.
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2053	python hash seed: * (glob)
c1850798f995 run-tests: stop matching line for missing feature Pierre-Yves David <pierre-yves.david@octobus.net> parents: 41744 diff changeset	2054	[1]
47500 23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2055
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2056	Test that a proper "python" has been set up
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2057	===========================================
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2058
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2059	(with a small check-code work around)
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2060	$ printf "#!/usr/bi" > test-py3.tmp
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2061	$ printf "n/en" >> test-py3.tmp
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2062	$ cat << EOF >> test-py3.tmp
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2063	> v python3
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2064	> import sys
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2065	> print('.'.join(str(x) for x in sys.version_info))
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2066	> EOF
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2067	$ mv test-py3.tmp test-py3.py
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2068	$ chmod +x test-py3.py
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2069
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2070	(with a small check-code work around)
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2071	$ printf "#!/usr/bi" > test-py.tmp
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2072	$ printf "n/en" >> test-py.tmp
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2073	$ cat << EOF >> test-py.tmp
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2074	> v python
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2075	> import sys
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2076	> print('.'.join(str(x) for x in sys.version_info))
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2077	> EOF
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2078	$ mv test-py.tmp test-py.py
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2079	$ chmod +x test-py.py
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2080
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2081	$ ./test-py3.py
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2082	3.* (glob)
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2083	$ ./test-py.py
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2084	2.* (glob) (no-py3 !)
23f5ed6dbcb1 run-tests: stop writing a `python3` symlink pointing to python2 Pierre-Yves David <pierre-yves.david@octobus.net> parents: 47182 diff changeset	2085	3.* (glob) (py3 !)

author	pacien <pacien.trangirard@pacien.net>
	Tue, 09 Nov 2021 02:16:43 +0100
branch	stable
changeset 48313	bc04a7615c96
parent 47588	eb611ecb435c
child 48550	21c0ae0693bc
permissions	-rw-r--r--