diff options
author | Magnus Lidén <mange@erlang.org> | 2013-12-10 14:31:40 +0100 |
---|---|---|
committer | Magnus Lidén <mange@erlang.org> | 2013-12-10 14:31:40 +0100 |
commit | 458e302f61e2de36ebd49c5a5a5b984224bdce94 (patch) | |
tree | 0eaff569e08f2cd170275fb38eff8e56993ae47d /lib/test_server/doc | |
parent | 6d22d78204ca8bc8ed4beb92f6021ff3ba93a882 (diff) | |
parent | 25237481ccccd3ddfa74582dc267632ad618ba30 (diff) | |
download | otp-458e302f61e2de36ebd49c5a5a5b984224bdce94.tar.gz otp-458e302f61e2de36ebd49c5a5a5b984224bdce94.tar.bz2 otp-458e302f61e2de36ebd49c5a5a5b984224bdce94.zip |
Merge tag 'OTP_R16B03'
The R16B03 release
Conflicts:
lib/sasl/vsn.mk
Diffstat (limited to 'lib/test_server/doc')
-rw-r--r-- | lib/test_server/doc/src/notes.xml | 48 |
1 files changed, 48 insertions, 0 deletions
diff --git a/lib/test_server/doc/src/notes.xml b/lib/test_server/doc/src/notes.xml index bc83231950..d05626094a 100644 --- a/lib/test_server/doc/src/notes.xml +++ b/lib/test_server/doc/src/notes.xml @@ -32,6 +32,54 @@ <file>notes.xml</file> </header> +<section><title>Test_Server 3.6.4</title> + + <section><title>Fixed Bugs and Malfunctions</title> + <list> + <item> + <p>The way Common Test handles skipping of test cases has + been updated. In previous versions, returning + <c>{skip,Reason}</c> from a configuration function (such + as init_per_suite or init_per_group), resulted in all + affected test cases getting skipped with status + <c>auto_skipped</c>. This was inappropriate, since this + status is supposed to be used to inform that Common Test + has taken the initiative to skip something (e.g. a test + case group if init_per_group failed). Therefore, in this + version of Common Test, whenever the user skips a suite, + group, or individual test case (by means of a + configuration function or test specification term), the + affected test cases get the status <c>user_skipped</c> + instead.</p> <p>This update has meant a few changes that + may affect Common Test users in various ways: <list> + <item>The test results and statistics will be affected, + which is important to know when running regression tests + and comparing results to previous test runs.</item> + <item>Users that read or parse the textual log file + <c>suite.log</c> will notice that an auto skipped + function is now reported as <c>auto_skipped</c> rather + than <c>skipped</c> as before.</item> <item>When + <c>require</c> fails in an info function (such as suite/0 + or group/1), all affected configuration functions and + test cases are marked as <c>auto_skipped</c>.</item> + <item>If Common Test detects an error in the test suite + (such as e.g. an invalid all/0 function), all affected + configuration functions and test cases are marked as + <c>auto_skipped</c>.</item> <item>If a repeated test run + session reaches a deadline with <c>force_stop</c> + enabled, all remaining test cases are marked as + <c>auto_skipped</c> rather than <c>user_skipped</c> as + before.</item> <item>The event messages that Common Test + generates during test runs have been affected by this + update. For details see OTP-11524.</item> </list> </p> + <p> + Own Id: OTP-11305 Aux Id: OTP-11524 </p> + </item> + </list> + </section> + +</section> + <section><title>Test_Server 3.6.3</title> <section><title>Fixed Bugs and Malfunctions</title> |