From 25237481ccccd3ddfa74582dc267632ad618ba30 Mon Sep 17 00:00:00 2001 From: Erlang/OTP Date: Mon, 9 Dec 2013 20:12:33 +0100 Subject: Prepare release --- lib/common_test/doc/src/notes.xml | 120 ++++++++++++++++++++++++++++++++++++++ 1 file changed, 120 insertions(+) (limited to 'lib/common_test/doc') diff --git a/lib/common_test/doc/src/notes.xml b/lib/common_test/doc/src/notes.xml index fce5401f13..535e2b6028 100644 --- a/lib/common_test/doc/src/notes.xml +++ b/lib/common_test/doc/src/notes.xml @@ -32,6 +32,126 @@ notes.xml +
Common_Test 1.7.4 + +
Fixed Bugs and Malfunctions + + +

+ Return values from group and testcase info functions are + now properly checked, and associated test cases are auto + skipped if a return value is invalid.

+

+ Own Id: OTP-10631 Aux Id: kunagi-345 [256]

+
+ +

The way Common Test handles skipping of test cases has + been updated. In previous versions, returning + {skip,Reason} from a configuration function (such + as init_per_suite or init_per_group), resulted in all + affected test cases getting skipped with status + auto_skipped. This was inappropriate, since this + status is supposed to be used to inform that Common Test + has taken the initiative to skip something (e.g. a test + case group if init_per_group failed). Therefore, in this + version of Common Test, whenever the user skips a suite, + group, or individual test case (by means of a + configuration function or test specification term), the + affected test cases get the status user_skipped + instead.

This update has meant a few changes that + may affect Common Test users in various ways: + The test results and statistics will be affected, + which is important to know when running regression tests + and comparing results to previous test runs. + Users that read or parse the textual log file + suite.log will notice that an auto skipped + function is now reported as auto_skipped rather + than skipped as before. When + require fails in an info function (such as suite/0 + or group/1), all affected configuration functions and + test cases are marked as auto_skipped. + If Common Test detects an error in the test suite + (such as e.g. an invalid all/0 function), all affected + configuration functions and test cases are marked as + auto_skipped. If a repeated test run + session reaches a deadline with force_stop + enabled, all remaining test cases are marked as + auto_skipped rather than user_skipped as + before. The event messages that Common Test + generates during test runs have been affected by this + update. For details see OTP-11524.

+

+ Own Id: OTP-11305 Aux Id: OTP-11524

+
+ +

+ Returning {skip, Reason} from a pre_end_per_group/3 user + hook function would result in an exit in the Common Test + cth_log_redirect hook. This problem has been solved.

+

+ Own Id: OTP-11409 Aux Id: seq12446

+
+ +

+ When the netconf server did not respond to the + close-session request, the call to + ct_netconfc:close_session/2 would hang forever waiting + for the netconf client to terminate. This has been + corrected. The client will now always terminate (and take + down the connection) if the close-session request times + out.

+

+ Own Id: OTP-11478

+
+
+
+ + +
Improvements and New Features + + +

+ Fix cth_log_redirect.erl to fulfill gen_event behaviour. + Thanks to Roberto Aloi.

+

+ Own Id: OTP-11401

+
+ +

+ The first argument of the CT hook callback function + on_tc_skip/3 has been modified. When this function + is called for init_per_group or + end_per_group, the value of the first argument is + now {init_per_group,GroupName} or + {end_per_group,GroupName}.

+

+ Own Id: OTP-11523

+
+ +

The following modifications have been made to the + event messages that Common Test sends during test + execution: For the tc_auto_skip + event, the value of the Func element has changed + from end_per_group to + {end_per_group,GroupName}. When + require fails in an info function, such as suite/0 + or group/1, the init configuration function is now + reported as auto_skipped intead of skipped, + with the tc_done event. When + require fails in an info function because of a + configuration name already in use, the tc_done + event now reports the error with a tuple (of size 2) + tagged failed instead of skipped. + Please see the Event Handling chapter in the + Common Test User's Guide for reference.

+

+ Own Id: OTP-11524 Aux Id: OTP-11305

+
+
+
+ +
+
Common_Test 1.7.3
Fixed Bugs and Malfunctions -- cgit v1.2.3