aboutsummaryrefslogtreecommitdiffstats
path: root/lib/common_test/test
AgeCommit message (Collapse)Author
2012-12-12[common_test] Fix cth_surefireSiri Hansen
The following corrections/changes are done in the cth_surefire hook: * Earlier there would always be a 'properties' element under the 'testsuites' element. This would exist even if there were now 'property' element inside it. This has been changed so if there are no 'property' elements to display, then there will not be a 'properties' element either. * The XML file will now (unless other is specified) be stored in the top log directory. Earlier, the default directory would be the current working directory for the erlang node, which would mostly, but not always, be the top log directory. * The 'hostname' attribute in the 'testsuite' element would earlier never have the correct value. This has been corrected. * The 'errors' attribute in the 'testsuite' element would earlier display the number of failed testcases. This has been changed and will now always have the value 0, while the 'failures' attribute will show the number of failed testcases. * A new attribute 'skipped' is added to the 'testsuite' element. This will display the number of skipped testcases. These would earlier be included in the number of failed test cases. * The total number of tests displayed by the 'tests' attribute in the 'testsuite' element would earlier include init/end_per_suite and init/end_per_group. This is no longer the case. The 'tests' attribute will now only count "real" test cases. * Earlier, auto skipped test cases would have no value in the 'log' attribute. This is now corrected. * A new attributes 'log' is added to the 'testsuite' element. * A new option named 'url_base' is added for this hook. If this option is used, a new attribute named 'url' will be added to the 'testcase' and 'testsuite' elements. Tests are added for the ct_surefire hook.
2012-11-23Update copyright yearsBjörn-Egil Dahlberg
2012-11-20Merge remote branch 'origin/peppe/common_test/group_search_r15b03' into maintPeter Andersson
* origin/peppe/common_test/group_search_r15b03: Fix problem with test case order in group specifications Finish the test suite and correct remaining bugs Implement new group search functionality OTP-10466
2012-11-19Fix problem with test case order in group specificationsPeter Andersson
2012-11-19Finish the test suite and correct remaining bugsPeter Andersson
OTP-10466
2012-11-19Implement new group search functionalityPeter Andersson
OTP-10466
2012-11-19Fix problem with config start option not accepting list of filesPeter Andersson
OTP-10495
2012-11-14[common_test] Ensure process down after ct_netconf:close_sessionSiri Hansen
OTP-10510 When starting a named netconf connection directly after stopping one with the same name, it sometimes failed with 'connection_exists'. This has been corrected.
2012-11-09Fix bug where require of same name at same config would return name in useLukas Larsson
2012-10-22Skip ct_netconf tests if there is no cryptoLukas Larsson
2012-09-10Fix broken interactive modePeter Andersson
2012-08-31Update copyright yearsBjörn-Egil Dahlberg
2012-08-29Merge branch 'siri/common_test/ct_netconfc/OTP-10025' into maintSiri Hansen
* siri/common_test/ct_netconfc/OTP-10025: [common_test] Change server address from localhost to 127.0.0.1 in netconf config [common_test] Fix timing dependent bugs in test for ct_netconfc
2012-08-28[common_test] Change server address from localhost to 127.0.0.1 in netconf ↵Siri Hansen
config Tests failed with ehostunreach on some hosts since localhost could not be resolved. CT configuration file for tests of ct_netconfc is now changed to use 127.0.0.1 instead.
2012-08-27[common_test] Fix timing dependent bugs in test for ct_netconfcSiri Hansen
Some of the tests failed every now and then because an ets table in the test netconf server was updated from different processes simultaneously. Also, the same entries were used for multiple netconf sessions. This has been corrected.
2012-08-27Make sure the test can never hang when ct:break/1/2 is calledPeter Andersson
2012-08-27Merge remote branch 'origin/peppe/common_test/silent_connection_testspec' ↵Peter Andersson
into maint * origin/peppe/common_test/silent_connection_testspec: Add silent_connections term to test specification
2012-08-27Merge branch 'lukas/common_test/deep_get_config/OTP-9626' into maintLukas Larsson
* lukas/common_test/deep_get_config/OTP-9626: Add more cross reference links to ct docs Remove config option from common_test args Update user config to use nested tuple keys
2012-08-24Add silent_connections term to test specificationPeter Andersson
2012-08-23Solve problems with verbosity levels and parallel test casesPeter Andersson
2012-08-23Merge remote branch 'origin/peppe/common_test/verbosity_level' into maintPeter Andersson
* origin/peppe/common_test/verbosity_level: Fix doc build error Implement verbosity levels and parameter for log printout importance Conflicts: lib/common_test/src/ct_logs.erl lib/common_test/src/ct_run.erl lib/common_test/src/ct_testspec.erl lib/common_test/src/ct_util.hrl lib/common_test/test/Makefile OTP-9625 OTP-10067
2012-08-23Update user config to use nested tuple keysLukas Larsson
ct:get_config and ct:require can now use nested tuples to fetch data from user configuration. E.g. ct:get_config({localhost,ip,v4}). This introduces a backwards incompatability with how names are associated with keys when using require/2. E.g. ct:require(a_name,{localhost,ip}) will associate a_name with ip instead of localhost.
2012-08-23Merge remote branch 'origin/peppe/common_test/testspec_updates' into maintPeter Andersson
* origin/peppe/common_test/testspec_updates: Test new testspec functionality and correct bugs Implement constants and new features for test specifications Conflicts: lib/common_test/src/ct_run.erl lib/common_test/test/Makefile OTP-10049 OTP-10089 OTP-10145
2012-08-23Merge remote branch 'origin/peppe/common_test/exit_status' into maintPeter Andersson
* origin/peppe/common_test/exit_status: Implement support for returning valid exit status from ct_run OTP-9865 OTP-10087
2012-08-21Test new testspec functionality and correct bugsPeter Andersson
OTP-10049 OTP-10089
2012-08-17[common_test] Move ct_netconfc_SUITE into datadir and run with ct_test_supportSiri Hansen
2012-08-17[common_test] Don't allow named (required) connection to be opened twiceSiri Hansen
Earlier, it was possible to open connection (ct_gen_conn) with the same (required) name twice, which could give unexpected results. Such attempts will now return {error,{connection_exists,OtherClient}}.
2012-08-17[common_test] Don't abort test run if connection process crashesSiri Hansen
Earlier ct_util_server would terminate and thus abort the complete test run if a connection process (ct_gen_conn) crashed. This is now changed so that ct_util will only print an error report (in the test case log) and continue the rest of the test.
2012-08-17[common_test] Add netconf client, ct_netconfcSiri Hansen
The netconf client supports basic netconf functionality over SSH. In order to allow testing of both success and failure cases, it is intentionally written to allow non-standard behavior. In order for the netconf client to use the generic connection mechanism in common_test, ct_gen_conn has been updated to be more flexible: Added options: {reconnect,bool()} {forward_messages,bool()} {use_existing_connection,bool()} Allow handle_msg to return {reply,Reply,State} | {noreply,State} | {stop,Reply,State} If forward_messages==true, the ct_gen_conn callback must also implement: handle_msgs(Msg,State) -> {noreply,State} | {stop,State}
2012-07-13Implement verbosity levels and parameter for log printout importancePeter Andersson
2012-06-05Update to work with whitespace in exec pathLukas Larsson
OTP-10106 OTP-10107
2012-05-15Implement support for returning valid exit status from ct_runPeter Andersson
Also change the return value of the ct:run_test/1 function. OTP-9865 OTP-10087
2012-03-30Update copyright yearsBjörn-Egil Dahlberg
2012-03-27Merge remote branch 'origin/peppe/common_test/otp-10022' into maintPeter Andersson
* origin/peppe/common_test/otp-10022: Fix problem with wrong data_dir sent to hooks if init_per_* is missing
2012-03-26Fix problem with wrong data_dir sent to hooks if init_per_* is missingPeter Andersson
2012-03-26Increase test margin for user timetrapsPeter Andersson
2012-03-26Merge remote branch 'origin/peppe/common_test/otp-9988_9871.merged' into maintPeter Andersson
* origin/peppe/common_test/otp-9988_9871.merged: Fix various problems with the user timetrap implementation Fix dialyzer reported errors Implement support for user controlled timetraps OTP-9988
2012-03-21Update ct_master to use the Common Test CSS file for the logsPeter Andersson
OTP-9973
2012-03-21Implement support for user controlled timetrapsPeter Andersson
OTP-9988
2012-03-19Fix error with group config deleted before post_end_per_groupPeter Andersson
OTP-9989 Also improve ct_hooks test suite.
2012-03-19Introduce new test suite for CTHsPeter Andersson
2012-03-19Use calls to ct_framework:init/end_per_suite for configurationPeter Andersson
Now that calls to ct_framework:init/end_per_suite take place whenever init/end_per_suite is missing in the test suite, these calls should trigger init/end_tc to perform configuration (such as calling calling CTH functions, suite/0, etc).
2012-03-19Change ct_init/end_per_group to init/end_per_groupPeter Andersson
OTP-9986
2012-03-15Merge remote branch 'origin/peppe/common_test/otp-9666' into maintPeter Andersson
* origin/peppe/common_test/otp-9666: Set correct group leader for end_per_testcase process after tc timeout OTP-9666
2012-03-14Set correct group leader for end_per_testcase process after tc timeoutPeter Andersson
Also make sure that warnings about failure or timeout of end_per_testcase (after a test case timeout) get printed in the test case log file. OTP-9666
2012-03-13Change the option name 'unique_priv_dir' to 'create_priv_dir'Peter Andersson
The new values for create_priv_dir are: auto_per_run, auto_per_tc, manual_per_tc
2012-03-13Add test suite for the unique_priv_dir featurePeter Andersson
2012-03-13Make it possible to use unique priv_dir namesPeter Andersson
Introduce the optional feature to have Test Server generate priv_dir directory names that are unique for each test case or config function. The name of the option/flag is 'unique_priv_dir' and it can be set to value 'auto' or 'manual'. If auto, Test Server creates each priv_dir automatically (can be expensive in case of many and/or repeated cases). If manual, the user needs to create the priv_dir explicitly by calling ct:make_priv_dir/0.
2012-03-13Merge remote branch 'origin/peppe/common_test/otp-9958' into maintPeter Andersson
* origin/peppe/common_test/otp-9958: Fix problem with dropped suite- and test case names OTP-9958
2012-03-06Add missing test suitePeter Andersson