aboutsummaryrefslogtreecommitdiffstats
path: root/lib/common_test/test
AgeCommit message (Collapse)Author
2012-12-20[common_test] Stop cover on slave node after node is terminatedSiri Hansen
Before terminating slave nodes, common_test calls cover:flush/1 to fetch data from the node without actually stopping cover on this node. If cover is not stopped for the node and a new node with the same name is started, then cover will be started on the new node. To avoid this common_test now calls cover:stop/1 after the slave node is terminated.
2012-12-18Merge branch 'maint'Siri Hansen
Conflicts: lib/common_test/test/Makefile
2012-12-12[common_test] Fix cth_surefireSiri Hansen
The following corrections/changes are done in the cth_surefire hook: * Earlier there would always be a 'properties' element under the 'testsuites' element. This would exist even if there were now 'property' element inside it. This has been changed so if there are no 'property' elements to display, then there will not be a 'properties' element either. * The XML file will now (unless other is specified) be stored in the top log directory. Earlier, the default directory would be the current working directory for the erlang node, which would mostly, but not always, be the top log directory. * The 'hostname' attribute in the 'testsuite' element would earlier never have the correct value. This has been corrected. * The 'errors' attribute in the 'testsuite' element would earlier display the number of failed testcases. This has been changed and will now always have the value 0, while the 'failures' attribute will show the number of failed testcases. * A new attribute 'skipped' is added to the 'testsuite' element. This will display the number of skipped testcases. These would earlier be included in the number of failed test cases. * The total number of tests displayed by the 'tests' attribute in the 'testsuite' element would earlier include init/end_per_suite and init/end_per_group. This is no longer the case. The 'tests' attribute will now only count "real" test cases. * Earlier, auto skipped test cases would have no value in the 'log' attribute. This is now corrected. * A new attributes 'log' is added to the 'testsuite' element. * A new option named 'url_base' is added for this hook. If this option is used, a new attribute named 'url' will be added to the 'testcase' and 'testsuite' elements. Tests are added for the ct_surefire hook.
2012-11-26Merge branch 'bjorn/ct/env-vars/OTP-10469'Björn Gustavsson
* bjorn/ct/env-vars/OTP-10469: Add support for passing environment variables in master mode Remove redundant sleep in ct_master_SUITE Test that test cases succeed Add ct_test_support:verify_events/4 which takes a node name
2012-11-23Merge branch 'maint'Björn-Egil Dahlberg
2012-11-23Update copyright yearsBjörn-Egil Dahlberg
2012-11-20Merge branch 'maint'Peter Andersson
Conflicts: lib/common_test/test/Makefile
2012-11-20Merge remote branch 'origin/peppe/common_test/group_search_r15b03' into maintPeter Andersson
* origin/peppe/common_test/group_search_r15b03: Fix problem with test case order in group specifications Finish the test suite and correct remaining bugs Implement new group search functionality OTP-10466
2012-11-20Merge branch 'maint'Peter Andersson
2012-11-19Fix problem with test case order in group specificationsPeter Andersson
2012-11-19Finish the test suite and correct remaining bugsPeter Andersson
OTP-10466
2012-11-19Implement new group search functionalityPeter Andersson
OTP-10466
2012-11-19Fix problem with config start option not accepting list of filesPeter Andersson
OTP-10495
2012-11-15Merge branch 'maint'Siri Hansen
2012-11-14[common_test] Ensure process down after ct_netconf:close_sessionSiri Hansen
OTP-10510 When starting a named netconf connection directly after stopping one with the same name, it sometimes failed with 'connection_exists'. This has been corrected.
2012-11-09Merge branch 'maint'Lukas Larsson
* maint: Fix bug where require of same name at same config would return name in use
2012-11-09Fix bug where require of same name at same config would return name in useLukas Larsson
2012-11-07Handle ct:abort_current_testcase/1 when executing parallel groupsBjörn Gustavsson
ct:abort_current_testcase/1 (which is a wrapper for the function with the same name in test_server_ctrl) would not work as expected when a group with parallel test cases was executing. Essentially, the abort_current_testcase message would be ignored until the group has finished and would then abort the end_per_group testcase for the group. Since there is no unique current testcase when a parallel group is executing, we must handle the abort_current_testcase message and return an error tuple. Also fix the bug that test_server_ctrl:abort_current_testcase/1 would always return 'ok'.
2012-11-07[common_test] Add tests for user timetraps in groupsSiri Hansen
2012-11-02Merge branch 'maint'Lukas Larsson
* maint: Skip ct_netconf tests if there is no crypto Migrate timers from test_server to ct interface Update tests to run with an oldshell emulator Move crypto check so that tc is skipped and not failed Update for new version of ppc compilation chain Verify that ebin folder of applications exists Conflicts: lib/asn1/test/asn1_SUITE.erl lib/kernel/test/interactive_shell_SUITE.erl
2012-10-31Add support for passing environment variables in master modeBjörn Gustavsson
Prototype-by: Magnus Lidén <[email protected]>
2012-10-31Remove redundant sleep in ct_master_SUITEBjörn Gustavsson
2012-10-31Test that test cases succeedBjörn Gustavsson
2012-10-31Add ct_test_support:verify_events/4 which takes a node nameBjörn Gustavsson
2012-10-30[common_test] Add test for OTP-9956Siri Hansen
OTP-9956 Test that the test suite itself can be cover compiled, and that data_dir is still set correctly.
2012-10-30[common_test] Add test suite for code coverage supportSiri Hansen
2012-10-30[common_test, test_server] Don't flush cover if cover is not runningSiri Hansen
ct_slave, ct_test_support and test_server_test_lib always called cover:flush/1 when stopping slave nodes. If cover was not running, this would cause cover_server to be started and thus test_server:is_cover/0 to return true afterwards. This has been corrected.
2012-10-30[test_server] Allow cross cover analysis when testing through common_testSiri Hansen
The cross cover analysis functionality in test_server was broken since OTP converted to running daily tests through common_test. This has been corrected.
2012-10-30[common_test] Don't stop cover before stopping slave nodeSiri Hansen
In order to avoid crash of processes that hold old code, cover is no longer stopped before slave nodes are stopped. Instead cover:flush is used which only fetches cover data from the slave. This, along with similar changes in test_server allows all common_test modules to be included in cover analysis.
2012-10-26common_test: Enable running cover on common_testBjörn Gustavsson
2012-10-23Test ct:capture/start/stop/getBjörn Gustavsson
2012-10-23Introduce ct_group_leader_SUITE that does nasty things with group leadersBjörn Gustavsson
2012-10-22Skip ct_netconf tests if there is no cryptoLukas Larsson
2012-10-11common_test: Make ct_system_error_SUITE portable to WindowsBjörn Gustavsson
On Windows, the log files are not placed under priv_dir, so we will have to retrieve the path using ct_test_support (which works fine on all platforms).
2012-10-01Merge branch 'siri/common_test/ct_snmp-tests'Siri Hansen
* siri/common_test/ct_snmp-tests: [common_test] Added tests and corrected bugs in ct_snmp OTP-10454 OTP-10434
2012-09-28[common_test] Added tests and corrected bugs in ct_snmpSiri Hansen
OTP-10454 OTP-10434 Function register_users/2, register_agents/2 and register_usm_users/2, and the corresponding unregister_*/1 functions were not executable. These are corrected/rewritten. Function update_usm_users/2 is removed, and an unregister function is added instead. Update can now be done with unregister_usm_users and then register_usm_users. Functions unregister_*/2 are added, so specific users/agents/usm users can be unregistered. Function unload_mibs/1 is added. Overriding configuration files did not work, since the files were written in priv_dir instead of in the configuration dir (priv_dir/conf). This has been corrected. Minor updates to documentation.
2012-09-27Merge branch 'dgud/ct/fix-trashed-logs/OTP-10369'Dan Gudmundsson
* dgud/ct/fix-trashed-logs/OTP-10369: [ct] Shorten testcase names Shorten testcase names [ct] Block output into single io call
2012-09-26[ct] Shorten testcase namesDan Gudmundsson
So it works on windows otherwise crashes the testrun when path is longer than 255 chars.
2012-09-24Merge branch 'siri/common_test/undefined-snmp-funcs/OTP-10088'Siri Hansen
* siri/common_test/undefined-snmp-funcs/OTP-10088: [common_test] Moved ct_snmp_SUITE into data dir and run as other ct tests [common_test] Updated (minimized) config for ct_snmp test after fixing bugs [common_test] Use ct_snmp 'agent_vsns' config value in snmp app config [common_test] Change NotifType to atom instead of string [common_test] Remove calls to undefined functions from ct_snmp [common_test] Add minor test suite for ct_snmp Conflicts: lib/common_test/test/Makefile
2012-09-21[common_test] Moved ct_snmp_SUITE into data dir and run as other ct testsSiri Hansen
2012-09-21[common_test] Updated (minimized) config for ct_snmp test after fixing bugsSiri Hansen
Bugs reported in OTP-10432 allowed the config for ct_snmp test to specify only one version for agent and manager.
2012-09-20[common_test] Add minor test suite for ct_snmpSiri Hansen
2012-09-19Teach test_server to report severe errors to common_testBjörn Gustavsson
If a severe error occurs in test_server (e.g. failing to write to log files), test_server would terminate without commont_test knowing about it. Since ct_run can now return an exit code, it is important that common_test is aware of severe problem so that it can indicate that an error has occurred.
2012-09-10Fix broken interactive modePeter Andersson
2012-08-31Update copyright yearsBjörn-Egil Dahlberg
2012-08-29Merge branch 'siri/common_test/ct_netconfc/OTP-10025' into maintSiri Hansen
* siri/common_test/ct_netconfc/OTP-10025: [common_test] Change server address from localhost to 127.0.0.1 in netconf config [common_test] Fix timing dependent bugs in test for ct_netconfc
2012-08-28[common_test] Change server address from localhost to 127.0.0.1 in netconf ↵Siri Hansen
config Tests failed with ehostunreach on some hosts since localhost could not be resolved. CT configuration file for tests of ct_netconfc is now changed to use 127.0.0.1 instead.
2012-08-27[common_test] Fix timing dependent bugs in test for ct_netconfcSiri Hansen
Some of the tests failed every now and then because an ets table in the test netconf server was updated from different processes simultaneously. Also, the same entries were used for multiple netconf sessions. This has been corrected.
2012-08-27Make sure the test can never hang when ct:break/1/2 is calledPeter Andersson
2012-08-27Merge remote branch 'origin/peppe/common_test/silent_connection_testspec' ↵Peter Andersson
into maint * origin/peppe/common_test/silent_connection_testspec: Add silent_connections term to test specification