Age | Commit message (Collapse) | Author |
|
The following bugs are corrected:
- if init_per_suite is exported from a test suite, but not
end_per_suite, then pre/post_end_per_suite will be called with
Suite=ct_framework instead of the correct suite name.
- if end_per_group is exported from a suite, but not init_per_group,
then end_per_group is never called.
According to the documentation, if implementing an init config
function, you must also implement the end config function, so the two
scenarios above are really not allowed. To make this more visible,
common_test will now mark the non-exported config function as failed
with reason 'undef' if the other function is exported.
For example, if init_per_suite is exported, but not end_per_suite,
then end_per_suite will be marked as failed with reason undef. (If
none of them exist, then they will both be marked as passed since the
default functions in ct_framework are called instead.)
All hook functions are always called with the correct suite name,
i.e. never with Suite=ct_framework.
Conflicts:
lib/common_test/test/ct_hooks_SUITE.erl
|
|
An extra argument, Suite, is added as the first argument to each of
the following hook callback functions:
- pre_init_per_group
- post_init_per_group
- pre_end_per_group
- post_end_per_group
- pre_init_per_testcase
- post_init_per_testcase
- pre_end_per_testcase
- post_end_per_testcase
- on_tc_fail
- on_tc_skip
For backwards compatibility, if the new function is not exported from
a hook callback module, common_test will fall back to the old
interface and call the function without the Suite argument.
The reason for adding the new argument is that if a test suite is
skipped by a 'skip_suites' statement in the test specification, then
there will be no call to pre/post_init_per_suite, and thus the hook
has no other way of knowing which Suite is skipped when it gets the
on_tc_skip callback. The other callbacks are updated for symmetry.
|
|
If CtHook:pre_init_per_testcase(...,end_per_testcase,...) failed, then
the ct_framework:end_tc would fail with function_clause. This is now
corrected.
|
|
* egil/cuddle-tests:
stdlib: Increase timetrap for rand_SUITE
common_test: Increase timetrap for cth_hooks_SUITE
compiler: Increase timetrap timeouts for lc_SUITE
|
|
|
|
|
|
|
|
|
|
OTP-14026
|
|
|
|
OTP-14044
|
|
* valgrind needs a lot of time
|
|
|
|
|
|
|
|
|
|
|
|
* lukas/ts/no_flush_on_halt:
ts: Don't flush port when ending test run
|
|
Fix some older errors as well.
|
|
epp learned to handle the -warning() directive in 14d72f02, but
make and ct_make were not updated to expect a {warning,_} return
value from epp:parse_erl_form/1.
|
|
Conflicts:
OTP_VERSION
erts/doc/src/notes.xml
erts/vsn.mk
lib/common_test/doc/src/notes.xml
lib/common_test/vsn.mk
lib/ssl/doc/src/notes.xml
lib/ssl/src/ssl.appup.src
lib/ssl/vsn.mk
lib/stdlib/test/ets_SUITE.erl
otp_versions.table
|
|
|
|
OTP-13730
|
|
|
|
Netconf client tests fail every now and then with
'table_trans_timeout' with no obvious reason. A monitor of the maint
netconf server process is now added - in case this process crashes
during the transaction.
|
|
Sometimes there are hanging ports left after a test run,
we don't want the emulator to be left haning if that happens
after a test run.
|
|
Tests using system time can be skipped on test hosts set up to do a
lot of time warps.
|
|
|
|
The ssh application is not installed on all test hosts. Catching the
call to ssh:start/0 allows the the netconf tests to be nicely skipped
if ssh does not exist.
|
|
* siri/cuddle-master:
Add short sleep when killing slave nodes
[ct test] Do reload_config instead of get_config
|
|
* zandra/ct-dialyzer:
ct_master_logs: Fix faulty error match
|
|
|
|
* peppe/common_test/OTP-13615:
Fix problem with incorrect type of timestamps
OTP-13615
|
|
OTP-13615
|
|
* zandra/common_test/ct-reload_config-doc:
Update ct:reload_config docs since {error, Reason} can be returned
|
|
* zandra/common_test/fix-ct_logs-crash-bug:
Avoid crash when monitored ct_logs process is not responding
|
|
|
|
The test case config_dynamic_SUITE:test_localtime_update sometimes
failed on slow machines, since the initial value of 'localtime' is
fetched with ct:get_config instead of ct:reload_config. The value is
then from the test run start, not from the time of the ct:get_config
call. This is now corrected.
|
|
* siri/cuddle-master:
[ct test] Wait for event receiver to be unregistered
[ct test] Flush messages from old client after close in telnet server
[ct test] Use monitor instead of ct:sleep
[ct test] Check that crypto is loaded, or skip netconf tests
[ct test] Reduce amount of data in netconfc1_SUITE:get_a_lot
|
|
* zandra/common_test/unmatched_returns/OTP-13345: (23 commits)
ct logs: Fix unmatched_return warnings
ct_util: Fix unmatched_return warnings
erl2html2: Fix unmatched_return warnings
cth_conn_log: Fix unmatched_return warnings
ct_webtool: Fix unmatched_return warnings
ct_telnet: Fix unmatched_return warnings
ct_ssh: Fix unmatched_return warnings
ct_snmp: Fix unmatched_return warnings
ct_slave: Fix unmatched_return warnings
ct_rpc: Fix unmatched_return warnings
ct_repeat: Fix unmatched_return warnings
ct_release_test: Fix unmatched_return warnings
ct_property_test: Fix unmatched_return warnings
ct_master: Fix unmatched_return warnings
ct_hooks_lock: Fix unmatched_return warnings
ct_hooks: Fix unmatched_return warnings
ct_groups: Fix unmatched_return warnings
ct_ftp: Fix unmatched_return warnings
ct_framework: Fix unmatched_return warnings
ct_config: Fix unmatched_return warnings
...
|
|
|
|
To avoid badarg when two tests are run within the same test case.
|
|
Since the same erlang process is used for subsequent telnet
connections, messages from old clients must be flushed after close.
|
|
ct_gen_conn_SUITE_data/conn_SUITE.erl uses a lot of ct:sleep(100) when
waiting for processes to exit. This commit removes all the sleeps and
introducess monitor instead.
|
|
Tests for ct_netconfc are failed instead of skipped if crypto can not
be loaded. This is now corrected.
|
|
This test case often fails with table_trans_timeout in the netconf
server (ns.erl) on slow machines. The amount of data was originally
reduced by commit 976214f8d738d4852348496df79f84264d899aba, but was
faulty reverted by commit 171d7e2a161ef9270240aff0fa15a285df21c1ef. It
is now reduced again...
|
|
|
|
* zandra/test_server/unmatched_returns/OTP-13345:
vts - Fix unmatched_return warnings
test_server_sup - Fix unmatched_return warnings
test_server_node - Fix unmatched_return warnings
test_server_io - Fix unmtached_return warnings
test_server_gl - Fix unmatched_return warnings
test_server_ctrl - Fix unmatched_return warnings
test_server - fix unmatched_return warnings
remove unused purify functions
|
|
* peppe/common_test/log_tests:
Write suite that tests the API for printing to log
|
|
* peppe/common_test/fix_failing_tests:
Make sure test node shuts down before skipping suite
Measure file i/o overhead and skip test if the speed is too slow
Skip test cases if cover or debug is running
|