aboutsummaryrefslogtreecommitdiffstats
path: root/lib/common_test/test
AgeCommit message (Collapse)Author
2015-03-06Merge branch 'maint'Peter Andersson
2015-03-06Merge remote-tracking branch ↵Peter Andersson
'origin/peppe/common_test/inconsistent_return_value' into maint * origin/peppe/common_test/inconsistent_return_value: Add tests Make it possible to skip test case by returning skipped tag OTP-12359
2015-03-06Merge branch 'maint'Peter Andersson
2015-03-06Merge remote-tracking branch 'origin/peppe/common_test/on_tc_fail_log' into ↵Peter Andersson
maint * origin/peppe/common_test/on_tc_fail_log: Modify some tests to verify that new functionality works Make it possible to print in the test case log from on_tc_* hook funcs OTP-12468
2015-02-18Merge branch 'maint'Zandra Hird
2015-02-17Modify some tests to verify that new functionality worksPeter Andersson
2015-02-11Add tests for absolute incl_dirs path and for excl_dirsRafal Studnicki
2015-01-28Add testsPeter Andersson
2014-12-29Merge branch 'lemenkov/use_os_getenv_2'Marcus Arendt
* lemenkov/use_os_getenv_2: fix missing include Start using os:getenv/2 fun Introduce os:getenv/2
2014-12-22[ct_cover] Fix paths of incl_dirs in cover specRafal Studnicki
It seems like the commit 5a3c4668908254ee930c8db2e5cf9741945f9b2b also broke the incl_dirs option and friends when given as relative paths. When a cover spec contains a relative path it is looked-up in the directory with the test results, not in the .cover file directory.
2014-12-15Start using os:getenv/2 funPeter Lemenkov
See #535 Signed-off-by: Peter Lemenkov <[email protected]>
2014-12-02Merge branch 'maint'Henrik Nord
2014-11-27[ct_telnet] Fix test case 'server_speaks'Siri Hansen
This test case simulates that the server spontaneously sends data. By changing ct_telnet:send to ct_telnet_client:send_data this simulations makes more sense - since client's buffers are not flushed. Also removed the newline at the end of "echo_no_prompt" command. Since newline is added automatically, the explicit newline at the end of the command causes a prompt to be sent which is not expected.
2014-11-27[ct_telnet] Add timestamp to telnet_server debug printoutSiri Hansen
This is the telnet server used when testing ct_telnet and friends. The telnet client itself is not changed.
2014-11-27[ct_telnet] Extend timeout in test from 1 to 2 sekSiri Hansen
This is for stabilizing test cases.
2014-11-11Merge branch 'maint'Peter Andersson
2014-11-07[ct] Add 'newline' option to send functions in ct_telnetSiri Hansen
ct_telnet by default adds a newline to all command strings before sending to the telnet server. In some situations this is not desired, for example when sending telnet command sequences (prefixed with the Interprete As Command, IAC, character). In such cases, the new option can be used. Example - send an Are Your There (AYT) sequence: ct_telnet:send(Connection, [255,246], [{newline,false}]).
2014-10-08Merge branch 'maint'Siri Hansen
2014-09-24[ct test] Explicitly unregister event receiver to avoid badargSiri Hansen
... when two tests are run within the same test case.
2014-09-23[ct_netconfc] Add optional parameters to edit-configSiri Hansen
Earlier there was no way to add optional parameters like default-operation to an edit-config request sent with ct_netconfc:edit_config/3,4, you had to use ct_netconfc:send_rpc/2,3. For simplicity and completion, a new optional argument, OptParams, is now added to the edit_config function.
2014-09-22Merge branch 'maint'Siri Hansen
2014-09-18[ct] Fix path of cover export/import filesSiri Hansen
5a3c4668 accidentially changed the base directory for cover export and import files, if given as relative paths. This commit fixes this - the files are again expected to be given relative to the directory of the cover spec file itself, or else as absolute paths.
2014-08-08Merge branch 'maint'Marcus Arendt
Conflicts: OTP_VERSION
2014-08-05Improve ct_snmp test casesRaimo Niskanen
2014-07-01[ct] Add test with netconf server on remote nodeSiri Hansen
The new test is related to support sequence seq12645. It tests that the netconf client process dies if the node hosting the netconf server terminates.
2014-06-05Improve cover analysis via common_testSiri Hansen
This addresses several bugs in common_test (ct) when using the cover analysis mechanism: In a ct test run, one can give a cover spec file which indicates that cover analysis shall be run, including a number of modules and a number of nodes. During the ct test run, multiple jobs may be started in test_server, and when the cover option is used, test_server would cover compile and analyse all given modules for each job. This commit instead allows the compilation and analysis to be explicitly ordered by ct for each test run. This way each module will only be cover compiled and analysed once. The cover log will be located in the common_test log directory (ct_run.<timestamp>), and the "Coverage log" link in each suite.log.html will point to this file. A new button is also added in the top level ct index file, which points to the cover log. This change also reduces the need of using the 'export' and 'import' options, since there is no longer any need to accumulate cover data over multiple test_server jobs. However, these options may still be used for importing and exporting cover data in order to store or accumulate data from multiple ct test runs. The 'nodes' option was earlier only used by ct to start cover on the given nodes before starting the first test_server job. After this job was completed, test_server would stop cover completely and then start it again for the next job without any knowledge of the 'nodes' options. For the next test_server jobs cover would therefore no longer be running on these nodes. Explcit calls to ct_cover:add_nodes had to be done in order to collect data through all test_server jobs. This bug has now been solved, since cover is no longer stopped between each test_server job. Finally, ct no longer stores cover data using ct_util:set_testdata. This was earlier used by ct_cover:add_nodes to make sure no node was added twice.This did, however, cause some problems when ct and cover were out of sync. ct could belive that a node was running cover and thus reject adding this node, while in reality cover had been stopped on the node (e.g. by test_server) so no cover data was collected. ct_cover:add_nodes will now instead use cover:which_nodes to check if a node is already running.
2014-05-20[ct] Add test of cover support when merge_tests=falseSiri Hansen
2014-04-16Fix problem with substring in large message getting incorrectly reversedPeter Andersson
OTP-11871
2014-04-02Document new ct_telnet logging featuresPeter Andersson
OTP-11440
2014-03-25Merge branch 'peppe/common_test/telnet_expect_timeout'Peter Andersson
* peppe/common_test/telnet_expect_timeout: Add test cases Introduce total timeout value in ct_telnet:expect/3 options OTP-11689
2014-03-22Add test casesPeter Andersson
2014-03-19Shorten default timetrap timeout for ct_master test suitePeter Andersson
2014-03-19Merge remote branch 'origin/peppe/common_test/telnet_logging_final'Peter Andersson
* origin/peppe/common_test/telnet_logging_final: Add test cases and fix some problems with logging and with the telnet client Get ct_telnet_client to print all data from server to log Change telnet logging behaviour OTP-11690
2014-03-12Update test suites and fix various remaining problemsPeter Andersson
2014-03-12Add test cases and fix some problems with logging and with the telnet clientPeter Andersson
2014-03-12Get ct_telnet_client to print all data from server to logPeter Andersson
2014-02-11Fix problem with verification for parallel groups in ct_telnet_SUITEPeter Andersson
2014-02-07Fix problem with logging exits that happen in init_per_testcasePeter Andersson
2014-01-29Add verification terms for the unix_telnet test casePeter Andersson
2014-01-28Fix remaining problems using raw telnet logging for parallel test casesPeter Andersson
2014-01-28Make it possible to use raw telnet logs in parallel test case groupsPeter Andersson
2014-01-27Implement tests for logging traffic for multiple telnet connectionsPeter Andersson
Also fix remaining problems in source code
2014-01-27Add and improve test casesPeter Andersson
Also correct some issues found during test
2014-01-27Implement new telnet logging systemPeter Andersson
2013-12-03Merge branch 'peppe/common_test/hook_skip_failure' into maintPeter Andersson
* peppe/common_test/hook_skip_failure: Fix CT hook pre_end_per_group causing crash when returning {skip,Reason} OTP-11409
2013-11-29Fix CT hook pre_end_per_group causing crash when returning {skip,Reason}Peter Andersson
OTP-11409
2013-11-29Merge branch 'siri/ct_netconfc/close_session-timeout-hangs/OTP-11478' into maintSiri Hansen
* siri/ct_netconfc/close_session-timeout-hangs/OTP-11478: [common_test] Don't hang netconf client when close-session times out
2013-11-29Merge branch 'siri/cuddle-with-tests' into maintSiri Hansen
* siri/cuddle-with-tests: [observer] Fix copy/paste error in observer_SUITE:app_file/1 [common_test] Minor corrections in test of ct_netconfc
2013-11-28Merge remote branch 'origin/peppe/common_test/change_skip_behaviour' into maintPeter Andersson
* origin/peppe/common_test/change_skip_behaviour: Modify the auto_skip report for group config funcs to include group name Fix problems with info functions and add more tests Add test cases for new and modified functionality Fix problem with suites and groups skipped from test specification Change report tag for failed init_per_testcase from skipped to auto_skipped Add tests for skipping parallel groups Correct tests cases that fail because of modified events Correct various bugs related to auto_skip and groups Change status from skip to auto_skip for config func that fails due to require Fix problem with handling Config and FW reports correctly Change skip vs auto_skip behaviour OTP-11305
2013-11-22[common_test] Minor corrections in test of ct_netconfcSiri Hansen