aboutsummaryrefslogtreecommitdiffstats
path: root/lib/test_server/src
AgeCommit message (Collapse)Author
2014-08-26Install internal hrl files when necessaryPeter Lemenkov
Sometimes we install *.erl files. Some these files include a private *.hrl files, so in order to make these *.erl files usable we have to install these private includes as well. Signed-off-by: Peter Lemenkov <[email protected]>
2014-06-17Merge branch 'siri/ct-and-cover/OTP-11971' into maintSiri Hansen
* siri/ct-and-cover/OTP-11971: [test_server] Fix bug introduced in 5a3c466
2014-06-16[test_server] Fix bug introduced in 5a3c466Siri Hansen
This was detected by dialyzer - an '=' character too much had erronously been inserted.
2014-06-16Merge branch 'peppe/common_test/ct_basic_html_error' into maintPeter Andersson
* peppe/common_test/ct_basic_html_error: Fix problem with mismatching html tags when running basic_html log mode OTP-11917
2014-06-05Improve cover analysis via common_testSiri Hansen
This addresses several bugs in common_test (ct) when using the cover analysis mechanism: In a ct test run, one can give a cover spec file which indicates that cover analysis shall be run, including a number of modules and a number of nodes. During the ct test run, multiple jobs may be started in test_server, and when the cover option is used, test_server would cover compile and analyse all given modules for each job. This commit instead allows the compilation and analysis to be explicitly ordered by ct for each test run. This way each module will only be cover compiled and analysed once. The cover log will be located in the common_test log directory (ct_run.<timestamp>), and the "Coverage log" link in each suite.log.html will point to this file. A new button is also added in the top level ct index file, which points to the cover log. This change also reduces the need of using the 'export' and 'import' options, since there is no longer any need to accumulate cover data over multiple test_server jobs. However, these options may still be used for importing and exporting cover data in order to store or accumulate data from multiple ct test runs. The 'nodes' option was earlier only used by ct to start cover on the given nodes before starting the first test_server job. After this job was completed, test_server would stop cover completely and then start it again for the next job without any knowledge of the 'nodes' options. For the next test_server jobs cover would therefore no longer be running on these nodes. Explcit calls to ct_cover:add_nodes had to be done in order to collect data through all test_server jobs. This bug has now been solved, since cover is no longer stopped between each test_server job. Finally, ct no longer stores cover data using ct_util:set_testdata. This was earlier used by ct_cover:add_nodes to make sure no node was added twice.This did, however, cause some problems when ct and cover were out of sync. ct could belive that a node was running cover and thus reject adding this node, while in reality cover had been stopped on the node (e.g. by test_server) so no cover data was collected. ct_cover:add_nodes will now instead use cover:which_nodes to check if a node is already running.
2014-06-03Fix problem with mismatching html tags when running basic_html log modePeter Andersson
2014-05-20Change internal format of CoverInfo in test_serverSiri Hansen
This is in preparation of a future change of the cover API between common_test and test_server.
2014-05-09Merge branch 'siri/cuddle-with-tests' into maintSiri Hansen
* siri/cuddle-with-tests: Fix regexp in release_handler test so versions are correctly replaced Update kernel, stdlib and sasl appup tests Minor update to test_server for finding old releases
2014-04-30Fix problem with comments getting lost when running parallel test casesPeter Andersson
OTP-11898
2014-04-22Minor update to test_server for finding old releasesSiri Hansen
This is valid internal in OTP test environment only Links starting with 'otp_beam_linux_' are removed.
2014-03-26Merge branch 'dgud/test_server/throw_skip'Dan Gudmundsson
* dgud/test_server/throw_skip: test_server: Allow init_per_ function to throw skip
2014-03-20Introduce runtime_dependencies in .app filesRickard Green
Most dependencies introduced are exactly the dependencies to other applications found by xref. That is, there might be real dependencies missing. There might also be pure debug dependencies listed that probably should be removed. Each application has to be manually inspected in order to ensure that all real dependencies are listed. All dependencies introduced are to application versions used in OTP 17.0. This since the previously used version scheme wasn't designed for this, and in order to minimize the work of introducing the dependencies.
2014-03-20test_server: Fix a Dialyzer warningHans Bolinder
2014-03-19Merge remote branch 'origin/peppe/common_test/telnet_logging_final'Peter Andersson
* origin/peppe/common_test/telnet_logging_final: Add test cases and fix some problems with logging and with the telnet client Get ct_telnet_client to print all data from server to log Change telnet logging behaviour OTP-11690
2014-03-12Merge branch 'peppe/common_test/group_events'Peter Andersson
* peppe/common_test/group_events: Update test suites and fix various remaining problems Update event protocol and CT Hooks API Introduce group name for skipped cases in events, hooks and overview log OTP-11732
2014-03-12Update test suites and fix various remaining problemsPeter Andersson
2014-03-12Update event protocol and CT Hooks APIPeter Andersson
2014-03-12Introduce group name for skipped cases in events, hooks and overview logPeter Andersson
2014-03-12Merge branch 'peppe/common_test/test_server_enoent_crash'Peter Andersson
* peppe/common_test/test_server_enoent_crash: Add more info to file open failure
2014-03-12Merge branch 'peppe/common_test/auto_compile_flag'Peter Andersson
* peppe/common_test/auto_compile_flag: Add flag to abort test run if suites fail to compile OTP-11769
2014-03-12Add ts:run/5 function to run specific test case(s) in a groupPeter Andersson
2014-03-12Add test cases and fix some problems with logging and with the telnet clientPeter Andersson
2014-03-12test_server: Allow init_per_ function to throw skipDan Gudmundsson
Allow all init_per_[suite|group|testcase] to throw (or exit) {skip, Reason} to explicitly ignore tests without failing. It is easier to catch it in one place instead of writing a try in each init_per_* to return {skip, Reason}.
2014-03-06Add more info to file open failurePeter Andersson
2014-03-05Add flag to abort test run if suites fail to compilePeter Andersson
OTP-11769
2014-02-24Merge branch 'schlagert/fix_basic_appups'Siri Hansen
* schlagert/fix_basic_appups: Dynamically configure typer_SUITE according to environment Disable hipe_SUITE when environment doesn't support it Make hipe non-upgradable by setting appup file empty Fix missing module on hipe app file template Add test suites performing app and appup file checks Introduce appup test utility Fix library application appup files Fix non-library appup files according to issue #240 OTP-11744
2014-02-24Introduce appup test utilityTobias Schlager
This adds a test function similar to the app file test function existing in test_server. The code is mostly taken from the asn1, snmp and inets test suites. Low-level upgrade instruction checking is stripped. Library application's appup files get specialized treatment, since their content is almost static.
2014-02-19Merge branch 'sverk/test_server/openbsd-dynlink'Sverker Eriksson
* sverk/test_server/openbsd-dynlink: erts: Skip driver_SUITE:thr_free_drv for VM without threads erts: Fix driver_SUITE:otp_9302 for VM without threads test_server: Fix dynlib link command for openbsd
2014-02-18Fix library application appup filesTobias Schlager
As discussed in issue #240 *all* OTP library applications use the '.*' wildcard as up and down version. This makes library applications always up- and downgradeable. Using the wildcard version obsoletes all maintenance tasks regarding library applications' appup files. Additionally, it prevents upgrade problems caused by automatically included application dependencies when using reltool to create releases. Missing copyright headers are now consistently present.
2014-02-17Merge branch 'peppe/common_test/parallel_tc_problem'Peter Andersson
* peppe/common_test/parallel_tc_problem: Fix problem with parallel test cases getting identical log file names OTP-11644
2014-02-13Fix problem with parallel test cases getting identical log file namesPeter Andersson
2014-02-13test_server: Allow cover to run on itselfBjörn Gustavsson
2014-02-07Fix problem with logging exits that happen in init_per_testcasePeter Andersson
2014-02-04test_server: Fix dynlib link command for openbsdSverker Eriksson
The old command failed with unresolved symbol __guard_local
2014-02-04Add more Common Test start arguments to the ts run interfacePeter Andersson
2014-01-27Implement new telnet logging systemPeter Andersson
2014-01-21test_server: Fix ts write unicode in config filesDan Gudmundsson
2014-01-16Teach ts_install --enable-mXX-build flagRickard Green
Pick up --enable-m32-build and --enable-m64-build configure flags from the CONFIG_FLAGS environment variable and pass along to the ts configure script.
2013-12-20Merge branch 'dgud/remove-gs-apps/OTP-10915'Dan Gudmundsson
2013-11-28Merge branch 'maint'Peter Andersson
2013-11-28Merge remote branch 'origin/peppe/common_test/change_skip_behaviour' into maintPeter Andersson
* origin/peppe/common_test/change_skip_behaviour: Modify the auto_skip report for group config funcs to include group name Fix problems with info functions and add more tests Add test cases for new and modified functionality Fix problem with suites and groups skipped from test specification Change report tag for failed init_per_testcase from skipped to auto_skipped Add tests for skipping parallel groups Correct tests cases that fail because of modified events Correct various bugs related to auto_skip and groups Change status from skip to auto_skip for config func that fails due to require Fix problem with handling Config and FW reports correctly Change skip vs auto_skip behaviour OTP-11305
2013-11-19Modify the auto_skip report for group config funcs to include group namePeter Andersson
Also correct failing test cases and find and fix remaining bugs.
2013-11-18Fix problems with info functions and add more testsPeter Andersson
2013-11-18Add test cases for new and modified functionalityPeter Andersson
2013-11-18Fix problem with suites and groups skipped from test specificationPeter Andersson
2013-11-18Change report tag for failed init_per_testcase from skipped to auto_skippedPeter Andersson
2013-11-18Correct tests cases that fail because of modified eventsPeter Andersson
2013-11-18Correct various bugs related to auto_skip and groupsPeter Andersson
2013-11-18Change status from skip to auto_skip for config func that fails due to requirePeter Andersson
2013-11-07Remove references to removed applicationsDan Gudmundsson