aboutsummaryrefslogtreecommitdiffstats
path: root/lib/common_test
AgeCommit message (Collapse)Author
2014-07-11[ct] Update runtime dependencies towards test_serverSiri Hansen
Ticket OTP-11971 introduced a runtime dependency towards test_server-3.7.1, since the interface between test_server and common_test was changed. Erroneously, the common_test.app file was not updated according to this. This has now been corrected.
2014-06-19Prepare releaseErlang/OTP
2014-06-16Merge branch 'peppe/common_test/ct_basic_html_error' into maintPeter Andersson
* peppe/common_test/ct_basic_html_error: Fix problem with mismatching html tags when running basic_html log mode OTP-11917
2014-06-16Merge branch 'peppe/common_test/ct_log_cache_error' into maintPeter Andersson
* peppe/common_test/ct_log_cache_error: Force CT log cache to rescan entries with incomplete results OTP-11988
2014-06-11Merge branch 'siri/ct-and-cover/OTP-11971' into maintSiri Hansen
* siri/ct-and-cover/OTP-11971: Improve cover analysis via common_test Change internal format of CoverInfo in test_server [ct] Add test of cover support when merge_tests=false
2014-06-05Improve cover analysis via common_testSiri Hansen
This addresses several bugs in common_test (ct) when using the cover analysis mechanism: In a ct test run, one can give a cover spec file which indicates that cover analysis shall be run, including a number of modules and a number of nodes. During the ct test run, multiple jobs may be started in test_server, and when the cover option is used, test_server would cover compile and analyse all given modules for each job. This commit instead allows the compilation and analysis to be explicitly ordered by ct for each test run. This way each module will only be cover compiled and analysed once. The cover log will be located in the common_test log directory (ct_run.<timestamp>), and the "Coverage log" link in each suite.log.html will point to this file. A new button is also added in the top level ct index file, which points to the cover log. This change also reduces the need of using the 'export' and 'import' options, since there is no longer any need to accumulate cover data over multiple test_server jobs. However, these options may still be used for importing and exporting cover data in order to store or accumulate data from multiple ct test runs. The 'nodes' option was earlier only used by ct to start cover on the given nodes before starting the first test_server job. After this job was completed, test_server would stop cover completely and then start it again for the next job without any knowledge of the 'nodes' options. For the next test_server jobs cover would therefore no longer be running on these nodes. Explcit calls to ct_cover:add_nodes had to be done in order to collect data through all test_server jobs. This bug has now been solved, since cover is no longer stopped between each test_server job. Finally, ct no longer stores cover data using ct_util:set_testdata. This was earlier used by ct_cover:add_nodes to make sure no node was added twice.This did, however, cause some problems when ct and cover were out of sync. ct could belive that a node was running cover and thus reject adding this node, while in reality cover had been stopped on the node (e.g. by test_server) so no cover data was collected. ct_cover:add_nodes will now instead use cover:which_nodes to check if a node is already running.
2014-06-03Fix problem with mismatching html tags when running basic_html log modePeter Andersson
2014-06-03Force CT log cache to rescan entries with incomplete resultsPeter Andersson
2014-05-25Fix permissions of some files in the repositoryAnthony Ramine
These files aren't supposed to be executable. For reference, the command used to find them was: git ls-files -z | xargs -0 -J % find % -type f -perm ++x
2014-05-20[ct] Add test of cover support when merge_tests=falseSiri Hansen
2014-05-02Merge remote branch 'origin/peppe/common_test/ct_comment_problem' into maintPeter Andersson
* origin/peppe/common_test/ct_comment_problem: Fix problem with comments getting lost when running parallel test cases
2014-04-30Fix problem with comments getting lost when running parallel test casesPeter Andersson
OTP-11898
2014-04-16Fix problem with send printout not being tagged with connection namePeter Andersson
2014-04-16Fix problem with substring in large message getting incorrectly reversedPeter Andersson
OTP-11871
2014-04-07Update release notesErlang/OTP
2014-04-02Document the abort_if_missing_suites functionalityPeter Andersson
OTP-11769
2014-04-02Document changes in the CT hooks API and the event message protocolPeter Andersson
OTP-11732
2014-04-02Document new ct_telnet logging featuresPeter Andersson
OTP-11440
2014-04-01Fix specs for return values in ct_netconfcSiri Hansen
Some functions in ct_netconfc which return XML data had faulty specs. These have been corrected.
2014-03-31Merge branch 'dw/common_test/run-test-typo'Björn-Egil Dahlberg
* dw/common_test/run-test-typo: Fix typo in common_test documentation for the -join_specs flag
2014-03-27Fix problem with bad match error after closePeter Andersson
2014-03-25Merge branch 'peppe/common_test/telnet_expect_timeout'Peter Andersson
* peppe/common_test/telnet_expect_timeout: Add test cases Introduce total timeout value in ct_telnet:expect/3 options OTP-11689
2014-03-25Merge branch 'peppe/common_test/cth_surefire_crash'Peter Andersson
* peppe/common_test/cth_surefire_crash: Prevent cth_surefire hook from crashing if previous hook returns fail or skip. OTP-11811
2014-03-25Merge branch 'peppe/common_test/dialyzer_warnings'Peter Andersson
* peppe/common_test/dialyzer_warnings: Update incorrect type specifications Fix code to get rid of dialyzer warnings Remove dead code
2014-03-25Merge branch 'peppe/common_test/master_test_timeout'Peter Andersson
* peppe/common_test/master_test_timeout: Shorten default timetrap timeout for ct_master test suite
2014-03-24Prevent cth_surefire hook from crashing if previous hook returns fail or skip.Peter Andersson
2014-03-24Update incorrect type specificationsPeter Andersson
2014-03-24Fix code to get rid of dialyzer warningsPeter Andersson
2014-03-22Remove dead codePeter Andersson
2014-03-22Add test casesPeter Andersson
2014-03-22Introduce total timeout value in ct_telnet:expect/3 optionsPeter Andersson
OTP-11689
2014-03-21Fix some dialyzer warnings in ct_netconfcSiri Hansen
2014-03-20Introduce runtime_dependencies in .app filesRickard Green
Most dependencies introduced are exactly the dependencies to other applications found by xref. That is, there might be real dependencies missing. There might also be pure debug dependencies listed that probably should be removed. Each application has to be manually inspected in order to ensure that all real dependencies are listed. All dependencies introduced are to application versions used in OTP 17.0. This since the previously used version scheme wasn't designed for this, and in order to minimize the work of introducing the dependencies.
2014-03-20Bump versions and ensure that all are "normal" versionsRickard Green
Ensure all are "normal" versions according to the new version scheme introduced in OTP 17.0
2014-03-19Shorten default timetrap timeout for ct_master test suitePeter Andersson
2014-03-19Merge remote branch 'origin/peppe/common_test/telnet_logging_final'Peter Andersson
* origin/peppe/common_test/telnet_logging_final: Add test cases and fix some problems with logging and with the telnet client Get ct_telnet_client to print all data from server to log Change telnet logging behaviour OTP-11690
2014-03-12Merge branch 'peppe/common_test/group_events'Peter Andersson
* peppe/common_test/group_events: Update test suites and fix various remaining problems Update event protocol and CT Hooks API Introduce group name for skipped cases in events, hooks and overview log OTP-11732
2014-03-12Update test suites and fix various remaining problemsPeter Andersson
2014-03-12Update event protocol and CT Hooks APIPeter Andersson
2014-03-12Introduce group name for skipped cases in events, hooks and overview logPeter Andersson
2014-03-12Add test cases and fix some problems with logging and with the telnet clientPeter Andersson
2014-03-12Get ct_telnet_client to print all data from server to logPeter Andersson
2014-03-12Change telnet logging behaviourPeter Andersson
OTP-11690
2014-03-05Add flag to abort test run if suites fail to compilePeter Andersson
OTP-11769
2014-02-24Merge branch 'fenollp/otp-edoc-usage-fixes'Henrik Nord
* fenollp/otp-edoc-usage-fixes: Fix edoc usage errors OTP-11702
2014-02-21Fix typo in common_test documentation for the -join_specs flagDaniel White
2014-02-18Fix library application appup filesTobias Schlager
As discussed in issue #240 *all* OTP library applications use the '.*' wildcard as up and down version. This makes library applications always up- and downgradeable. Using the wildcard version obsoletes all maintenance tasks regarding library applications' appup files. Additionally, it prevents upgrade problems caused by automatically included application dependencies when using reltool to create releases. Missing copyright headers are now consistently present.
2014-02-14Fix edoc usage errorsPierre Fenoll
Errors discovered using `erldocs`: Superfluous @hidden tag would exit edoc application; 'Multiple @spec tag': appended a @clear tag after macro condition; '@spec arity does not match': added missing argument.
2014-02-11Fix problem with verification for parallel groups in ct_telnet_SUITEPeter Andersson
2014-02-07Fix problem with logging exits that happen in init_per_testcasePeter Andersson