aboutsummaryrefslogtreecommitdiffstats
path: root/lib/test_server/src
AgeCommit message (Collapse)Author
2011-02-17Merge branch 'lukas/common_test/updates_needed_before_migration/OTP-8768' ↵Lukas Larsson
into dev * lukas/common_test/updates_needed_before_migration/OTP-8768: Update ts to take the config path as an invironmental and as a variables passed with all_tests and also with the normal run Update TEST_SERVER_FRAMEWORK os variable to be regarded as undet if set to undefined Fix bug with subgroups after introduction of remote groups Rename Suite Callback to Common Test Hook Update so that cover is skipper for applications without a .cover file Update minimal build target to include runtime_tools and common_test Update ts to start common test with both ts.config and ts.PLATFORM.config Update ts scb to add nodenames in all pre_init clauses Add release/tests/test_server to path Add ts_install_scb which is a common_test SCB that handles making of test modules. Update ts to work with common test instead of test_server Add kill_slavenodes/0 as an exported function Change format of remote groups to {group, Module, GroupName}, note that this is an unsupported feature Add possibility to get all testdata Fix bug when groups refer to groups in the groups/0 function Add support for external groups. Refactor code to make it easier to debug Update so that when asking for os and we are in the test_server_ctrl process, just use os:type(). Fix so that groups can return external test cases, i.e.
2011-02-16Update ts to take the config path as an invironmental and as a variables ↵Lukas Larsson
passed with all_tests and also with the normal run
2011-02-16Update TEST_SERVER_FRAMEWORK os variable to be regarded as undet if set to ↵Lukas Larsson
undefined
2011-02-09Rename Suite Callback to Common Test HookLukas Larsson
2011-01-24Update so that cover is skipper for applications without a .cover fileLukas Larsson
2011-01-24Update ts to start common test with both ts.config and ts.PLATFORM.configLukas Larsson
2011-01-24Update ts scb to add nodenames in all pre_init clausesLukas Larsson
2011-01-24Add release/tests/test_server to pathLukas Larsson
2011-01-24Add ts_install_scb which is a common_test SCB that handles making of test ↵Lukas Larsson
modules.
2011-01-24Update ts to work with common test instead of test_serverLukas Larsson
2011-01-24Add kill_slavenodes/0 as an exported functionLukas Larsson
2010-12-08Update ct_framework calls to allow manipulation of test results in end_tc ↵Lukas Larsson
without breaking backwards compatability (I hope)
2010-12-08Update end_tc fw call to get {skip,Reason} instead of 'skipped' as return valueLukas Larsson
2010-12-08Update framework callbacks to use end_tc/4 if available. end_tc/4 can return ↵Lukas Larsson
anything which init_tc/3 can, and also modify the COnfig variable when called from init_per_suite and init_per_group
2010-12-06Update so that when asking for os and we are in the test_server_ctrl ↵Lukas Larsson
process, just use os:type().
2010-09-30ts_install: Identify the halfword emulatorBjörn Gustavsson
2010-09-10Remove warnings for clashes with new autoimported BIFsPatrik Nyblom
2010-09-10Merge branch 'peppe/common_test/dev/OTP-8805' into devLukas Larsson
* peppe/common_test/dev/OTP-8805: Fix problem with {fail,Result} from end_tc not being recognized Fix problem with prepared_tests tuple not being recognized Add verification terms to test suite Fix various test suite, makefile, and doc related problems Fix error in the repeat_until_* group property handling
2010-09-10Merge branch 'peppe/common_test/dev/OTP-8753' into devLukas Larsson
* peppe/common_test/dev/OTP-8753: Fix problem with prepared_tests tuple not being recognized Add verification terms to test suite Fix various test suite, makefile, and doc related problems Fix error in the repeat_until_* group property handling Add test suite for groups with repeat property Add verification events to sequence group test suite Fix error in handling of sequence groups Fix error in test suite Fix problems with sequences and sub-groups Add test cases to sequence suite Fix error with group term in ct:run_test/1 Add test suite to examplify problem with nested groups in a sequence
2010-09-06Fix error in the repeat_until_* group property handlingPeter Andersson
2010-09-02Fix problem with {fail,Result} from end_tc not being recognizedPeter Andersson
2010-09-02Fix error in handling of sequence groupsPeter Andersson
2010-09-02Fix error in the repeat_until_* group property handlingPeter Andersson
2010-09-02Fix problems with sequences and sub-groupsPeter Andersson
Getting sequences to work properly when a sub-group fails in init_per_group has been unsuccessful (see tests in ct_sequence_1_SUITE). Skipping parent group tests from the auto_skip conf clause fails because of problems with where/how the group status is stored. Work in progress...
2010-08-13Use proper install methodMartti Kuparinen
Only real program files should be installed with INSTALL_PROGRAM while scripts should be installed with INSTALL_SCRIPT and data files with INSTALL_DATA.
2010-08-03ts: Eliminate Clearcase references in commentsBjörn Gustavsson
2010-08-03ts: Remove Clearcase detectionBjörn Gustavsson
ts_lib:erlang_type/0 used to dectect whether the system was run in Clearcase, in an uninstalled source tree or in an installed system. There now only remain two cases: running in a source tree/git repository or in an installed system. Update ts_lib:erlang_type/0 and all callers accordingly.
2010-07-06Improve handling of test case group specificationsPeter Andersson
Still a few things missing: * Documentation * More tests * Fix old broken test cases
2010-07-06Add textured backgound to html log filesPeter Andersson
The overview html log files now have a textured background. This default new look can be switched off with the 'basic_html' option.
2010-07-06Implement handling of group specificationsPeter Andersson
It's possible now to specify execution of test case groups (and test cases within groups) by means of run_test options and test specification terms. From test specifications, groups (and test cases) may also be skipped. ct_run has been improved to report errors better. New test suites have been introduced.
2010-07-06Rewrite handling of group definitions in Common Test test suitesPeter Andersson
This is to enable execution of specific groups, and/or test cases within groups, by means of run_test options or test specifications.
2010-06-09Make {repeat*,N} property in group execute the group N times exactlyPeter Andersson
To be consistent with the behaviour of the run_test repeat flag/option, the repeat* group property has been changed to specify absolute number of test runs. Previously {repeat,N} meant "execute the group 1 time + N repeats". Now it means "execute the group N times".
2010-06-09Fix so that ct_run converts relative diretories in the code path to absolutePeter Andersson
Directories added with run_test -pa or -pz in the pre erl_args part of the command line will be converted from relative to absolute, this to avoid confusion when Common Test switches working directory during the test run. Also fixed in this commit: Problem with timeouts during init_tc or end_tc (in the Test Server framework).
2010-06-09Fix bug in handling framework:end_tc timeoutsPeter Andersson
2010-06-09Add support for executing pre-loaded suites (e.g. modules loaded as binaries)Peter Andersson
Also fixed bug in test_server that calls end_per_testcase after test case timeout or abortion.
2010-06-09Fix error with {repeat,0} property in groups causing double iterationsPeter Andersson
2010-06-09Add support for config info functions (e.g. init_per_suite/0)Peter Andersson
Also fixed bug: return value {fail,Reason} from end_tc(init_per_suite) was ignored.
2010-06-09Add support for dynamic timetrap handlingPeter Andersson
2010-06-09Have end_per_testcase run even after timetrap_timeout and abort_testcasePeter Andersson
2010-06-09Make it possible to run ts tests for Common Test via the ↵Peter Andersson
ct_run:script_start() interface The possibility to pass start arguments to ct_run:start_script/0 by means of an application environment variable has been implemented. This will be used by ct_test_support for automatic testing of all common_test start interfaces.
2010-06-09Implement support for user controllable timetrap parameters (multiply and scale)Peter Andersson
Documentation still missing.
2010-06-09Remove dialyzer warningAndrey Pampukha
2010-06-09Remove non-breaking spaceAndrey Pampukha
Some editors get confused by illegal break character.
2010-05-11Compile tests that communicate with R12 nodes with the r12 optionBjörn Gustavsson
R12 nodes cannot load code that use the optimized receive that we are about to implement.
2010-05-02Merge branch 'bg/remove-stray-ose-support' into devErlang/OTP
* bg/remove-stray-ose-support: configure: Remove stray OSE/Delta support Makefiles: Remove stray OSE/Delta support kernel tests: Remove stray OSE/Delta support system tests: Remove stray OSE/Delta support erl_interface tests: Remove stray OSE/Delta support epmd: Remove stray OSE/Delta support epmd: #ifdef out start_epmd() for other platforms than VxWorks emulator tests: Remove stray OSE/Delta support emulator: Remove stray OSE/Delta support emulator: Eliminate #ifdef for sys_tty_reset() test_server: Remove stray support for OSE/Delta OTP-8585 bg/remove-stray-ose-support
2010-04-30test_server: Remove stray support for OSE/DeltaBjörn Gustavsson
Remove code supporting testing on OSE/Delta. Some cross-testing support only used by OSE/Delta is kept (see the mention of OSE in test_server_internal.hrl), because it could presumably be useful in the future if we are to test some other embedded system.
2010-04-07Merge branch 'bg/ts_run' into devErlang/OTP
* bg/ts_run: ts_run: Don't run make:all/1 without a good reason OTP-8556 bg/ts_run
2010-04-03ts_run: Don't run make:all/1 without a good reasonBjörn Gustavsson
ts:run() runs make:all/1 to facilitate interactive development of a test suite - when you have changed your test suite, just run ts:run() and it will rebuild the test suite for you. Some test suites, such as for the public_key application, are meant to be built once and for all by "make release_tests". Re-building it later with make:all/1 will fail because it references an internal .hrl file in the source directory for public_key. Running make:all/1 for the public_key test suite would not cause any harm in most circumstances, because make:all/1 would consider the *.beam files to be up-to-date and therefore not actually try to re-build anything. In 2c6d9b57ce4557a431bcf02565c3634a0ed7ca61, however, the public_key test suite started to include "test_server.hrl" using -include_lib() instead of -include(). That means that "test_server.hrl" will be included from the Erlang/OTP system being tested, and if that system has been built *after* the test suite was built, the *.beam files in the test suite will be out-of-date and make:all/1 will try to re-build them (and fail). To avoid this problem, modify ts:run() as follows: * If the test suite has an Emakefile (such as the emulator test suite), it is clearly meant to be (re-)built by make:all/1, so we run make:all/1. * If there is no Emakefile and no .beam files (such as in the erl_interface test suite), it also seems clear that the test suite is meant to be built by make:all/1. To make sure that the test suite will also be *re-built*, create an Emakefile that will re-build all *.erl files in the directory for the test suite. * If there is no Emakefile and there are *.beam files (such as for the public_key test suite), we assume that the test suite are not meant to re-built. However, there may be generated *_SUITE_make.erl files (if there are *_SUITE_data directories containg Makefile.src files, as in the xmerl application). If there are any *_SUITE_make.erl files, generate an Emakefile for compiling only those files and run make:all/1. Otherwise, don't run make:all/1.
2010-03-25Merge branch 'bg/compiler-remove-r11-support' into devErlang/OTP
* bg/compiler-remove-r11-support: compiler: Don't support the no_binaries option erts: Don't support the put_string/3 instruction compiler: Don't support the no_constant_pool option compiler: Don't support the r11 option test_server: Don't support communication with R11 nodes binary_SUITE: Don't test bit-level binary roundtrips with R11 nodes erts: Test compatibility of funs with R12 instead of R11 OTP-8531 bg/compiler-remove-r11-support
2010-03-22test_server: Don't support communication with R11 nodesBjörn Gustavsson
Since R14 does not need to be compatible with any older Erlang systems than R12, we no longer need to use the r11 compiler option when compiling the test_server_node module.