This document describes the changes made to the ERTS application.
Fix the seq_trace token to not be cleared when a process
receives messages sent by erts. Some examples of when
this could happen is all port BIFs, i.e.
Fix so that messages sent by nifs can be traced using
normal and
Own Id: OTP-15038 Aux Id: ERL-602
Fixed specs and documentation for
Own Id: OTP-15180 Aux Id: ERL-648
Fix bug in generation of erl_crash.dump, which could cause VM to crash.
Bug exist since erts-9.2 (OTP-20.2).
Own Id: OTP-15181
Fix bug where ctrl-break or ctrl-c would not trigger the break mode properly on Windows. This bug was introduced in erts-10.0 (OTP-21).
Own Id: OTP-15205
Fix a performance bug for reception of UDP packages, where a memory buffer would be reallocated when it should not have been.
Introduce a limit on the maximum automatic increase of the UDP user-space buffer to the theoretical max of the network PATH, i.e. 65535.
Own Id: OTP-15206
Fix alignment of erts allocator state internally in erts. With the improper alignment the emulator would refuse to start when compiled with clang on 32-bit systems.
Own Id: OTP-15208 Aux Id: PR-1897 ERL-677
Fix bug where too many concurrent calls to
Own Id: OTP-15210
Upgraded the ERTS internal PCRE library from version 8.41
to version 8.42. See
Own Id: OTP-15217
Fix
Own Id: OTP-15236 Aux Id: ERL-692
Fixed bug in
Own Id: OTP-15276 Aux Id: PR-1920
Fixed bug in
Own Id: OTP-15278
Minor
Own Id: OTP-15282
Improved robustness of distribution connection setup. In OTP-21.0 a truly asynchronous connection setup was introduced. This is further improvement on that work to make the emulator more robust and also be able to recover in cases when involved Erlang processes misbehave.
Own Id: OTP-15297 Aux Id: OTP-15279, OTP-15280
The socket options
Own Id: OTP-15145 Aux Id: ERIERL-187
As of ERTS version 10.0 (OTP 21.0) the
Own Id: OTP-15289 Aux Id: ERIERL-235, OTP-14943, ERL-576
The fix made for OTP-15279 in erts-10.07 (OTP-21.0.8) was not complete. It could cause a new connection attempt to be incorrectly aborted in certain cases. This fix will amend that flaw.
Own Id: OTP-15296 Aux Id: OTP-15279, ERIERL-226
A process could get stuck in an infinite rescheduling loop between normal and dirty schedulers. This bug was introduced in ERTS version 10.0.
Thanks to Maxim Fedorov for finding and fixing this issue.
Own Id: OTP-15275 Aux Id: PR-1943
Garbage collection of a distribution entry could cause an
emulator crash if
Own Id: OTP-15279 Aux Id: ERIERL-226
A race between termination of a process and resume of the
same process via
Own Id: OTP-15237
When tracing on
Own Id: OTP-15269 Aux Id: ERL-713
Fixed a bug which caused an emulator crash when
Own Id: OTP-15223
Fixed a bug causing some Erlang references to be inconsistently ordered. This could for example cause failure to look up certain elements with references as keys in search data structures. This bug was introduced in R13B02.
Thanks to Simon Cornish for finding the bug and supplying a fix.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-15225
Fixed a bug that prevented the
Own Id: OTP-15169
Fixed a crash when matching directly against a literal map using a single key that had been saved on the stack.
Own Id: OTP-15184
Fix node crash when passing a bad time option to
Own Id: OTP-15196
Fixed a scheduler bug that caused normal schedulers to run dirty code.
Own Id: OTP-15154
Fixed a bug in
Own Id: OTP-15183 Aux Id: ERL-670
Fixed a rare bug that could cause processes to be scheduled after they had been freed.
Own Id: OTP-15067 Aux Id: ERL-573
Fixed a race condition in the inet driver that could cause receive to hang when the emulator was compiled with gcc 8.
Own Id: OTP-15158 Aux Id: ERL-654
The keys used in
Own Id: OTP-15147 Aux Id: ERL-644
The type specifications for
Own Id: OTP-14019 Aux Id: ERL-550
Fix error printout from run_erl and a bug that could cause unintended fds to be leaked into the started program.
Own Id: OTP-14537 Aux Id: PR1529
File operations used to accept
Also environment variable
operations used to accept
Primitive environment
variable operations also used to accept the
Also
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14543 Aux Id: ERL-370
Fix bugs related to the bookkeeping of microstate accounting states.
Own Id: OTP-14652
On Windows this means that
you can no longer resolve DLL dependencies by modifying
the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14666
Corrected
Own Id: OTP-14713 Aux Id: ERL-500
Fixed a bug where the PATH environment variable wasn't updated correctly on a release downgrade, effectively keeping the PATH of the new release.
Own Id: OTP-14719
A receive optimization that avoids scanning the entire message queue when receiving a message containing a freshly created reference could in rare circumstances (involving recursive calls to the functions that does the receive) cause the receive to hang. This has been corrected.
Own Id: OTP-14782 Aux Id: ERL-511
Fix building of Erlang/OTP on platforms which have small data area with short addressing. For example the PowerPC/RTEMS platform.
Own Id: OTP-14909 Aux Id: PR-1692
Fixed a crash when
Own Id: OTP-14931
Fixed a crash when
Own Id: OTP-14932
The erl_child_setup program now ignores SIGTERM signals.
Own Id: OTP-14943 Aux Id: ERL-576
Force 64-bit alignment on pre-allocators on architectures which needs it.
Own Id: OTP-14977
Fixed a bug where dirty scheduler picked up non-dirty work.
Own Id: OTP-14978
Calls to
Own Id: OTP-15001
Own Id: OTP-15008
Fix bug where rapid
Own Id: OTP-15013
Improve
There are however, still cases when
Own Id: OTP-15015 Aux Id: OTP-14890
Fixed a deadlock that would occur on certain
allocators when a reallocation failed with
Own Id: OTP-15024
Fix bug that made it impossible to use an erl_tracer as the seq_trace trace receiver.
Own Id: OTP-15029
Fix bug where a large (> 1 GB) emulator generated error logger message would cause the emulator to crash.
Own Id: OTP-15032
The emulator will no longer crash when reading the file information of an ordinary file that has an NTFS reparse point, such as files stored in a OneDrive-mapped folder.
Own Id: OTP-15062 Aux Id: ERL-615
Fixed bug in
Own Id: OTP-15080
Fixed bug in
Own Id: OTP-15085
On OSs with per thread CPU time support, change
Own Id: OTP-15090
Fix segfault in abort_signal_task which could happen if a port terminated while there were outstanding port tasks that were not signals, for example a ready_input/ready_output event.
Own Id: OTP-15108 Aux Id: ERL-621
Fixed bug in
Own Id: OTP-15109
Owner and group changes through
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-15118
Fix a bug error reporting from escripts on windows where the error message would get garbled.
Own Id: OTP-15119 Aux Id: PR-1826
Fix segfault when a process is interally re-scheduled while being traced for in out events. This bug was introduced in erts-8.0 (OTP-19.0).
Own Id: OTP-15125
It is now possible to open device files and FIFOs with
Own Id: OTP-11462
The
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11694
A new logging API is added to Erlang/OTP, see the
Calls to
Notice the following potential incompatibilities:
Kernel configuration parameters
In general, parameters for configuring error logger are overwritten by new parameters for configuring Logger.
The concept of SASL error logging is deprecated, meaning that by default the SASL application does not affect which log events are logged.
By default, supervisor reports and crash reports are logged by the default Logger handler started by Kernel, and end up at the same destination (terminal or file) as other standard log event from Erlang/OTP.
Progress reports are not logged by default, but can be
enabled by setting the primary log level to info, for
example with the Kernel configuration parameter
To obtain backwards
compatibility with the SASL error logging functionality
from earlier releases, set Kernel configuration parameter
Since Logger is new in Erlang/OTP 21.0, we do reserve the right to introduce changes to the Logger API and functionality in patches following this release. These changes might or might not be backwards compatible with the initial version.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13295
Own Id: OTP-13760 Aux Id: PR-1592
The file driver has been rewritten as a NIF, decreasing the latency of file operations. Notable incompatibilities are:
The
The
file-specific DTrace probes have been removed. The same
effect can be achieved with normal tracing together with
the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14256
The I/O polling functionality of erts has been re-written to better make use of the OSs polling mechanisms. This change means that erts will now always prefer to use a kernel-polling mechanism if possible. Also all of the I/O polling has been moved to dedicated threads instead of being placed in the scheduler loops.
As a result of this, the
The new
Own Id: OTP-14346
Truly asynchronous auto-connect. Earlier, when
The same applies to all distributed operations that
may trigger auto-connect, i.e.
The interface for all these functions are unchanged as
they do not return connection failures. The only
exception is
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14370
Changed the default behaviour of
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14439
New functionality for implementation of alternative
carriers for the Erlang distribution has been introduced.
This mainly consists of support for usage of distribution
controller processes (previously only ports could be used
as distribution controllers). For more information see
Own Id: OTP-14459
Add support for the lcc compiler and in extension the Elbrus 2000 platform.
Own Id: OTP-14492
Support for "tuple calls" have been removed from the
run-time system. Tuple calls was an undocumented and
unsupported feature which allowed the module argument for
an apply operation to be a tuple:
For legacy code that need to use parameterized modules
or tuple calls for some other reason, there is a new
compiler option called
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14497
Creation of small maps with literal keys has been optimized to be faster and potentially use less memory. The keys are combined into a literal key tuple which is put into the literal pool. The key tuple can be shared between many instances of maps having the same keys.
Own Id: OTP-14502
When an exception is thrown, include the arguments of the
call in the stacktrace for BIFs
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14508
The non-smp emulators have been removed. This means that
the configure options
In order to achieve a similar setup as the non-smp
emulator, it is possible to start Erlang/OTP with the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14518
Modules that use floating point constants compiled with R15 or earlier will need to be re-compiled before they can be loaded.
Own Id: OTP-14575
Implementation of true asynchronous signaling between processes in order to improve scalability. Signals affected include exit, monitor, demonitor, monitor triggered, link, unlink, and group leader.
Own Id: OTP-14589
Added a PGO (profile guided optimization) pass to the build step of erts. This can be disabled by passing --disable-pgo to configure.
Own Id: OTP-14604
Improved the performance of
Own Id: OTP-14610 Aux Id: PR-1480
It is not longer possible to disable dirty schedulers when building erlang.
Own Id: OTP-14613
Loaded BEAM code in a 64-bit system requires less memory because of better packing of operands for instructions.
These memory savings were achieved by major
improvements to the
Own Id: OTP-14626
Own Id: OTP-14637 Aux Id: ERL-327 PR-1524
It is no longer possible to disable the
Own Id: OTP-14651
The reduction cost of sending messages is now constant. It will no longer scale according to the length of the receiving process' message queue.
Own Id: OTP-14667
Improved loading of modules with
Own Id: OTP-14680
On platforms with real-time signals available, SIGRTMIN+1 is now used as the internal scheduler suspend signal instead of SIGUSR2.
Own Id: OTP-14682
When the value returned from a '
Own Id: OTP-14683
The guarantees and non-guarantees of
Own Id: OTP-14687
There is a new syntax in '
Own Id: OTP-14692
New 'used' option for
Own Id: OTP-14780
Added more statistics for
Own Id: OTP-14795 Aux Id: ERL-88
Added
Own Id: OTP-14797
There is a new option '
Own Id: OTP-14830
Added
Own Id: OTP-14884
Own Id: OTP-14899
Optimized the common case of
Own Id: OTP-14901
Make hipe compiled code work on x86_64 (amd64) with OS security feature PIE, where executable code can be loaded into a random location. Old behavior, if hipe was enabled, was to disable PIE build options for the VM.
Own Id: OTP-14903
The number of driver async threads will now default to
1 as the standard drivers do not use them anymore. Users
that changed this value to tweak the file driver should
replace
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14928
Optimize
Own Id: OTP-14934 Aux Id: PR-1708
Refactorings making some internal process flags available for other usage.
Own Id: OTP-14948
Removed need for HiPE to allocate native executable
memory in low 2GB address space on x86_64. Command line
option
Own Id: OTP-14951
Added
Own Id: OTP-14954
Added configuration switches for busy-wait and wake up thresholds for dirty schedulers, and changing these settings for normal schedulers will no longer affect dirty schedulers.
Refer to the documentation for
details. The new switches are
The
default busy wait threshold for dirty scheduler threads
has also been lowered to
Own Id: OTP-14959
The list of "taints" now also includes dynamic loaded
drivers in addition to NIF libraries. Statically linked
drivers and NIF libraries that are part of erts are not
included. The "taints" are returned by
Own Id: OTP-14960
Added
The old
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14961
The process suspend functionality used by the
You can easily create deadlocks if processes suspends each other (directly or in circles). In ERTS versions prior to ERTS version 10.0, the runtime system prevented such deadlocks, but this prevention has now been removed due to performance reasons.
Other ERTS internal functionality that used the previous process suspend functionality have also been reimplemented to use asynchronous signaling instead.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14964 Aux Id: OTP-14589
Added the
Own Id: OTP-14965
New implementation of
In the general case when inspecting another process, the new implementation sends an asynchronous process-info request signal to the other process and waits for the result instead of locking the other process and reading the result directly. In some special cases where no conflicts occur, signal order wont be violated, and the amount of data requested is guaranteed to be small, the inspected process may be inspected directly.
Appropriate amount of reductions are now also bumped when inspecting a process.
Own Id: OTP-14966
Removed process start time from crash dump in order to save memory in process control block.
Own Id: OTP-14975 Aux Id: PR-1597
Optimize
Own Id: OTP-14976
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14986 Aux Id: PR-1745
New
Own Id: OTP-14987
New NIF functions:
Own Id: OTP-14994
When
Own Id: OTP-15026
Fixed bug for named
Own Id: OTP-15031
Two new guards BIFs operating on maps have been added:
Own Id: OTP-15037 Aux Id: PR-1784, PR-1802
Release run-queue lock while cleaning up terminated dirty process.
Own Id: OTP-15081
The callback module passed as
Documentation has also been added in
the
Own Id: OTP-15086 Aux Id: PR-1694
Fixed a bug which caused an emulator crash when
Own Id: OTP-15223
Fixed a bug causing some Erlang references to be inconsistently ordered. This could for example cause failure to look up certain elements with references as keys in search data structures. This bug was introduced in R13B02.
Thanks to Simon Cornish for finding the bug and supplying a fix.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-15225
Fixed a race condition in the inet driver that could cause receive to hang when the emulator was compiled with gcc 8.
Own Id: OTP-15158 Aux Id: ERL-654
Fix bug in generation of erl_crash.dump, which could cause VM to crash.
Bug exist since erts-9.2 (OTP-20.2).
Own Id: OTP-15181
Fixed a rare bug that could cause processes to be scheduled after they had been freed.
Own Id: OTP-15067 Aux Id: ERL-573
Fixed bug in
Own Id: OTP-15109
Fixed bug in
Own Id: OTP-15080
Fixed bug in
Own Id: OTP-15085
Fixed a crash in
Own Id: OTP-15034
Fixed a
Own Id: OTP-14840 Aux Id: ERL-529
File names containing unicode codepoints larger than 255 were not correctly encoded in stack traces.
Own Id: OTP-14847 Aux Id: ERL-544
Fix HiPE bug for binary constructs like
This fix affects both the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14850 Aux Id: PR-1664
Fix
Own Id: OTP-14876 Aux Id: ERL-548
Fix bug in erlang:binary_to_integer/2 where invalid
characters were not detected for bases larger then 10.
e.g.
Own Id: OTP-14879
Fixed bug in
For example,
Own Id: OTP-14890
Fix bug causing slow hipe execution in modules loaded
early during boot or loaded by
Own Id: OTP-14891
Fixed a buffer overflow in an internal string
formatting function that could be hit if specifying a
long floating-point format specifier to
Own Id: OTP-14920
Own Id: OTP-14921
Own Id: OTP-14926
Reject loading modules with names containing directory separators ('/' or '\' on Windows).
Own Id: OTP-14933 Aux Id: ERL-564, PR-1716
Fix potential dead-lock when the tracer process dies while a the traced process is running on a dirty scheduler.
Own Id: OTP-14938
More crash dump info such as: process binary virtual heap stats, full info for process causing out-of-mem during GC, more port related info, and dirty scheduler info.
Own Id: OTP-14820
Improve search algorithm of abandoned memory carriers. Instead of limited linear search, each allocator instance maintain a balanced search tree of all its abandoned carriers for faster and more exhaustive search.
Own Id: OTP-14915 Aux Id: ERIERL-88
New erts_alloc command line options
Own Id: OTP-14916 Aux Id: ERIERL-88
New family of
Own Id: OTP-14917 Aux Id: ERIERL-88
Add possibility to change allocator options at runtime
with
Own Id: OTP-14918 Aux Id: ERIERL-88
Fix a bug in tracing where the {caller} match spec function would be set to undefined incorrectly when used in conjunction with return_to or return_trace on some functions.
The functions effected are: erlang:put/2, erlang:erase/1, erlang:process_info/1,2, erlang:nif_load/2, erts_internal:garbage_collection/1 and erts_internal:check_process_code/1.
Because of this bug, the analysis done by fprof could become incorrect when the functions above are the tail-call in a function.
Own Id: OTP-14677
Fix emulator deadlock that would happen if
Own Id: OTP-14678 Aux Id: ERL-495
Writing of crash dumps is significantly faster.
Maps are now included in crash dumps.
Constants terms would only be shown in one process, while other processes referencing the same constant term would show a marker for incomplete heap.
Own Id: OTP-14685 Aux Id: OTP-14611, OTP-14603, OTP-14595
The fallback home directory for windows has been changed to be the PROFILE directory instead of the WINDOWS directory. The fallback is used when the environment variables HOMEDRIVE and HOMEPATH have not been set.
Own Id: OTP-14691
Fix bug for hipe compiled code using
On architectures other than x86_64, code need to be recompiled to benefit from this fix.
Own Id: OTP-14740
Fixed bug in
Own Id: OTP-14752
ERL_NIF_MINOR_VERSION wasn't bumped with the addition
of
Own Id: OTP-14779
Purging of loaded code that contained "fake literals"
(for example the magic reference obtained from
'
Own Id: OTP-14791
Setting the size of the atom table to a number near
2147483647 (using the '
Own Id: OTP-14796
Fixed a bug that prevented registered process names from being resolved in lcnt results.
Own Id: OTP-14803
Formatting bugs were fixed in several HiPE debug BIFs.
Own Id: OTP-14804
Binaries and some other data in crash dumps are now encoded in base64 (instead of in hex), which will reduce the size of crash dumps.
A few bugs in the handling of sub binaries in
Own Id: OTP-14686
Micro optimization for send operations of messages to other nodes. The local ack-message, which is otherwise sent back from TPC/IP port driver to sending client process, is now ignored earlier for distributed send operations.
Own Id: OTP-14689
Fixed a bug in file closure on Unix; close(2) was retried on EINTR which could cause a different (recently opened) file to be closed as well.
Own Id: OTP-14775
A race-condition when tearing down a connection with active node monitors could cause the runtime system to crash.
This bug was introduced in ERTS version 8.0 (OTP 19.0).
Own Id: OTP-14781 Aux Id: OTP-13047
Microstate accounting sometimes produced incorrect results for dirty schedulers.
Own Id: OTP-14707
Fixed a regression in
Own Id: OTP-14730 Aux Id: ERL-507
Fixed a memory corruption bug in
Own Id: OTP-14745
Fixed a crash in
Own Id: OTP-14750
Own Id: OTP-14751
Added zlib:set_controlling_process/2 to move a zstream() between processes.
Own Id: OTP-14672 Aux Id: ERL-494
Fix so that schedulers are bound correctly when the first available cpu is not the first detected cpu. e.g. when using "taskset -c X..Y" when X is not equal to 0.
Own Id: OTP-14694
Fixed bug that could cause a VM crash when a corrupt message is received on distribution channel from other node.
Own Id: OTP-14661 Aux Id: ERIERL-80
The new zlib module returned a data_error when inflating concatenated streams, which was incompatible with the old module's behavior of returning the uncompressed data up to the end of the first stream.
Own Id: OTP-14648
zlib:gunzip/1 will no longer stop at the end of the first stream when decompressing concatenated gzip files.
Own Id: OTP-14649
Changed
Own Id: OTP-14490 Aux Id: ERL-432
On macOS,
Own Id: OTP-14499 Aux Id: ERL-251 ERL-439
Fixed bug in enif_whereis_pid/port that could cause heap corruption in rare cases.
Own Id: OTP-14523
Fix so that trace messages generated when in a dirty nif are flushed correctly when the dirty nif is done executing.
Own Id: OTP-14538
Fix escape code handling when using ANSI color codes in the shell.
Own Id: OTP-14549 Aux Id: PR1536
Upgraded the ERTS internal PCRE library from version 8.40
to version 8.41. See
Own Id: OTP-14574
Fixed a bug causing
Own Id: OTP-14597 Aux Id: ERL-465
Fixed small memory leak that could occur when sending to a terminating port.
Own Id: OTP-14609
Fix bug causing VM crash when a module with
Own Id: OTP-14612
A warning that the compiler may optimize away atoms
have been added to the documentation of
Own Id: OTP-14614 Aux Id: ERL-453
Lock counting can now be fully toggled at runtime in
the lock counting emulator (
Own Id: OTP-13170
The
The
following functions have been deprecated, but will not
produce compiler warnings until OTP 21:
The behavior of throwing
an error when a dictionary is required for decompression
has also been deprecated. Refer to the documentation on
Own Id: OTP-14185
Own Id: OTP-14412
Add
Own Id: OTP-14520
When provided with bad arguments, the
Own Id: OTP-14527
Own Id: OTP-14553
Add new nif API functions for managing an I/O Queue. The added functions are:
Own Id: OTP-14598
Fixed bug in
Own Id: OTP-14590 Aux Id: ERL-474
A timer internal bit-field used for storing scheduler id was too small. As a result, VM internal timer data structures could become inconsistent when using 1024 schedulers on the system. Note that systems with less than 1024 schedulers are not effected by this bug.
This bug was introduced in ERTS version 7.0 (OTP 18.0).
Own Id: OTP-14548 Aux Id: OTP-11997, ERL-468
Automatic cleanup of a BIF timer, when the owner process terminated, could race with the timeout of the timer. This could cause the VM internal data structures to become inconsistent which very likely caused a VM crash.
This bug was introduced in ERTS version 9.0 (OTP 20.0).
Own Id: OTP-14554 Aux Id: OTP-14356, ERL-468
Binary append operations did not check for overflow, resulting in nonsensical results when huge binaries were appended.
Own Id: OTP-14524
Added missing release notes for OTP-14491 ("performance bug in pre-allocators") which was included in erts-9.0.1 (OTP-20.0.1).
Own Id: OTP-14494
Fixed a bug that prevented TCP sockets from being closed properly on send timeouts.
Own Id: OTP-14509
Fixed bug in operator
Own Id: OTP-14514
Fixed a bug in gen_tcp:send where it never returned when repeatedly called on a remotely closed TCP socket.
Own Id: OTP-13939 Aux Id: ERL-193
Fixed segfault that could happen during cleanup of aborted erlang:port_command/3 calls. A port_command is aborted if the port is closed at the same time as the port_command was issued. This bug was introduced in erts-8.0.
Own Id: OTP-14481
Fixed implementation of
Own Id: OTP-14484
Fix performance bug in pre-allocators that could cause them to permanently fall back on normal more expensive memory allocation. Pre-allocators are used for quick allocation of short lived meta data used by messages and other scheduled tasks. Bug exists since OTP_R15B02. [this release note was missing in erts-9.0.1]
Own Id: OTP-14491
Fix various bugs regarding loading, upgrade and purge of HiPE compiled code:
Own Id: OTP-13968
Hipe optional LLVM backend does require LLVM version 3.9 or later as older versions forced strong dependencies on erts internals structures.
Own Id: OTP-14238
When an exception such as '
Own Id: OTP-14255 Aux Id: OTP-14400, OTP-14401
Slogans in crash dumps have been extended to print more complex terms.
Own Id: OTP-14303
Fixed bug when using
Own Id: OTP-14304
The address family
Own Id: OTP-14305
Use
Own Id: OTP-14307 Aux Id: PR-1379
Disable hipe for
Own Id: OTP-14314 Aux Id: ERL-369, PR-1394
Fix 'epmd -kill' to return a failure exit status code if epmd was not killed because of some error.
Own Id: OTP-14324
Fixed the following dirty scheduler related bugs:
the
Own Id: OTP-14335
Fix erlexec to handle mismatch in sysconf and proc fs
when figuring out the cpu topology. This behaviour has
been seen when using docker together with
Own Id: OTP-14352
Fixed memory segment cache used for multiblock carriers. Huge (> 2GB) memory segments could cause a VM crash. Creation of such huge memory segments used for multiblock carriers is however very uncommon.
Own Id: OTP-14360 Aux Id: ERL-401, PR-1417
Fix bug causing
Own Id: OTP-14390
Fix emulator crash when receive tracing on a
Own Id: OTP-14411
Fix file:sendfile error handling on SunOS when a connection is closed during transmission.
Own Id: OTP-14424
Own Id: OTP-14433
Fix erroneous lock check assertion when
Own Id: OTP-14437 Aux Id: ERL-360
Active-mode TCP sockets are now cleaned up properly on send/shutdown errors.
Own Id: OTP-14441 Aux Id: ERL-430
Fix compilation of hipe_mkliterals when the LIBS configure variable had to be set.
Own Id: OTP-14447
Added
Own Id: OTP-11695
Optimized test for tuples with an atom as first element.
Own Id: OTP-12148
Erlang literals are no longer copied during process to process messaging.
Own Id: OTP-13529
Add support in the
enif_select
enif_monitor_process
enif_demonitor_process
enif_compare_monitors
enif_open_resource_type_x
Own Id: OTP-13684
There are two new guard BIFs '
Own Id: OTP-13692
Remove deprecated
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13827
Replaced usage of deprecated symbolic
Own Id: OTP-13831 Aux Id: OTP-13735
Added support in zlib for extraction of the inflation dictionary.
Own Id: OTP-13842
The previously used purge strategy has been removed. The optional purge strategy introduced in ERTS version 8.1 is now the only strategy available.
The new purge strategy is slightly incompatible with the
old strategy. Previously processes holding
For more information see the documentation of
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13844 Aux Id: OTP-13833
Dirty schedulers are now enabled by default when the runtime system is built with SMP support.
Own Id: OTP-13860
Improved ETS lookup/insert/delete speed for large
Own Id: OTP-13903
The NIF library
Runtime upgrade of a NIF library is still supported by using the Erlang module upgrade mechanics with a current and an old module instance existing at the same time with their corresponding NIF libraries.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13908
Add
Own Id: OTP-13976
The function
Own Id: OTP-14000
Own Id: OTP-14002
Add driver and nif lock instrumentation to lcnt
Own Id: OTP-14069
Reduce memory pressure by converting sub-binaries to heap-binaries when possible. This is done during garbage collection.
Own Id: OTP-14149
Dirty schedulers are now enabled and supported on Erlang runtime systems with SMP support.
Besides support for dirty NIFs also support for dirty BIFs and dirty garbage collection have been introduced. All garbage collections that potentially will take a long time to complete are now performed on dirty schedulers if enabled.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14152
Atoms may now contain arbitrary Unicode characters.
Own Id: OTP-14178
Introduce an event manager in Erlang to handle OS signals. A subset of OS signals may be subscribed to and those are described in the Kernel application.
Own Id: OTP-14186
The
This is useful for standalone systems with
Own Id: OTP-14201 Aux Id: PR-1293
All uses of the magic binary kludge has been replaced by uses of erlang references.
A magic binary was presented as an empty binary, but actually referred other data internally in the Erlang VM. Since they were presented as empty binaries, different magic binaries compared as equal, and also lost their internal data when passed out of an erlang node.
The new usage of references has not got any of these strange semantic issues, and the usage of these references has been optimized to give the same performance benefits as well as memory usage benefits as magic binaries had.
A couple of examples of previous uses of magic binaries are match specifications and NIF resources.
Own Id: OTP-14205
The non-smp emulators have been deprecated and are scheduled for removal in OTP-21.
In preparation for this, the threaded non-smp emulator is no longer built by default and has to be enabled using the --enable-plain-emulator to configure.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14272
Allow HiPE to run on VM built with
Own Id: OTP-14330 Aux Id: PR-1397
Upgraded the OTP internal PCRE library from version 8.33
to version 8.40. This library is used for implementation
of the
Besides various bug fixes, the new version allows for
better stack protection. In order to utilize this
feature, the stack size of normal scheduler threads is
now by default set to 128 kilo words on all platforms.
The stack size of normal scheduler threads can be set
upon system start by passing the
See
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-14331 Aux Id: ERL-208
Remove generation of atoms in old latin1 external format
in the distribution between erlang nodes,
Atoms that can be encoded using latin1 are still encoded
by
Own Id: OTP-14337
Added function
Own Id: OTP-14347 Aux Id: PR-1412
Added new debug bif
Own Id: OTP-14348
Various improvements of timer management internally in the VM. These improvements both reduced memory consumption of timer wheels as well as reduce the amount of work that has to be performed in order to handle timers.
Own Id: OTP-14356
Sockets can now be bound to device (SO_BINDTODEVICE) on platforms where it is supported.
This has
been implemented e.g to support VRF-Lite under Linux; see
Own Id: OTP-14357 Aux Id: PR-1326
Added the following
for dirty CPU schedulers
for dirty IO schedulers
The default suggested stack size for dirty schedulers is 40 kilo words.
Own Id: OTP-14380
Changed erts startup program name, argv 0, to use the
environment variable
Own Id: OTP-14381
Improvements of
Own Id: OTP-14384 Aux Id: OTP-14201
Add function
Own Id: OTP-14385 Aux Id: PR-1413
'
On Windows,
Own Id: OTP-14407
Warnings have been added to the relevant documentation about not using un-secure distributed nodes in exposed environments.
Own Id: OTP-14425
Improvement of the documentation of the environment
variable
Own Id: OTP-14434
Enabled off-heap message queue for some system processes that might receive large amounts of messages.
Own Id: OTP-14438
ETS lock indexes have been replaced with the table name in LCNT results.
Own Id: OTP-14442 Aux Id: ERIERL-22
Introduced the new functions
Own Id: OTP-14453 Aux Id: PR-1400
Fixed small memory leak that could occur when sending to a terminating port.
Own Id: OTP-14609 Aux Id: ERIERL-238
Fixed a race condition in the inet driver that could cause receive to hang when the emulator was compiled with gcc 8.
Own Id: OTP-15158 Aux Id: ERL-654
Fixed a bug causing some Erlang references to be inconsistently ordered. This could for example cause failure to look up certain elements with references as keys in search data structures. This bug was introduced in R13B02.
Thanks to Simon Cornish for finding the bug and supplying a fix.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-15225
Fixed a bug in file closure on Unix; close(2) was retried on EINTR which could cause a different (recently opened) file to be closed as well.
Own Id: OTP-14775
A race-condition when tearing down a connection with active node monitors could cause the runtime system to crash.
This bug was introduced in ERTS version 8.0 (OTP 19.0).
Own Id: OTP-14781 Aux Id: OTP-13047
A timer internal bit-field used for storing scheduler id was too small. As a result, VM internal timer data structures could become inconsistent when using 1024 schedulers on the system. Note that systems with less than 1024 schedulers are not effected by this bug.
This bug was introduced in ERTS version 7.0 (OTP 18.0).
Own Id: OTP-14548 Aux Id: OTP-11997, ERL-468
Fixed bug in
Own Id: OTP-14590 Aux Id: ERL-474
Fix bug causing VM crash when a module with
Own Id: OTP-14612
Fixed bug that could cause a VM crash when a corrupt message is received on distribution channel from other node.
Own Id: OTP-14661 Aux Id: ERIERL-80
Fix performance bug in pre-allocators that could cause them to permanently fall back on normal more expensive memory allocation. Pre-allocators are used for quick allocation of short lived meta data used by messages and other scheduled tasks. Bug exists since OTP_R15B02.
Own Id: OTP-14491
Fixed a bug that prevented TCP sockets from being closed properly on send timeouts.
Own Id: OTP-14509
Fixed bug in operator
Own Id: OTP-14514
Fixed a bug in gen_tcp:send where it never returned when repeatedly called on a remotely closed TCP socket.
Own Id: OTP-13939 Aux Id: ERL-193
Fixed segfault that could happen during cleanup of aborted erlang:port_command/3 calls. A port_command is aborted if the port is closed at the same time as the port_command was issued. This bug was introduced in erts-8.0.
Own Id: OTP-14481
Fixed implementation of
Own Id: OTP-14484
Active-mode TCP sockets are now cleaned up properly on send/shutdown errors.
Own Id: OTP-14441 Aux Id: ERL-430
A code purge operation could under certain circumstances expand the size of hibernated processes.
Own Id: OTP-14444 Aux Id: ERIERL-24
Fix so that the ERL_ZZ_SIGTERM_KILL introduced in erts-8.3.4 works.
Own Id: OTP-14451
Add option to make SIGTERM trigger the OS default behaviour instead of doing a gracefull shutdown. To activate this bahviour the environment variable ERL_ZZ_SIGTERM_KILL should be set to "true". This option only works in OTP 19 as OTP 20 will have a different way to deal with SIGTERM.
Own Id: OTP-14418 Aux Id: ERIERL-15
Fixed memory segment cache used for multiblock carriers. Huge (> 2GB) memory segments could cause a VM crash. Creation of such huge memory segments used for multiblock carriers is however very uncommon.
Own Id: OTP-14360 Aux Id: ERL-401, PR-1417
Fix release note for OTP-14290 in ERTS version 8.3.1. It was erroneously placed under "Known Bugs and Problems".
Own Id: OTP-14363 Aux Id: OTP-14290
The
Own Id: OTP-14358 Aux Id: OTP-14085
Invoking
Own Id: OTP-14290
Trying to open a directory with file:read_file/1 on Unix leaked a file descriptor. This bug has now been fixed.
Own Id: OTP-14308 Aux Id: ERL-383
Fixed a number of bugs that caused faulty stack-traces to be generated. The faulty stack traces were generated either when applying the following functions or tracing the following functions:
Own Id: OTP-14055
Corrected documentation about memory footprint for maps.
Own Id: OTP-14118
Fix
Own Id: OTP-14119 Aux Id: PR-1263
A process calling
Own Id: OTP-14121
Dirty scheduler bug fixes:
Fixed call time tracing of process being scheduled on dirty scheduler.
GC info from dirty schedulers.
Multi scheduling block with dirty schedulers could crash the runtime system.
Process structures could be removed prematurely.
GC on dirty scheduler could crash the runtime system.
Termination of a process executing on a dirty scheduler could cause a runtime system crash.
Own Id: OTP-14122
Fixed crash that occurred when writing timer data to a crash dump.
Own Id: OTP-14133
A literal area could be removed while still referred from processes.
Own Id: OTP-14134
Fixed a bug in the garbage collector that could crash the runtime system.
Own Id: OTP-14135
Fixed a bug in call-time trace for NIFs which caused tracing to erroneously be started multiple times for one call.
Own Id: OTP-14136
Remove a debug printout and an unnecessary garbage collection when handling exceptions in hipe compiled code.
Own Id: OTP-14153
Fix bug in tracing of garbage collection that could cause VM crash. Bug exists since OTP 19.0.
Own Id: OTP-14154
Fix bug in
Own Id: OTP-14159 Aux Id: ERL-340
Fix suspension of schedulers when generating a crashdump.
Own Id: OTP-14164
NIF resources was not handled in a thread-safe manner in the runtime system without SMP support.
As a consequence of this fix, the following driver functions are now thread-safe also in the runtime system without SMP support:
Own Id: OTP-14202
Fix
Own Id: OTP-14227
Add size of literals to module code size in crash dump
and
Own Id: OTP-14228
Fix potential bug in
Own Id: OTP-14229
Fix bug where passing an appendable binary to
Own Id: OTP-14231
Receive expressions with timeout in the Erlang shell could cause a VM crash.
Own Id: OTP-14241 Aux Id: ERL-365
A received SIGTERM signal to beam will generate a
Own Id: OTP-14085
Workaround for buggy Android implementation of
Own Id: OTP-14165 Aux Id: ERL-319
Add configure option --without-thread-names that removes the naming of individual emulator threads.
Own Id: OTP-14234
Add warning in documentation of
Own Id: OTP-14254 Aux Id: ERL-362
Fix bug in
Own Id: OTP-14159 Aux Id: ERL-340
The driver efile_drv when opening a file now use fstat() on the open file instead of stat() before opening, if fstat() exists. This avoids a race when the file happens to change between stat() and open().
Own Id: OTP-14184 Aux Id: seq-13266
Fix a quite rare bug causing VM crash during code loading and the use of export funs (fun M:F/A) of not yet loaded modules. Requires a very specfic timing of concurrent scheduler threads. Has been seen on ARM but can probably also occure on other architectures. Bug has existed since OTP R16.
Own Id: OTP-14144 Aux Id: seq13242
Fixed
Own Id: OTP-13904 Aux Id: ERL-256
Own Id: OTP-13920 Aux Id: ERL-267
Fix a compilation error of erts in OpenBSD related to the usage of the __errno variable.
Own Id: OTP-13927
Fixed so that when enabling tracing on a process that had an invalid tracer associated with it, the new tracer overwrites the old tracer. Before this fix, calling erlang:trace/3 would behave as if the tracer was still alive and not apply the new trace.
This fault was introduced in ERTS 8.0.
Own Id: OTP-13928
Fix parsing of
Own Id: OTP-13955 Aux Id: ERL-280
A slight improvement of
Own Id: OTP-13992
Correct type declaration of match specification head.
Own Id: OTP-13996
HiPE code loading failed for x86_64 if gcc was configured
with
Own Id: OTP-14031 Aux Id: ERL-294, PR-1239
Faulty arguments could be presented on exception from a
NIF that had rescheduled itself using
Own Id: OTP-14048
The runtime system could crash if a garbage collection on
a process was performed immediately after a NIF had been
rescheduled using
Own Id: OTP-14049
A reference to purged code could be left undetected by
the purge operation if a process just had rescheduled a
NIF call using
Own Id: OTP-14050
Fixed a number of dirty scheduler related bugs:
Process priority was not handled correct when scheduling on a dirty scheduler.
The runtime system could crash when an exit signal with a compound exit reason was sent to a process executing on a dirty scheduler.
The runtime system crashed when call tracing a process executing on a dirty scheduler.
A code purge operation could end up hanging forever when a process executed on a dirty scheduler
Own Id: OTP-14051
Fix minor soft purge race bug that could incorrectly trigger code_server to load new code for the module if the soft purge failed and no current version of the module existed.
Own Id: OTP-13925
To ease troubleshooting,
Own Id: OTP-13951
New environment variable
Own Id: OTP-14046
A code purge operation could under certain circumstances expand the size of hibernated processes.
Own Id: OTP-14444 Aux Id: ERIERL-24
The emulator got a dynamic library dependency towards libsctp, which on Linux was not intended since the emulator there loads and resolves the needed sctp functions in runtime. This has been fixed and a configure switch --enable-sctp=lib has been added for those who want such a library dependency.
Own Id: OTP-13956 Aux Id: ERL-262, ERL-133
Fix SIGUSR1 crashdump generation
Do not generate a core when a crashdump is asked for.
Own Id: OTP-13997
The new functions in
The functions affected of this problem were:
Own Id: OTP-14009
Fix bug for calls from hipe code to BIFs that disable GC while yielding. Has been causing Dialyzer crashes on ARM (and presumably all other non-intel platforms).
Own Id: OTP-13724 Aux Id: PR-1116
Fix a bug where changing the current working directory of
the VM would not change the current working directory of
programs spawned using
Own Id: OTP-13733 Aux Id: ERL-175
Fix a bug where disabling tracing from a process that had
return_to tracing enabled and was tracing on
Own Id: OTP-13734
Update all erts documentation to use simpler English, use consistent terminology and be easier to navigate.
Own Id: OTP-13740
Add dirty schedulers to the microstate accounting statistics.
Own Id: OTP-13744
Fixed dirty scheduler build support on 32-bit windows.
Own Id: OTP-13759
inet:getstat(Socket) on an SCTP socket returned 0 for send stats. This bug has now been corrected. Reported by systra as issue ERL-102 on bugs.erlang.org.
Own Id: OTP-13773 Aux Id: ERL-102
AF_UNSPEC and unknown address families were misread by UDP receive in prim_inet resulting in an exception. This bug has now been corrected.
Own Id: OTP-13775
Sweep HiPE stack for literals during code purge.
Own Id: OTP-13777 Aux Id: PR-1122
Fix bug in run_erl for OpenBSD that could cause it on rare occations to exit without starting the program (erl) at all.
Own Id: OTP-13795
Update build scripts to not make assumtions about where env, cp and perl are located.
Own Id: OTP-13800
Fixed a bug where init:stop could deadlock if a process with infinite shutdown timeout (e.g. a supervisor) attempted to load code while terminating.
Own Id: OTP-13802
Fixed a segmentation fault on sparc CPUs when free'ing a tracer module's state.
Own Id: OTP-13803
Own Id: OTP-13809
Fixed a memory leak when the process monitoring a port crashed.
Own Id: OTP-13818
Fixed multiple dirty scheduler related tracing bugs.
Own Id: OTP-13822
Fix error handling in beam code runtime loader for a number of cases when index and size fields got corrupted (negative) values.
Own Id: OTP-13848 Aux Id: ERL-216
Minor fix of dirty scheduler implementation.
Own Id: OTP-13852
Calls to
Own Id: OTP-13866
Fix a rare race condition in
Own Id: OTP-13868
Driver and NIF operations accessing processes or ports could cause an emulator crash when used from non-scheduler threads. Those operations are:
Own Id: OTP-13869
Fix start scripts generation dependency in Makefile
Own Id: OTP-13871 Aux Id: ERL-241
The VM could crash if
Own Id: OTP-13877
Calling
Own Id: OTP-13893 Aux Id: ERL-240
Improved accuracy of timeouts on MacOS X. This by setting premature timeouts followed by a short actual timeout during scheduler wait.
Own Id: OTP-13698
Added the following symbolic time unit representations
to the
The following
symbolic time unit representations are now
deprecated, but still part of the
Own Id: OTP-13735
Fix maps hashing entropy of maps with maps keys.
Own Id: OTP-13763 Aux Id: ERL-199
Improved dirty scheduler support. A purge of a module can now be performed without having to wait for completion of all ongoing dirty NIF calls.
Note that when enabling support for dirty schedulers, a
new purge strategy will as of ERTS version 8.1 be
enabled. This new strategy is not fully backwards
compatible with the strategy used by default. For more
information see the documentation of
Own Id: OTP-13808 Aux Id: OTP-13833
A new purge strategy has been introduced. The new strategy will by default be disabled during the OTP 19 release, but will be the only strategy available as of the OTP 20 release.
The new strategy is slightly incompatible with the
strategy being used by default in OTP 19. Using the
default strategy, processes holding
The new strategy can optionally be enabled when building OTP during OTP 19, and will automatically be enabled if the runtime system is built with support for dirty schedulers.
For more information see the documentation of
Own Id: OTP-13833
Fixed unnecessary overestimation of heap size need during garbage collection.
Own Id: OTP-13851
Fixed a VM crash that occurred in a garbage collection of a process when it had received binaries. This bug was introduced in ERTS version 8.0 (OTP 19.0).
Own Id: OTP-13890
Fixed a VM crash that occurred in garbage collection of a process when it had received maps over the distribution. This bug was introduced in ERTS version 8.0 (OTP 19.0).
Own Id: OTP-13889
Fixed a race that could cause a lost wakeup of a process
that timed out in a
Own Id: OTP-13798 Aux Id: OTP-11997
Fixed segfault after writing an erl crash dump.
Own Id: OTP-13799
Fix scheduler deadlock bug in
Own Id: OTP-13731 Aux Id: ERL-188
Fix VM abort "Overrun stack and heap" in garbage
collection triggered by a
Own Id: OTP-13732 Aux Id: seq13142
A memory allocation bug in
Own Id: OTP-13716
The handling of
Own Id: OTP-12593
Own Id: OTP-13034
Fix
Own Id: OTP-13288 Aux Id: PR913
Cleanup hipe signal handling code for x86 and make it more portable.
Own Id: OTP-13341 Aux Id: PR951
Make file:datasync use fsync instead of fdatasync on Mac OSX.
Own Id: OTP-13411
Make sure to create a crash dump when running out of memory. This was accidentally removed in the erts-7.3 release.
Own Id: OTP-13419
A bug has been fixed where if erlang was started +B on a unix platform it would be killed by a SIGUSR2 signal when creating a crash dump.
Own Id: OTP-13425
Fix race between
A process could terminate due to exit signal even though
Own Id: OTP-13452
Don't search for non-existing Map keys twice
For
Own Id: OTP-13459
When an abnormally large distribution message is about to be sent, the VM has been changed to create a crash dump instead of a core dump.
Own Id: OTP-13474
Fix
Own Id: OTP-13485 Aux Id: ERL-123
Fix bug in
Own Id: OTP-13489 Aux Id: ERL-127
Fixed a race-condition bug where the emulator could crash
when
Own Id: OTP-13494 Aux Id: ERL-126
Fixed bugs where the reduction counter was not handled correct.
Own Id: OTP-13512
Fixed typo in description of the
Own Id: OTP-13517
Fixed a bug where a process flagged as sensitive would sometimes record its save_calls when it shouldn't.
Own Id: OTP-13540
Update configure scripts to not use hard-coded path for /bin/pwd and /bin/rm.
Own Id: OTP-13562
When passing a larger binary than the outputv callback of a linked-in driver can handle in one io vector slot, the binary is now split into multiple slots in the io vector. This change only effects system where the max size of an io vector slot is smaller then the word size of the system (e.g. Windows).
This change means that it is now possible on Windows to send binaries that are larger than 4GB to port_command, which is what is used for file:write, gen_tcp:send etc.
Own Id: OTP-13628
Workaround of Maps output in crashdumps. Currently the atom 'undefined' is generated instead of Map data if a Map type is encountered during crash.
Own Id: OTP-13657
The tracing support has been extended to allow a
With the introduction of this feature,
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10267
Introduce LTTng tracing of Erlang Runtime System
For LTTng to be enabled OTP needs to be built with
configure option
This feature introduces tracepoints for schedulers, drivers, memory carriers, memory and async thread pool.
For a list of all tracepoints, see
Own Id: OTP-10282
Make it possible to monitor/demonitor ports using the
Own Id: OTP-11384
Add microstate accounting
Microstate accounting is a way to track which state the different threads within ERTS are in. The main usage area is to pin point performance bottlenecks by checking which states the threads are in and then from there figuring out why and where to optimize.
Since checking whether microstate accounting is on or off is relatively expensive only a few of the states are enabled by default and more states can be enabled through configure.
There is a convenience module called msacc that has been added to runtime_tools that can assist in gathering and interpreting the data from Microstate accounting.
For more information see
Own Id: OTP-12345
The port of Erlang/OTP to the real-time operating system OSE has been removed.
Own Id: OTP-12573
Sharing preserved copy for messages and exit signals
Enable sharing preserved copy with configure option
Own Id: OTP-12590 Aux Id: OTP-10251
Halfword BEAM has been removed.
Own Id: OTP-12883
Added
The perf_counter is a very very cheap and high resolution timer that can be used to timestamp system events. It does not have monoticity guarantees, but should on most OS's expose a monotonous time.
Own Id: OTP-12908
Support for a fragmented young heap generation. That is, the young heap generation can consist of multiple non continuous memory areas. The main reason for this change is to avoid extra copying of messages that could not be allocated directly on the receivers heap.
Own Id: OTP-13047
Erlang linked-in driver can now force the call to open_port to block until a call to erl_drv_init_ack is made inside the driver. This is useful when you want to do some asynchronous initialization, for example getting configuration from a pipe, and you want the initial open_port call to fail if the configuration is incomplete or wrong. See the erl_driver documentation for more details on the API.
Own Id: OTP-13086
Erlang linked-in drivers can now set their own pids as
seen in
Own Id: OTP-13087
The functionality behind
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13088
Improved yielding strategy in the implementation of the following native functions:
This in order to improve performance of these functions.
Own Id: OTP-13096
All garbage collections of processes now bump reductions. Also the amount of reductions bumped when garbage collecting has been adjusted. It now better corresponds to the amount of work performed. This in order to improve the real time characteristics of the system.
Own Id: OTP-13097
New functions that can load multiple modules at once
have been added to the '
Own Id: OTP-13111
The
The function
The undocumented and unsupported function
Own Id: OTP-13112
Low level BIF
Own Id: OTP-13122
Improved dirty scheduler implementation. For more
information see the
The dirty scheduler support is still experimental.
The support
for determining whether dirty NIF support exist or not at
compile time using the C preprocessor macro
The
Own Id: OTP-13123
Various optimizations done to process dictionary access.
Own Id: OTP-13167
Added max_heap_size process flag. max_heap_size allows
the user to limit the maximum heap used by a process. See
Own Id: OTP-13174
Allow dynamic drivers and NIF libraries to be built with
gcc option
Own Id: OTP-13227
Add
Own Id: OTP-13265
The functions
Own Id: OTP-13293
Improved memory allocation strategy for hipe native code
on x86_64 (amd64) architectures by reserving enough low
virtual address space needed for the HiPE/AMD64 small
code model. The default virtual address area for hipe
code is set to 512Mb, but can be changed with emulator
flag
Own Id: OTP-13359
Introduction of configurable management of data referred to by the message queue of a process. Each process can be configured individually.
It is now possible to configure the message queue of a process, so that all data referred by it will be kept outside of the heap, and by this prevent this data from being part of garbage collections.
For more information see the documentation of
Own Id: OTP-13366 Aux Id: OTP-13047
Processes now yield when scanning large message queues and not finding a matching message. This in order to improve real time characteristics.
Own Id: OTP-13401
Optimized an erts internal function that is used to traverse erlang terms. The internal function was mainly used by term_to_binary and comparison of terms. Benchmarks have shown up to a 10% performance increase in those functions after the optimization.
Own Id: OTP-13440
Add the following NIF API functions:
For details of what each function does, see the erl_nif documentation.
Own Id: OTP-13442
Optimize
Own Id: OTP-13487
Handle terms (pids,ports and refs) from nodes with a 'creation' value larger than 3. This is a preparation of the distribution protocol to allow OTP 19 nodes to correctly communicate with future nodes (20 or higher). The 'creation' value differentiates different incarnations of the same node (name).
Own Id: OTP-13488
Don't send unasked for systemd notifications in epmd
Own Id: OTP-13493 Aux Id: PR-999
The enif_send API has been extended to allow NULL to be used as the message environment. When used this way, a message environment is implicitly created and the given term is copied into that environment before sending. This can be an optimization if many small messages are being sent by the nif.
Own Id: OTP-13495
The tracing support has been extended to allow tracing on ports. Ports can be traced on using the 'ports', 'send' and 'receive' trace flags.
The first argument of
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13496
When the
This new trace event is marked as an incompatibility because tools that expect certain trace events when enabling 'procs' will have to updated.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13497
Add the
Own Id: OTP-13501
The erts internal tracing support has been changed to have much less overhead and be more scalable.
This rewrite does not break any backwards incompatibilities, but it does change the ordering of some trace messages when compared to previous releases. It should be noted that this only applies to trace messages sent to processes or ports, it does not apply to the new tracer module. However in future releases they may also be effected by this.
Trace messages are only guaranteed to be ordered from one
traced process or port. In previous releases this was not
visible as a
Own Id: OTP-13503
Add possibility to filter
Own Id: OTP-13507
Add
Own Id: OTP-13522 Aux Id: PR-1025
Introduce LTTng tracing via Erlang tracing.
For LTTng to be enabled OTP needs to be built with
configure option
The dynamic trace module
This feature also introduces an incompatible change in
trace tags. The trace tags
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-13532
Print heap pointers for garbing processes during crashdump
Own Id: OTP-13541 Aux Id: PR-1026
Changed and improved low level memory statistics returned
by
Own Id: OTP-13560
Add enif_snprintf to the NIF API
The function
Own Id: OTP-13580
The warning in the documentation for
Own Id: OTP-13599
Fix bugs caused by the VM sometimes truncating object sizes or offsets to 32 bits on 64-bit hosts. These bugs were mainly found when working with large unicode strings and nifs environments.
Own Id: OTP-13606
Add
Add
Own Id: OTP-13627
Own Id: OTP-13630
Fix possible race in poller wake up on windows
Own Id: OTP-13634
Fix performance bug in pre-allocators that could cause them to permanently fall back on normal more expensive memory allocation. Pre-allocators are used for quick allocation of short lived meta data used by messages and other scheduled tasks. Bug exists since OTP_R15B02.
Own Id: OTP-14491
Fixed bug in operator
Own Id: OTP-14514
A timer internal bit-field used for storing scheduler id was too small. As a result, VM internal timer data structures could become inconsistent when using 1024 schedulers on the system. Note that systems with less than 1024 schedulers are not effected by this bug.
This bug was introduced in ERTS version 7.0 (OTP 18.0).
Own Id: OTP-14548 Aux Id: OTP-11997, ERL-468
Fixed bug in
Own Id: OTP-14590 Aux Id: ERL-474
A bug has been fixed where if erlang was started +B on a unix platform it would be killed by a SIGUSR2 signal when creating a crash dump.
Own Id: OTP-13425 Aux Id: ERL-94
Calls to
Own Id: OTP-13866
Driver and NIF operations accessing processes or ports could cause an emulator crash when used from non-scheduler threads. Those operations are:
Own Id: OTP-13869
Fix bug in
Own Id: OTP-14159 Aux Id: ERL-340
Fixed a race that could cause a lost wakeup of a process
that timed out in a
Own Id: OTP-13798 Aux Id: OTP-11997
Fixed segfault after writing an erl crash dump.
Own Id: OTP-13799
Fix scheduler deadlock bug in
Own Id: OTP-13731 Aux Id: ERL-188
Own Id: OTP-13418
Make sure to create a crash dump when running out of memory. This was accidentally removed in the erts-7.3 release.
Own Id: OTP-13419
Schedulers could be woken by a premature timeout on Linux. This premature wakeup was however harmless.
Own Id: OTP-13420
A process communicating with a port via one of the
This bug was introduced in erts version 5.10 (OTP R16A).
Own Id: OTP-13424 Aux Id: OTP-10336
The reference count of a process structure could under rare circumstances be erroneously managed. When this happened invalid memory accesses occurred.
Own Id: OTP-13446
Fix race between
A process could terminate due to exit signal even though
Own Id: OTP-13452
The '-path' flag to 'erl' has been documented. This flag replaces the path specified in the boot script. It has always existed, but was earlier only documented in SASL (script).
Own Id: OTP-13060
The
This functionality now use Erlang monotonic time in order to measure time. Besides fixing the erroneous results due to OS system time being used, the results are often also better since Erlang monotonic time often has better accuracy and precision.
Own Id: OTP-13216
Fix behaviour of -delay_write command line switch of epmd, which is used for debugging - in some cases epmd was sleeping twice the requested amount of time.
Own Id: OTP-13220
Fix race between timeout and exit signal that could cause a process to ignore the exit signal and continue execution. Bug exist since OTP 18.0.
Own Id: OTP-13245
Fix bug in
Own Id: OTP-13251 Aux Id: ERL-49
Own Id: OTP-13254 Aux Id: OTP-11997, OTP-13222
Fix faulty error handling when writing to a compressed file.
Own Id: OTP-13270
Fix sendfile usage for large files on FreeBSD
Own Id: OTP-13271
Fix bug that could cause
Own Id: OTP-13282 Aux Id: ERL-79
Out of memory errors have been changed to cause an exit instead of abort.
Own Id: OTP-13292
When calling
Own Id: OTP-13298 Aux Id: OTP-11388
A workaround for an issue with older gcc versions (less
than 5) and inline assembly on 32-bit x86 caused an
emulator crash when it had been compiled with a newer gcc
version. An improved
Own Id: OTP-13326 Aux Id: ERL-80
Introduced new statistics functionality in order to more efficiently retrieve information about run able and active processes and ports. For more information see:
Own Id: OTP-13201
Time warp safety improvements.
Introduced the options
Introduced the option
Own Id: OTP-13222 Aux Id: OTP-11997
Fix a register race where down nodes goes undetected in epmd
Own Id: OTP-13301
Improved the gcc inline assembly implementing double word atomic compare and exchange on x86/x86_64 so that it also can be used when compiling with clang.
Own Id: OTP-13336
An optimization preventing a long wait for a scheduler thread looking up information about a process executing on another scheduler thread had unintentionally been lost in erts-5.10 (OTP R16A). This optimization has now been reintroduced.
Own Id: OTP-13365 Aux Id: OTP-9892
Introduced new statistics functionality in order to more efficiently retrieve information about run able and active processes and ports. For more information see:
Own Id: OTP-13201
Revert "Fix erroneous splitting of emulator path"
Own Id: OTP-13202
Fix HiPE enabled emulator for FreeBSD.
Own Id: OTP-13204 Aux Id: pr926
Small documentation fixes
Own Id: OTP-13017
Fix memory corruption bug caused by disabling distribution and then re-enable distribution with a node name that has previously been used by a remote node.
Own Id: OTP-13076 Aux Id: seq12959
Renamed variables with name bool as Visual Studio 2015 now treats this is a keyword.
Own Id: OTP-13079
Own Id: OTP-13102
Fixed compilation of erts together with libc versions that do not define __uint32_t.
Own Id: OTP-13105
erl -make now returns non-zero exit codes on failure
Own Id: OTP-13107
Fix crash on init:restart in embedded mode caused by on_load handler process not being relaunched leading to load failure for modules such as crypto and asn1rt_nif that need it to be present for correct NIF loading.
Own Id: OTP-13115
Fix maps decode in erlang:binary_to_term/1
Decoding a term with a large (HAMT) map in an small (FLAT) map could cause a critical error if the external format was not produced by beam.
Own Id: OTP-13125
Fix very rare bug in GC when big maps with a lot of hash collisions from a remote node are waiting in inner message queue.
Own Id: OTP-13146
Fixed a bug that could cause a crash dump to become almost empty.
Own Id: OTP-13150
Updated the xmllint target to just check the xml
files with real documentation content.
Corrected
some errors and added some missing target in the DTD's.
Own Id: OTP-13026
Add function enif_getenv to read OS environment variables in a portable way from NIFs.
Own Id: OTP-13147
Fix bug in ETS that could cause stray objects marked for
deletion to occasionally be missed by the cleanup done by
Own Id: OTP-12870
Fixed VM crash that could occur if a trace port was linked to a process, and the trace port terminated abnormally while handling a trace message. This bug has always existed in the runtime system with SMP support.
Own Id: OTP-12901
Instead of aborting, the vm now creates a crash dump when a system process is terminated.
Own Id: OTP-12934
Fixed a rare emulator dead lock that occurred when erlang:process_flag(priority,...) was called by a process that was also scheduled for an internal system activity.
Own Id: OTP-12943
The runtime system on various posix platforms (except for Linux and Solaris) could crash when large amounts of file-descriptors were in use.
Own Id: OTP-12954
A beam file compiled by hipe for an incompatible runtime system was sometimes not rejected by the loader, which could lead to vm crash. This fix will also allow the same hipe compiler to be used by both normal and debug-built vm.
Own Id: OTP-12962
Fix bug in
Own Id: OTP-12965
When tracing with
Own Id: OTP-12968
Fixed possible output deadlock in tty driver when hitting "CTRL-C" in a non-smp emulator shell on unix.
Own Id: OTP-12987 Aux Id: Seq12947
Fix
Own Id: OTP-12988
Suppress warning of unused argument when using macro enif_make_pid.
Own Id: OTP-12989
Changed default clock source used for OS system time on
MacOS X to
Own Id: OTP-12945 Aux Id: OTP-12892
Added the
Own Id: OTP-12971
Fixed a binary memory leak when printing to shell using the tty driver (i.e. not -oldshell).
Own Id: OTP-12941
Fix a bug where the standard error port sometimes crashes with eagain as the reason.
Own Id: OTP-12942
When tracing with
Own Id: OTP-12968
A process could end up in an inconsistent half exited state in the runtime system without SMP support. This could occur if the processes was traced by a port that it also was linked to, and the port terminated abnormally while handling a trace message for the process.
This bug has always existed in the runtime system without SMP support, but never in the runtime system with SMP support.
Own Id: OTP-12889 Aux Id: seq12885
Removed unnecessary copying of data when retrieving corrected Erlang monotonic time.
Own Id: OTP-12894
Changed default OS monotonic clock source chosen at build time. This in order to improve performance. The behavior will now on most systems be that (both OS and Erlang) monotonic time stops when the system is suspended.
If you prefer that monotonic time elapse during suspend
of the machine, you can pass the command line argument
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12895
Own Id: OTP-12896
The
Own Id: OTP-12892
Fix a rare hanging of the VM seen to happen just after emulator start. Bug exists since R14.
Own Id: OTP-12859 Aux Id: seq12882
Fix issuing with spaces and quoting in the arguments when using erlang:open_port spawn_executable on windows. The behavior now mimics how unix works. This change implies a backwards incompatibility for how spawn_executable works on windows.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11905
Fix global call trace when hipe compiled code call beam compiled functions. Tracing of beam functions should now alway work regardless who the caller is.
Own Id: OTP-11939
Correct cache alignment for ETS
Own Id: OTP-11974
All possibly blocking operations in the fd/spawn and terminal driver have been converted to non-blocking operations. Before this fix it was possible for the VM to be blocked for a long time if the entity consuming stdout/stderr did not consume it fast enough.
Own Id: OTP-12239
Add missing overhead for offheap binaries created from
external format. This fix can improve the garbage
collection of large binaries originating from
Own Id: OTP-12554
Ensure hashing of zero is consistent
Erlang treats positive and negative zero as equal:
However, Erlangs hash functions: hash, phash and phash2 did not reflect this behaviour. The hash values produced by the different hash functions would not be identical for positive and negative zero.
This change ensures that hash value of positive zero is always produced regardless of the signedness of the zero float, i.e.,
Own Id: OTP-12641
Ensure NIF term creation disallows illegal floating point values and too long atoms. Such values will cause a NIF to throw badarg exception when it returns.
Own Id: OTP-12655
Fixed building of Map results from match_specs
A faulty "box-value" entered into the heap which could cause a segmentation fault in the garbage collector if it was written on a heap fragment.
Own Id: OTP-12656
Fix hipe bug when matching a "writable" binary. The bug has been seen to sometimes cause a failed binary matching of a correct utf8 character, but other symptoms are also possible.
Own Id: OTP-12667
Keep dirty schedulers from waking other schedulers.
Own Id: OTP-12685
Disable floating point exceptions if the VM is compiled by clang/llvm. This is a known long-standing problem in clang/llvm.
Own Id: OTP-12717
Fix bug in
Own Id: OTP-12720
Fix the broken Android support in erl_child_setup.c
Own Id: OTP-12751
Faulty statistics reported by the
Own Id: OTP-12766
Fix two erts_snprintf() calls to correct sizes.
- run_erl.c (ose): Use the size of the signal type, not its pointer. - erl_node_tables.c: Use the size of the _BUFFER in erts_snprintf() to make sure we can use the full space.
Own Id: OTP-12771
Delayed memory allocations could be delayed an unnecessarily long time.
Own Id: OTP-12812
Make sure that timeouts on a pool of acceptors are released in the correct order.
Own Id: OTP-12817
Fix segmentation fault in module_info for deleted modules
Own Id: OTP-12820
Fix garbage collection of literals in code purge
During code purging and check_process_code, the checking of the binary reference embedded in the match binary state was omitted for the tracing tests. This would cause the binary match state to reference deallocated memory.
Own Id: OTP-12821
A bug has been corrected for gen_tcp:close so when {linger,{true,0}} is in effect it does not wait for data in the driver queue to transfer out before closing the port. Bug fix by Rory Byrne.
Own Id: OTP-12840
The documentation of the driver callback
Own Id: OTP-12855
Add
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11940
Debug function
Own Id: OTP-11941
The time functionality of Erlang has been extended.
This both includes a
Besides the API changes and time warp modes a lot of scalability and performance improvements regarding time management has been made internally in the runtime system. Examples of such improvements are scheduler specific timer wheels, scheduler specific BIF timer management, parallel retrieval of monotonic time and system time on systems with primitives that are not buggy.
Own Id: OTP-11997
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12099
New BIF:
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12151 Aux Id: seq12521
Make distributed send of large messages yield to improve real-time characteristics.
Own Id: OTP-12232
Use high accuracy poll timeouts
Where available, use poll/select API's that can handle time resolutions less than 1ms. In the cases where such API's are not available the timeout is rounded up to the nearest ms.
Own Id: OTP-12236
The internal group to user_drv protocol has been changed to be synchronous in order to guarantee that output sent to a process implementing the user_drv protocol is printed before replying. This protocol is used by the standard_output device and the ssh application when acting as a client.
This change changes the previous unlimited buffer when printing to standard_io and other devices that end up in user_drv to 1KB.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12240
The previously introduced "eager check I/O" feature is now enabled by default.
Eager check I/O can be disabled using the
Characteristics impact compared to previous default:
Own Id: OTP-12254 Aux Id: OTP-12117
Properly support maps in match_specs
Own Id: OTP-12270
The notice that a crashdump has been written has been moved to be printed before the crashdump is generated instead of afterwords. The wording of the notice has also been changed.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12292
New function
Own Id: OTP-12309
Tracing with cpu_timestamp option has been enabled on Linux.
Own Id: OTP-12366
ets:info/1,2 now contains information about whether write_concurrency or read_concurrency is enabled.
Own Id: OTP-12376
Improved usage of
The largest improvement will be seen when compiling with
a
For more information see the "
Own Id: OTP-12383
Introduce
Own Id: OTP-12411
The documentation of the Abstract Format (in the ERTS User's Guide) has been updated with types and specification. (Thanks to Anthony Ramine.)
The
explicit representation of parentheses used in types of
the abstract format has been removed. Instead the new
functions
Own Id: OTP-12492
Remove perfctr support
Development of perfctr in the linux kernel ceased in 2010. The perfctr support code in the Erlang VM is thus effectively dead code and therefor removed.
Own Id: OTP-12508
Own Id: OTP-12548
Use linear search for small select_val arrays
Own Id: OTP-12555
New BIF ets:update_counter/4 with a default object as argument, which will be inserted in the table if the key was not found.
Own Id: OTP-12563
Export missing types from zlib module
Own Id: OTP-12584
Use persistent hashmaps for large Maps
Maps will use a persistent hashmap implementation when the number of pairs in a Map becomes sufficiently large. The change will occur when a Map reaches 33 pairs in size but this limit might change in the future.
The most significant impact for the user by this
change is speed, and to a lesser degree memory
consumption and introspection of Maps. Memory consumption
size is probalistic but lesser than
Semantics of Maps have changed in two incompatible ways compared to the experimental implementation in OTP 17:
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12585
Scalability improvement for
Previous implementation generated a strictly monotonically increasing sequence of references corresponding to creation time on the runtime system instance. This is not the case with current implementation. You can only expect reference to be unique. The Erlang/OTP documentation has never mentioned anything else but the uniqueness property, so this change is fully compatible. The only reason we've marked this as a potential incompatibility is since an early draft for an Erlang specification mentions strict monotonicity as a property.
If you need to create data with a strict monotonicity
property use
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12610
Enable different abort signal from heart
By using environment variable HEART_KILL_SIGNAL, heart can now use a different signal to kill the old running Erlang.
By default the signal is SIGKILL but SIGABRT may also be used by setting environment variable: HEART_KILL_SIGNAL=SIGABRT
Own Id: OTP-12613 Aux Id: seq12826
Update autconf to latest version 2015-03-04
Own Id: OTP-12646
Optimization of timers internally in the VM. This include
process timers (
Each scheduler thread now has its own lock-free timer service instead of one locked central service. This dramatically improves performance of timer management on systems with a large amount of schedulers and timers.
The timer service internal data structure has also been optimized to be able to handle more timers than before. That is, each timer service is by its self able to handle more timers without dramatic performance loss than the old centralized timer service.
The API of BIF timers has also been extended. Timeout
values are for example no longer limited to 32-bit
integers. For more information see the documentation of
Characteristics impact: Calls to the synchronous versions
of
Own Id: OTP-12650 Aux Id: OTP-11997
Specialize instructions from common assembler patterns
Specialize common instructions of
Specialize move patterns from x-registers to the stack
with a new
Own Id: OTP-12690
Fix cross compilation for Android.
Own Id: OTP-12693
Fix incorrect use of autoconf macro AC_EGREP_CPP, which could cause faulty configuration if run from a path containing the string 'yes'.
Own Id: OTP-12706
Minimal Java version is now 1.6
Own Id: OTP-12715
Send format and args on process exit to error_logger
Previously, the emulator would generate a whole string
with values and call the error_logger passing
Own Id: OTP-12735
Map error logger warnings to warning messages by default.
Own Id: OTP-12755
Configure architecture ppc64le architecture as a ppc64
Own Id: OTP-12761
Add function
Own Id: OTP-12770
Optimized node table statistics retrieval.
Own Id: OTP-12777
Map beam error logger warnings to warning messages by default. Previously these messages were mapped to the error channel by default.
Own Id: OTP-12781
gen_tcp:shutdown/2 is now asynchronous
This solves the following problems with the old implementation:
It doesn't block when the TCP peer is idle or slow. This is the expected behaviour when shutdown() is called: the caller needs to be able to continue reading from the socket, not be prevented from doing so.
It doesn't truncate the output. The current version of gen_tcp:shutdown/2 will truncate any outbound data in the driver queue after about 10 seconds if the TCP peer is idle of slow. Worse yet, it doesn't even inform anyone that the data has been truncated: 'ok' is returned to the caller; and a FIN rather than an RST is sent to the TCP peer.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12797
Introduced delayed node table GC. This in order to avoid
oscillation of entries in and out of the tables. The
oscillation caused unnecessary lock contention on the
table locks. The delay length can be set by passing the
Characteristics impact: The tables can grow to very large
sizes with unused entries if the node is get huge amounts
of short lived connections from other nodes. This problem
can be alleviated by shortening the length of the delay
using the
Own Id: OTP-12802
Improved implementation of
Characteristics impact: The actual call to
Own Id: OTP-12842
There are many cases where user code needs to be able to distinguish between a socket that was closed normally and one that was aborted. Setting the option {show_econnreset, true} enables the user to receive ECONNRESET errors on both active and passive sockets.
Own Id: OTP-12843
Do not preallocate too large event pool
A default pool size of 4000 is too excessive for the common case. This corresponds directly to the number of threads in the system. Change ERTS_TS_EV_ALLOC_DEFAULT_POOL_SIZE to 2048. Change ERTS_TS_EV_ALLOC_POOL_SIZE to 32.
Own Id: OTP-12849
A process communicating with a port via one of the
This bug was introduced in erts version 5.10 (OTP R16A).
Own Id: OTP-13424 Aux Id: OTP-10336
Calls to
Own Id: OTP-13866
Driver and NIF operations accessing processes or ports could cause an emulator crash when used from non-scheduler threads. Those operations are:
Own Id: OTP-13869
Fix bug in
Own Id: OTP-14159 Aux Id: ERL-340
Fixed bug in operator
Own Id: OTP-14514
Fixed bug in
Own Id: OTP-14590 Aux Id: ERL-474
When calling
Own Id: OTP-13298 Aux Id: OTP-11388
Fixed a bug that could cause a crash dump to become almost empty.
Own Id: OTP-13150
The 'raw' socket option could not be used multiple times in one call to any e.g gen_tcp function because only one of the occurrences were used. This bug has been fixed, and also a small bug concerning propagating error codes from within inet:setopts/2.
Own Id: OTP-11482 Aux Id: seq12872
The VTS mode in Common Test has been modified to use a private version of the Webtool application (ct_webtool).
Own Id: OTP-12704 Aux Id: OTP-10922
Fix missing quotation in the
Own Id: OTP-12388
Fix erroneous printout of monitors in crashdump file.
Own Id: OTP-12537
The runtime system without SMP support could crash in the
BIF
Own Id: OTP-12544 Aux Id: Seq12777
Avoid corrupt oversized integer to be created from binary matching. Instead throw system_limit exception which is the correct behavior. A peculiar symptom of this bug was that bitwise operations (band, bor, bxor) on such oversized integers could return the empty list []. Credit: Mikael Pettersson, Nico Kruber
Own Id: OTP-12556
A race condition when calling
Own Id: OTP-12587
Fix comparison of exact terms. An overflow that could cause faulty comparisons has been fixed. Comparison of exact terms is exclusively used within Maps.
Own Id: OTP-12623
Fix bug in
Own Id: OTP-12624
Introduced a runtime system internal 64-bit API for atomic memory operations.
Own Id: OTP-12351
Add command line argument option for the initial size of process dictionaries.
Use '+hpds <size>' to set initial process dictionary size for spawned processes.
Own Id: OTP-12535 Aux Id: seq12809
Fix documentation on $char for Unicode
Own Id: OTP-12545
Fix getifaddrs realloc pointer error
When a buffer was exhausted and subsequently reallocated, we could get an unsafe pointer pointing to faulty memory.
For this to occur we would need to have a large number of interfaces and a reallocation of memory to a lower addresses.
The symptom would be garbage returned from erlang:port_control(Port, 25, []) (prim_inet:getifaddrs(Port) resulting in a badarg) or a segmentation fault.
Own Id: OTP-12445
Don't close all file descriptors twice in child_setup
The commit c2b4eab25c907f453a394d382c04cd04e6c06b49 introduced an error in which child_setup erroneously tried to close all file descriptors twice.
Use closefrom() if available when closing all file descriptors.
The function closefrom() was only used in the vfork() case before but is now also used in the fork() case if available.
Own Id: OTP-12446
During a crashdump all file descriptors are closed to ensure the closing of the epmd port and to reserve a file descriptor for the crashdump file.
If a driver (third party library) cannot handle closing of sockets this could result in a segmentation fault in which case a crashdump would not be produced. This is now fixed by only closing inets sockets via an emergency close callback to the driver and thus closing the epmd socket.
Own Id: OTP-12447
Fix HiPE debug lock checking on OS X 64bit
Position-independent code is mandatory on OS X. We use r11 as an intermediate register to fill BIF_P->hipe.bif_callee. This fixes the following error when doing `make debug FLAVOR=smp`:
clang -cc1as: fatal error: error in backend: 32-bit absolute addressing is not supported in 64-bit mode
Own Id: OTP-12188
Fix race bug that could cause VM crash in
Own Id: OTP-12208
Correct make variable SSL_DED_LD_RUNTIME_LIBRARY_PATH when erl_xcomp_sysroot ends with a slash.
Own Id: OTP-12216 Aux Id: seq12700
Fix two cases of unreachable code caused by false use of assigment operators.
Own Id: OTP-12222
Fix bug when hipe compiled code makes tail call to a BIF that disables GC while trapping (sush as binary_to_list, list_to_binary, binary_to_term, term_to_binary).
Own Id: OTP-12231
Fix bug when a migrated empty memory carrier is reused just before it should be destroyed by the thread that created it.
Own Id: OTP-12249
Prevents compile-time errors in NIFs, when the compiler is instructed to treat missing field initializers as errors, by adding an initializer for the new options field which was added to ErlNifEntry for 17.3.
Own Id: OTP-12266
Fixed CPU topology detection on FreeBSD systems where Erlang/OTP is compiled by new C compilers (including, but possibly not limited to, gcc 4.9 and clang).
Own Id: OTP-12267
Use C99 function isfinite() instead of finite() when available on non GCC compilers.
Own Id: OTP-12268
Fix bug on windows where an incorrect number of links could be returned when doing file:read_file_info on a directory.
Own Id: OTP-12269
Fix rare bug when purging module on VM started with +Meamin.
Own Id: OTP-12273
Repair run_erl terminal window size adjustment sent from to_erl. This was broken in OTP 17.0 which could lead to strange cursor behaviour in the to_erl shell.
Own Id: OTP-12275 Aux Id: seq12739
Fixed bug on windows causing gen_tcp/udp to return an error when given an fd to work with.
Own Id: OTP-12289
Fix various internal erts issues where negating a signed integer in C would trigger undefined behavior. This fixes issues when dividing with bignums and list_to_integer.
Own Id: OTP-12290
When flushing output to stdout on windows, the emulator could sometimes hang indefinitely waiting for the flush to complete. This has been fixed.
Own Id: OTP-12291
Fix so that non-smp emulators with dirty scheduler support shows the correct number of dirty schedulers when calling erlang:system_info(system_version).
Own Id: OTP-12295
Add
Own Id: OTP-12298
Fix bug that could cause the return value from dirty NIF with zero arity to be treated as garbage, leading to VM crash.
Own Id: OTP-12300
Improve allocation carrier migration search logic. This will reduce the risk of failed migrations that could lead to excess memory consumption. It will also improve smp performance due to reduced memory contention on the migration pool.
Own Id: OTP-12323
Introduced support for eager check I/O.
By default eager check I/O will be disabled, but this will most likely be changed in OTP 18. When eager check I/O is enabled, schedulers will more frequently check for I/O work. Outstanding I/O operations will however not be prioritized to the same extent as when eager check I/O is disabled.
Eager check I/O can be enabled using the
Characteristics impact when enabled:
Own Id: OTP-12117
Fix erts .app-file
Own Id: OTP-12189
Add configure option --with-ssl-incl=PATH to support OpenSSL installations with headers and libraries at different places.
Own Id: OTP-12215 Aux Id: seq12700
Optimization of atomic memory operations with release barrier semantics on 32-bit PowerPC when using the implementation included in OTP.
Own Id: OTP-12250
Minor adjustment of scheduler activation code making sure that an activation of a scheduler is not prevented by its run-queue being non-empty. (Thanks to Songlu Cai)
Own Id: OTP-12287
Improved support for atomic memory operations provided by
the
The
Own Id: OTP-12302
Add configure option --with-ssl-rpath to control which runtime library path to use for dynamic linkage toward OpenSSL.
Own Id: OTP-12316 Aux Id: seq12753
Added systemd notify support to epmd
Own Id: OTP-12321
Fix bug when an migrated empty memory carrier is reused just before it should be destroyed by the thread that created it.
Own Id: OTP-12249
Repair run_erl terminal window size adjustment sent from to_erl. This was broken in OTP 17.0 which could lead to strange cursor behaviour in the to_erl shell.
Own Id: OTP-12275 Aux Id: seq12739
General documentation updates.
Own Id: OTP-12052
A bug in the VM code implementing sending of signals
to ports could cause the receiving port queue to remain
in a busy state forever. When this state had been
reached, processes sending command signals to the port
either got suspended forever, or, if the
In order for this bug to be triggered on a port, one
had to at least once utilize the
Thanks Vasily Demidenok for reporting the issue, and Sergey Kudryashov for providing a testcase.
Own Id: OTP-12082 Aux Id: OTP-10336
Fix size overflow bug at memory allocation. A memory allocation call, with an insane size close to the entire address space, could return successfully as if it had allocated just a few bytes. (Thanks to Don A. Bailey for reporting)
Own Id: OTP-12091
Fix various issues where negating a signed integer would trigger undefined behaviour. This fixes issues in the enif_make_int64 interface and some edge cases inside the erlang runtime system.
Own Id: OTP-12097
The documentation erroneously listed the
Own Id: OTP-12102 Aux Id: OTP-10994
Profiling messages could be delivered out of order when
profiling on
Own Id: OTP-12105 Aux Id: OTP-10336
Various logging fixes, including: Add run queue index to
the process dump in crash dumps.
Add thread index to
enomem slogan when crashing.
Remove error logger
message for sending messages to old instances of the same
node.
Own Id: OTP-12115
Fix compiler warnings reported by LLVM
Own Id: OTP-12138
Correct conversion of
Own Id: OTP-12140
Fix bug in
Own Id: OTP-12141
Real_path method used while prim loading archive files was not taking into account the fact that windows directory symlinks can be across different drives.
Own Id: OTP-12155
Add log2 histogram to lcnt for lock wait time
Own Id: OTP-12059
Introduced
The
The
See the
Thanks to Steve Vinoski.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-12128
OTP-11850 fixed filelib:wildcard/1 to work with broken symlinks. This correction, however, introduced problems since symlinks were no longer followed for functions like filelib:ensure_dir/1, filelib:is_dir/1, filelib:file_size/1, etc. This is now corrected.
Own Id: OTP-12054 Aux Id: seq12660
Fixed ETHR_FORCE_INLINE which caused the build to break on some platforms without adequate thread support (VxWorks).
Own Id: OTP-12010
The documentation for
Own Id: OTP-11849
Fix broken system monitoring of
Own Id: OTP-11852
The emulator without SMP support crashed when passing a
message to a process without enough heap space for the
message. This bug was introduced in
Own Id: OTP-11887 Aux Id: OTP-11388
Fix race between ETS table deletion and unfixation that could cause VM crash. The race could happen between a terminating process that does not own the table but has a fixation on it and another process that deletes the table (maybe the owner terminating) at the same time. Bug existed since R15B02.
Own Id: OTP-11892
The string following the
That bug would cause the build of Erlang/OTP to fail when building in a directory whose pathname contained non-US ASCII characters encoded in UTF-8. (Thanks to Eric Pailleau for reporting this bug.)
Own Id: OTP-11916
Fix erts_debug:size/1 to handle Map sizes
Own Id: OTP-11923
Removed
Own Id: OTP-11942
Fixed compilation using mingw-w64 on Windows.
Thanks to Jani Hakala.
Own Id: OTP-11945
The git sha is no longer printed in the shell start header when erlang is built from a tagged git release.
Own Id: OTP-11961
Fixed a bug where
Own Id: OTP-11968
The following native functions now bump an appropriate amount of reductions and yield when out of reductions:
Characteristics impact:
Own Id: OTP-11888
The systemd features of epmd have been removed from epmd by default. To enable them you have to build erlang with the configure option --enable-systemd.
Own Id: OTP-11921
Removed Erlang wrapper code used when calling
Own Id: OTP-11931
Add erlang:system_info(tolerant_timeofday), an API to check whether compensation for sudden changes of system time is enabled or not.
Own Id: OTP-11970
Fix broken system monitoring of
Own Id: OTP-11852
Fixed type spec of
Own Id: OTP-11859 Aux Id: OTP-11615
The option dupnames did not work as intended in re. When looking for names with {capture, [Name, ...]}, re:run returned a random instance of the match for that name, instead of the leftmost matching instance, which was what the documentation stated. This is now corrected to adhere to the documentation. The option {capture,all_names} along with a re:inspect/2 function is also added to further help in using named subpatterns.
Own Id: OTP-11205
Allow loading of NIF library with unicode path name
Own Id: OTP-11408
Allow loading of driver with unicode path name
Own Id: OTP-11549
Fixed a bug where starting Erlang without having an open stdin on fd 0 would sometimes deadlock the emulator when terminating.
Own Id: OTP-11558
The option '-names' in epmd now works on Windows (Thanks to Johannes Weißl)
Own Id: OTP-11565
Correction of the examples in escript documentation. (Thanks to Pierre Fenoll).
Own Id: OTP-11577
Fix bs_get_integer instruction
The instruction bs_get_integer could unnecessarily trigger a garbage collection in failure cases which is unwanted or outright dangerous.
Ex:
<<X:Sz,_/bits>> = <<"some binary">>
Previously, if Sz induced X to a bignum it would reserved memory size this on the heap via a garbage collection before checking if the size could actually match.
It will now check the binary size before triggering a collection.
Own Id: OTP-11581
Remove heap space overestimation in
Own Id: OTP-11585
Add support for detecting the separate tinfo library from ncurses (Thanks to Dirkjan Ochtman)
Own Id: OTP-11590
Deprecation warning for system_flag(cpu_topology) has been extended for removal in OTP 18 (Thanks to Steve Vinoski for the update)
Own Id: OTP-11602
Documentation improvement regarding some awkward wording around the +spp flag. (Thanks to Brian L. Troutwine )
Own Id: OTP-11607
Fixed bug where sendfile would return the wrong error code for a remotely closed socket if the socket was in passive mode. (Thanks to Vincent Siliakus for reporting the bug.)
Own Id: OTP-11614
Increase garbage collection tenure rate
The garbage collector tries to maintain the previous heap block size during a minor gc, i.e. 'need' is not utilized in determining the size of the new heap, instead it relies on tenure and garbage to be sufficiently large.
In instances during intense growing with exclusively live data on the heap coupled with delayed tenure, fullsweeps would be triggered directly after a minor gc to make room for 'need' since the new heap would be full.
To remedy this, the tenure of terms on the minor heap will always happen (if it is below the high watermark) instead of every other minor gc.
Characteristics Impact: Reduced CPU-time spent in garbage collection but may infer delays in collecting garbage from the heap. Tweak 'fullsweep_after' options to increase gc pressure if needed.
Own Id: OTP-11617
Fix bug when comparing integers with floats larger than 2^992. The bug could potentially cause memory corruption on 32-bit emulators.
Own Id: OTP-11618
Cross-compilation fixes for TileraMDE-3.0.1.125620
Own Id: OTP-11635
sendfile no longer uses async threads by default
This has been done because a slow client attack is possible if the async thread pool is used. The scenario is:
Client does a request for a file and then slowly receives the file one byte at a time. This will eventually fill the async thread pool with blocking sendfile operations and thus starving the vm of all file operations.
If you still want to use the async threads pool for sendfile an option to enable it has been introduced.
Thanks to Christopher Faulet for identifying this vulnerability.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11639
Do proper rollback of calls to
Own Id: OTP-11722
Changed the default configuration when configuring with
Previously floating point exceptions got enabled by
default on Linux when HiPE was enabled when configuring
with
For more information see
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11723
A comment in erl_db_tree.c no longer differ from the code. (Thanks to Cobus Carstens)
Own Id: OTP-11793
Fix epmd debug functionality for VxWorks (Thanks to Jay True)
Own Id: OTP-11808
Use closefrom/2 when available in child_setup (Thanks to Rick Reed and Anthony Ramine)
Own Id: OTP-11809
Fix dtrace/systemtap bug where the probe arguments would be concatenated due to faulty length calculation.
Thanks to Michal Ptaszek and Scott Lystig Fritchie
Own Id: OTP-11816
It is now better documented that the
Own Id: OTP-11818
Options to set match_limit and match_limit_recursion are added to re:run. The option report_errors is also added to get more information when re:run fails due to limits or compilation errors.
Own Id: OTP-10285
Dialyzer's
Own Id: OTP-10908
A common case is to wrap an argument to
Impact: May cause incompatibility since a single binary
is no longer copied. Use
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11082
Make erlang:open_port/2 spawn and spawn_executable handle unicode.
Own Id: OTP-11105
Handle unicode (widestring) in erl, erlc, heart, etc on windows.
Own Id: OTP-11135
The version of the PCRE library Used by Erlang's re module is raised to 8.33 from 7.6. This means, among other things, better Unicode and Unicode Character Properties support. New options connected to PCRE 8.33 are also added to the re module (ucd, notempty_atstart, no_start_optimize). PCRE has extended the regular expression syntax between 7.6 and 8.33, why this imposes a potential incompatibility. Only very complicated regular expressions may be affected, but if you know you are using obscure features, please test run your regular expressions and verify that their behavior has not changed.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11204
Filenames containing UTF-8 encoded characters can now be handled by erlc.
If you have set the
Own Id: OTP-11248
By giving --enable-static-{nifs,drivers} to configure it is now possible to statically linking of nifs and drivers to the main Erlang VM binary. At the moment only the asn1 and crypto nifs of the Erlang/OTP nifs and drivers have been prepared to be statically linked. For more details see the Installation Guide in the System documentation.
Own Id: OTP-11258
Erlang/OTP has been ported to the realtime operating
system OSE. The port supports both smp and non-smp
emulator. For details around the port and how to started
see the User's Guide in the
Note that not all parts of Erlang/OTP has been ported.
Notable things that work are: non-smp and smp emulators, OSE signal interaction, crypto, asn1, run_erl/to_erl, tcp, epmd, distribution and most if not all non-os specific functionality of Erlang.
Notable things that does not work are: udp/sctp, os_mon, erl_interface, binding of schedulers.
Own Id: OTP-11334
Add the {active,N} socket option for TCP, UDP, and SCTP, where N is an integer in the range -32768..32767, to allow a caller to specify the number of data messages to be delivered to the controlling process. Once the socket's delivered message count either reaches 0 or is explicitly set to 0 with inet:setopts/2 or by including {active,0} as an option when the socket is created, the socket transitions to passive ({active, false}) mode and the socket's controlling process receives a message to inform it of the transition. TCP sockets receive {tcp_passive,Socket}, UDP sockets receive {udp_passive,Socket} and SCTP sockets receive {sctp_passive,Socket}.
The socket's delivered message counter defaults to 0, but it can be set using {active,N} via any gen_tcp, gen_udp, or gen_sctp function that takes socket options as arguments, or via inet:setopts/2. New N values are added to the socket's current counter value, and negative numbers can be used to reduce the counter value. Specifying a number that would cause the socket's counter value to go above 32767 causes an einval error. If a negative number is specified such that the counter value would become negative, the socket's counter value is set to 0 and the socket transitions to passive mode. If the counter value is already 0 and inet:setopts(Socket, [{active,0}]) is specified, the counter value remains at 0 but the appropriate passive mode transition message is generated for the socket.
Thanks to Steve Vinoski
Own Id: OTP-11368
A new optional scheduler utilization balancing mechanism
has been introduced. For more information see the
Characteristics impact: None, when not enabled. When enabled, changed timing in the system, normally a small overhead due to measuring of utilization and calculating balancing information. On some systems, such as old Windows systems, the overhead can be quite substantial. This time measurement overhead highly depend on the underlying primitives provided by the OS.
Own Id: OTP-11385
A call to either the
The
Characteristics impact: A call to the
Own Id: OTP-11388 Aux Id: OTP-11535, OTP-11648
Cleanup 'Buckets' and 'Time left' fields in crashdump to ease parsing.
Own Id: OTP-11419
Add sync option to file:open/2.
The sync option adds the POSIX O_SYNC flag to the open system call on platforms that support the flag or its equivalent, e.g., FILE_FLAG_WRITE_THROUGH on Windows. For platforms that don't support it, file:open/2 returns {error, enotsup} if the sync option is passed in. Thank to Steve Vinoski and Joseph Blomstedt
Own Id: OTP-11498
erlang:binary_to_term will now cost an appropriate amount of reductions and will interrupt (yield) for reschedule if the term is big. This avoids too long schedules when binary_to_term is used. (Thanks to Svante Karlsson for the original patch)
Impact: Programs running binary_to_term on large binaries will run more smoothly, but rescheduling will impact the single process performance of the BIF. Single threaded benchmarks might show degraded performance of the BIF, while general system behaviour will be improved.
Own Id: OTP-11535 Aux Id: OTP-11388
Added high resolution icon for windows. (Thanks to Daniel Goertz for the inspiration.)
Own Id: OTP-11560
Migration of memory carriers has been enabled by default
on all ERTS internal memory allocators based on the
By passing
Characteristics impact: Improved memory characteristics with a smaller memory footprint at the expense of a quite small performance cost.
Own Id: OTP-11604 Aux Id: OTP-10279
A clarification has been added to the documentation of
Own Id: OTP-11611
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11612
EEP43: New data type - Maps
With Maps you may for instance:
For information on how to use Maps please see Map Expressions in the
The current implementation is without the following features:
Note that Maps is experimental during OTP 17.0.
Own Id: OTP-11616
The previously deprecated driver API function
Thanks to Steve Vinoski.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11628
Experimental "dirty scheduler" functionality has been
introduced. In order to try the functionality out, you
need to pass the command line argument
Dirty schedulers can currently only be used by NIFs on a
system with SMP support. More information can be found in
the
Note that the functionality is experimental, and not supported. This functionality will be subject to backward incompatible changes. You should not enable the dirty scheduler functionality on production systems. It is only provided for testing.
Thanks to Steve Vinoski.
Own Id: OTP-11629
Improve reduction cost and yielding of
Impact: Improves system responsiveness when
Own Id: OTP-11648 Aux Id: OTP-11388
By default, the system's version of zlib will be used,
provided its version is 1.2.4 or higher; otherwise the
built-in zlib will be used. The built-in version of zlib
has been bumped to 1.2.8. (Use the
Own Id: OTP-11669
The default float encoding in binary_to_term and external_size has been changed to use minor_mode 1 instead of 0.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11738
Introduced the
Own Id: OTP-11742
Halfword emulator is marked as deprecated. It still works as before but is planned to be removed in a future major release.
Own Id: OTP-11777
The external format for Maps has changed in a way that is not compatible with the format used in OTP 17.0-rc1 and OTP 17.0-rc2.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11782
Fixed faulty make dependency that would make some make versions fail while building gen_git_version.mk.
Own Id: OTP-11784
Introduced functionality for allowing old drivers and NIF
libraries to be loaded during a transition period. For
more information see
Own Id: OTP-11799
Support file paths longer than 259 characters on Windows.
Long absolute paths are automatically converted to UNC
format with a
Own Id: OTP-11813
Document that escript:create/2 also accepts a 3-elements tuple containing files and zip:create/3 options to build a zip file.
Thanks to Pierre Fenoll
Own Id: OTP-11827
Add systemd socket activation for epmd.
Thanks to Matwey V. Kornilov
Own Id: OTP-11829
When using gen_tcp:connect and the
Own Id: OTP-12061
When normalizing paths, erl_prim_loader would always convert backslash to forward slash. This is correct on Windows, but not on other operating systems. erl_prim_loader now checks which OS is running before performing this conversion.
Own Id: OTP-11170
Fixed syslog defines and defined LOG_ERR for systems without syslog.h. Thanks to Matt Lewandowsky.
Own Id: OTP-11349
Check all pattern arguments passed to binary:matches/2. Thanks to Mike Sassak.
Own Id: OTP-11350
Fix two small silent rules omissions. Thanks to Anthony Ramine.
Own Id: OTP-11351
Teach configure to detect if posix_memalign cannot align to more than the system page size.
For cross-compiled systems a new environment variable called erl_xcomp_posix_memalign has been introduced to indicate whether posix_memalign should be used.
Own Id: OTP-11371
Fix bsr bug occurring when shifting a huge number a huge number of bits to the right. Thanks to Lars Hesel Christensen.
Own Id: OTP-11381
Fix memory leak for distributed monitors
Own Id: OTP-11410
Fix various typos in erts, kernel and ssh. Thanks to Martin Hässler.
Own Id: OTP-11414
Crashdumps initiated by out-of-memory on process spawn could cause the beam to segfault during crashdump writing due to invalid pointers.
The pointers are invalid since the process creation never finished. This fix removes these processes from the printouts. Reported by Richard Carlsson.
Own Id: OTP-11420
Crash dumps from 64-bit Erlang machines would have all memory addresses truncated to 32 bits, which could cause trouble inspecting processes message queues and stacks in the crashdump viewer.
Own Id: OTP-11450
Threads other than schedulers threads could make thread
unsafe accesses when support for migration of memory
carriers had been enabled, i.e., when the
This bug was introduced in erts-5.10.2 when the support for migration of memory carriers was introduced.
Own Id: OTP-11456 Aux Id: OTP-10279
Fix bug in
Own Id: OTP-11479
Under rare circumstances a process calling
Own Id: OTP-11491
Fix bug that could cause a 32-bit emulator to always crash at start (since R16B01) depending on the alignment of static data in the beam executable.
Own Id: OTP-11496
Fix benign bugs regarding bitstring compare. Only a nuisance for debug and valgrind VM.
Own Id: OTP-11501
Silence warnings (Thanks to Anthony Ramine)
Own Id: OTP-11517
The default wordsize of the emulator (beam) is now determined by compiler default on Mac OSX (Darwin). This was previously forced to 32bits by the configure script unless otherwise specified.
Own Id: OTP-11521
A new memory allocation feature called "super carrier" has been introduced. The super carrier feature can be used in different ways. It can for example be used for pre-allocation of all memory that the runtime system should be able to use.
By default the super carrier is disabled. It is enabled
by passing the
Since it is disabled by default there should be no impact on system characteristics if not used.
This change has been marked as a potential
incompatibility since the returned list when calling
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11149
Added erlang:system_info(ets_limit) to provide a way to retrieve the runtime's maximum number of ETS tables. Thanks to Steve Vinoski
Own Id: OTP-11362
Add new BIF os:unsetenv/1 which deletes an environment variable. Thanks to Martin Hässler.
Own Id: OTP-11446
Introduced a new guarantee regarding exit signals from ports:
If the process calling one of the synchronous port BIFs listed below is linked to the port identified by the first argument, and the port exits before sending the result of the port operation, the exit signal issued due to this link will be received by the processes before the BIF returns, or fail with an exception due to the port not being open.
The synchronous port BIFs are:
Note that some ports under certain circumstances unlink themselves from the calling process before exiting, i.e. even though the process linked itself to the port there might be no link triggering an exit signal.
Characteristics impact: The return or exception from the synchronous port BIF will be delayed if the port simultaneously exit due to some issue unrelated to the outstanding synchronous port BIF call. In all other cases characteristics are unchanged.
Own Id: OTP-11489
Memory allocators will be able to create
Windows systems will create carriers using
Own Id: OTP-11318
The documentation of predefined types and built-in types has been corrected.
Own Id: OTP-11090
Fix changing terminal parameters in to_erl
Change the behaviour of to_erl to use TCSADRAIN instead of TCSANOW when changing terminal parameters. This makes the serial driver wait for the output queues to be empty before applying the terminal parameter change. Thanks to Stefan Zegenhagen.
Own Id: OTP-11206
The default value of {flush, boolean()} in erlang:halt/2 is documented to be 'true' if the status is an integer. The implementation behaviour was reversed. The Implementation is now corrected to adhere to the documentation. Thanks to Jose Valim for reporting the error.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11218
Fix serious race bug in R16B01 that could cause PID mix-ups when a lot of processes were spawned and terminated in a very rapid pace on an SMP emulator with at least two scheduler threads.
Own Id: OTP-11225
Validating a trace pattern with the option silent no longer incorrectly enables/disables the silent option of the calling process.
Own Id: OTP-11232
Fixed a bug where GCC 4.8 and later use a more aggressive loop optimization algorithm that broke some previously working code in the efile driver. Thanks to Tomas Abrahamsson for reporting this issue.
Own Id: OTP-11246
Fixed bug when printing memory allocator acul option in crash dump.
Own Id: OTP-11264
Opening a new compressed file on Windows could in rare (random) cases result in {error,eisdir} or other error codes although it should have succeeded. This is now corrected.
Own Id: OTP-11265
Fixed a race condition when closing a trace port that would cause the emulator to crash.
Own Id: OTP-11290
There is a new somewhat experimental socket option 'netns' that can set the network namespace for a socket on Linux:es where it is supported. See the documentation.
Own Id: OTP-11157
New allocator strategy
Own Id: OTP-11174
Introduced functionality for inspection of system and build configuration.
Own Id: OTP-11196
Fix matching of floating point middle-endian machines. Thanks to Johannes Weissl.
Own Id: OTP-11201
Fix compile error on ARM and GCC versions greater than 4.1.0. Thanks to Johannes Weissl.
Own Id: OTP-11214
run_erl: Redirect standard streams to /dev/null. Thanks to Johannes Weissl.
Own Id: OTP-11215
Misc. corrections in documentation for erl_driver. Thanks to Giacomo Olgeni.
Own Id: OTP-11227
Fix documentation regarding binary_part.
Own Id: OTP-11239
Make edlin understand a few important control keys. Thanks to Stefan Zegenhagen.
Own Id: OTP-11251
Export type zlib:zstream/0. Thanks to Loic Hoguin.
Own Id: OTP-11278
Add erl option to set schedulers by percentages.
For applications where measurements show enhanced performance from the use of a non-default number of emulator scheduler threads, having to accurately set the right number of scheduler threads across multiple hosts each with different numbers of logical processors is difficult because the erl +S option requires absolute numbers of scheduler threads and scheduler threads online to be specified.
To address this issue, add a +SP option to erl, similar to the existing +S option but allowing the number of scheduler threads and scheduler threads online to be set as percentages of logical processors configured and logical processors available, respectively. For example, "+SP 50:25" sets the number of scheduler threads to 50% of the logical processors configured, and the number of scheduler threads online to 25% of the logical processors available. The +SP option also interacts with any settings specified with the +S option, such that the combination of options "+S 4:4 +SP 50:50" (in either order) results in 2 scheduler threads and 2 scheduler threads online.
Thanks to Steve Vinoski
Own Id: OTP-11282
Extend erl_driver interface with lock names
Lock and thread names are already a feature in the driver interface. This extension will let developers read these names which eases debugging.
Own Id: OTP-11303
Fix incorrect values returned by integer_to_binary/2. Thanks to Juan Jose Comellas.
Own Id: OTP-11311
Fix system_flag scheduling_statistics - disable . Thanks to Steve Vinoski.
Own Id: OTP-11317
The documentation of predefined types has been corrected Thanks to Kostis Sagonas.
Own Id: OTP-11321
A bug in prim_inet has been corrected. If the port owner was killed at a bad time while closing the socket port the port could become orphaned hence causing port and socket leaking. Reported by Fred Herbert, Dmitry Belyaev and others.
Own Id: OTP-10497 Aux Id: OTP-10562
Compilation fixes for NetBSD. Thanks to YAMAMOTO Takashi.
Own Id: OTP-10941
Fixed a race condition when using delayed_write when writing to a file which would cause the same data to be written multiple times.
Own Id: OTP-10984
Fix small memory leak from tracing with option
Own Id: OTP-10997
Correct typo in erlsrv usage. Thanks to Bryan Hunter
Own Id: OTP-11002
ct_run: delete unused function. Thanks to Tuncer Ayaz.
Own Id: OTP-11003
Corrections to run_erl/to_erl handshake behaviour.
Own Id: OTP-11012
Fix typo in type: erlang:process_info_item(). Thanks to Andrew Tunnell-Jones.
Own Id: OTP-11024
Fix src/dest overlap issue in ttsl driver. Thanks to Steve Vinoski.
Own Id: OTP-11064
When sending to a port using
Own Id: OTP-11076 Aux Id: OTP-10336
When converting a faulty binary to a list with unicode:characters_to_list, the error return value could contain a faulty "rest", i.e. the io_list of characters that could not be converted was wrong. This happened only if input was a sub binary and conversion was from utf8. This is now corrected.
Own Id: OTP-11080
Runtime system could crash when reporting stale
Own Id: OTP-11084
Fix lock order violation for memory instrumentation (+Mim, +Mis, +Mit).
Own Id: OTP-11085
Fixed some compilation warnings on miscellaneous platforms. Thanks to Anthony Ramine.
Own Id: OTP-11086
Fixed issue when flushing i/o during shutdown on windows where the Erlang VM would sometime hang due to a race condition.
Own Id: OTP-11096
Fixed issue where repeated calls to erlang:nodes() could cause unnecessary contention in the dist_table lock.
Own Id: OTP-11097
Properly guard WIDE_TAG use with HAVE_WCWIDTH in ttsl_drv. Thanks to Anthony Ramine
Own Id: OTP-11106
Fix some Makefile rules that didn't support silent rules. Thanks to Anthony Ramine.
Own Id: OTP-11111
Fix receive support in erl_eval with a BEAM module. Thanks to Anthony Ramine.
Own Id: OTP-11137
erlang:now() could suddenly jump ~24 days into the future on Windows. This is now corrected. Thanks to Garret Smith for reporting and testing fixes.
Own Id: OTP-11146
erlang:term_to_binary will now cost an appropriate amount of reductions and will interrupt (yield) for reschedule if the term is big. This avoids too long schedules when term_to_binary is used.
Impact: Programs running term_to_binary on large terms will run more smothly, but rescheduling will impact the single process performance of the BIF. Single threaded benchmarks will show degraded performance of the BIF when called with very large terms, while general system behaviour will be improved. The overhead for allowing restart and reduction counting also degrades local performance of the BIF with between 5% and 10% even for small terms.
Own Id: OTP-11163
Replaced the lock protecting gathering of garbage collection statistics with a lock-free solution.
Own Id: OTP-10271 Aux Id: kunagi-108 [04c5410f-9cc4-4696-8639-36bf98686c7a-7]
Support for migration of memory carriers between memory allocator instances has been introduced.
By default this feature is not enabled and do not effect the characteristics of the system. When enabled it has the following impact on the characteristics of the system:
For more information, see the documentation of the
Own Id: OTP-10279
Change specs for spawn_opt to use the process_level() type declaration instead of re-defining it in various places. Thanks to Kostis Sagonas.
Own Id: OTP-11008
Postscript files no longer needed for the generation of PDF files have been removed.
Own Id: OTP-11016
Erlang source files with non-ASCII characters are now encoded in UTF-8 (instead of latin1).
Own Id: OTP-11041 Aux Id: OTP-10907
Optimization of simultaneous
Impact on the characteristics of the system: Improved performance.
Own Id: OTP-11074
The
Own Id: OTP-11075 Aux Id: OTP-10336
A new better algorithm for management of the process, and port tables has been introduced.
Impact on the characteristics of the system:
Due to the above mensioned potential incompatibility,
it will still be possible to enable the old algorithm for
some time. The command line argument
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-11077
Support wide characters in the shell through wcwidth(). Thanks to Anthony Ramine. Reported by Loïc Hoguin.
Own Id: OTP-11088
Added total used memory for each process in erlang crash dumps.
Own Id: OTP-11098
Added support for hipe on Raspberry Pi (armv6l). Thanks to Klaus Alfert.
Own Id: OTP-11125
Remove 'query' from the list of reserved words in docs. Thanks to Matthias Endler and Loïc Hoguin.
Own Id: OTP-11158
Lift static limitation (FD_SETSIZE) for file descriptors on Mac OS X. (Thanks to Anthony Ramine)
Own Id: OTP-11159
Miscellaneous native code in OTP misbehave either due to lengthy execution, or due to not bumping reductions properly. Problems typically occur when passing huge sets of data to a misbehaving BIF. Fixing this has high priority and is being worked on, but there will remain issues like this for some time.
In order to alleviate problems with scheduling which
might occur when executing misbehaving native code, the
command line argument
By default this feature is disabled and you are advised not to enable it if you do not encounter problems with misbehaving native code.
When enabled it has the following impact on the characteristics of the system:
Own Id: OTP-11164
A bug in the implementation of offline schedulers has been fixed. The bug was introduced in OTP-R16A/ERTS-5.10, and caused work-stealing between schedulers to fail. This in turn, caused work to accumulate in some run-queues. The bug was only triggered when there were offline schedulers in the system, i.e., when the amount of online schedulers was less than the total amount of schedulers. The effect of the bug got more severe the larger amount of offline schedulers the system had.
Own Id: OTP-11022 Aux Id: OTP-9892
The BIF
Own Id: OTP-10926
Fix a problem in
Own Id: OTP-10932
The
Own Id: OTP-11000
Scheduler threads will now by default be less eager
requesting wakeup due to certain cleanup operations. This
can also be controlled using the
Own Id: OTP-10994
Threads created internally in the runtime system by
vanilla, fd, and spawn drivers on Windows systems could
make thread unsafe calls to
Own Id: OTP-10802
Threads created internally in the runtime system by the vanilla, fd, and spawn drivers on Windows systems could make unsafe memory accesses to driver data after port had terminated.
Own Id: OTP-10803
The runtime system could crash when flushing data to standard out or standard error on Windows.
Own Id: OTP-10807
Bugs due to the port optimizations introduced in erts-5.10/OTP-R16A have been fixed:
Own Id: OTP-10809 Aux Id: OTP-10336
Fix
Own Id: OTP-10824
Fix rounding issues in float_to_list/1,2. Thanks to Serge Aleynikov
Own Id: OTP-10837
Fix memory leak in file driver introduced in R16A.
Own Id: OTP-10841
A bug in an ERTS internal queue implementation could cause the loss of a wake up signal to a consumer thread. This has now been fixed.
The effect of this bug, when triggered, was often only a small or even no delay of certain operations. This since, threads often are woken due to other unrelated reasons. However, if the consumer thread was not woken due to other reasons when the bug was triggered, these operations could be left hanging, potentially for ever. Such effects seems to have been very rare, but we have on at least one occasion gotten a report about such an issue.
Operations potentially effected by this bug:
Own Id: OTP-10854
OS X Snow Leopard now only uses write, as writev does not work properly on very large files.
Own Id: OTP-10858
Fixed a bug where line oriented file I/O using read_ahead was very slow for files with very large difference in line length.
Own Id: OTP-10859
In erts-5.10 (R16A) faulty hashvalues were produced for non-ASCII atoms (characters in byte-range 128..255). This has now been fixed and hashvalues conforms to previous OTP releases.
Own Id: OTP-10860
Fixes of memory accesses that might be thread unsafe when the runtime system has been linked against third-party libraries for atomic memory operations during the build. Most builds are uneffected by this bug. If triggered, the runtime system will most likely crash more or less immediately.
Own Id: OTP-10875 Aux Id: OTP-10854
Fixed a bug where it was longer possible to give the +sws proposal flag to non-smp emulators.
Own Id: OTP-10881 Aux Id: seq12258
Faulty type to bytes read for ReadFile on Windows. This could cause windows systems to misbehave. The correct type is now used.
Own Id: OTP-10890
Change default max ports for Windows to 8192. Having a
too large value caused Windows to not be able to recover
properly. If you want to use another value, pass
Own Id: OTP-10892
Fix rare crash on halfword vm during code loading.
Own Id: OTP-10896
Tuple funs (deprecated in R15B) are no longer supported.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10170
Added four new bifs,
These bifs are auto-imported into erlang source files and
can therefore be used without the
Own Id: OTP-10300 Aux Id: kunagi-74 [74]
The experimental support for packages has been removed.
Own Id: OTP-10348 Aux Id: kunagi-316 [227]
The driver API function
These functions are provided in order to better support co-operative scheduling, improve system responsiveness, and to make it easier to prevent misbehaviors of the VM due to a process or port monopolizing a scheduler thread. They can be used when dividing lengthy work into a number of repeated calls without the need to use threads.
Own Id: OTP-10810
The list_to_integer/2 bif has been optimized when used with bases other than 10.
Own Id: OTP-10834 Aux Id: kunagi-74 [74]
The git commit sha of the HEAD commit is now added to the Erlang shell when compiling a non-released Erlang version.
Own Id: OTP-10838
Change caching policy for memory segment allocator. For instance, prefer sbc segments over mbc segments, caching policy is time-arrow aware, evicting older cached segments to store newer segments.
The default
number of cachable segment has been increased from five
to ten segments. This can be modified, same as before,
with the command line option
Impact: Increased speed for processing on larger
objects, e.g. binaries. Slight increase of mapped and
resident memory. Tune your system with memory options to
Own Id: OTP-10840
Updated config.sub and config.guess to latest version from gnu.org
Own Id: OTP-10848
Add an xcomp file for Blue Gene/Q. Thanks to Kostis Sagonas.
Own Id: OTP-10849
Cleanup of documentation of the type language. Thanks to Kostis Sagonas.
Own Id: OTP-10850
Change the return value of hipe_bifs:remove_refs_from/1. Thanks to Kostis Sagonas.
Own Id: OTP-10851
As of ERTS-5.10/OTP-R16A node names passed in the EPMD protocol are required to be encoded in UTF-8. Since EPMD previously accepted latin1 encoded node names this is an incompatibility. However, since Erlang nodes always have required characters in node names to be 7-bit ASCII characters (and still do require this), this incompatibility should not effect anyone using EPMD as an Erlang Port Mapper Daemon.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10872 Aux Id: OTP-10753
The +pc flag to erl can be used to set the range of characters considered printable. This affects how the shell and io:format("~tp",...) functionality does heuristic string detection. More can be read in STDLIB users guide.
Own Id: OTP-10884
Fix a number of type cast errors related to formatted printing on Win64 that can potentially cause problem when the Erlang VM exceeds 4 GB of ram. (Thanks to Blaine Whittle for the original patch)
Own Id: OTP-10887
The effect of the deprecated environment variable ERL_MAX_PORTS had been removed premeturely. It has now been readded. Note that this is still scheduled to be released in R17B.
Own Id: OTP-10895
Set new peeled off SCTP socket to nonblocking socket (Thanks to Jonas Falkevik)
Own Id: OTP-10491
Fix various typos (thanks to Tuncer Ayaz)
Own Id: OTP-10611
Fix fd leak when using async thread pool
When using the async thread pool, if an erlang process asks to open a file and it gets shutdown/killed while the file:open/2 call hasn't returned, it's possible to leak a file descriptor against the target file. This has now been fixed. (Thanks to Filipe David Manana)
Own Id: OTP-10677
Use sys/types.h instead of string.h to pull ssize_t definition to erl_driver.h. This fixes build issue on NetBSD. (Thanks to Yamamoto Takashi).
Own Id: OTP-10699
Arguments given with the -run or -s flags to erl are now translated according to the file name encoding mode of the runtime system.
Own Id: OTP-10702
The octet counters in the gen_tcp/inet interface could behave in unexpected ways on 64bit platforms. The behaviour is now as expected.
Own Id: OTP-10746
Certain linux kernels, most notably in redhat and CentOS distribution, had a bug in writev which generated an infinite loop in the tcp code of the VM. The bug is now worked around.
Own Id: OTP-10747
A process that got killed (got an exit signal) while operating on a compresseed file, could cause a segmentation fault in the VM. This is now corrected. Thanks to Filipe David Manana for identifying the problem and submitting a solution.
Own Id: OTP-10748
Windows previously used three digit exponent in formatting which caused difference between platforms, as can be seen by float_to_list/1. This has now been fixed.
Own Id: OTP-10751
A boolean socket option 'ipv6_v6only' for IPv6 sockets
has been added. The default value of the option is OS
dependent, so applications aiming to be portable should
consider using
Own Id: OTP-8928 Aux Id: kunagi-193 [104]
It is now allowed to define stubs for BIFs, to allow
type specs to be written for BIFs. For example, if there
is BIF called
Own Id: OTP-9861
Process optimizations. The most notable:
These changes imply changes of the characteristics the system. Most notable: changed timing in the system.
Own Id: OTP-9892 Aux Id: OTP-10167
Non-blocking code loading. Earlier when an Erlang module was loaded, all other execution in the VM were halted while the load operation was carried out in single threaded mode. Now modules are loaded without blocking the VM. Processes may continue executing undisturbed in parallel during the entire load operation. The load operation is completed by making the loaded code visible to all processes in a consistent way with one single atomic instruction. Non-blocking code loading will improve realtime characteristics when modules are loaded/upgraded on a running SMP system.
Own Id: OTP-9974
In the SMP emulator, turning on and off tracing will no longer take down the system to single-scheduling.
Own Id: OTP-10122
Remove VxWorks support
Own Id: OTP-10146
Added a general framework for executing benchmarks of Erlang/OTP. Benchmarks for the Erlang VM and mnesia have been incorporated in the framework.
For details about how to add more benchmarks see $ERL_TOP/HOWTO/BENCHMARKS.md in the source distribution.
Own Id: OTP-10156
Optimized deletion of ETS-tables which significantly improves performance when large amounts of temporary tables are used.
This change imply changes of the characteristics the system. Most notable: changed timing in the system.
Own Id: OTP-10167 Aux Id: OTP-9892
Tuple funs (deprecated in R15B) are no longer supported.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10170
New internal header scheme for allocators
Impact: Reduces size on object allocated in multiblock carriers by one word
Own Id: OTP-10273 Aux Id: kunagi-20 [20]
Major port improvements. The most notable:
These changes imply changes of the characteristics of the system. The most notable:
Potential incompatibilities:
The
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10336 Aux Id: OTP-9892
The experimental support for packages has been removed.
Own Id: OTP-10348 Aux Id: kunagi-316 [227]
Wrong parameters when setting seq_trace-tokens from within a trace-pattern could crash the VM. This is now corrected.
Own Id: OTP-10522
Erlang specification 4.7.3 defines max tuple size to 65535 elements It is now enforced to no more than 16777215 elements (arity 24 bits)
Previous edge cases (28 bits) were not validated and could cause undefined behaviour.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10633
Add insert_element/3 and delete_element/2
Own Id: OTP-10643
The previous default of a maximum of 32768 simultaneous
processes has been raised to 262144. This value can be
changed using the the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10647 Aux Id: OTP-9892, OTP-10336
The previously (in R15) proposed scheduler wakeup strategy is now used by default. This strategy is not as quick to forget about previous overload as the previous strategy.
This change imply changes of the characteristics the system. Most notable: When a small overload comes and then disappears repeatedly, the system will for a bit longer time be willing to wake up schedulers than before. Timing in the system will due to this also change.
The previous strategy can still be enabled by passing the
Own Id: OTP-10661 Aux Id: OTP-10033
The
Own Id: OTP-10668
Support ANSI in console
Unix platforms will no longer filter control sequences to the ttsl driver thus enabling ANSI and colors in console. (Thanks to Pedram Nimreezi)
Own Id: OTP-10678
Add file:allocate/3 operation
This operation allows pre-allocation of space for files. It succeeds only on systems that support such operation. (Thanks to Filipe David Manana)
Own Id: OTP-10680
Treat
Own Id: OTP-10683
Implement ./otp_build configure --enable-silent-rules
With silent rules, the output of make is less verbose and compilation warnings are easier to spot. Silent rules are disabled by default and can be disabled or enabled at will by make V=0 and make V=1. (Thanks to Anthony Ramine)
Own Id: OTP-10726
Use share flags for all file operations on Windows. Thanks to Filipe David Borba Manana.
Own Id: OTP-10727
Make/fakefop adjustments. Thanks to Tuncer Ayaz and Sebastian Rasmussen.
Own Id: OTP-10733
The runtime system will now by default use 10 async threads if thread support has been enabled when building the runtime system.
This will prevent long blocking file-operations from blocking scheduler threads for long periods of time, which can be harmful. Apart from file-operations, it also effects other operations scheduled on the async thread pool by user implemented drivers.
The amount of async threads can be controlled by using
the
This change imply changes of the characteristics the system compared to the previous default. The responsiveness of the system as a whole will be improved. Operations scheduled on the async thread pool will get an increased latency. The throughput of these operations may increase, or decrease depending on the type of the operations and how they get scheduled. In the case of file operations, the throughput very much depends on how the Erlang application access files. Multiple concurrent accesses to different files have the potential of an increased throughput.
Own Id: OTP-10736
The default reader group limit has been increased to 64
from 8. This limit can be set using the
This change of default value will reduce lock contention
on ETS tables using the
Own Id: OTP-10737
New BIF float_to_list/2 which solves a problem of float_to_list/1 that doesn't allow specifying the number of digits after the decimal point when formatting floats (Thanks to Serge Aleynikov).
Own Id: OTP-10752
Limited support for unicode atoms in the external format and in the internal representation of the vm. This is a preparative feature in order to support communication with future releases of Erlang/OTP that may create unicode atoms.
Own Id: OTP-10753
Increased potential concurrency in ETS for
Own Id: OTP-10787
Create an erl_crash.dump if no heart exists and no ERL_CRASH_DUMP_SECONDS is set (behaviour changed).
Don't create an erl_crash.dump if heart do exists and no ERL_CRASH_DUMP_SECONDS is set (behaviour not changed).
This changes the behaviour back to the R15B02 default considering if a beam was running with no heart.
Own Id: OTP-10602
Fix linking in OpenBSD. (Thanks to Matthew Dempsky)
Own Id: OTP-10395
Fix bug causing fallback atomics to be used even though healthy gcc atomics or libatomic_ops was detected.
Own Id: OTP-10418
Ensure 'erl_crash.dump' when asked for it. This will change erl_crash.dump behaviour.
* Not setting ERL_CRASH_DUMP_SECONDS will now terminate beam immediately on a crash without writing a crash dump file.
* Setting ERL_CRASH_DUMP_SECONDS to 0 will also terminate beam immediately on a crash without writing a crash dump file, i.e. same as not setting ERL_CRASH_DUMP_SECONDS environment variable.
* Setting ERL_CRASH_DUMP_SECONDS to a negative value will let the beam wait indefinitely on the crash dump file being written.
* Setting ERL_CRASH_DUMP_SECONDS to a positive value will let the beam wait that many seconds on the crash dump file being written.
A positive value will set an alarm/timeout for restart both in beam and in heart if heart is running.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-10422 Aux Id: kunagi-250 [161]
Fix bug where MSVRT100.dll was not included in the windows installer.
Own Id: OTP-10481
In the expression
Own Id: OTP-10524
The runtime system could crash while scheduling a port task. The port task was scheduled either due to an external I/O event being triggered, a driver timeout being triggered, or data being sent over a distribution channel.
Own Id: OTP-10556
Own Id: OTP-10558
Fix compile error in generated file hipe_amd64_bifs.S for Solaris.
Own Id: OTP-10577
A faulty spec for process_info/2 could cause false dialyzer warnings. The spec is corrected.
Own Id: OTP-10584
In very rare cases, the VM could crash if a garbage collector was called while executing an appending bit syntax instruction. The symptom was a core when reallocating memory in the function erts_bs_append. The garbage collector bug is now corrected.
Own Id: OTP-10590
Improve support for building and testing in embedded ppc environments.
Own Id: OTP-10265 Aux Id: kunagi-159 [daf97f67-5724-4812-a5b6-7e86990133d2-1]
Due to a race condition on Windows, sometimes when printing to standard output and then immediately terminating erlang all data would not be printed. The emulator now waits for all data to be printed before exiting.
Own Id: OTP-10325 Aux Id: kunagi-166 [dd72d0e2-3e76-4a51-8b56-7564e24eecae]
The frequency with which sleeping schedulers are woken due to outstanding memory deallocation jobs has been reduced.
Own Id: OTP-10476 Aux Id: OTP-10162
Clearer warnings about the dangers of misuse of
Own Id: OTP-10557
Fix erl_prim_loader errors in handling of primary archive. The following errors have been corrected:
Thanks to Tuncer Ayaz and Shunichi Shinohara for reporting and co-authoring corrections.
Own Id: OTP-10071
Fix: Add port-I/O statistics for active once and true and not only active false.
Own Id: OTP-10073
The 64-bit windows installer did not look in the right directories for 64-bit version of Microsoft Visual C++ 2010 Redistibutable Package and hence took the wrong decision about having to install the redistributable package if the 32-bit version was installed but not the 64-bit and vice versa. This bug has now been fixed Furthermore the sub-installer for the redistributable package is now run in silent mode if the erlang installer is.
Own Id: OTP-10096
epmd would fail to start automatically when starting a distributed erlang node installed in a location with a whitespace in the path.
Own Id: OTP-10106
A more or less harmless bug that sometimes caused memory deallocations to be delayed longer than intended has been fixed.
Own Id: OTP-10116
Fix bug causing emulator crash when running HiPE on ARM. Bug has existed since R15B.
Own Id: OTP-10137
A bug regarding spaces in C function prototypes has been fixed. (Thanks to Richard O'Keefe.)
Own Id: OTP-10138
Corrected dtrace pid length in message related probes. (Thanks to Zheng Siyao)
Own Id: OTP-10142
Correct formating in exit error messages
Ensure displayed sizes are not negative. (Thanks to Michael Santos)
Own Id: OTP-10148
fix escript/primary archive reloading
If the mtime of an escript/primary archive file changes after being added to the code path, correctly reload the archive and update the cache. (Thanks to Tuncer Ayaz)
Own Id: OTP-10151
Doc fix: link from erlang:now/0 to os:timestamp/0
Sometimes os:timestamp/0 is more appropriate than erlang:now/0. The documentation for the former has a link to the latter; this patch adds a link in the other direction to make os:timestamp/0 more visible. Thanks to Magnus Henoch
Own Id: OTP-10180
The caret in the werl window (on Windows) could appear at the wrong place after regaining focus. This is now corrected.
Own Id: OTP-10181
Fix bug that in some cases could cause corrupted binaries
in ETS tables with
Own Id: OTP-10182
Fix use of "clever" mktime
Commit 1eef765 introduced regression (conditional _always_ evaluates to true) in which erlang:localtime_to_universaltime/2 stopped working on systems configured with timezone without DST (i.e. UTC) on *BSD platforms: 1> erlang:localtime_to_universaltime({{2012,1,1},{0,0,0}}, true). ** exception error: bad argument Thanks to Piotr Sikora
Own Id: OTP-10187
Relocate bodies of DTrace probes to the statically-linked VM.
Due to various operating systems (in both the DTrace and SystemTap worlds) not fully supporting DTrace probes (or SystemTap-compatibility mode probes) in shared libraries, we relocate those probes to the statically-linked virtual machine. This could be seen as pollution of the pristine VM by a (yet) experimental feature. However:
1. This code can be eliminated completely by the C preprocessor. 2. Leaving the probes in the dyntrace NIF shared library simply does not work correctly on too many platforms. *Many* thanks to Macneil Shonle at Basho for assisting when my RSI-injured fingers gave out. (note: Solaris 10 and FreeBSD 9.0-RELEASE can take a long time to compile)
Own Id: OTP-10189
Fix bug in
Own Id: OTP-10190
Supplying a filename longer than the operating system MAX_PATH to file:read_link/1 would cause a crash (Segemntation fault/Critical Error) on all platforms. This is now corrected.
Own Id: OTP-10200
If Perl was configured to interpret files as being
encoded in UTF-8, the build would crash in
Own Id: OTP-10201
Fix the erlc -MP flag
Because of a copy-and-paste error in erlc.c, the -MP flag had the same effect as -MG. As a workaround, you had to pass +makedep_phony to enable the MP option. This patch makes -MP work as intended.
Own Id: OTP-10211
Allow mixed IPv4 and IPv6 addresses to sctp_bindx
Also allow mixed address families to bind, since the first address on a multihomed sctp socket must be bound with bind, while the rest are to be bound using sctp_bindx. At least Linux supports adding address of mixing families. Make inet_set_faddress function available also when HAVE_SCTP is not defined, since we use it to find an address for bind to be able to mix ipv4 and ipv6 addresses. Thanks to Tomas Abrahamsson
Own Id: OTP-10217
Fix support for leap seconds-aware timezones
erlang:universaltime_to_localtime is leap seconds-aware (since 2008), however erlang:localtime_to_universaltime is not, which gives surprising results on systems configured with leap seconds-aware timezones: 1> erlang:universaltime_to_localtime({{2012,1,1},{0,0,0}}). {{2012,1,1},{0,0,0}} 2> erlang:localtime_to_universaltime({{2012,1,1},{0,0,0}}). {{2012,1,1},{0,0,24}} and completely breaks calendar:local_time_to_universal_time_dst: 3> calendar:local_time_to_universal_time_dst({{2011,1,1},{0,0,0}}). [] Thanks to Piotr Sikora
Own Id: OTP-10227
erlsrv: gracefully stop emulator on Windows shutdown
Windows will send the SERVICE_CONTROL_SHUTDOWN event to the service control handler when shutting down the system. Instead of ignoring the event, erlsrv will now invoke the stop action. Likewise, the Erlang emulator (and it's po drivers) must not quit upon reception of the CTRL_SHUTDOWN_EVENT event in th console control handler. Thanks to Jan Kloetzke
Own Id: OTP-10228
Fix dtrace bug in file rename operation.
Own Id: OTP-10234
Fix bug in memory management of driver port data locks
(PDL). In some cases PDLs could be deallocated before
Own Id: OTP-10249
Add port and suspend options to lock-counter profiling. (Thanks to Rick Reed)
Own Id: OTP-10051
Latency when using the active_once option in gen_tcp communication is reduced.
Own Id: OTP-10055 Aux Id: sto139
Remove bit8 option support from inet
Own Id: OTP-10056
The OS Pid of a port program is now available by calling erlang:port_info(Port,os_pid), Thanks to Matthias Lang for the original patch.
Own Id: OTP-10057
Fix openpty usage in run_erl.
Reopening a slave file descriptor which was closed earlier could lead to a misbehaving connection. This has now been remedied.
Own Id: OTP-10076
Remove all code, documentation, options and diagnostic functions which were related to the experimental hybrid heap implementation.
Own Id: OTP-10105
Optimizations of memory deallocations.
Own Id: OTP-10162 Aux Id: OTP-7775
Optimization of process locking.
Own Id: OTP-10163
Added a xcomp example file for powerpc-dso-linux-gnu
Own Id: OTP-10198
Detect when middle endian doubles are used by a platform and account for it when decoding floats. (Thanks to Mike Sperber)
Own Id: OTP-10209
On Linux systems using heart (erl -heart) and a HEAR_BEAT_TIMEOUT less than default, heart could fire even though Erlang was running fine after approx 298 to 497 days (depending on kernel config). This was due to the behaviour of the times(2) system call. Usage of times(2) is now replaced with clock_gettime(2) and the CLOCK_MONOTONIC clock, resulting in a more stable solution. The Erlang VM itself has used clock_gettime(2) on linux since before R12B, so this only affects the heart program.
Own Id: OTP-10111 Aux Id: seq12075
If threads support for the runtime system had been
disabled at compile time (
Due to this bug the file driver did not split tasks into smaller chunks, but instead completed the whole task at once, i.e., the scheduler got occupied with I/O for a longer time than intended.
Own Id: OTP-10059
A proposal for a new scheduler wakeup strategy has been
implemented. For more information see the documentation
of the
Own Id: OTP-10033 Aux Id: Seq12025
A switch for configuration of busy wait length for
scheduler threads has been added. For more information
see the documentation of the
Own Id: OTP-10044 Aux Id: Seq11976
The extra memory barriers introduced by bug-fix OTP-9281
were unnecessarily used also on tables without the
OTP-9281 (R14B03): ETS tables using the
Own Id: OTP-10048 Aux Id: OTP-9281
Own Id: OTP-9849
Calling trace_info/2 asking for information about a function that had native could could crash the run-time system.
Own Id: OTP-9886
reduce smp locking time range in erts_garbage_collect (thanks to Jovi Zhang)
Own Id: OTP-9912
Fix typo in supervisor behaviour doc (Thanks to Ricardo Catalinas Jiménez)
Own Id: OTP-9924
Correct spelling of registered (Thanks to Richard Carlsson)
Own Id: OTP-9925
erts: Remove unused variable (Thanks to Jovi Zhang)
Own Id: OTP-9926
Fix bug in ETS with
Own Id: OTP-9932
Handle Linux OS where /sys/devices/system/node is only readable by root. Fallback to /sys/devices/system/cpu for topology info.
Own Id: OTP-9978
When an escript ends now all printout to standard output and standard error gets out on the terminal. This bug has been corrected by changing the behaviour of erlang:halt/0,1, which should fix the same problem for other escript-like applications, i.e that data stored in the output port driver buffers got lost when printing on a TTY and exiting through erlang:halt/0,1.
The BIF:s erlang:halt/0,1 has gotten improved semantics and there is a new BIF erlang:halt/2 to accomplish something like the old semantics. See the documentation.
Now erlang:halt/0 and erlang:halt/1 with an integer argument will close all ports and allow all pending async threads operations to finish before exiting the emulator. Previously erlang:halt/0 and erlang:halt(0) would just wait for pending async threads operations but not close ports. And erlang:halt/1 with a non-zero integer argument would not even wait for pending async threads operations.
To roughly the old behaviour, to not wait for ports and async threads operations when you exit the emulator, you use erlang:halt/2 with an integer first argument and an option list containing {flush,false} as the second argument. Note that now is flushing not dependant of the exit code, and you can not only flush async threads operations which we deemed as a strange behaviour anyway.
Also, erlang:halt/1,2 has gotten a new feature: If the first argument is the atom 'abort' the emulator is aborted producing a core dump, if the operating system so allows.
Own Id: OTP-9985
Added check to inet driver to avoid building on operating systems that do not yet have IPv6 compatible socket API. (Thanks to Peer Stritzinger)
Own Id: OTP-9996
Fix bug when the number of CPUs actually found is lower than the configured value. (Thanks to Benjamin Herrenschmidt)
Own Id: OTP-10004
The runtime system without SMP support and without thread
support erroneously busy waited when no work was present.
This bug first appeared in
Own Id: OTP-10019
Various typographical errors corrected in documentation for common_test, driver, erl_driver and windows installation instructions. (Thanks to Tuncer Ayaz)
Own Id: OTP-10037
Fix memory leak caused by race on exiting process
Own Id: OTP-10041
Add
Own Id: OTP-9858
ERTS internal API improvements. In some cases the amount of atomic read operations needed have been reduced due to this.
Own Id: OTP-9922
The DTrace source patch from Scott Lystig Fritchie is integrated in the source tree. Using an emulator with dtrace probe is still not supported for production use, but may be a valuable debugging tool. Configure with --with-dynamic-trace=dtrace (or --with-dynamic-trace=systemtap) to create a build with dtrace probes enabled. See runtime_tools for documentation and examples.
Own Id: OTP-10017
enif_make_copy may invalidate enif_inspect_binary.
Own Id: OTP-9828
A feature test for the
Own Id: OTP-9843
I/O events could potentially be delayed for ever when enabling kernel-poll on a non-SMP runtime system executing on Solaris. When also combined with async-threads the runtime system hung before completing the boot phase. This bug was introduced in erts-5.9/OTP-R15B.
Own Id: OTP-9844
Honor option
Own Id: OTP-9389
A few contracts in the
Own Id: OTP-9616
The Unicode noncharacter code points 16#FFFE and 16#FFFE
were not allowed to be encoded or decoded using the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9624
Make epp search directory of current file first when including another file This completes a partial fix in R11 that only worked for include_lib(). (Thanks to Richard Carlsson)
Own Id: OTP-9645
Fixed memory leak in
Own Id: OTP-9668
The number of beam catches allowed in code are no longer statically defined and will grow according to its need.
Own Id: OTP-9692
Add missing parenthesis in heart doc.
Add missing spaces in the Reference Manual distributed section.
In the HTML version of the doc those spaces are necessary to separate those words.
Own Id: OTP-9693
Fixes module erlang doc style: option description (Thanks to Ricardo Catalinas Jiménez)
Own Id: OTP-9697
Specifying a scope to binary:match/3 when using multiple searchstrings resulted in faulty return values. This is now corrected.
Own Id: OTP-9701
The runtime system crashed if more than one thread tried to exit the runtime system at the same time.
Own Id: OTP-9705
Fix documentation for erlang:process_flag/2
For the subsection about process_flag(save_calls, N) there's an unrelated paragraph about process priorities which was copied from the preceding subsection regarding process_flag(priority, Level). (Thanks to Filipe David Manana)
Own Id: OTP-9714
Calls to
A spinlock used by the run-queue management sometimes got heavily contended. This code has now been rewritten, and the spinlock has been removed.
Own Id: OTP-9727
Use libdlpi to get physical address (Thanks to Trond Norbye)
Own Id: OTP-9818
An option list argument can now be passed to
Own Id: OTP-7687
A number of memory allocation optimizations have been implemented. Most optimizations reduce contention caused by synchronization between threads during allocation and deallocation of memory. Most notably:
Own Id: OTP-7775
The ethread atomic memory operations API used by the runtime system has been extended and improved.
The ethread library now also performs runtime tests for presence of hardware features, such as for example SSE2 instructions, instead of requiring this to be determined at compile time.
All uses of the old deprecated atomic API in the runtime system have been replaced with the use of the new atomic API. In a lot of places this change imply a relaxation of memory barriers used.
Own Id: OTP-9014
gen_sctp:open/0-2 may now return {error,eprotonosupport} if SCTP is not supported
gen_sctp:peeloff/1 has been implemented and creates a one-to-one socket which also are supported now
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9239
Sendfile has been added to the file module's API. sendfile/2 is used to read data from a file and send it to a tcp socket using a zero copying mechanism if available on that OS.
Thanks to Tuncer Ayaz and Steve Vinovski for original implementation
Own Id: OTP-9240
enif_get_reverse_list function added to nif API. This function should be used to reverse small lists which are deep within other structures making it impractical to do the reverse in Erlang.
Own Id: OTP-9392
The deprecated concat_binary/1 BIF has been removed. Use
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9421
Erlang/OTP can now be built using parallel make if you
limit the number of jobs, for instance using '
Own Id: OTP-9451
Line number and filename information are now included
in exception backtraces as a fourth element in the MFA
tuple. The information will be pretty-printed by the
shell and used by
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9468
All binary constants used to be handled as heap binaries (i.e. the entire binary would be copied when sent to another process). Binary constants larger than 64 bytes are now refc binaries (i.e. the actual data in the binary will not be copied when sent to another process).
Own Id: OTP-9486
If a float and an integer is compared, the integer is only converted to a float if the float datatype can contain it. Otherwise the float is converted to an integer.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9497
Add NIF function enif_is_number
This function allows for easily determining if a term represents or not a number (integer, float, small or big).(Thanks to Filipe David Manana)
Own Id: OTP-9629
The ERTS internal system block functionality has been replaced by new functionality for blocking the system. The old system block functionality had contention issues and complexity issues. The new functionality piggy-backs on thread progress tracking functionality needed by newly introduced lock-free synchronization in the runtime system. When the functionality for blocking the system isn't used, there is more or less no overhead at all. This since the functionality for tracking thread progress is there and needed anyway.
Own Id: OTP-9631
An ERTS internal, generic, many to one, lock-free queue for communication between threads has been introduced. The many to one scenario is very common in ERTS, so it can be used in a lot of places in the future. Currently it is used by scheduling of certain jobs, and the async thread pool, but more uses are planned for the future.
Drivers using the driver_async functionality are not automatically locked to the system anymore, and can be unloaded as any dynamically linked in driver.
Scheduling of ready async jobs is now also interleaved in between other jobs. Previously all ready async jobs were performed at once.
Own Id: OTP-9632
Tuple funs (a two-element tuple with a module name and a
function) are now officially deprecated and will be
removed in R16. Use '
Own Id: OTP-9649
Changed the internal BIF calling convention. Will make simpler faster code and allow BIFs with an arbitrary arity.
Own Id: OTP-9662
Windows native critical sections are now used internally in the runtime system on Windows as mutex implementation. This since they perform better under extreme contention than our own implementation.
Own Id: OTP-9671
Convert some erl_nif macros into inline functions. Allow for better compile time type checking. (Thanks to Tuncer Ayaz)
Own Id: OTP-9675
The
Own Id: OTP-9695
The build system has been updated so that Erlang/OTP can be built on Mac OS X Lion systems without a GCC compiler. The INSTALL guide has been updated with instructions on how to install a GCC compiler and build Erlang/OTP with it, in order to get a run-time system with better performance.
Own Id: OTP-9712
When loading a module, the system use to run on a single scheduler during the entire loading process. This has been changed to only take down the system just before inserting the loaded code into the system tables, resulting in a much shorter disruption if a module is loaded in a busy system. (Suggested by Bob Ippolito.)
Own Id: OTP-9720
Possible to run HiPE without floating point exceptions (FPE). Useful on platforms that lack reliable FPE. Slower float operations compared to HiPE with FPE.
Own Id: OTP-9724
As of ERTS version 5.9 (OTP-R15B) the runtime system will by default not bind schedulers to logical processors.
If the Erlang runtime system is the only operating system process that binds threads to logical processors, this improves the performance of the runtime system. However, if other operating system processes (as for example another Erlang runtime system) also bind threads to logical processors, there might be a performance penalty instead. In some cases this performance penalty might be severe. Due to this, we change the default so that the user must make an active decision in order to bind schedulers.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9726
The use of
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9749
An ancient workaround for a Windows bug was removed from the open_port code, open_port({spawn,...}...) is now faster. Thanks to Daniel Goertzen.
Own Id: OTP-9766
The use of deprecated 32bit time_t on 32bit Windows is removed.
Own Id: OTP-9767
The NIF
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9771
The driver interface has been changed to enable 64-bit
aware drivers. Most importantly the return types for
ErlDrvEntry callbacks 'call' and 'control' has ben
enlarged which require drivers to be changed or they will
cause emulator crashes. See
Due to this driver
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-9795
Eliminate use of deprecated regexp module
Own Id: OTP-9810
Several bugs concerning constant binary constructions such as <<0:4294967295>> have been corrected. Depending on the actual size of the binary and the type of run-time system (32-bit, halfword, 64-bit), such expression could either crash the run-time system or make the loader refuse loading of the module.
Own Id: OTP-9284
The Erlsrv utility failed to stop the erlang machine if no StopAction was defined when the service was stopped. This is now corrected.
Own Id: OTP-9344
Due to a bug in glibc the runtime system could abort while trying to destroy a mutex. A fix for this was introduced in R14B02. This fix did, however, not solve the problem. The runtime system will now issue a warning instead of aborting.
Own Id: OTP-9373 Aux Id: OTP-9009
Replace atom in DRV macro in prim_file with string
An experimental version of Dialyzer discovered that the atom that replaced the DRV macro in prim_file ends up in calls to erlang:open_port({spawn, Driver}, Portopts) as the Driver argument. The documentation states that this call requires a string there.
This change is also consistent with the one introduced in commit 0f03b1e9d2bef3bc830c31a369261af4c5234727 by Kostis Sagonas.
Own Id: OTP-9377
Fix typos in the epmd documentation (Thanks to Holger Weiß )
Own Id: OTP-9387
Fix faulty integer terms created by NIF API from 64-bit integers on halfword emulator. (Thanks to Paolo Negri and Paul Davis)
Own Id: OTP-9394
Fix
Own Id: OTP-9427 Aux Id: seq11855
The ets:test_ms function could in rare cases truncate the error messages. This is now corrected.
Own Id: OTP-9435
Fix bug related to hibernate and HiPE (clear F_HIBERNATE_SCHED flag)
F_HIBERNATE_SCHED flag that was introduced in b7ecdcd1ae9e11b8f75e must be cleared in hipe_mode_switch as well. Otherwise, processes running HiPE code that hibernate, wake up and then trap into a BIF will not be rescheduled.(Thanks to Paul Guyot)
Own Id: OTP-9452
Fix bug in FreeBSD topology detection code (Thanks to Paul Guyot)
Own Id: OTP-9453
Fix use of logical operator && with constant operand instead of bitwise & (Thanks to Cristian Greco)
Own Id: OTP-9454
inet: error if fd does not match socket domain
If an IPv4 fd is opened as an IPv6 socket, unexpected behaviour can occur. For example, if an IPv4 UDP socket is opened and passed into Erlang as an IPv6 socket, the first 3 bytes (corresponding to 1 byte representing the protocol family, 2 bytes set to the port) are stripped from the payload. The cause of the UDP payload truncation happens in inet_drv.c:packet_inet_input when a call to inet_get_address fails silently because the family is set to PF_INET6 but the buffer len is the size of an IPv4 struct sockaddr_in.
(Thanks to Andrew Tunnell-Jones for finding the bug and the test case!)
Own Id: OTP-9455
erts: use a union to avoid strict aliasing issues
Use a union for pointer type conversion to avoid compiler warnings about strict-aliasing violations with gcc-4.1. gcc >= 4.2 does not emit the warning. erts: adapt matrix_nif to R14 erl_nif API changes (Thanks To Tuncer Ayaz)
Own Id: OTP-9487
fix 64-bit issues in the garbage collection (Thanks to Richard Carlsson)
Own Id: OTP-9488
epmd: fix compiler warnings
Suppress compiler warnings about ignored return values. (Thanks to Michael Santos )
Own Id: OTP-9500
Fix non-existing function (erlang:disconnect/1) in distributed reference manual (Thanks to Fabian Król)
Own Id: OTP-9504
Document fdatasync -lrt requirement (SunOS <= 5.10) (Thanks to Tuncer Ayaz)
Own Id: OTP-9512
Let epmd ignore empty ERL_EPMD_ADDRESS
If the environment variable ERL_EPMD_ADDRESS is set to the empty string, empd now behaves like it does by default when ERL_EPMD_ADDRESS is unset. That is, in this case, epmd now listens on all available interfaces instead of using only the loopback interface, which happened because epmd added the loopback address to the (in this case empty) list of addresses specified via ERL_EPMD_ADDRESS.
Also, epmd now ignores ERL_EPMD_ADDRESS if it contains only separator characters (comma and space).
The same applies to epmd's -address option.(Thanks to Holger Weiß)
Own Id: OTP-9525
Remove dead code in erl_compile (Thanks to Tuncer Ayaz)
Own Id: OTP-9527
Add erlang:external_size/2 BIF
This BIF's second parameter is a list of options. Currently the only allowed option is {minor_version, Version} where version is either 0 (default) or 1. (Thanks to Filipe David Manana )
Own Id: OTP-9528
Fix enif_compare on 64bits machines
In 64bits machines the Sint type has a size of 8 bytes, while on 32bits machines it has a 4 bytes size. enif_compare was ignoring this and therefore returning incorrect values when the result of the CMP function (which returns a Sint value) doesn't fit in 4 bytes. (Thanks to Filipe David Manana)
Own Id: OTP-9533
Implement or fix -Werror option
If -Werror is enabled and there are warnings no output file is written. Also make sure that error/warning reporting is consistent. (Thanks to Tuncer Ayaz)
Own Id: OTP-9536
In some rare cases we did not have a run queue when scheduling misc ops. This is now fixed.
Own Id: OTP-9537
Remove misc. compiler warnings
Own Id: OTP-9542
Two bugs in gen_sctp has been corrected: getopts/setopts hence also send could only be called from socket owner, and options 'linger', 'rcvbuf' and 'sndbuf' was read from wrong protocol layer hence read wrong values by getopts.
Own Id: OTP-9544
Erlang/OTP can now be built on MacOS X Lion.
Own Id: OTP-9547
XML files have been corrected.
Own Id: OTP-9550 Aux Id: OTP-9541
Fix potential errors inspired by running cppcheck(1) (Thanks to Christian von Roques)
Own Id: OTP-9557
When auxiliary work was enqueued on a scheduler, the wakeup of the scheduler in order to handle this work could be lost. Wakeups in order to handle ordinary work were not effected by this bug. The bug only effected runtime systems with SMP support as follows:
Own Id: OTP-9567
Handle rare race in the crypto key server functionality
Own Id: OTP-9586
Types and specifications have been added.
Own Id: OTP-9356
New allocator strategy "address order first fit". May ease the emptying of memory carriers and thereby real release of memory back to the OS.
Own Id: OTP-9424
The new
Own Id: OTP-9495
Update documentation and specifications of some of the zlib functions.
Own Id: OTP-9506
Detect the available CPUs on IRIX
Add support for querying the number of configured and online processors on SGI systems running IRIX.(Thanks to Holger Weiß)
Own Id: OTP-9531
Fix binary and iolist overflow problems. Typically problems arose in length calculation where the result would exceed (1 bsl 32 - 1).
Own Id: OTP-9118
Using the old erlang shell (i.e. erl instead on werl) on windows and doing several init:restart's would eventually hang the VM. That is no longer the case.
Own Id: OTP-9139
Removed recursive C code when printing Erlang terms to buffers, avoiding stack overflows that could cause VM to crash.
Own Id: OTP-9140
The send_timeout option in gen_tcp did not work properly in active mode or with {active,once} options. This is now corrected.
Own Id: OTP-9145
Fixed various typos across the documentation (Thanks to Tuncer Ayaz)
Own Id: OTP-9154
Remove duplicate stack entries which could occur after calling certain BIFs.
Own Id: OTP-9163
A race when starting two nodes simultaneously using run_erl has been removed.
Own Id: OTP-9164
Add documentation on .erlang processing back again (Thanks to Gabor Liptak)
Own Id: OTP-9189
Remove gratuitous paren in driver_entry(Thanks to Tuncer Ayaz)
Own Id: OTP-9192
Fix some wrong pointer dereferences (Thanks to Cristian Greco)
Own Id: OTP-9194
erts: Remove unused variables (Thanks to Tuncer Ayaz)
Own Id: OTP-9205
The documentation for
Own Id: OTP-9209
Allow user to specify the IP address epmd binds to
The IP address(es) epmd binds to can now be specified by the user, either via epmd's new "-address" option or (if that's not used) by setting the environment variable ERL_EPMD_ADDRESS. Multiple addresses may be specified using a comma-separated list. If the loopback address is not in this list, it will be added implicitly, so that the daemon can be queried by an interactive epmd process.(Thanks to Holger Weiß)
Own Id: OTP-9213
epmd: include host address in local access check
In FreeBSD jails, the source and destination address of connections to localhost are changed to be the IP address of the jail. Consider connections from the host's IP address to itself (e.g., the source and destination address match) to be local for the access control checks. (Thanks to Michal Santos and Tom at diogunix.com)
Own Id: OTP-9214
Fix list returned by net_kernel:epmd_module
Function epmd_module of net_kernel returns a list instead of an atom, when the epmd_module-flag is used. (Thanks to Markus Knofe)
Own Id: OTP-9215
Fix epmd's dbg_perror() output
The dbg_perror() function now hands the current errno value over to dbg_gen_printf(). This fixes the problem that errno had been reset to zero by the time it was used (to print the corresponding error message) in the dbg_gen_printf() function. (Thanks to Holger Weiß)
Own Id: OTP-9223
heart: remove garbage appended to heart command
heart:get_cmd/0 is documented to return an empty string if the command is cleared. get_cmd/0 returns 2 extra bytes: 1 byte for the trailing null, 1 byte from the op (the op is an unsigned char and 2 bytes are allocated for it in the returned buffer). (Thanks to Michael Santos)
Own Id: OTP-9224
file: fix hang reading compressed files
The gzio driver goes into an infinite loop when reading past the end of a compressed file. Reported-By: Alex Morarash (Thanks to Michael Santos)
Own Id: OTP-9245
Eliminate alias warnings from gcc 4.5.2
Own Id: OTP-9250
Unsigned integer may overflow in error message (Thanks to Michael Santos)
Own Id: OTP-9251
Driver names should be strings, not atoms
Own Id: OTP-9253
driver_entry: Remove gratuitous paren and fix typo (Thanks to Tuncer Ayaz)
Own Id: OTP-9254
Fix format specifiers in erl_exit messages
Fix an error message by using an unsigned integer specifier as seen in a tweet by @metabrew: #erlang VM crashed with "no next heap size found: -2090496108, offset 0", suddenly allocated all available RAM
Also correct mis-typed string formats in bif.c.(Thanks to Michael Santos)
Own Id: OTP-9262
net_drv: remove unused tcp request id inet_drv: remove gratuitous assignment (Thanks to Tuncer Ayaz)
Own Id: OTP-9263
Teach run_erl RUN_ERL_DISABLE_FLOWCNTRL for disabling flow control
Flow control can cause unwanted behaviour of the beam process, if accidentally hit Ctrl-S (instead of Ctrl-D to detach) the entire beam may be blocked.
Fix this problem by making it possible to turn off flow control by setting the environment variable RUN_ERL_DISABLE_FLOWCNTRL. (Thanks to Jonas Faklkevik)
Own Id: OTP-9270
The following bugs due to missing memory barriers have been fixed:
ETS tables using the
ETS tables using the
A number of memory barriers
have been added when building with the
The BIF
A thread blocking other threads during code loading, or setup of tracing could potentially read invalid data.
Fixation of ETS tables could potentially get into an internally inconsistent state.
Own Id: OTP-9281
Fix halfword bug for ETS ordered_set when doing
Own Id: OTP-9292
Fix bug in
Own Id: OTP-9298
Calling
Own Id: OTP-9302
New
Own Id: OTP-9150
A process being garbage collected by another process
could be scheduled on another scheduler. This prevented
this scheduler from doing any useful work until the
garbage collection was done. This either occurred due to
a explicit call to the
Own Id: OTP-9211
Remove unnecessary validation copy in prim_file:drv_command/3 (Thanks to Tony Rogvall)
Own Id: OTP-9276
Symbolic link handling on windows have been slightly updated to map error conditions more consequently and correctly read directory links created outside of the Erlang environment.
Own Id: OTP-9279
Due to standard library DLL mismatches between versions of OpenSSL and Erlang/OTP, OpenSSL is now linked statically to the crypto driver on Windows. This fixes problems starting crypto when running Erlang as a service on all Windows versions.
Own Id: OTP-9280
Halfword emulator memory handling improvements:
Much more of internal memory structures have been made able to use "high" memory and are no longer restricted to the 4Gb limit that still applies for all process heap data.
Fixed faulty
values from
New counter
Own Id: OTP-9291 Aux Id: seq11841
The value set in the undocumented and unsupported ERL_version_FLAGS (e.g. ERL_R14B03_FLAGS) environment variable can now be overridden by the command line (similar to ERL_AFLAGS).
Own Id: OTP-9297
Fix halfword emulator bug in
Own Id: OTP-9258 Aux Id: seq11836
Ets table type ordered_set could order large integer keys wrongly on pure 64bit platforms. This is now corrected.
Own Id: OTP-9181
The status of a process was unnecessarily set to waiting
before a process was enqueued in a run queue. This bug
was harmless up until OTP-R14B01. In OTP-R14B02
OTP-9125 also introduced a thread unsafe access to the status field of a process which now also have been fixed.
*** INCOMPATIBILITY with noxs ***
Own Id: OTP-9197
The scroll wheel now scrolls the werl window on Windows.
Own Id: OTP-8985
Some malformed distribution messages could cause VM to crash, this is now corrected.
Own Id: OTP-8993
The OS function getifaddrs() can return NULL in some address fields for e.g PPP and tunnel devices which caused the emulator to segfault. This bug has now been corrected.
Own Id: OTP-8996
The expression <<A:0>> would always produce
an empty binary, even if
Own Id: OTP-8997
A bug that potentially could cause an emulator crash when deleting an ETS-table has been fixed. A resource leak when hitting the maximum amount of ETS-tables allowed has also been fixed.
Own Id: OTP-8999
A bug in the
Own Id: OTP-9005
Due to a bug in glibc the runtime system could abort while trying to destroy a mutex. The runtime system will now issue a warning instead of aborting.
Own Id: OTP-9009
A bug in epmd could create strange behaviour when listen() calls failed. This is now corrected thanks to Steve Vinoski.
Own Id: OTP-9024
When setting file_info the win32_driver will now correctly set access and modified time. Previously these entities were swapped.
Own Id: OTP-9046
Setting scheduler bind type to
Own Id: OTP-9056 Aux Id: Seq11779
Two problems were fixed in crash dump: The time left for timers are now shown as unsigned integers and the contents of ordered_set ETS tables is no longer included.
Own Id: OTP-9057
The VM could fail to set IP_TOS and SO_PRIORITY in certain situations, either because sockets were supplied as open file descriptors, or because SO_PRIORITY by default was set higher than the user can explicitly set it to. Those situations are now handled.
Own Id: OTP-9069
Wx on MacOS X generated complains on stderr about certain cocoa functions not being called from the "Main thread". This is now corrected.
Own Id: OTP-9081
Fix a couple typos in driver_entry(3) (thanks to Tuncer Ayaz).
Own Id: OTP-9085
Mention that "-detached" implies "-noinput"
Clarify that specifying "-noinput" is unnecessary if the "-detached" flag is given. (thanks to Holger Weiß)
Own Id: OTP-9086
A potential problem (found by code inspection) when calling a fun whose code was not loaded has been fixed.
Own Id: OTP-9095
The emulator could get into a state where it didn't check for I/O.
Own Id: OTP-9105 Aux Id: Seq11798
Attempting to create binaries exceeding 2Gb (using for
example
Own Id: OTP-9117
Fix erlang:hibernate/3 on HiPE enabled emulator (Thanks to Paul Guyot)
Own Id: OTP-9125
From this release, the previously experimental
halfword emulator is now official. It can be enabled by
giving the
The halfword emulator is a 64-bit application, but uses halfwords (32-bit words) for all data in Erlang processes, therefore using less memory and being faster than the standard 64-bit emulator. The total size of all BEAM code and all process data for all processes is limited to 4Gb, but ETS tables and off-heap binaries are only limited by the amount of available memory.
Own Id: OTP-8941
32-bit atomic memory operations have been introduced internally in the run time system, and are now used where appropriate. There were previously only atomic memory operations of word size available. The 32-bit atomic memory operations slightly reduce memory consumption, and slightly improve performance on 64-bit runtime systems.
Own Id: OTP-8974
Performance enhancements for looking up timer-entries and removing timers from the wheel.
Own Id: OTP-8990
Write accesses to ETS tables have been optimized by reducing the amount of atomic memory operations needed during a write access.
Own Id: OTP-9000
Strange C coding in the VM made the -D_FORTIFY_SOURCE option to gcc-4.5 react badly. The code is now cleaned up so that it's accepted by gcc-4.5.
Own Id: OTP-9025
The memory footprint for loaded code has been somewhat reduced (especially in the 64-bit BEAM machine).
Own Id: OTP-9030
The maximum number of allowed arguments for an Erlang function has been lowered from 256 to 255, so that the number of arguments can now fit in a byte.
Own Id: OTP-9049
Dependency generation for Makefiles has been added to the
compiler and erlc. See the manual pages for
Own Id: OTP-9065
Fix format_man_pages so it handles all man sections and remove warnings/errors in various man pages.
Own Id: OTP-8600
The
Own Id: OTP-8847
Windows 2003 and Windows XP pre SP3 would sometimes not start the Erlang R14B VM at all due to a bug in the cpu topology detection. The bug affects Windows only, no other platform is even remotely affected. The bug is now corrected.
Own Id: OTP-8876
The HiPE run-time in the 64-bit emulator could do a 64-bit write to a 32-bit struct field. It happened to be harmless on Intel/AMD processors. Corrected. (Thanks to Mikael Pettersson.)
Own Id: OTP-8877
A bug in
Own Id: OTP-8889
Calling
Own Id: OTP-8914
The ERTS internal rwlock implementation could get into an inconsistent state. This bug was very seldom triggered, but could be during heavy contention. The bug was introduced in R14B (erts-5.8.1).
The bug was most likely to be triggered when using the
Own Id: OTP-8925 Aux Id: OTP-8544
Tracing to port could cause an emulator crash when unloading the trace driver.
Own Id: OTP-8932
Removed use of CancelIoEx on Windows that had been shown to cause problems with some drivers.
Own Id: OTP-8937
The fallback implementation used when no native atomic implementation was found did not compile. (Thanks to Patrick Baggett, and Tuncer Ayaz)
Own Id: OTP-8944
Some integer values used during load balancing could under rare circumstances wrap causing a load unbalance between schedulers.
Own Id: OTP-8950
The windows VM now correctly handles appending to large files (> 4GB).
Own Id: OTP-8958
Name resolving of IPv6 addresses has been implemented for Windows versions that support it. The use of ancient resolver flags (AI_V4MAPPED | AI_ADDRCONFIG) to the getaddrinfo() function has been removed since e.g FreeBSD regard mapped IPv4 addresses to be a security problem and the semantics of the address configured flag is uncertain.
Own Id: OTP-8969
The help texts produced by the
Own Id: OTP-8859
When the runtime system had fewer schedulers than logical processors, the system could get an unnecessarily large amount reader groups.
Own Id: OTP-8861
Own Id: OTP-8878
The Erlang VM now supports Unicode filenames. The feature is turned on by default on systems where Unicode filenames are mandatory (Windows and MacOSX), but can be enabled on other systems with the '+fnu' emulator option. Enabling the Unicode filename feature on systems where it is not default is however considered experimental and not to be used for production. Together with the Unicode file name support, the concept of "raw filenames" is introduced, which means filenames provided without implicit unicode encoding translation. Raw filenames are provided as binaries, not lists. For further information, see stdlib users guide and the chapter about using Unicode in Erlang. Also see the file module manual page.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8887
Buffer overflows have been prevented in
Own Id: OTP-8892
The runtime system is now less eager to suspend processes sending messages over the distribution. The default value of the distribution buffer busy limit has also been increased from 128 KB to 1 MB. This in order to improve throughput.
Own Id: OTP-8901
The distribution buffer busy limit can now be configured
at system startup. For more information see the
documentation of the
Own Id: OTP-8912
The inet driver internal buffer stack implementation has been rewritten in order to reduce lock contention.
Own Id: OTP-8916
New ETS option
Own Id: OTP-8922 Aux Id: seq11658
There is now a new function inet:getifaddrs/0 modeled after C library function getifaddrs() on BSD and LInux that reports existing interfaces and their addresses on the host. This replaces the undocumented and unsupported inet:getiflist/0 and inet:ifget/2.
Own Id: OTP-8926
Support for detection of CPU topology and binding of schedulers on FreeBSD 8 have been added. (Thanks to Paul Guyot)
Own Id: OTP-8939
Several bugs related to hibernate/3 and HiPE have been corrected. (Thanks to Paul Guyot.)
Own Id: OTP-8952
Support for soft and hard links on Windows versions and filesystems that support them is added.
Own Id: OTP-8955
The win32 virtual machine is now linked large address aware. his allows the Erlang VM to use up to 3 gigs of address space on Windows instead of the default of 2 gigs.
Own Id: OTP-8956
Fix that the documentation top index generator can handle an Ericsson internal application group.
Own Id: OTP-8875
In embedded mode, on_load handlers that called
Also extended the
Own Id: OTP-8902 Aux Id: seq11703
Windows 2003 and Windows XP pre SP3 would sometimes not start the Erlang R14B VM at all due to a bug in the cpu topology detection. The bug affects Windows only, no other platform is even remotely affected. The bug is now corrected.
Own Id: OTP-8876
Very small floating point numbers generated errors when converting from list to float in some versions of the VM, this is now corrected so that i.e. list_to_float("1.0e-324"). returns 0.0 in all versions of Erlang.
Own Id: OTP-7178
Windows Vista and Windows 7 file system virtualization, which makes "old style" windows programs execute in a file system sandbox, was previously unintentionally turned on for the Erlang VM. This is now corrected so that i.e. writes to C:\Program Files\. without administrator privileges will fail.
Own Id: OTP-7405
Fix faulty 64-bit integer term output from drivers. Large 64-bits integers did not generate correct bignums and could even cause emulator crash. Only affects drivers using ERL_DRV_INT64 or ERL_DRV_UINT64, introduced in R13B03.
Own Id: OTP-8716
Fixed: inet:setopts(S, [{linger,{true,2}}]) returned {error,einval} for SCTP sockets. The inet_drv had a bug when checking the option size.
Own Id: OTP-8726 Aux Id: seq11617
Fix libm linking with --as-needed flag
When building with "--as-needed" linker flags on Linux the build will fail. This has now been fixed.
(Thanks to Christian Faulhammer)
Own Id: OTP-8728
gen_udp:connect/3 was broken for SCTP enabled builds. It did not detect remote end errors as it should.
Own Id: OTP-8729
Reduce the risk of integer wrapping in bin vheap size counting.
The vheap size series will now use the golden ratio instead of doubling and fibonacci sequences.
Own Id: OTP-8730
ETS ordered_set containing
Own Id: OTP-8732
reference() has been substituted for ref() in the documentation.
Own Id: OTP-8733
When a native compiled module called a not loaded non-native compiled module that had an on_load function, the export entries were trashed after code loading so on the next call from the native compiled module to the non-native compiled the emulator crashed. This bug has now been fixed.
Own Id: OTP-8736
HiPE-enabled Erlang VMs running on BSD systems sometimes generated messages like "Yikes! erts_alloc() returned misaligned address 0x8016a512c". Fixed. (Thanks to Mikael Pettersson.)
Own Id: OTP-8769
A race condition in
Own Id: OTP-8773
Removed some potential vulnerabilities from the Erlang Port Mapper Daemon (epmd) and straightened up access control. Also removed hazardous interfaces allowing anyone on a machine to forcefully unregister other nodes. This means that the ei_unregister/erl_unregister interfaces in erl_interface is rendered not only error prone and mystifying as before, but totally ineffective. The old behaviour of unchecked node unregistering can be restored if needed, see epmd documentation for details.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8780
Building in a source tree without prebuilt platform independent build results failed on the SSL examples when:
Own Id: OTP-8791
inet:getsockopt for SCTP sctp_default_send_param had a bug to not initialize required feilds causing random answers. It is now corrected.
Own Id: OTP-8795 Aux Id: seq11655
The hipe_bifs:get_hrvtime/0 BIF now always returns a real value even if the "perfctr" Linux kernel extension is not available. It used to return a dummy value. (Thanks to Mikael Pettersson.)
Own Id: OTP-8798
Calling a native-code compiled module with an
Own Id: OTP-8799
The emulator could crash while writing a crash dump if native-compiled modules had been loaded. (Thanks to Paul Guyot.)
Own Id: OTP-8801
The garbage collector could crash if invoked from native-compiled code after a call to a BIF. (Thanks to Paul Guyot.)
Own Id: OTP-8821
A rare memory leak in binary:matches is removed
Own Id: OTP-8823
For a socket in the HTTP packet mode, the return value
from
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8831
ets:select_reverse/{1,2,3} are now documented.
Own Id: OTP-7863
External format of integers changed to make full use of all 32 bits of INTEGER_EXT. This is a compatible change as old code can read full 32-bit integers but only produce 28-bit integers as INTEGER_EXT.
Own Id: OTP-8540 Aux Id: seq11534
Large parts of the
Most notable improvement is a reader optimized rwlock
implementation which dramatically improve the performance
of read-lock/read-unlock operations on multi processor
systems by avoiding ping-ponging of the rwlock cache
lines. The reader optimized rwlock implementation is used
by miscellaneous rwlocks in the runtime system that are
known to be read-locked frequently, and can be enabled on
ETS tables by passing the
There is also a new implementation of rwlocks that is not optimized for readers. Both implementations interleaves readers and writers during contention as opposed to, e.g., the NPTL (Linux) pthread rwlock implementation which use either a reader or writer preferred strategy. The reader/writer preferred strategy is problematic since it starves threads doing the non-preferred operation.
The new rwlock implementations in general performs better in ERTS than common pthread implementations. However, in some extremely heavily contended cases this is not the case. Such heavy contention can more or less only appear on ETS tables. This when multiple processes do very large amounts of write locked operations simultaneously on the same table. Such use of ETS is bad regardless of rwlock implementation, will never scale, and is something we strongly advise against.
The new rwlock implementations depend on atomic operations. If no native atomic implementation is found, a fallback solution will be used. Using the fallback implies a performance degradation. That is, it is more important now than before to build OTP with a native atomic implementation.
The
The
The changed API of the
Note: When building for x86, the
Own Id: OTP-8544
erlang:localtime_to_universaltime({{2008, 8, 1}, {0, 0, 0}},true) when TZ=UTC now behaves consistently on all Unix platforms.
The problem fixed was originally reported by Paul Guyot on erlang-bugs mailing list:
http://www.erlang.org/pipermail/erlang-bugs/2008-November/001077.html
Own Id: OTP-8580
Optimization reducing memory consumption by two words per ETS object.
Own Id: OTP-8737
Fixes for unsupported halfword-emulator
Own Id: OTP-8745
NIF 64-bit integer support;
Own Id: OTP-8746
Alignment of trailing data in messages has been adjusted. This in order to be able to pass data of any type as trailing data in the future.
Own Id: OTP-8754
The obsolete/driver.h header file has been removed. It has been obsolete and deprecated since R8B. Drivers that still include obsolete/driver.h must be updated to include erl_driver.h.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8758
Added erlang:system_info(build_type) which makes it easier to chose drivers, NIF libraries, etc based on build type of the runtime system.
The NIF library for crypto can now be built for valgrind and/or debug as separate NIF libraries that will be automatically loaded if the runtime system has been built with a matching build type.
Own Id: OTP-8760
Further lessened the memory requirements of ETS objects.
Own Id: OTP-8762
The broken elib_malloc alternate memory allocator has
been removed.
Own Id: OTP-8764
Calling
The CPU topology is now automatically detected on Windows
systems with less than 33 logical processors. The runtime
system will now, also on Windows, by default bind
schedulers to logical processors using the
Own Id: OTP-8765
The SMP ERTS internal child waiter thread used on Linux system with NPTL was unintentionally disabled during cross compilation rewrites (OTP-8323 in R13B03). It has now been re-enabled. Enabling it again gives a slight performance improvement.
Own Id: OTP-8774
Own Id: OTP-8775
The scheduler wakeup threshold is now possible to adjust
at system boot. For more information see the
Own Id: OTP-8811
The undocumented function inet:ifget/2 has been improved to return interface hardware address (MAC) on platforms supporting getaddrinfo() (such as BSD unixes). Note it still does not work on all platforms for example not Windows nor Solaris, so the function is still undocumented.
Buffer overflow and field init bugs for inet:ifget/2 and inet:getservbyname/2 has also been fixed.
Thanks to Michael Santos.
Own Id: OTP-8816
Optimizations for MIPS when using gcc atomics. (Thanks to Steve Vinoski)
Own Id: OTP-8834
Lock optimization in timer functionality.
Own Id: OTP-8835
Fix epmd and build environment to build on VxWorks
Own Id: OTP-8838
Driver threads, such as async threads, using
Own Id: OTP-8475
The use of
The
The
The
(Thanks to Steve Vinoski for reporting these issues)
Own Id: OTP-8484
A call to the BIF
Own Id: OTP-8487
The runtime system crashed if fewer logical processors
were found than reported by
Own Id: OTP-8549
Fix memory management bug causing crash of non-SMP emulator with async threads enabled. The bug did first appear in R13B03.
Own Id: OTP-8591 Aux Id: seq11554
Port locks could be prematurely destroyed.
Own Id: OTP-8612
The
Own Id: OTP-8618
When kernel poll has been enabled, a livelock could in rare circumstances occur. Problem reported by Chetan Ahuja, fix by Mikael Pettersson.
Own Id: OTP-8632
Windows: Closing port of program that stalled without reading all data could deadlock scheduler thread.
Own Id: OTP-8641
On some combination of Montavista Linux on Cavium Octeon processors, some socket-related system calls returned other numbers than -1 for errors. This caused a core dump in inet_drv.c. Now the code works around this problem.
Own Id: OTP-8654
Missing memory barriers in
Own Id: OTP-8658
Own Id: OTP-8662
Extreme combinations of register/unregister in a highly parallell SMP application could crash the VM. The error is corrected.
Own Id: OTP-8663
On Windows, files are now opened with FILE_SHARE_DELETE to get closer to Unix semantics.
Own Id: OTP-8667
Own Id: OTP-8675
Fix bug causing
Own Id: OTP-8685
Own Id: OTP-8701
A user defined CPU topology set via a call to
Own Id: OTP-8710
The grammar for match specifications in ERTS users guide only described the tracing dialect of match specifications. An informal grammar for the ETS dialect is added.
Own Id: OTP-8086 Aux Id: seq11333
The module binary from EEP31 (and EEP9) is implemented.
Own Id: OTP-8217
New NIF API function
Own Id: OTP-8474
The guard BIF
Own Id: OTP-8477
Added function
Added functions to create and extract escripts. See
The undocumented function
Record fields has been annotated with type info. Source files as been adapted to fit within 80 chars and trailing whitespace has been removed.
Own Id: OTP-8521
A regular expression with many levels of parenthesis could cause a buffer overflow. That has been corrected. (Thanks to Michael Santos.)
Own Id: OTP-8539
Own Id: OTP-8548
New NIF features:
And
some incompatible changes made to the API. For more
information see the warning text in
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8555
If the '
Own Id: OTP-8559
When defining macros the closing right parenthesis before the dot is now mandatory.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8562
Local and imported functions now override the auto-imported BIFs when the names clash. The pre R14 behaviour was that auto-imported BIFs would override local functions. To avoid that old programs change behaviour, the following will generate an error:
Doing a call without explicit module name to a local function having a name clashing with the name of an auto-imported BIF that was present (and auto-imported) before OTP R14A
Explicitly importing a function having a name clashing with the name of an autoimported BIF that was present (and autoimported) before OTP R14A
Using any form of the old compiler directive
If the BIF was added or auto-imported in OTP R14A or later, overriding it with an import or a local function will only result in a warning,
To resolve clashes, you
can either use the explicit module name
The
change makes it possible to add auto-imported BIFs
without breaking or silently changing old code in the
future. However some current code ingeniously utilizing
the old behaviour or the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8579
A bug in re that could cause certain regular expression matches never to terminate is corrected. (Thanks to Michael Santos and Gordon Guthrie.)
Own Id: OTP-8589
The erlang:open_port spawn and spawn_executable
directives can include an
Own Id: OTP-8614
Own Id: OTP-8623
The functions file:advise/4 and file:datasync/1 have been added. (Thanks to Filipe David Manana.)
Own Id: OTP-8637
New NIF API functions:
Own Id: OTP-8640
Support for using gcc's built-in functions for atomic memory access has been added. This functionallity will be used if available and no other native atomic implementation in ERTS is available.
Own Id: OTP-8659
The number of spinlocks used when implementing atomic fall-backs when no native atomic implementation is available has been increased from 16 to 1024.
Own Id: OTP-8660
Writer preferred pthread read/write locks has been enabled on Linux.
Own Id: OTP-8661
The runtime system will by default bind schedulers to
logical processors using the
NOTE: If the Erlang runtime system is the only
operating system process that binds threads to logical
processors, this improves the performance of the runtime
system. However, if other operating system processes (as
for example another Erlang runtime system) also bind
threads to logical processors, there might be a
performance penalty instead. If this is the case you, are
are advised to unbind the schedulers using the
Own Id: OTP-8666
The recently added BIFs erlang:min/2, erlang:max/2 and erlang:port_command/3 are now auto-imported (as they were originally intended to be). Due to the recent compiler change (OTP-8579), the only impact on old code defining it's own min/2, max/2 or port_command/3 functions will be a warning, the local functions will still be used. The warning can be removed by using -compile({no_auto_import,[min/2,max/2,port_command/3]}). in the source file.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8669 Aux Id: OTP-8579
There is a new option 'exclusive' to file:open/2 that uses the OS O_EXCL flag where supported to open the file in exclusive mode.
Own Id: OTP-8670
Now, binary_to_term/2 is auto-imported. This will cause a compile warning if and only if a module has got a local function with that name.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8671
Alignment of scheduler data and run queues were adjusted.
Own Id: OTP-8673
Call time breakpoint tracing
Teach call count tracing to use atomics
Own Id: OTP-8677
Note: The API for the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8706
Two bugs in gen_sctp has been corrected: getopts/setopts hence also send could only be called from socket owner, and options 'linger', 'rcvbuf' and 'sndbuf' was read from wrong protocol layer hence read wrong values by getopts.
Own Id: OTP-9544
Driver threads, such as async threads, using
Own Id: OTP-8475
A call to the BIF
Own Id: OTP-8487
Fix memory management bug causing crash of non-SMP emulator with async threads enabled. The bug did first appear in R13B03.
Own Id: OTP-8591 Aux Id: seq11554
Fix
Own Id: OTP-8336
Processes and/or ports could get stuck on a blocked
scheduler when
Processes and/or ports could get stuck on an offline
scheduler when schedulers online were reduced using
Own Id: OTP-8342
Building on Windows will now work if the paths to
Own Id: OTP-8345
EPMD now correctly handles the extra data field which can be given in the ALIVE2_REQ request and retrieved in the PORT2_RESP response. (Thanks to Klas Johansson.)
Own Id: OTP-8361
The configure test for reliable floating point exceptions has been update to work on modern versions of Mac OS X. (Thanks to Trannie Carter.)
Own Id: OTP-8368
ERTS makefiles used to detect the use of a gcc C compiler by checking if CC equaled gcc. That is, the makefiles failed to detect gcc C compilers with other command line names than gcc. `configure' now substitute GCC into the makefiles. If CC is a gcc C compiler, GCC will have the value yes. (Thanks to Jean-Sébastien Pédron)
Own Id: OTP-8373
ETS bug causing the
Own Id: OTP-8377 Aux Id: seq11442
Immediately repeated multi-scheduling block/unblock
cycles using
Own Id: OTP-8386
A number of bugs concerning re and unicode are corrected:
re:compile no longer loses unicode option, which also fixes bug in re:split.
re:replace now handles unicode charlist replacement argument
re:replace now handles unicode RE charlist argument correctly
re:replace now handles binary unicode output correctly when nothing is replaced.
Most code, testcases and error isolation done by Rory Byrne.
Own Id: OTP-8394
The loading of native code was not properly atomic in the SMP emulator, which could cause crashes. Also a per-MFA information table for the native code has now been protected with a lock since it turns that it could be accessed concurrently in the SMP emulator. (Thanks to Mikael Pettersson.)
Own Id: OTP-8397
Fix processes in exiting status that are about to be scheduled, to not be allowed to garbage collect.
Own Id: OTP-8420
Removed bogus "\011" character sequence in documentation.
Own Id: OTP-8422
The resolver routines failed to look up the own node name as hostname, if the OS native resolver was erroneously configured, bug reported by Yogish Baliga, now fixed.
The resolver routines now tries to parse the hostname as an IP string as most OS resolvers do, unless the native resolver is used.
The DNS resolver inet_res and file resolver inet_hosts now do not read OS configuration files until they are needed. Since the native resolver is default, in most cases they are never needed.
The DNS resolver's automatic updating of OS configuration file data (/etc/resolv.conf) now uses the 'domain' keyword as default search domain if there is no 'search' keyword.
Own Id: OTP-8426 Aux Id: OTP-8381
The re module: A regular expression with an option change at the start of a pattern that had top-level alternatives could cause overwriting and/or a crash. (Thanks to Michael Santos.)
Own Id: OTP-8438
Harmless buffer overflow by one byte in asn1 and ram_file_drv.
Own Id: OTP-8451
Improved GC performance after BIF/NIF call when a lot of heap fragments was created. This will mainly benefit NIFs that return large compound terms.
Own Id: OTP-8240
Incompatible changes in the experimental NIF feature.
Read more in the documentation of
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8304
Cross compilation improvements and other build system improvements.
Most notable:
(Thanks to Henrik Riomar for suggestions and testing)
(Thanks to Winston Smith for the AVR32-Linux cross configuration and testing)
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-8323
NIF improvements:
Own Id: OTP-8335
Minor alignment adjustments of scheduler specific data.
Own Id: OTP-8341
The documentation is now possible to build in an open source environment after a number of bugs are fixed and some features are added in the documentation build process.
- The arity calculation is updated.
- The module prefix used in the function names for bif's are removed in the generated links so the links will look like "http://www.erlang.org/doc/man/erlang.html#append_element-2" instead of "http://www.erlang.org/doc/man/erlang.html#erlang:append_element-2".
- Enhanced the menu positioning in the html documentation when a new page is loaded.
- A number of corrections in the generation of man pages (thanks to Sergei Golovan)
- The legal notice is taken from the xml book file so OTP's build process can be used for non OTP applications.
Own Id: OTP-8343
There is new
Own Id: OTP-8367
The default settings for garbage collection of binaries
has been adjusted to be less aggressive than in R13B03.
It is now also possible configure the settings for binary
GC. See the documentation for
Own Id: OTP-8370
A bug causing memory corruption in re:run() has been corrected. (Thanks to Yamashina Hio.)
Own Id: OTP-8375
The
Own Id: OTP-8382
Explicit top directories in archive files are now optional.
For example, if an archive (app-vsn.ez) just contains an app-vsn/ebin/mod.beam file, the file info for the app-vsn and app-vsn/ebin directories are faked using the file info from the archive file as origin. The virtual direcories can also be listed. For short, the top directories are virtual if they does not exist.
Own Id: OTP-8387
An unnecessary lock operation in os:timestamp/0 has been eliminated, making it slightly more efficient. (Thanks to Jonas Falkevik and Tuncer Ayaz.)
Own Id: OTP-8390
There is a new
Own Id: OTP-8405
Fixed numerous compiler warnings generated by gcc 4.4.1 and tile-cc 2.0.1.78377 when compiling the runtime system.
Own Id: OTP-8412
Own Id: OTP-8415
HiPE now works in the 64-bit emulator on Mac OS X. (Thanks to Geoff Cant.)
Own Id: OTP-8416
Improved handling of symbolic links to escripts
Own Id: OTP-8417
Add lock profiling tool.
The Lock profiling tool, lcnt, can make use of the internal lock statistics when the runtime system is built with this feature enabled.
This provides a mechanism to examine potential lock bottlenecks within the runtime itself.
- Add erts_debug:lock_counters({copy_save, bool()}). This option enables or disables statistics saving for destroyed processes and ets-tables. Enabling this might consume a lot of memory.
- Add id-numbering for lock classes which is otherwise undefined.
Own Id: OTP-8424
Removed spurious options to the emulator from escript.
Own Id: OTP-8427
Minor documentation fixes. Mainly anchor adjustments.
Own Id: OTP-8457
An insufficient stack allocation was made when reading CPU information on BSD operating systems. (Thanks Michael Turner and Akira Kitada)
Own Id: OTP-8207
A bug when supplying an argument without a dash directly after the program name when starting erlang could prevent distribution to start. This is now corrected.
Own Id: OTP-8209
A ticker process could potentially be blocked indefinitely trying to send a tick to a node not responding. If this happened, the connection would not be brought down as it should.
Own Id: OTP-8218
Using certain firewalls (i.e. MS IAS Client and certain versions of COMODO) could expose an undocumented behaviour in the Win32 socket interface causing the name resolution calls to hang infinitely. This is now worked around by adding possibilities for port programs under Windows to use overlapped I/O on their standard input/output file handles.
Own Id: OTP-8230
Fixed bug on ETS tables with
Own Id: OTP-8242
The
The following BIFs behaviors can be modeled as if an
asynchronous
When
Own Id: OTP-8245
Errors in the
Own Id: OTP-8257
Low watermark socket option modified high watermark instead of low watermark in the inet_driver. (Thanks to Feng Yu and Tuncer Ayaz)
Own Id: OTP-8279
A race condition could cause the runtime system with SMP support to end up in a completely unresponsive state.
Own Id: OTP-8297
The use of
Own Id: OTP-8193
The documentation is now built with open source tools (xsltproc and fop) that exists on most platforms. One visible change is that the frames are removed.
Own Id: OTP-8201
A new garbage collecting strategy for binaries which is more aggressive than the previous implementation. Binaries now has a virtual binary heap tied to each process. When binaries are created or received to a process it will check if the heap limit has been reached and if a reclaim should be done. This imitates the behavior of ordinary Erlang terms. The virtual heaps are grown and shrunk like ordinary heaps. This will lessen the memory footprint of binaries in a system.
Own Id: OTP-8202
The
For more information see the
Own Id: OTP-8205
[escript] The restriction that the first line in escripts
must begin with
[escript] Some command line options to the escript executable has now been documented. For example you can run an escript in the debugger by just adding a command line option.
[escript] The documentation of the escript header syntax
has been clarified. For example the header is optional.
This means that it is possible to directly "execute"
Own Id: OTP-8215
The instruction for building OTP on Windows was outdated and incomplete, the document is updated.
Also the otp_build script required windows drives to show up in Cygwin using the /cygdrive prefix. That requirement is now removed.
Own Id: OTP-8219
A module can have native implemented functions (NIFs)
that are dynamically loaded by calling
Own Id: OTP-8220
The
Own Id: OTP-8221
The
Own Id: OTP-8225
'
Own Id: OTP-8236
On Windows, open_port({spawn,Command},Opts) could not run executables with spaces in the path or filename, regardless of quoting efforts. While open_port({spawn_executable,Exec},Opts) can run any executable, it was still impossible to use 'spawn' to do the same thing. This is now corrected.
Own Id: OTP-8055
The scheduler bind type
The new scheduler bind type
Own Id: OTP-8063
Automatically detected CPU topology on Linux system could
erroneously contain logical processors with
Own Id: OTP-8064
When the minimal term [] (end of list) was sent as the complete message to a process on another node, and received there, it could not be decoded. This bug is now corrected. Fortunately [] is uncommon as the complete message in real applications but it is a serious bug anyway.
Own Id: OTP-8092
A bug when the floating point exception pointer was not initialized has been corrected. It manifested itself on CentOS 5.1 sometimes when a floating point value was sent to a remote node. Bug reported and patch suggested by David Reiss, confirmed by Mikael Pettersson.
Some build problems on IRIX was also corrected. Problem reported by Patrick Baggett, patch by Mikael Pettersson.
Own Id: OTP-8095
A terminating process could erroneously unregister a name for another process. This could occur under the following conditions: The name of the terminating process was unregistered and then registered for another process simultaneously as the process that first had the name was terminating.
Own Id: OTP-8099 Aux Id: seq11344
Running erlc in a very deep directory (with a path length
of more 256 or more characters) would cause the emulator
to crash in a call to
Own Id: OTP-8124
A deadlock of the runtime system could occur when unregistering the name of a port.
Own Id: OTP-8145
Own Id: OTP-8157
The pthread rwlock implemention on Linux could cause starvation of writers. We, therefore, now use our own rwlock implementation on Linux.
Own Id: OTP-8158
Open source Erlang builds are updated to work well on Snow Leopard (MacOS X 10.6)
Own Id: OTP-8168
A call to
Own Id: OTP-8169
An error in erlang:system_profile/2 could cause timestamped messages to arrive out of order in the SMP case. This has now been fixed.
Own Id: OTP-8171
Own Id: OTP-8192
The async thread pool in the runtime system without SMP support used a memory allocator that was not thread safe for async jobs.
Own Id: OTP-8194
Processor internal NUMA nodes are now supported in the
ERTS internal CPU topology representation. For more
information see the documentation of the
Own Id: OTP-8041
Documentation for ets improved about concurrency.
Own Id: OTP-8050
Emulator flags in an escript were earlier inherited to
emulators started from from the emulator running the
escript. For example when an escript invoked
Escript filenames may now contain dots.
Own Id: OTP-8060
Made some BIFs non-recursive (relational operators,hash and phash) to limit internal stack usage.
Own Id: OTP-8065
Fixed Windows specific bug in erl_prim_loader. Now it handles the root directory (e.g. c:/) better. This bug affected the directory listing in the debugger.
Own Id: OTP-8080
A TCP socket with option
Own Id: OTP-8102
The maximum size of the export table has been raised from 65536 to 524288 entries.
Own Id: OTP-8104 Aux Id: seq11345
The file module has now a read_line/1 function similar to the io:get_line/2, but with byte oriented semantics. The function file:read_line/1 works for raw files as well, but for good performance it is recommended to use it together with the 'read_ahead' option for raw file access.
Own Id: OTP-8108
Fixed bug causing emulator crash when reading a term in external format containing a corrupt list with a negative length.
Own Id: OTP-8117
New emulator flag
Own Id: OTP-8119
The Windows utility Erlsrv, run in interactive mode now accepts options for registering internal service name and description field of Windows registry database.
Own Id: OTP-8132
A new option
Own Id: OTP-8143
I/O tasks could unnecessarily be rescheduled. This was harmless, but not useful work.
Own Id: OTP-8148
Minor improvements of
Own Id: OTP-8152
New configuration option to enable use of shared zlib.
Own Id: OTP-8155
Fixed smp bug in ETS that could cause emulator crash when
table with more than 1000 objects accessed by several
processes, including calls to variants of
Own Id: OTP-8166 Aux Id: seq11392
The code path interpretation is now more relaxed. The flag -code_path_choice now defaults to relaxed instead of strict. See the documentation of code and init for more info.
Own Id: OTP-8170
Load balancing of run queues and check for I/O are triggered more often than before in situations where processes are scheduled often but are doing very little work each time they execute.
Own Id: OTP-8172
Call tracing binary comprehensions would cause an emulator crash. (Thanks to Paul Mineiro.)
Own Id: OTP-8179
Own Id: OTP-8180
Crash dumps should now cause less problems for the crashdump_viewer application. (For processes where arity was non-zero, the arguments are now longer printed - they used to be printed in a format that was not parseable.)
Own Id: OTP-7472 Aux Id: seq11019, 11292
Processes could potentially get stuck on an offline scheduler.
Own Id: OTP-7990
Own Id: OTP-7997
A process could under very rare circumstances erroneously be resumed.
Own Id: OTP-8000
Load balancing between schedulers could under rare circumstances cause an emulator crash.
Own Id: OTP-8008
Own Id: OTP-8022
Major improvements of the Erlang distribution for Erlang runtime systems with SMP support. Previously distribution port locks were heavily contended, and all encoding and decoding for a specific distribution channel had to be done in sequence. Lock contention due to the distribution is now negligible and both encoding and decoding of Erlang messages can be done in parallel.
The old atom cache protocol used by the Erlang distribution has been dropped since it effectively prevented all parallel encoding and decoding of messages passed over the same distribution channel.
A new atom cache protocol has been introduced which isolates atom cache accesses and makes parallel encoding and decoding of messages passed over the same distribution channel possible. The new atom cache protocol also use an atom cache size 8 times larger than before. The new atom cache protocol is documented in the ERTS users guide.
Erlang messages received via the distribution are now decoded by the receiving Erlang processes without holding any distribution channel specific locks. Erlang messages and signals sent over the distribution are as before encoded by the sending Erlang process, but now without holding any distribution channel specific locks during the encoding. That is, both encoding and decoding can be and are done in parallel regardless of distribution channel used.
The part that cannot be parallelized is the atom cache updates. Atom cache updates are therefore now scheduled on the distribution port. Since it is only one entity per distribution channel doing this work there is no lock contention due to the atom cache updates.
The new runtime system does not understand the old atom cache protocol. New and old runtime systems can however still communicate, but no atom cache will be used.
Own Id: OTP-7774
Fixed a bug that caused error logging from
Own Id: OTP-7898 Aux Id: seq11304
Improved SMP concurrency for ETS tables. Several mutating
operations can now be performed truly concurrent on
different records of the same table. To support this, the
table has to be created with option
Own Id: OTP-7922
erl (that is erl.exe and dyn_erl) and erlexec has been made more dynamic so no hard coded paths needs to added at installation time to erl (that is erl.ini and erl). Reltool will make use of this in a future release.
Own Id: OTP-7952
Added functionality to get higher resolution timestamp from system. The erlang:now function returns a timestamp that's not always consistent with the actual operating system time (due to resilience against large time changes in the operating system). The function os:timestamp/0 is added to get a similar timestamp as the one being returned by erlang:now, but untouched by Erlangs time correcting and smoothing algorithms. The timestamp returned by os:timestamp is always consistent with the operating systems view of time, like the calendar functions for getting wall clock time, but with higher resolution. Example of usage can be found in the os manual page.
Own Id: OTP-7971
Two new options are added to open_port - spawn_executable which runs external executables in a controlled way, and spawn_driver which only opens port to loaded Erlang drivers. See the erlang manual page for details.
Own Id: OTP-7995
New functionality in ETS to transfer the ownership of a
table. A table can either change owner be declaring an
"heir", another process that will inherit the table if
the owner terminates. A table can also change owner by
calling a new function
Own Id: OTP-8006
Updates to Tilera build environment.
Own Id: OTP-8009
A stack trace was unnecessarily saved during process termination.
Own Id: OTP-8014
User defined CPU topology and scheduler bind type can now
be set from the command line when starting an emulator.
For more information see the documentation of the
The CPU topologies returned from
Own Id: OTP-8030
Various fixes in ETS:
Own Id: OTP-8040
Fixed a bug on Windows that could make
Own Id: OTP-7816
The runtime system could under rare circumstances crash during load balancing.
Own Id: OTP-7908 Aux Id: otp-7500
Own Id: OTP-7916 Aux Id: seq11249
A message buffer memory leak in the runtime system without smp support has been fixed.
Own Id: OTP-7941
Attempting to append a binary of 16Mb or greater to
another binary using the bit syntax would cause a
Own Id: OTP-7942
The runtime system with SMP support failed to terminate
the caller of
Own Id: OTP-7946
Rudimentary support for cross compiling is added to the source release. The support is still in its infancy and has only been used to cross compile on Linux for a different cpu architecture and a different Linux version, but should be extendible to support other platforms as well. The cross configuration files with examples are placed in $ERL_TOP/xcomp/. View README.xcomp and run $ERL_TOP/otp_build -help for further information.
Own Id: OTP-7854
The escape sequence
Own Id: OTP-7891 Aux Id: OTP-7855
The
Also fixed some minor issues in
Own Id: OTP-7894
Several glitches and performance issues in the Unicode and I/O-system implementation of R13A have been corrected.
Own Id: OTP-7896 Aux Id: OTP-7648 OTP-7887
Minor documentation improvements of the
Own Id: OTP-7901 Aux Id: OTP-7777
There is a new BIF
Own Id: OTP-7913
OpenSource:
FreeBSD leap-seconds are handled according to patch submitted by OpenSource user Kenji Rikitake. No test case covers this functionality (unsupported platform).
Own Id: OTP-7609
A corrected bug in ETS for
Own Id: OTP-7665
A new driver call-back
Own Id: OTP-7670
A bug fixed for TCP sockets with option
Own Id: OTP-7682 Aux Id: OTP-7647
run_erl did in some cases fail to extract control sequences from to_erl (like: winsize=X,Y) and did instead send them to be interpreted by the erlang shell.
Own Id: OTP-7688
A bug in the installer on Windows not updating file associations properly is now corrected.
Own Id: OTP-7746
More space than necessary could be allocated in binaries when appending to a binary (also in a binary comprehension) and the data appended did not consist of wholes bytes (e.g. 13 bits).
Own Id: OTP-7747
The gen_sctp option sctp_peer_addr_params, #sctp_paddrparams{address={IP,Port} was erroneously decoded in the inet driver. This bug has now been corrected.
Own Id: OTP-7755
Outstanding async driver jobs leaked memory if the issuing port died before the async jobs completed.
Own Id: OTP-7784
A bug in the dynamic library loading affecting, among others, OpenSolaris is now corrected. (Thanks to Paul Fisher.)
Own Id: OTP-7796
run_erl compile errors fixed for FreeBSD
Own Id: OTP-7817
A bug in the inet driver for SCTP on Solaris showing for e.g gen_sctp:abort/1 and gen_sctp:eof/1 has been corrected. Patch suggestion by Simon Cornish.
Own Id: OTP-7866
The order of objects visited in select for ordered_set is now documented.
Own Id: OTP-7339
The runtime system with SMP support now uses multiple, scheduler specific run queues, instead of one globally shared run queue.
The lock protecting the shared run queue was heavily contended, and the shared run queue also caused Erlang processes to randomly migrate between schedulers with negative cache effects as a result.
With the current scheduler specific run queue solution, lock contention due to run queue protection has been reduced, and Erlang processes are only migrated when needed to balance the load between the schedulers. The reduced amount of migration also reduce lock contention on locks protecting the scheduler specific instances of the erts internal memory allocators.
The scheduler specific run queues are also a necessity for a lot of future planned NUMA (Non-Uniform Memory Access) specific optimizations.
Own Id: OTP-7500
Support for Unicode is implemented as described in EEP10. Formatting and reading of unicode data both from terminals and files is supported by the io and io_lib modules. Files can be opened in modes with automatic translation to and from different unicode formats. The module 'unicode' contains functions for conversion between external and internal unicode formats and the re module has support for unicode data. There is also language syntax for specifying string and character data beyond the ISO-latin-1 range.
The interactive shell will support input and output of unicode characters when the terminal and operating system supports it.
Please see the EEP and the io/io_lib manual pages as well as the stdlib users guide for details.
I/O-protocol incompatibilities:
The io_protocol between io_Server and client is updated to handle protocol data in unicode formats. The updated protocol is now documented. The specification resides in the stdlib users manual, which is a new part of the manual.
io module incompatibilities:
The io:put_chars, io:get_chars and io:get_line all handle and return unicode data. In the case where binaries can be provided (as to io:put_chars), they shall be encoded in UTF-8. When binaries are returned (as by io:get_line/get_chars when the io_server is set in binary mode) the returned data is also always encoded as UTF-8. The file module however still returns byte-oriented data, why file:read can be used instead of io:get_chars to read binary data in ISO-latin-1.
io_lib module incompatibilities:
io_lib:format can, given new format directives (i.e "~ts" and "~tc"), return lists containing integers larger than 255.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7648 Aux Id: OTP-7580 OTP-7514 OTP-7494 OTP-7443 OTP-7181 EEP10 EEP11
The format of the string returned by
Own Id: OTP-7649
Message passing has been further optimized for parallel execution. Serial message passing is slightly more expensive than before, but parallel send to a common receiver is much cheaper.
Own Id: OTP-7659
Lock contention on the atom table lock when decoding Erlang terms on the external format has been drastically reduced.
Own Id: OTP-7660
The undocumented, unsupported, and deprecated guard BIF
*** INCOMPATIBILITY with R12B ***
Own Id: OTP-7673
The Erlang process lock implementation has been improved by Mat Hostetter at Tilera Corporation.
Own Id: OTP-7692
A
Own Id: OTP-7725
The short-circuit operators
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7748
A new BIF,
Own Id: OTP-7752
Optimization for drivers by creating small binaries direct on process heap.
Own Id: OTP-7762
There would always be a garbage collection when
evaluating
If
If
Own Id: OTP-7764
Scheduler threads can now be bound to logical processors on newer Linux and Solaris systems. More systems will be supported in the future.
In some cases performance has increased drastically when
binding schedulers. Schedulers are not bound by default,
though. This since it might cause a performance
degradation if multiple programs have bound to
processors, e.g. multiple Erlang runtime systems. For
more information see the documentation of
In order to bind scheduler threads the CPU topology need
to be known. On some newer Linux and Solaris systems the
runtime system automatically detects the CPU topology. If
the emulator isn't able to automatically detect the CPU
topology, the CPU topology can be defined. For more
information see the documentation of
Own Id: OTP-7777
The compiler will refuse to a compile file where the module name in the file differs from the output file name.
When compiling using
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7793
The BIFs
Own Id: OTP-7804
The amount of schedulers online can now be changed during
operation. The amount of schedulers online defaults to
the same amount as available logical processors. For more
information see the documentation of
Own Id: OTP-7811
The deprecated functions
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7812
Erts internal dynamically allocated process and port specific data for rarely used data. This is used to reduce memory usage of processes and ports that do not use specific functionality. More functionality will be moved to process and port specific data in future releases.
Own Id: OTP-7818
New packet type
Own Id: OTP-7821
The obsolete wd_keeper program for embedded Solaris systems has been removed.
Own Id: OTP-7822
Nodes belonging to different independent clusters can now co-exist on the same host with the help of a new environment variable setting ERL_EPMD_PORT.
Own Id: OTP-7826
There are new functions
Own Id: OTP-7841
The copyright notices have been updated.
Own Id: OTP-7851
Enhanced build environment for cross compilation to Tilera Tile architecture.
Support for native ethread atomics on Tilera Tile64/TilePro (Thanks to Tilera Corporation).
Own Id: OTP-7852
The escape sequences
NOTE: These new escape sequences are still considered experimental and may be changed in the R13B release.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7855
The PCRE library's exported function names are now prefixed with erts_ in the erlang emulator to avoid clashes with dynamically loaded drivers.
Own Id: OTP-7861
A runtime system with SMP support will now be built by default on most platforms if a usable posix thread library or native windows threads are found.
For more information see the top README file.
Own Id: OTP-7872
A corrected bug in ETS for
Own Id: OTP-7665
A bug fixed for TCP sockets with option
Own Id: OTP-7682 Aux Id: OTP-7647
Calling
Own Id: OTP-7731 Aux Id: seq11161
A process being garbage collected via the
Own Id: OTP-7738
A bug in inet_drv concerning gen_tcp:connect has been corrected. A connect towards a non-open port through open firewalls could sometimes erroneously be successful. Any subsequent operation would fail, though.
Own Id: OTP-6542
Floating point arithmetics in drivers could cause a runtime system crash and/or unexpected results on runtime systems with floating point exceptions enabled. Floating point exceptions are disabled unless explicitly enabled or if hipe is enabled.
Own Id: OTP-7237
A bug when many sockets got signalled simultaneously causing the emulator to panic with the message "Inconsistent, why isnt io reported?" is now corrected.
Own Id: OTP-7420
Starting erl with option "-detached" now disconnects correctly from terminal session on Unix.
Own Id: OTP-7461
Mended gdb etp-commands for ETS access.
Own Id: OTP-7538
Own Id: OTP-7543
An emulator compiled for SCTP now starts even if the dynamic libraries are not present. The SCTP driver is then of course not loaded.
Own Id: OTP-7551
To build on Mac OS X, 10.3.0 or later is now required because of fixes for two problems:
There would be a resource leak when
Signal handling in the run-time system for HiPE has
been updated to work on later versions of Mac OS X than
10.2.x. Therefore,
Thanks to Geoff Cant for the patches.
Own Id: OTP-7562
Corrected some information about the protocol between EPMD and Erlang nodes. (Thanks to Michael Regen.)
Own Id: OTP-7594
When using
Own Id: OTP-7622 Aux Id: OTP-4903, seq8379
The driver entry of a dynamically loaded driver is now copied when loaded which enables some internal optimizations. Note that drivers that modify the driver entry during execution will not work anymore. Such a miss-use of the driver interface is however not supported.
Own Id: OTP-6900
The split function is now added to the re library. Exceptions and errors from both run, replace and split are made more consistent.
Own Id: OTP-7514 Aux Id: OTP-7494
Fixed harmless compiler warnings when building the emulator and minor build changes in order to avoid unnecessary rebuilds.
Own Id: OTP-7530
There is now experimental support for loading of code
from archive files. See the documentation of
The error handling of
An
An
An
The internal module
Own Id: OTP-7548 Aux Id: otp-6622
The reallocation functionality part of the ERTS internal memory allocators, now consider current block in combination with surrounding free blocks as an alternative location for a reallocation.
Own Id: OTP-7555
There could remain false references from a process to a module that has been called earlier, so that the process would be killed if the module was reloaded. (Thanks to Richard Carlsson.)
Also, the fix for this bug also made it possible to
make stack backtraces (as returned from
Own Id: OTP-7559
Improved locking in IO-handling for better smp performance.
Own Id: OTP-7560
Improved BIF rescheduling functionality.
Own Id: OTP-7587
Loading a module compiled with Erlang/OTP R9C and calling
Own Id: OTP-7590
A process calling one of the following BIFs could under
very rare conditions deadlock in the runtime system with
SMP support:
Own Id: OTP-7582
A couple of statistics variables were not managed in a thread safe manner in the runtime system with SMP support.
Own Id: OTP-7583
An extremely rare race condition when terminating a process could potentially cause a runtime system crash.
Own Id: OTP-7584
Under certain conditions and when using run_erl/to_erl, the terminal Erlang driver (ttsl_drv) could crash the emulator by doing a division by zero due to incorrect handling of terminals reporting a zero width. For terminals reporting zero width, the driver now fallbacks to a default width of 80 and a default height of 24 (vt100), as a fallback behaviour. This fixes the crashes and also makes output on "dumb" terminals much more readable.
Own Id: OTP-7592 Aux Id: seq11073
A new
Own Id: OTP-7540
The new option
Own Id: OTP-7578 Aux Id: seq11052
Double backslashes in format string passed to the erts internal printf implementation produced erroneous results. No such format strings were passed to the erts internal printf implementation, i.e., the bug was therefore completely harmless. (Thanks to Perry Smith.)
Own Id: OTP-7408
Large files are now handled on Windows, where the filesystem supports it.
Own Id: OTP-7410
Bug fixed for
Own Id: OTP-7458
The trace option
Own Id: OTP-7484
Using 16#ffffFFFF as a timeout value in receive...after would often cause a timeout almost at once due to an 32-bit integer overflow. (Thanks to Serge Aleynikov and Matthias Lang.)
Own Id: OTP-7493
For the process that an escript runs in, the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7517
A bug in the
Own Id: OTP-7526
Performance for ETS intensive applications should now
be better in the SMP emulator. Also, ETS table
identifiers (as returned by
NOTE: Table identifiers can now be negative integers. Programs that (incorrectly) assume that table identifiers can only be positive integers might stop to work. (The type of a table identifier is intentionally not documented, and may change in a future release.)
Own Id: OTP-7348
New BIF
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7404
The source code for the documentation for some applications (erts, kernel, stdlib, and several others) are now included in the source tar ball. There is currently no Makefile support for building HTML files from the source (such support will be included in a future release).
Own Id: OTP-7406
A lot of frequently accessed memory counters (erts
internal) have been removed. This since they hurt
performance on the runtime system with SMP support. As a
result
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7468
Pre-allocators used for, for example, timers, and messages have been rewritten to be scheduler specific. That is, different schedulers will now allocate from different pools which reduces lock contention.
Own Id: OTP-7470
On Mac OS X, file:sync/1 now guarantees that all filesystem buffers are written to the disk by using the fcntl() with F_FULLFSYNC option. Previously, file:sync/1 called fsync(), which only guaranteed that the data had been transferred to the disk drive. (Thanks to Jan Lehnardt.)
Own Id: OTP-7471
Termination of a process that takes a long time can now be preempted, i.e., the terminating process will be rescheduled for later continuation of termination so that other processes can execute. Termination of a process that owns many and/or large ets tables typically takes a long time.
Own Id: OTP-7477
A new trace option
The
Own Id: OTP-7481
The re module is extended with repetitive matches (global option) and replacement function.
Own Id: OTP-7494 Aux Id: OTP-7181
In the section about binary construction, the reference manual now mentions what happens when an integer value does not fit into an integer segment of size N (namely, that the N least significant bits will be put into into the binary and that the most significant bits will be silently discarded). (Thanks to Edwin Fine.)
Own Id: OTP-7506
Setting the
Own Id: OTP-7520
Floating point arithmetics in drivers can cause a runtime system crash and/or unexpected results on runtime systems with floating point exceptions enabled. Floating point exceptions are disabled unless explicitly enabled or if hipe is enabled.
Own Id: OTP-7237
Binary construction with an integer field of size 0 at the end of the constructed binary (and the size given in a variable), would cause a write of one byte outside the memory reserved for the binary, which in turn could cause an emulator crash.
Own Id: OTP-7422
A race condition in the dynamic driver implementation could cause an emulator crash. (Thanks to Paul Fisher)
Own Id: OTP-7464
Calls to
Own Id: OTP-7474
The
Own Id: OTP-7475
Operations that needed to block other threads in the
runtime system with SMP support unnecessarily waited for
async threads to block. Most important the
Own Id: OTP-7480
Calls to
Own Id: OTP-7415
Doing local call trace on bit syntax matching code that has been optimized with delayed sub-binary creation could crash the emulator.
Own Id: OTP-7399 Aux Id: seq10978
Only one to_erl process at a time is allowed to connect to the same run_erl pipe. Prevents buggy behaviour when IO from several to_erl's get interleaved.
Own Id: OTP-5107
IPv6 name resolving has now been fixed to use getaddrinfo() patch (thoroughly reworked) courtesy of Love Hörnquist-Åstrand submitted by Fredrik Thulin. It also can use gethostname2() patch (also reworked) courtesy of Mikael Magnusson for debian submitted by Sergei Golovan.
Own Id: OTP-5382
Improved error handling in run_erl
Own Id: OTP-7252
A permanent fix for the deadlock issue temporarily fixed by OTP-7260.
Own Id: OTP-7267 Aux Id: OTP-7260
./configure has been improved to find 64-bit OpenSSL libraries.
Own Id: OTP-7270
A terminating process could under very rare circumstances trigger a bug which could crash the runtime system with SMP support.
Own Id: OTP-7272
SCTP_ADDR_CONFIRMED events are now handled by gen_sctp.
Own Id: OTP-7276
binary_to_term/1 would crash the emulator if the binary data contained an external fun with non-atom module and/or function. Corrected to generate a badarg exception.
Own Id: OTP-7281
On Mac OS 10.5 (Leopard), sending to socket which the other end closes could cause the emulator to consume 100% CPU time. (Thanks to Matthias Radestock.)
Own Id: OTP-7289
The vanilla driver used on Windows could crash the
emulator and sometimes produced corrupt files. The
vanilla driver is the driver that is used when one only
pass a filename as first argument to
Own Id: OTP-7301
Faulty matching in binaries larger than 512Mb on 64bit machines fixed.(On 32bit, the size limit for binaries is still 512Mb). Thanks to Edwin Fine and Per Gustafsson for finding fault and fix.
Own Id: OTP-7309
crypto:start() on Windows caused emulator to hang on error popup window if openssl DLL was not found. Windows error popups now suppressed.
Own Id: OTP-7325
Configuration option
Own Id: OTP-7338
to_erl reports its terminal window size to run_erl in order to get output formatted accordingly
Own Id: OTP-7342
On Solaris, the
Own Id: OTP-7343 Aux Id: seq10949
A race condition in the runtime system with SMP support causing an erroneous removal of a newly created ets table has been fixed.
The race occurred when a process removed a table during
termination simultaneously as another process removed the
same table via
Own Id: OTP-7349
Own Id: OTP-7359
If the total number of allowed atoms is exceeded, there will now be a controlled termination of the emulator with a crash dump file. The emulator used to simply crash. (Thanks Howard Yeh and Thomas Lindgren.)
Own Id: OTP-7372
The break handler in werl on Windows could cause the emulator to hang or crash, that is now corrected.
Own Id: OTP-7394 Aux Id: seq10969
The configure script now tests for an serious optimization bug in gcc-4.3.0. If the bug is present, the configure script will abort (if this happens, the only way to build Erlang/OTP is to change to another version of gcc). (Thanks to Mikael Pettersson.)
Own Id: OTP-7397
On Unix, the emulator now notices when the width of the terminal has changed. (Thanks to Matthew Dempsky and Patrick Mahoney.)
Own Id: OTP-7290
There is a new function
Own Id: OTP-7308
process_info(Pid, garbage_collection) now returns more information
Own Id: OTP-7311
The
Own Id: OTP-7358
Floating point arithmetics in drivers can cause a runtime system crash on runtime systems with floating point exceptions enabled. Floating point exceptions are disabled unless explicitly enabled or if hipe is enabled.
Own Id: OTP-7237
The maximum length of an atom of 255 characters is now
strictly enforced.
Own Id: OTP-7147
A bug in "bignum handling" on some 64bit architectures could cause rem and div operations on large numbers to hang indefinitely. Rem operations involving the smallest negative number representable in 28 bits or 60 bits could also cause access violation and emulator crash. Both errors are corrected.
Own Id: OTP-7177
When doing the initial garbage collection after waking a hibernated process, a fullsweep garbage collection was unnecessarily triggered.
Own Id: OTP-7212
The beta testing module
Try it, give comments and send in bug reports!
Own Id: OTP-7225
Invalid arguments to
Own Id: OTP-7226
The runtime system with SMP support could under rare circumstances deadlock when a distribution channel was taken down while multiple simultaneous operations were performed on it.
Own Id: OTP-7260
More checksum/hash algorithms from the zlib library are now available as built in functions (like md5 hashes has been for a long time).
Own Id: OTP-7128
Minor improvements in the garbage collector.
Own Id: OTP-7139 Aux Id: OTP-7132
The switch "-detached" to the windows werl program now can create an erlang virtual machine without any main window and without a temporary console showing.
Own Id: OTP-7142
The scale factor returned by
Own Id: OTP-7175
A new BIF ets:update_element/3. To update individual elements within an ets-tuple, without having to read, update and write back the entire tuple.
Own Id: OTP-7200
A process executing the
The documentation of the
Own Id: OTP-7213
Not enough parameters were passed when sending an error report in erl_check_io.c (Thanks to Matthew Dempsky).
Own Id: OTP-7176
In rare circumstances, complex binary matching code could cause the emulator to crash or not match when it should. (Thanks to Rory Byrne.)
Own Id: OTP-7198
The
Own Id: OTP-7167
The finishing reallocation of the heap block when hibernating a process is now always moving the heap block since it drastically reduces memory fragmentation when hibernating large amounts of processes.
Own Id: OTP-7187
The SMP emulator on sparc64 erroneously used the sparc32 atomic and the sparc32 spinlock implementations which caused it to crash.
Own Id: OTP-7006
Call tracing the new guard BIFs
Own Id: OTP-7008
configuring --enable-darwin-universal or --enable-darwin-64bit on MacOSX could result in a non optimized emulator. Top level configure script now corrected.
Own Id: OTP-7014
configuring --with-gd did not produce correct include flags for percept.
Own Id: OTP-7015
Environment variables weren't handled in thread safe manner in the runtime system with SMP support on Windows.
Own Id: OTP-7035
HIPE: Corrected the choice of interface to the send/3 and setnode/3 BIFs for native-compiled code. Using the incorrect interface could, in unusual circumstances, lead to random runtime errors.
Own Id: OTP-7067
Garbage collections could become extremely slow when there were many keys in the process dictionary. (Thanks to Fredrik Svahn.)
Own Id: OTP-7068
The duplicate documentation directory in the windows installation is removed.
Own Id: OTP-7070
Documentation bugfixes and clarifications.
(Thanks to Joern (opendev@gmail.com), Matthias Lang, and Richard Carlsson.)Own Id: OTP-7079
The runtime system with SMP support not using the native atomic integer implementation part of OTP could deadlock when run on a system with more than one logical processor. That is, only the runtime system with SMP support on other hardware platforms than x86, x86_64, sparc32, and powerpc32 were effected by this bug.
Own Id: OTP-7080
The break handling code (run when Ctrl-C is hit) could could potentially deadlock the runtime system with SMP support.
Own Id: OTP-7104
The sctp driver has been updated to work against newer lksctp packages e.g 1.0.7 that uses the API spelling change adaption -> adaptation. Older lksctp (1.0.6) still work. The erlang API in gen_sctp.erl and inet_sctp.hrl now spells 'adaptation' regardless of the underlying C API.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7120
A bug in
Own Id: OTP-7127
The emulator could under rare circumstances crash while garbage collecting.
Own Id: OTP-7132
The documentation has been updated so as to reflect
the last updates of the Erlang shell as well as the minor
modifications of the control sequence
Superfluous empty lines have been removed from code examples and from Erlang shell examples.
Own Id: OTP-6944 Aux Id: OTP-6554, OTP-6911
Bit syntax construction with a small integer in a non-byte aligned field wider than the CPU's word size could cause garbage bits in the beginning of the field.
Own Id: OTP-7085
All Windows versions older than Windows 2000 are now not supported by the Erlang runtime system. This since there was a need for usage of features introduced in Windows 2000.
Own Id: OTP-7086
Memory management improvements especially for the runtime system with SMP support:
If you
for some reason want the memory allocators to be
configured as before, you can pass the
For more
information see the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-7100
On Unix, denormalized floating point numbers could not be
created using
Own Id: OTP-7122
Native atomic integers and spin-locks are now also available for the runtime system with SMP support on sparc64.
Own Id: OTP-7130
FP exceptions support for sparc64 userspace on Linux has
been added. Note that FP exception support is now turned
off by default, so to actually enable it you need to do
'
Own Id: OTP-7131
A bug for raw files when reading 0 bytes returning 'eof' instead of empty data has been corrected.
Own Id: OTP-6291 Aux Id: OTP-6967
All exported functions in gzio.c have now been renamed to avoid conflict with drivers that are indirectly linked with an external zlib library.
Own Id: OTP-6816 Aux Id: OTP-6591
On the 64-bit Erlang emulator, bit syntax construction with integers containing more than 60 bits ("big numbers") into fields with more than 60 bits could produce incorrect results.
Own Id: OTP-6833
When the runtime system failed to allocate memory for
binaries, it could dead lock while writing the
Own Id: OTP-6848
The runtime system with SMP support could deadlock if a
process called the
Processes suspending each other via the
Own Id: OTP-6920
Processes suspended via
Processes could previously be suspended by one process and resumed by another unless someone was tracing the suspendee. This is not possible anymore. The process resuming a process has to be the one that suspended it.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6946
file:write_file/3, file:write/2 and file:read/2 could crash (contrary to documentation) for odd enough file system problems, e.g write to full file system. This bug has now been corrected.
In this process the file module has been rewritten to produce better error codes. Posix error codes now originate from the OS file system calls or are generated only for very similar causes (for example 'enomem' is generated if a memory allocation fails, and 'einval' is generated if the file handle in Erlang is a file handle but currently invalid).
More Erlang-ish error codes are now generated. For
example
The possibility to write
a single byte using
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6967 Aux Id: OTP-6597 OTP-6291
Monitor messages produced by the system monitor functionality, and garbage collect trace messages could contain erroneous heap and/or stack sizes when the actual heaps and/or stacks were huge.
As of erts version 5.6 the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6974 Aux Id: seq10796
Own Id: OTP-7003
The emulator internal process lock implementation has been rewritten and optimized. A slight risk of starvation existed in the previous implementation. This risk has also been eliminated in the new implementation.
Own Id: OTP-6500
Bitstrings (bit-level) binaries and binary comprehensions are now part of the language. See the Reference Manual.
Own Id: OTP-6558
The windows version of erlang now has SMP support. The SMP emulator is run by default on machines which shows more than one virtual or physical processor.
Own Id: OTP-6560 Aux Id: OTP-6925
The details of the compressed term format has been documented in erl_ext_dist.txt. (Thanks to Daniel Goertzen.)
Own Id: OTP-6755
The runtime system with SMP support is now started by
default if more than one logical processor are detected.
For more information, see the
Own Id: OTP-6756
The external format for Erlang terms and the distribution protocol are now documented in ERTS User's Guide.
Own Id: OTP-6779
New BIF's erlang:system_profile/1 and erlang:system_profile/2. These BIF's controls concurrency profiling options for processes, ports and schedulers.
Own Id: OTP-6783 Aux Id: OTP-6285
The
Also the data types
The incorrect data types
For more information see the
Own Id: OTP-6823
Miscellaneous improvements of the erts internal thread library.
It now support optimized atomic operations and spin-locks on windows.
Fall-backs based on mutexes and/or spin-locks for missing optimized atomic operations, spin-locks, or rwlocks has been implemented. This makes it possible to compile the runtime system with SMP support on a lot more platforms.
Default stack size on OpenBSD has been increased to 256 kilo-words.
Own Id: OTP-6831 Aux Id: OTP-6560
Many bit syntax operations, both construction and matching, are faster. For further information, see the Efficiency Guide.
Own Id: OTP-6838
Literal lists, tuples, and binaries are no longer constructed at run-time as they used to be, but are stored in a per-module constant pool. Literals that are used more than once are stored only once.
This is not a change to the language, only in the details of its implementation. Therefore, the implications of this change is described in the Efficiency Guide.
Example 1: In the expression
Example 2: Literal strings, such as
Own Id: OTP-6850
The Erlang driver API has been extended with a portable POSIX thread like API for multi-threading. The Erlang driver thread API provides:
For more
information see the
Own Id: OTP-6857
Recursive calls now usually consume less stack than in R11B. See the Efficiency Guide.
Own Id: OTP-6862 Aux Id: seq10746
The deprecated BIFs
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6876
Calls to driver call-backs triggered by external events are now scheduled and interleaved with execution of Erlang processes also on the runtime system without SMP support.
Own Id: OTP-6878
Faster arithmetic of integers of more than 27 bits signed (or 60 bits signed on an 64-bit CPU), and also faster integer multiplication. (Thanks to Tony Rogvall.)
Own Id: OTP-6891
Significant improvements of the
For more information see the
Own Id: OTP-6899
Own Id: OTP-6901
Two new guard BIFs have been introduced as a
recommended replacement for
There is also a new
Own Id: OTP-6902
The
The
The
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6906
As the linux kernel may generate a minor fault when tracing with CPU timestamps, and there exists no patch to the Linux kernel that fixes the problem, cpu timestamps are disabled on Linux for now.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6922
The functions io:columns/0, io:columns/1, io:rows/0 and io:rows/1 are added to allow the user to get information about the terminal geometry. The shell takes some advantage of this when formatting output. For regular files and other io-devices where height and width are not applicable, the functions return {error,enotsup}.
Potential incompatibility: If one has written a custom io-handler, the handler has to either return an error or take care of io-requests regarding terminal height and width. Usually that is no problem as io-handlers, as a rule of thumb, should give an error reply when receiving unknown io-requests, instead of crashing.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6933
Own Id: OTP-6951
The emulator can now be compiled for 64bit intel, as well as a 32bit universal binary on darwin/MacOSX 10.4 and 10.5.
Own Id: OTP-6961
If
Own Id: OTP-6968
The
Own Id: OTP-6975
On Windows, the werl window now handles resize, so that the whole window can be utilized. Text selection is also updated to be line oriented instead of rectangle oriented as in earlier versions.
Own Id: OTP-6994 Aux Id: OTP-6933
Kqueue support (kernel-poll) has been enabled on FreeBSD. The problem with kqueue not detecting writes on a pipe on FreeBSD was actually not a kqueue issue, but a writev on pipes issue. Neither poll(), nor select() detected the write when the bug hit. NetBSD and DragonFlyBSD probably have or have had the same bug. This bug should have been fixed in FreeBSD 6.3 and FreeBSD 7.0 thanks to Jean-Sebastien Pedron.
Own Id: OTP-7001
Hanging writes on temporarily unavailable NFS filesystems could cause the execution of (not file related) erlang code to get blocked even though I/O threads were used. This is now corrected.
Own Id: OTP-6907 Aux Id: seq10771
Data passed to a driver via
Own Id: OTP-6879
In the SMP emulator, if several processes called ets:update_counter/3 (even for different tables) when the counter values exceeded 27 bits, the counter values could be corrupted or the emulator could crash.
Own Id: OTP-6880 Aux Id: seq10760
Creating a named table using
Turning on call trace on the internal BIF that
implements
SMP emulator only: Using
Own Id: OTP-6872 Aux Id: seq10756, seq10757
ets:select/3 on ordered_set and with a chunksize a multiple of 1000 gave all elements instead of just 1000. Also ets:slot/2 on ordered set could give unexpected results on SMP emulator. Both problems are corrected.
Own Id: OTP-6842
All exported functions in gzio.c have now been renamed to avoid conflict with drivers that are indirectly linked with an external zlib library.
Own Id: OTP-6816 Aux Id: OTP-6591
Calling binary_to_term/1 with certain invalid binaries would crash the emulator.
Own Id: OTP-6817
Restored speed of bit-syntax matching of 32 bits integers.
Own Id: OTP-6789 Aux Id: seq10688
The functions in gzio.c have been renamed to avoid conflict with drivers that indirectly linked with an external zlib library.
Own Id: OTP-6591
The emulator without SMP support dumped core if an
async-thread finished a job after the emulator had begun
writing an
Own Id: OTP-6685
In bit syntax matching, integer fields with greater size than 16Mb would fail to match. (Thanks to Bertil Karlsson and Francesco Pierfederici.)
Matching out a 32-bit integer not aligned on a byte boundary from a binary could cause an heap overflow (and subsequent termination of the emulator).
A module that contained bit syntax construction with a literal field size greater than 16Mb would fail to load.
Several other similar bugs having to do with huge field sizes were eliminated.
Attempting to construct a binary longer than 536870911
bytes will now fail with a
Own Id: OTP-6686
Bugs in rem and div of very large numbers are corrected.
Own Id: OTP-6692
Own Id: OTP-6693
It was previously not possible to pass
A
Own Id: OTP-6699
The
Own Id: OTP-6729
For scripts written using
Own Id: OTP-6593
The section Guards in the chapter The Abstract Format of the ERTS User's Guide has been updated.
Own Id: OTP-6600
Corrected protocol layer flue for socket options SO_LINGER, SO_SNDBUF and SO_RCVBUF, for SCTP.
Own Id: OTP-6625 Aux Id: OTP-6336
The behaviour of the inet option {active,once} on peer close is improved and documented.
Own Id: OTP-6681
The inet option send_timeout for connection oriented sockets is added to allow for timeouts in communicating send requests to the underlying TCP stack.
Own Id: OTP-6684 Aux Id: seq10637 OTP-6681
The command line flag
Own Id: OTP-6697
The
Own Id: OTP-6731
Own Id: OTP-6627 Aux Id: OTP-6160
The minimum and default stack size for async-threads has
been increased to 16 kilowords. This since the previous
minimum and default stack size of 8 kilowords proved to
be too small (introduced in
Own Id: OTP-6628 Aux Id: OTP-6580, Seq10633
process_flag/2 accepts the new flag
Own Id: OTP-6592 Aux Id: seq10555
When a port steals control over a file descriptor from another port, the stealing port tests if the other port is alive. This in order to be able to give an accurate error message. In the runtime system with SMP support, this test was done without appropriate locks held. This could in worst case lead to an erroneous error message; therefore, this bug is to be considered harmless.
Own Id: OTP-6602
The default stack size for threads in the async-thread
pool has been shrunk to 8 kilowords, i.e., 32 KB on
32-bit architectures. This small default size has been
chosen since the amount of async-threads might be quite
large. The default stack size is enough for drivers
delivered with Erlang/OTP, but might not be sufficiently
large for other dynamically linked in drivers that use
the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6580
Setting the time on the system while using heart on a linux machine where the emulator was built with clock_gettime support (default from Linux 2.6/erts-5.5.4 and upwards), could make the heart command fire. This was due to bug in the heart executable which is now corrected.
Own Id: OTP-6598 Aux Id: seq10614
Corrected misspelling of '
Own Id: OTP-6433
The MD5 calculation of a BEAM file done by
Own Id: OTP-6459
The emulator could dump core while writing an
Own Id: OTP-6504
Own Id: OTP-6528
A bug in linuxthreads could cause the emulator to dump core when dlerror() was called before the first call to dlopen(). As a workaround the emulator always makes a call to dlopen() on initialization when linuxthreads is used as thread library.
Own Id: OTP-6530
file:sync/1 did not do anything on Windows. Now it calls the system function for flushing buffers (FlushFileBuffers()). (Thanks to Matthew Sackman.)
Own Id: OTP-6531
Own Id: OTP-6536
The file driver (efile_drv) did not flush data written using the option 'delayed_write' after the set timeout time, rather at the next file operation. This bug has now been corrected.
Own Id: OTP-6538
An interface towards the SCTP Socket API Extensions has been implemented.It is an Open Source patch courtesy of Serge Aleynikov and Leonid Timochouk. The Erlang code parts has been adapted by the OTP team, changing the Erlang API somewhat.
The Erlang interface consists of the module
The delivered Open Source patch, before the OTP team rewrites, was written according to http://tools.ietf.org/html/draft-ietf-tsvwg-sctpsocket-13 and was claimed to work fine, tested on Linux Fedora Core 5.0 (kernel 2.6.15-2054 or later) and on Solaris 10 and 11. The OTP team rewrites used the same standard document but might have accidentally broken some functionality. If so it will soon be patched to working state. The tricky parts in C and the general design has essentially not changed. During the rewrites the code was hand tested on SuSE Linux Enterprise Server 10, and briefly on Solaris 10. Feedbach on code and docs is very much appreciated.
The SCTP interface is in beta state. It has only been hand tested and has no automatic test suites in OPT meaning everything is most certainly not tested. Socket active mode is broken. IPv6 is not tested. The documentation has been reworked due to the API changes, but has not been proofread after this.
Thank you from the OTP team to Serge Aleynikov and Leonid Timochouk for a valuable contribution. We hope we have not messed it up too much.
Own Id: OTP-6336
A
Own Id: OTP-6434
There is a new
Own Id: OTP-6505
Setting and getting socket options in a "raw" fashion is now allowed. Using this feature will inevitably produce non portable code, but will allow setting ang getting arbitrary uncommon options on TCP stacks that do have them.
Own Id: OTP-6519
Miscellaneous signal handling improvements on the Erlang runtime system with SMP support.
The fallback implementation of spin locks and atomic operations are now implemented using pthread spin locks when pthread spin locks are found on the system.
The Erlang runtime system with SMP support can now run on
Linux systems that has Linuxthreads instead of NPTL
(Native POSIX Thread Library). Note that the SMP support
hasn't been as thoroughly tested with Linuxthreads as
with NPTL. A runtime system with SMP support will
therefore not be built by default on Linux when NPTL
isn't found. In order to force a build of the runtime
system with SMP support, pass
Own Id: OTP-6525
Own Id: OTP-6431 Aux Id: OTP-6403
The runtime system with SMP support failed to call the driver timeout callback of ports in state closing. This could cause ports to fail flushing their I/O queues.
Own Id: OTP-6432
The
Own Id: OTP-6437
The async id of async jobs created via
Own Id: OTP-6438
Under rare circumstances a terminating connection between two nodes could cause an instantaneous reconnect between the two nodes to fail on the runtime system with SMP support.
Own Id: OTP-6447
In the documentation of the driver entry field
The runtime check for detection of old incompatible drivers made when loading drivers has been improved. The emulator can, however, not make sure that a driver that doesn't use the extended driver interface isn't incompatible. Therefore, when loading a driver that doesn't use the extended driver interface, there is a risk that it will be loaded also when the driver is incompatible. When the driver use the extended driver interface, the emulator can verify that it isn't of an incompatible driver version. You are therefore advised to use the extended driver interface.
For more information see the
Own Id: OTP-6452 Aux Id: OTP-6330
When terminating ports on the runtime system with SMP support, removal of links to processes was done without locking the link lock on processes. This could cause an emulator crash.
Own Id: OTP-6475
The emulator with SMP support could crash when a port
flushed its I/O queue by calling
Own Id: OTP-6479
Large exit reasons could under rare circumstances cause the runtime system with SMP support to crash.
Own Id: OTP-6521
Faster system calls for keeping the time accurate are used on newer Linux kernels, which can result in a significant speed-up of the emulator on those systems.
Own Id: OTP-6430
Added number of async threads and number of scheduler
threads to the system information that can be retrieved
via
Own Id: OTP-6440
When
Own Id: OTP-6465
term_to_binary/2 with compression is now faster.
term_to_binary/2 now accepts the option
'
Future compatibility bugfix: binary_to_term/1 did not
handle the
Own Id: OTP-6494
Removed unnecessary reallocation when initializing kernel-poll set.
Own Id: OTP-6516
Node and fun table entries could under rare circumstances be deallocated multiple times on the emulator with SMP support.
Own Id: OTP-6369
epoll_wait() can repeat entries for the same file descriptor in the result array. This could cause the ready_input, ready_output, or event callbacks of a driver to unintentionally be called multiple times. We have only noted repeated entries when an error condition has occurred on the file descriptor. In this case, the repeated entries should normally not be a problem for the driver since it should detect the error and de-select the file descriptor. Therefore this bug should be considered harmless. The emulator now coalesce repeated entries into one.
You are only affected by this bug if you are using erts-5.5.2.* and the kernel-poll feature on linux.
Own Id: OTP-6376 Aux Id: OTP-6222
If a process that was waiting in gen_tcp:accept/1 was
killed, calling gen_tcp:accept/1 again on the same listen
socket would fail with '
Own Id: OTP-6381 Aux Id: seq10535
The emulator failed to start on Solaris 10 when kernel-poll support was enabled and the maximum number of filedescriptors configured was less than or equal to 256.
Own Id: OTP-6384 Aux Id: OTP-6222
The R10B compiler could generate unsafe
Own Id: OTP-6386
Process and port timers could fail to work properly on the runtime system with SMP support. Many thanks to Dmitriy Kargapolov and Serge Aleynikov who tracked down this bug.
Own Id: OTP-6387
Bit syntax code compiled by an R10B compiler that matched out a floating point number would not properly check that the floating point number was valid; if the float was, for instance, NaN the emulator could crash.
Own Id: OTP-6395
statistics(runtime) on Windows used to return the elapsed system time for the process, instead of the user time. Corrected. (Thanks to Robert Virding.)
Own Id: OTP-6407
A loadable driver (loaded by erl_ddll) which used driver_async() would cause the emulator to crash. (Thanks to Dmitriy Kargapolov.)
Own Id: OTP-6410
Under rare circumstances the emulator on unix platforms
could fail to terminate the Erlang port corresponding to
a port program opened with the
Own Id: OTP-6411
A link removed via
Own Id: OTP-6425 Aux Id: OTP-6160
In the runtime system with SMP support, ports are now being scheduled on the scheduler threads interleaved with processes instead of being run in a separate I/O thread.
Own Id: OTP-6262
More interfaces are added in erl_ddll, to support different usage scenarios.
Own Id: OTP-6307 Aux Id: OTP-6234
In the runtime system with SMP support, the global
I/O lock has been replaced with a more fine grained port
locking scheme. Port locking is either done on driver
level, i.e., all ports executing the same driver share a
lock, or on port level, i.e., each port has its own lock.
Currently the inet driver, the efile driver, and the
spawn driver use port level locking and all other
statically linked in drivers use driver level locking. By
default dynamically linked in drivers will use locking on
driver level. For more information on how to enable port
level locking see the
As of erts
version 5.5.3 the driver interface has been extended. The
extended interface introduce version management, the
possibility to pass capability flags to the runtime
system at driver initialization, and some new driver API
functions. For example, the
NOTE: Dynamically linked in drivers have to be recompiled.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6330 Aux Id: OTP-6262
A test and debug feature which modifies the timing of the
runtime system has been added. For more information, see
documentation of the
Own Id: OTP-6382
The version of zlib (http://zlib.net) linked into run-time system has been updated to version 1.2.3.
Own Id: OTP-6394
The
If the
Own Id: OTP-6398
The
A
Own Id: OTP-6403
A port program that had been started with the
Now the emulator doesn't poll for termination of the port program at all; instead, it waits for the child signal from the terminated port program to arrive and then schedules the Erlang port for termination.
The termination of any port programs have also been
optimized. Previously the termination of any port program
did always cause a scan of a table of the size equal to
maximum number of file descriptors. If the maximum number
of file descriptors was large, this scan could be quite
expensive. Now the search have been reduced to the set of
ports started with the
Note, all of the above only applies to Erlang emulators on Unix platforms.
Own Id: OTP-6412 Aux Id: seq10194
* BEAM: added support for floating-point exceptions on FreeBSD (32-bit x86)
* SMP: made locking procedures work even when native lock operations aren't implemented
* SMP: improved timing accuracy in the timer thread (if enabled)
Own Id: OTP-6424
A bug in the kernel poll implementation could cause the emulator to omit polling for events on file descriptors. The bug was only present when using the kernel poll implementation based on epoll or kqueue. This bug was introduced in erts-5.5.2.
Own Id: OTP-6344 Aux Id: OTP-6222
The run_erl program now acquires its pseudo-ttys using openpty(3), so that it will work on newer Linux distributions that don't have the traditional pseudo-tty devices in the file system. On platforms that don't have openpty(3), run_erl will still search for pseudo-tty devices in the file system.
The run_erl program will now wait using waitpid(3) to prevent the program it spawned to become defunct. run_erl will also terminate after a delay of 5 seconds (to allow any pending output to be written to the log file) if the spawned program terminates even if some child of it still holds stdin and/or stdout open.
Own Id: OTP-6225 Aux Id: seq10500
A bug in ordered_set ETS datatyp caused ets:select (and match) to return faulty results when the table contained process id's from another node.
Own Id: OTP-6338
erlc: A typo in the help text for '-pa path' was corrected.
Own Id: OTP-6218
Failure in port command/control driver callbacks could crash the non-SMP emulator. This bug was introduced in the 5.5 version of erts.
Own Id: OTP-6224
Erroneous "
Own Id: OTP-6229 Aux Id: OTP-3993, Seq5266, Seq7247, OTP-4307
The emulator could cause a type assertion failure while writing an erl_crash.dump, causing the erl_crash.dump to be terminated and a core dump generated.
Own Id: OTP-6235 Aux Id: seq10444
The registered name of a process is now the last observable resource removed before links and monitors are triggered when a process terminates.
Previously ets tables were removed after the registered name. This could cause problems on the runtime system with SMP support for code that expected that ets tables owned by a specific process had been removed if the name of the process had been removed.
Own Id: OTP-6237
Failure to fork() a new (os) process could cause the emulator to deadlock. This bug affect all emulators with SMP support, and emulators with async thread support on SunOS.
Own Id: OTP-6241 Aux Id: OTP-3906
Fprof traces could become truncated for the SMP emulator. This bug has now been corrected.
Own Id: OTP-6246
The undocumented functions inet:getiflist/0,1 inet:ifget/2,3 and inet:getif/1 were completely broken on Windows. That has been fixed.
Own Id: OTP-6255
Behavior in case of disappeared nodes when using the dist_auto_connect once got changed in R11B-1. The timeouts regarding normal distributed operations is now reverted to the old (pre R11B-1).
Own Id: OTP-6258 Aux Id: OTP-6200, seq10449
The bsl and bsr operators could cause the emulator to crash if given invalid arguments. (Thanks to datacompboy and Per Gustafsson.)
Own Id: OTP-6259
driver_cancel_timer() could under certain circumstances fail to cancel the timer on the runtime system with SMP support.
Own Id: OTP-6261
A call to erlang:system_info(info) could deadlock the runtime system with SMP support.
Own Id: OTP-6268
Exit signals are now truly asynchronous in the runtime system with SMP support. This simplifies locking in bifs a lot, and makes process termination cheaper.
Own Id: OTP-6160
When tracing on the runtime system with SMP support it
can be difficult to know when a trace has been delivered
to the tracer. A new built in function
Own Id: OTP-6205 Aux Id: OTP-6269
Kernel poll support can now be combined with SMP support.
Currently the following kernel poll versions exist:
The "check io" implementation for unix has been completely rewritten. The current kernel poll implementation reduce the amount of system calls needed compared to the old kernel poll implementation.
When
Kernel poll support is now enabled by default if
Note:
Own Id: OTP-6222 Aux Id: seq10380
The
Own Id: OTP-6234
The SMP emulator now avoids locking for the following
operations (thus making them as fast as in the UP
emulator):
Own Id: OTP-6252
There are new BIFs
The
Own Id: OTP-6281
There is now an option read_packets for UDP sockets that sets the maximum number of UDP packets that will be read for each invocation of the socket driver.
Own Id: OTP-6249 Aux Id: seq10452
Complex pattern matching of strings would fail in the 64 bits emulator because of a bug in the loader. (Thanks to Igor Goryachev.)
Own Id: OTP-6142
Own Id: OTP-6154
erlang:display/1 displayed erroneous values for negative integers.
Big integers (both positive and negative) were previously displayed in hexadecimal form while small integers were displayed in decimal form. All integers are now displayed in decimal form.
NOTE: erlang:display/1 should only be used for debugging.
Own Id: OTP-6156
A call to erlang:trace/3 with erroneous flags caused the SMP emulator to deadlock instead of exiting the calling process with badarg.
Own Id: OTP-6175
A bug causing the emulator to hang when exiting a process that is exception traced has been fixed.
Own Id: OTP-6180
ets:rename/1 could deadlock, or crash the SMP emulator when the table wasn't a named table.
ets:next/2, and ets:prev/2 could return erroneous results on the SMP emulator.
Own Id: OTP-6198 Aux Id: seq10392, seq10415
A memory allocation bug could cause the SMP emulator to
crash when a process had executed a
Own Id: OTP-6199
The runtime system with SMP support did not slowly adjust its view of time when the system time suddenly changed.
Timeouts could sometimes timeout too early on the runtime system with SMP support.
Own Id: OTP-6202
The smp runtime system now automatically detects the number of logical processors on MacOSX (darwin) and OpenBSD.
The smp runtime system is now built by default on MacOSX (darwin) on x86.
Own Id: OTP-6119
The
Especially the
Own Id: OTP-6126
Increased the reduction cost for sending messages in the SMP emulator so it behaves more like the non-SMP emulator.
Own Id: OTP-6196
A port running a dynamically linked-in driver that exits
due to the driver being unloaded now exits with exit
reason
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6204
Changed name of the
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6208
The changes below were made by Mikael Pettersson, HiPE.
HiPE runtime system:
Reduce overheads in the HiPE runtime system's BIF glue code.
Fix bug when exceptions are thrown from BEAM to HiPE.
Support SPARC on Linux.
Support x86 on FreeBSD.
Floating-point exceptions:
Reduce overheads in checking results of floating-point operations.
Minor bug fix in SSE2 floating-point exception handling.
Support SSE2 floating-point exceptions on 32-bit x86 machines.
Make FP exceptions work in the SMP runtime system on FreeBSD/x86.
Support floating-point exceptions on SPARCs running Linux.
Runtime system:
Minor scheduler optimisation in the non-SMP runtime system.
Substantial reduction of I/O thread overheads in the SMP runtime system if the separate timer thread is used. (In R11B-1, the separate timer thread is not used.)
Own Id: OTP-6211
Previously
The new behavior of
NOTE: This change can cause some obscure code to fail which previously did not. For example, the following code might hang:
ok
%% We were previously guaranteed to get a down message
%% (since we exited the process ourself), so we could
%% in this case leave out:
%% after 0 -> ok
end,
]]>
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-5772
Two bugs fixed: If the environment variable
Own Id: OTP-6054
The documentation for writing drivers in the ERTS User's Guide has been expanded and updated.
Own Id: OTP-5192
The
Own Id: OTP-5894 Aux Id: OTP-5149
There is a new trace match spec function
The
Own Id: OTP-5956
Erlang runtime system with SMP (symmetric multi processing) support.
The runtime system with SMP support is in this release focused on stability and there are a number of steps with optimizations to follow before it will take full advantage of multi processor systems. The released system is however truly multi threaded and you will notice increased performance for many applications already. We recommend that you evaluate your application on the SMP version of the runtime system and wait for some more optimizations before you use it in a real product. You will then discover if there are any problems in your application that needs to be fixed in order for it to work properly in a multi threaded environment. More optimized versions of the runtime system with SMP support will be included in the R11B maintenance releases.
The SMP enabled runtime system will be started if
the
A runtime system with SMP support is by default built on the following platforms if posix threads, and a gcc compiler of at least version 2.95 is found:
Linux with at least kernel version 2.6 and the Native POSIX Thread Library on x86, x86_64, and 32-bits PowerPC.
Solaris of at least version 8 on 32-bits SPARC-V9.
MacOSX of at least version 10.4 (Darwin 8.0) on 32-bits PowerPC.
The runtime system with SMP support is known not to build on:
Windows.
Linux with kernel versions less than 2.4, or without the Native POSIX Thread Library.
Other hardware platforms than x86, x86_64, 32-bits SPARC-V9 and 32-bits PowerPC.
Windows will be supported in a future release.
The runtime system with SMP support might build on other
operating systems in combination with supported hardware.
In order to force a build of a runtime system with SMP
support, pass the
NOTE: The design of SMP support for drivers is ongoing. There will probably be incompatible driver changes (only affecting drivers run on the runtime system with SMP support) released as patches for R11B.
Potential incompatibility: Previously, specific driver call-backs were always called from the same thread. This is not true in the runtime system with SMP support. Calls to call-backs will be made from different threads, e.g., two consecutive calls to exactly the same call-back can be made from two different threads. This will in most cases not be a problem. All calls to call-backs are synchronized, i.e., only one call-back will be called at a time.
In the future the default behavior will probably be the following: Calls to call-backs will, as now, be made from different threads. Calls to call-backs in the same driver instance will be synchronized. It will probably be possible to configure so that all calls to call-backs in all driver instances of a specific driver type will be synchronized. It may be possible to configure so that all calls to call-backs of a driver instance or a of a specific driver type will be made from the same thread.
Parallelism in the Erlang code executed is a necessity for the Erlang runtime system to be able to take advantage of multi-core or multi-processor hardware. There need to be at least as many Erlang processes runnable as processor cores for the Erlang runtime system to be able to take advantage of all processor cores.
An Erlang runtime system with SMP support with only one Erlang process runnable all the time will almost always be slower than the same Erlang runtime system without SMP support. This is due to thread synchronization overhead.
Known major bottleneck in the Erlang runtime system:
Currently the I/O system uses one "big lock", i.e. only one thread can do I/O at a time (with the exception of async threads and threads created by users own linked-in drivers). This is high on the list of things to optimize. Note, code that does not do I/O can be executed at the same time as one thread does I/O.
Some pitfalls which might cause Erlang programs that work on the non-SMP runtime system to fail on the SMP runtime system:
A newly spawned process will often begin executing immediately. Code that expects that the parent process will be able to execute for a while before the child process begins executing is likely to fail.
High priority processes could previously provide mutual exclusion (bad programming style) by preventing normal and low priority processes from being run. High priority processes cannot be used this way to provide mutual exclusion.
Obscure pitfall, only if a process being traced also
sends normal messages to the tracer:
The order between trace messages and normal
messages is undefined. I.e. the order between normal
messages sent from a tracee to a tracer and the trace
messages generated from the same tracee to the same
tracer is undefined. The internal order of normal
messages and the internal order of trace messages will,
of course, be preserved as before.
The kernel poll feature is currently not supported by the runtime system with SMP support. It will probably be supported in a future release.
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6006 Aux Id: OTP-6095
Linked-in driver modifications.
Linked-in drivers must be recompiled.
The
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-6095 Aux Id: OTP-6006
Large files (more than 2 GBytes) are now handled on Solaris 8.
Own Id: OTP-5849 Aux Id: seq10157
A failing bit syntax construction could fail with the
PREVIOUS exception reason that had occurred in the process
(instead of with
Own Id: OTP-5911
When building OTP, the Kernel application was built in both the primary and secondary bootstrap steps, which would cause problems if OTP including its bootstrap is checked into a version control system (such as CVS). (Thanks to Sebastian Strollo.)
Own Id: OTP-5921
Own Id: OTP-5933
Own Id: OTP-5940
Execution of match specs could under rare circumstances cause the emulator to dump core.
Execution of match specs could cause memory leaks in the hybrid emulator.
Own Id: OTP-5955
A bug in
Own Id: OTP-5957
Different (and old)
Own Id: OTP-5967
pthread header and library mismatch on Linux systems (at least some SuSE and Debian) with both NPTL and Linuxthreads libraries installed.
Own Id: OTP-5981
The driver_set_timer did not change the previous timeout if called a second time. Now it works as specified, changing the timeout.
Own Id: OTP-5942
The undocumented
Own Id: OTP-5945
The setuid_socket_wrap program was corrected to work for
C compilers that treat the
Own Id: OTP-5946
Fixed a minor build problem on Windows.
Own Id: OTP-5819 Aux Id: OTP-5382 OTP-5540 OTP-5577
The
Own Id: OTP-5822
If there were user-defined variables in the boot
script, and their values were not provided using the
The
Own Id: OTP-5828 Aux Id: seq10151
The HiPE compiler identifies more leaf functions, giving slightly faster code.
Corrected problems in HiPE's coalescing register allocating that would cause it to fail when compiling very large functions (e.g. some of parse modules in the Megaco application).
Own Id: OTP-5853
Timers could sometimes timeout too early. This bug has now been fixed.
Automatic cancellation of timers created by
In order to be able to maintain a larger amount of timers without increasing the maintenance cost, the internal timer wheel and bif timer table have been enlarged.
Also a number of minor bif timer optimizations have been implemented.
Own Id: OTP-5795 Aux Id: OTP-5090, seq8913, seq10139, OTP-5782
Own Id: OTP-5827
By setting Unix environment variables, the priority for
the emulator can be lowered when it is writing crash
dumps and the time allowed for finishing writing a crash
dump can be set to a certain number of seconds. See the
documentation for
Own Id: OTP-5818
Documentation improvements:
- documentation for
- command line flag
-
-
Own Id: OTP-5847
-D_GNU_SOURCE is now always passed on the compile command line on linux. This in order to ensure that all included system headers see _GNU_SOURCE defined.
_GNU_SOURCE is now also defined on linux in configure when looking for features.
Some minor (harmless) configure bugs were also fixed.
Own Id: OTP-5749
Some compiler warnings and Dialyzer warnings were eliminated in the Tools application.
When tracing to a port (which
Own Id: OTP-5757
The BIFs
The BIF
Minor bug fix: The exception reason could be changed
to
Minor bugfix: On Windows,
The message in the documentation for
Own Id: OTP-5709 Aux Id: seq10100
The previously undocumented and UNSUPPORTED
*** POTENTIAL INCOMPATIBILITY ***
Own Id: OTP-5715
New socket options
Own Id: OTP-5756
Only the emulator is now linked with termcap library in order to decrease library dependencies for other otp programs.
Own Id: OTP-5758
The native resolver has gotten an control API for
extended debugging and soft restart. It is:
Own Id: OTP-5751 Aux Id: EABln25013
On VxWorks, epmd did not handle file descriptors with higher numbers than 63. Also, if epmd should get a file descriptor with a number >= FD_SETSIZE, it will close a the file descriptor and write a message to the log (instead of mysteriously fail); the Erlang node that tried to register will fail with a duplicate_name error (unfortunately, epmd has no way to indicate to the Erlang node why the register attempt failed).
Own Id: OTP-5716 Aux Id: seq10070
Timezone data is now initialized better. (was a problem at least on NetBSD 2.0.2) Thanks to Rich Neswold.
Own Id: OTP-5621
The hybrid-heap emulator ('erl -hybrid') is much more stable. We have corrected all known bugs that caused it to dump core while running our test suites.
Own Id: OTP-5634
Fixed rare memory leaks in
Own Id: OTP-5692
Processes were sometimes unnecessarily garbage collected when terminating. These unnecessary garbage collections have now been eliminated.
Own Id: OTP-5693
The
The
Own Id: OTP-5645 Aux Id: seq9984
The term-building driver functions
The ERL_DRV_FLOAT type has been added.
For the ERL_DRV_BINARY type, the length and offset are now validated against the length of the driver binary.
The ERL_DRV_PID type is now implemented (it was documented, but not implemented).
Own Id: OTP-5674
Own Id: OTP-5572
A bug regarding tcp sockets which results in hanging
Corrected a bug in the (undocumented and unsupported)
option
Updated the documentation regarding the second argument to
Own Id: OTP-5582 Aux Id: seq9839
Erlang/OTP will now build on Mac OS X 10.4 "Tiger" (the problem was that 10.4 has a partially implemented poll() function that can't handle devices). Also, on Mac OS X 10.3 "Panther", Erlang/OTP will now use select() instead of poll() (because poll() on Mac OS X 10.3 is implemented using select()).
Own Id: OTP-5595
A bug in the file driver when opening a file in
compressed mode, and the returned allocated pointer from
the compressing library was in very high memory (>= 2GB),
causing e.g.
Own Id: OTP-5618
The new fun
The new type test
Own Id: OTP-5584
In the HiPE application, there's a new experimental register allocator (optimistic coalescing), and the linear scan register allocator is now also available on ppc. Plus lots of cleanups.
Minor hybrid heap corrections.
The maximum size of a heap used to be artificially limited so that the size of a heap would fit in 28 bits; that limitation could cause the emulator to terminate in a garbage collection even if there still was available memory. Now the largest heap size for a 32 bit CPU is 1,699,221,830 bytes. (Thanks to Jesper Wilhelmsson.)
Also removed the undocumented
Own Id: OTP-5596
Own Id: OTP-5561
The
Own Id: OTP-5532 Aux Id: seq9813
The last known
Own Id: OTP-5544 Aux Id: OTP-5522
Some math libraries do not always throw floating-point exceptions on errors. In order to be able to use these libraries, floating-point errors are now more thoroughly checked.
Misc floating-point fixes for Linux and MacOSX.
Own Id: OTP-5467
An internal buffer was sometimes not cleared which caused garbage to appear in error messages sent to the error logger.
Only emulators on unix platforms were affected by these bugs.
Own Id: OTP-5492
The ethread library now works on OpenBSD.
Own Id: OTP-5515
Corrected a bug in the (undocumented and unsupported)
option
Own Id: OTP-5519
Own Id: OTP-5484 Aux Id: seq9801
Some more stability problems were fixed in the hybrid-heap emulator.
Own Id: OTP-5489
After
Own Id: OTP-5522
If a process had node links (created by
Own Id: OTP-5420
Minor corrections to the help text printed by
Own Id: OTP-5428
32-bit words were used for offsets in the garbage collector. This caused the emulator to crash on 64-bit machines when heaps were moved more than 4 GB during garbage collection.
Own Id: OTP-5430
Own Id: OTP-5448
If there was a call to
Own Id: OTP-5450 Aux Id: seq9722
The
Own Id: OTP-5388
The function
Own Id: OTP-5297 Aux Id: OTP-4927
The
Own Id: OTP-5324 Aux Id: seq9698
In the 'bag' type of ets tables, elements having the same key were supposed to be order in insertion order. The would be wrong if a rehash occurred.
Own Id: OTP-5340 Aux Id: seq9704
Linked in drivers in the Crypto and Asn1 applications
are now compiled with the
Linked in drivers on MacOSX are not compiled with the
undocumented
Linked in driver in Crypto, and port programs in SSL, now compiles on OSF1.
Minor makefile improvements in Runtime_Tools.
Own Id: OTP-5346
Fixed a bug in the hybrid heap in distributed send operations.
Own Id: OTP-5361
A BIF
Own Id: OTP-5376 Aux Id: OTP-5257
Mikael Pettersson (HiPE) corrected a few bugs in the emulator that caused problems when compiled with the experimental gcc-4.0.0.
Own Id: OTP-5386
Minor update of the internal documentation of
the
The listen port of
Own Id: OTP-5234
Own Id: OTP-5384
A few bugs were corrected in the HiPE application.
Own Id: OTP-5385
Font and color preferences for
Own Id: OTP-5250
OTP archive libraries, e.g. the
Own Id: OTP-5274
Bugs in
Own Id: OTP-5292
Corrected a crash in the 64-bits emulator.
Corrected a problem in the hybrid heap emulator.
In the chapter about the abstract format in the ERTS User's Guide, updated the last section about how the abstract format is stored in BEAM files.
Own Id: OTP-5262
The maximum number of concurrent threads in the internal ethread thread package has been limited to 2048.
Own Id: OTP-5280
If Erlang/OTP was installed in a short directory name,
such as
Own Id: OTP-5254
If one used
Own Id: OTP-5209 Aux Id: seq9198
Arithmetic with big numbers could crash the emulator.
The HiPE native code compiler and run-time code in the emulator has been updated. (Note: Native code is still not supported.)
Eliminated a few bugs that could crash the hybrid emulator (which is not supported).
Own Id: OTP-5233 Aux Id: seq9587
The ethread library was unnecessarily rebuilt multiple times during the build process, also a debug version of the library was build during the install phase. These unnecessary builds have now been removed. Note, the content of the installed Erlang/OTP system is not effected at all by this change.
Own Id: OTP-5203
The emulator could fail to clear the memory segment cache. This could potentially cause memory allocation to unnecessarily fail when memory usage was close to its maximum. This bug has now been fixed.
Own Id: OTP-5211
std_alloc (std short for standard) was sometimes called def_alloc (def short for default). std_alloc is now everywhere referred to as std_alloc.
Own Id: OTP-5216
A documentation bug has been corrected in
the
Own Id: OTP-5217
The emulator now close all open files and sockets
immediately after receiving an USR1 signal. This causes
the emulator to unregister at
Own Id: OTP-5221 Aux Id: OTP-4985, seq9514
Try/catch support in the emulator slightly updated.
Own Id: OTP-5229