The HiPE compiler would badly miscompile certain try/catch expressions, so it will now refuse to compile modules containing try or catch.

As a consequence of this, dialyzer will no longer compile key modules to native code.

*** POTENTIAL INCOMPATIBILITY ***

Own Id: OTP-15949

Add function hipe:erllvm_is_supported to check for the presences of a suitable version of the LLVM tool chain as well as supported hardware architecture. The old hipe:llvm_support_available has been removed.

Own Id: OTP-15385 Aux Id: PR-1986

Fix hipe LLVM for FreeBSD and other non-linux unix to use /tmp/ instead of /dev/shm/.

Own Id: OTP-15386 Aux Id: PR-1963

In OTP 22, HiPE (the native code compiler) is not fully functional. The reasons for this are:

There are new BEAM instructions for binary matching that the HiPE native code compiler does not support.

The new optimizations in the Erlang compiler create new combination of instructions that HiPE currently does not handle correctly.

If erlc is invoked with the +native option, and if any of the new binary matching instructions are used, the compiler will issue a warning and produce a BEAM file without native code.

Own Id: OTP-15596

Fix a bug in the handling of the Key argument of lists:{keysearch, keyfind, keymember}.

Own Id: OTP-15570

The code was updated to avoid causing a dialyzer warning because of a tightened spec for beam_lib:info/1.

Own Id: OTP-15482

Improved documentation.

Own Id: OTP-15190

Optimize receive statements that are only waiting for messages containing a reference created before the receive. All messages that existed in the queue when the reference was created will be bypassed, as they cannot possibly contain the reference. This optimization has existed for vanilla BEAM since OTP R14.

Own Id: OTP-14785 Aux Id: PR-1632

Add validation pass to hipe compiler to detect internal errors causing primop calls that may trigger an unsafe GC at run-time. The pass can be disabled with option no_verify_gcsafe.

Own Id: OTP-14900 Aux Id: PR-1685, PR-1621

Make hipe compiled code work on x86_64 (amd64) with OS security feature PIE, where executable code can be loaded into a random location. Old behavior, if hipe was enabled, was to disable PIE build options for the VM.

Own Id: OTP-14903

Inline more type test BIFs; is_number, is_bitstring, is_map.

Own Id: OTP-14941 Aux Id: PR-1718

Fix HiPE bug for binary constructs like <<X/utf8>> which could in rare cases cause faulty results or VM crash.

This fix affects both the hipe compiler and erts runtime in an incompatible way. Old hipe compiled files need to be recompiled to load and run properly as native.

*** POTENTIAL INCOMPATIBILITY ***

Own Id: OTP-14850 Aux Id: PR-1664

The BEAM compiler chooses not to perform tailcall optimisations for some calls in tail position, for example to some built-in functions. However, when the ErLLVM HiPE backend is used, LLVM may choose to perform tailcall optimisation on these calls, breaking the expected semantics.

To preserve the precise semantics exhibited by BEAM, the 'notail' marker, present in LLVM since version 3.8, is added to call instructions that BEAM has not turned into tail calls, which inhibits LLVM from performing tail-call optimisation in turn.

Own Id: OTP-14886

Fix bug for hipe compiled code using <<X/utf32>> binary construction that could cause faulty result or even VM crash.

On architectures other than x86_64, code need to be recompiled to benefit from this fix.

Own Id: OTP-14740

Added documentation about limitations of hipe compared to beam compiled code.

Own Id: OTP-14767

Fix a bug regarding map types that caused Dialyzer to go into an infinite loop. A consequence of the fix is that compound map keys such as maps and tuples sometimes are handled with less precision than before.

Own Id: OTP-14572 Aux Id: seq13319

General Unicode improvements.

Own Id: OTP-14462

Fix hipe compiler flags o0 and o1 that have previously been ignored by mistake.

Own Id: OTP-13862 Aux Id: PR-1154

Fix LLVM backend to not convert all remote calls to own module, like ?MODULE:foo(), into local calls.

Own Id: OTP-13983

Hipe optional LLVM backend does require LLVM version 3.9 or later as older versions forced strong dependencies on erts internals structures.

Own Id: OTP-14238

Fix a bug that has been seen causing failed loading of hipe compiled modules on NetBSD due to unaligned data pointers.

Own Id: OTP-14302 Aux Id: ERL-376, PR-1386

Fix miscompilation bug in hipe that could cause wrong function clause to be called from non-tail calls, where the return value is unused, if the right function clause is only reachable from those non-tail calls.

Own Id: OTP-14306 Aux Id: ERL-278, PR-1392

Improve hipe compilation time for large functions.

Own Id: OTP-13810 Aux Id: PR-1124

Replaced usage of deprecated symbolic time unit representations.

Own Id: OTP-13831 Aux Id: OTP-13735

Speed up hipe compile time register allocation for larger function.

Own Id: OTP-13879

Various code generation improvements.

Own Id: OTP-14261 Aux Id: PR-1360

Improve hipe compiler to generate code with better CPU register utilization at runtime by the use of 'Live Range Splitting' techniques.

Own Id: OTP-14293 Aux Id: PR-1380

Allow HiPE to run on VM built with --enable-m32-build.

Own Id: OTP-14330 Aux Id: PR-1397

Fix a bug concerning parameterized opaque types.

Own Id: OTP-14130

Fixed xml issues in old release notes

Own Id: OTP-14269

Fix flow control bug in hipe compiler that may cause compile time crash.

Own Id: OTP-13965 Aux Id: PR-1253

Fix bug in native compilation of bitstring pattern matching causing erroneous runtime matching result. The bug only affects code containing constant-valued segments whose size is expressed in bits; it is triggered when the pattern matching against these segments fails (i.e., when the next clause needs to be tried).

Own Id: OTP-14005

Workaround in HiPE LLVM backend for a bug in LLVM 3.9. The bug could cause LLVM-compiled modules to be rejected during loading with a badarg exception in hipe_bifs:enter_sdecs/1, but also cause corruption or segmentation faults i runtime.

Own Id: OTP-14027 Aux Id: ERL-292, PR-1237

Fix a bug in HiPE LLVM backend involving incorrect type tests of atoms sometimes causing incorrect behaviour or even segfaults.

Own Id: OTP-14028 Aux Id: PR-1237

Fixed various hipe compiler backend bugs affecting mostly ARM and SPARC.

Own Id: OTP-13846 Aux Id: PR-1146

Fixed some Dialyzer warnings and code cleanup for the Sparc compiler backend.

Own Id: OTP-13861 Aux Id: PR-1148

Fix erl_bif_types opaque bug.

Own Id: OTP-13878 Aux Id: PR-1161, ERL-249

Fix erl_types opaque match order

Own Id: OTP-13876

HiPE compiler crashed, during compilation, in some cases that involved inlining of float operations on complicated control flow graphs.

Own Id: OTP-13407 Aux Id: PR-984

Various fixes and improvements to the HiPE LLVM backend.

Own Id: OTP-13626

Elimination of maps:is_key/2 calls to HiPE

Own Id: OTP-13625 Aux Id: PR-1069

Fix pretty printing of Core Maps

Literal maps could cause Dialyzer to crash when pretty printing the results.

Own Id: OTP-13238

Dialyzer warnings removed.

Own Id: OTP-13379

Fix HiPE ErLLVM code generation for pattern matching with UTF binaries.

Own Id: OTP-13269

Fix various binary construction inconsistencies for hipe compiled code.

Own Id: OTP-13272

Fix hipe bug causing segfaults when native code constructs binaries starting with a zero-length integer field.

Own Id: OTP-13048

Reintroduce the erlang:make_fun/3 BIF in erl_bif_types.

Own Id: OTP-13068

In certain cases of matching with very big binaries, the HiPE compiler generated code that would fail the match, even in cases that the matching was successful. The problem was more quite noticeable on 32-bit platforms.

Own Id: OTP-13092

mikpe/hipe_x86_signal-musl-support

Own Id: OTP-13159

Fix bugs concerning erlang:abs/1.

Own Id: OTP-12948

Fix a bug concerning lists:keydelete/3 with union and opaque types.

Own Id: OTP-12949

A beam file compiled by hipe for an incompatible runtime system was sometimes not rejected by the loader, which could lead to vm crash. This fix will also allow the same hipe compiler to be used by both normal and debug-built vm.

Own Id: OTP-12962

New function hipe:erts_checksum/0 which returns a value identifying the target runtime system for the compiler. Used by dialyzer for its beam cache directory.

Own Id: OTP-12963 Aux Id: OTP-12962, OTP-12964

Fix a minor bug in the handling of opaque types.

Own Id: OTP-12666

Fix hipe bug when matching a "writable" binary. The bug has been seen to sometimes cause a failed binary matching of a correct utf8 character, but other symptoms are also possible.

Own Id: OTP-12667

Optimizations and code cleanup in hipe code loader.

Own Id: OTP-12816

Improved error handling when memory allocation for HiPE code fails.

Own Id: OTP-12448

Allow use of complete interface of cerl_pmatch module

Own Id: OTP-12794

Fix HiPE for ARM when Erlang VM is compiled for Thumb execution mode. This was a problem on e.g. Ubuntu which configures its system GCC to generate Thumb by default.

Own Id: OTP-12405

Reduced lock contention of dynamic function lookups (like apply) from hipe compiled code.

Own Id: OTP-12557

Fix two bugs in HiPE compiler regarding floating-points, both leading to crash during compilation. The target-specific code generators failed to handle integer to floating-point conversion instructions with constant operands. The middle-end could use an incorrect representation for copies between floating-point registers.

Own Id: OTP-12413

Improved error handling when memory allocation for HiPE code fails.

Own Id: OTP-12448

Fixed internal elf_format hrl file to contain valid erlang

Own Id: OTP-12322

The pretty-printing of bitstrings has been corrected.

Own Id: OTP-12015

A bug concerning is_record/2,3 has been fixed, as well as some cases where Dialyzer could crash due to reaching system limits.

Own Id: OTP-12018

A Dialyzer crash involving analysis of Map types has now been fixed.

Own Id: OTP-11947

Handle Maps instructions get_map_elements, put_map_assoc, put_map_exact in HiPE compiler.

Own Id: OTP-11900

Fix compilation with 'no_remove_comments' (Thanks to Johannes Weißl)

Own Id: OTP-11564

Application upgrade (appup) files are corrected for the following applications:

asn1, common_test, compiler, crypto, debugger, dialyzer, edoc, eldap, erl_docgen, et, eunit, gs, hipe, inets, observer, odbc, os_mon, otp_mibs, parsetools, percept, public_key, reltool, runtime_tools, ssh, syntax_tools, test_server, tools, typer, webtool, wx, xmerl

A new test utility for testing appup files is added to test_server. This is now used by most applications in OTP.

(Thanks to Tobias Schlager)

Own Id: OTP-11744

There is now a test suite for the Hipe application

Own Id: OTP-11748

Support for a LLVM backend has been added in HiPE

Own Id: OTP-11801

The pre-defined types array/0, dict/0, digraph/0, gb_set/0, gb_tree/0, queue/0, set/0, and tid/0 have been deprecated. They will be removed in Erlang/OTP 18.0.

Instead the types array:array/0, dict:dict/0, digraph:graph/0, gb_set:set/0, gb_tree:tree/0, queue:queue/0, sets:set/0, and ets:tid/0 can be used. (Note: it has always been necessary to use ets:tid/0.)

It is allowed in Erlang/OTP 17.0 to locally re-define the types array/0, dict/0, and so on.

New types array:array/1, dict:dict/2, gb_sets:set/1, gb_trees:tree/2, queue:queue/1, and sets:set/1 have been added.

A compiler option, nowarn_deprecated_type, has been introduced. By including the attribute

in an Erlang source file, warnings about deprecated types can be avoided in Erlang/OTP 17.0.

The option can also be given as a compiler flag:

Own Id: OTP-10342

EEP43: New data type - Maps

With Maps you may for instance:

For information on how to use Maps please see Map Expressions in the Reference Manual.

The current implementation is without the following features:

Note that Maps is experimental during OTP 17.0.

Own Id: OTP-11616

Parameterized opaque types have been introduced.

Own Id: OTP-11625

Add support for the compilation of the is_map/1 and map_size/1 guards to native code.

Own Id: OTP-11831

Fixed a dialyzer crash when using remote types in the tail position of a maybe_improper_list/2 type. Thanks to Kostis Sagonas

Own Id: OTP-11374

The encoding of the notes.xml file has been changed from latin1 to utf-8 to avoid future merge problems.

Own Id: OTP-11310

Fix the title of hipe_app documentation page. Thanks to Loïc Hoguin.

Own Id: OTP-10904

Fix native code compiler crash involving bs_match_string. Thanks to Kostis Sagonas.

Own Id: OTP-10985

Loosen the assumptions of code that handles escaping functions. Thanks to Kostis Sagonas

Own Id: OTP-11031

Bug fixed in hipe to where it did not allow unicode code points 16#FFFE and 16#FFFF in bit syntax in natively compiled modules.

Own Id: OTP-10867

Fix bug in hipe compiled code related to the handling of is_number/1. (Thanks to Sebastian Egner and Johannes Weißl for minimal test code and Kostis for quick patch)

Own Id: OTP-10897

The type ascii_string() in the base64 module has been corrected. The type file:file_info() has been cleaned up. The type file:fd() has been made opaque in the documentation.

Own Id: OTP-10624 Aux Id: kunagi-352 [263]

Support for Unicode has been implemented.

Own Id: OTP-10302

Where necessary a comment stating encoding has been added to Erlang files. The comment is meant to be removed in Erlang/OTP R17B when UTF-8 becomes the default encoding.

Own Id: OTP-10630

Update .gitignore (lib/hipe/boot_ebin). Thanks to Tuncer Ayaz.

Own Id: OTP-10705

A faulty spec for process_info/2 could cause false dialyzer warnings. The spec is corrected.

Own Id: OTP-10584

Correct handling of type names in contracts. Fix crash related to contract checking. Do not rewrite unchanged PLT.

Own Id: OTP-10083

Changes in comments and minor code cleanups

Thanks to Kostis Sagonas.

Own Id: OTP-10230

Remove all code, documentation, options and diagnostic functions which were related to the experimental hybrid heap implementation.

Own Id: OTP-10105

Bugs in erl_types:t_inf() (HiPE) and in dialyzer_dataflow (Dialyzer) have been fixed.

Own Id: OTP-10191

References to is_constant/1 (which was removed in the R12 release) has been removed from documentation and code.

Own Id: OTP-6454 Aux Id: seq10407

Fixed a discrepancy in compile_info

The BEAM disassembler used the atom 'none' to signify the absence of a compile_info chunk in a .beam file. This clashed with the type declaration of the compile_info field of a #beam_file{} record as containing a list. Now [] signifies the absence of this chunk. This simplifies the code and avoids a dialyzer warning.

Own Id: OTP-9917

Make dialyzer recognize the process_flag option sensitive add missing specs to documentation (Thanks to Tobias Schlager)

Own Id: OTP-9923

Remove hipe_ceach from hipe.app.src to fix reltool-generated release startup. (Thanks to Tim Stewart)

Own Id: OTP-9939

Own Id: OTP-9758

Own Id: OTP-9776

Possible to run HiPE without floating point exceptions (FPE). Useful on platforms that lack reliable FPE. Slower float operations compared to HiPE with FPE.

Own Id: OTP-9724

HiPE compiler: The possibility to compile and load selected functions from a module has been removed.

*** POTENTIAL INCOMPATIBILITY ***

Own Id: OTP-9751

filename:find_src/1,2 will now work on stripped BEAM files (reported by Per Hedeland). The HiPE compiler will also work on stripped BEAM files. The BEAM compiler will no longer include compilation options given in the source code itself in M:module_info(compile) (because those options will be applied anyway if the module is re-compiled).

Own Id: OTP-9752

Optimize erl_types:t_unify().

Own Id: OTP-9768

Clean up hipe.hrl.src (Thanks to Tuncer Ayaz)

Own Id: OTP-9511

Fix bug with binary pattern matching of floats of variable size

Pattern matching of floats with variable size (<<F:S/float>>) did always fail. Judging from similar code for ints, this bug is simply a typo.(Thanks to Paul Guyot)

Own Id: OTP-9556

Quote atoms if necessary in types

Atoms in some occurrences were not correctly quoted when formatted to strings, for instance by the typer program (Thanks to Tomas Abrahamsson)

Update Dialyzer's reference results

Own Id: OTP-9560

Fix typer's crash for nonexisting files Remove unused macro Fix bug in dataflow Decrease tuple arity limit This fixes a memory related crash.

Own Id: OTP-9597

Types for several BIFs have been extended/corrected. Also the types for types for lists:keyfind/3, lists:keysearch/3, and lists:keyemember/3 have been corrected. The incorrect/incomplete types could cause false dialyzer warnings.

Own Id: OTP-9496

Fix hipe bug causing minor heap corruption related to binary matching. The bug has not been confirmed as the cause of any actual fault symptom.

Own Id: OTP-9182

Enable HiPE by default when compiling for PPC64

Own Id: OTP-9198

Fix handling of <<_:N,_:_*M>> type expressions Fix the argument of erlang:list_to_bitstring/1 Remove unneeded function 'sequence/2' Same functionality provided by string:join/2.

Own Id: OTP-9277

Fix erroneous fail info of a hipe_bs_primop

Own Id: OTP-9036

The change fixes a bug in the translation of 'bs_add' BEAM instruction to HiPE's Icode representation. When these instructions appeared in a guard context the previous translation was obviously buggy.

Own Id: OTP-9044

Sanitize the specs of the code module

After the addition of unicode_binary() to the file:filename() type, dialyzer started complaining about erroneous or incomplete specs in some functions of the 'code' module. The culprit was hard-coded information in erl_bif_types for functions of this module, which were not updated. Since these functions have proper specs these days and code duplication (pun intended) is never a good idea, their type information was removed from erl_bif_types.

While doing this, some erroneous comments were fixed in the code module and also made sure that the code now runs without dialyzer warnings even when the -Wunmatched_returns option is used.

Some cleanups were applied to erl_bif_types too.

Own Id: OTP-9100

Fix bug in the simplification of inexact comparisons

On 31/1/2011 Paul Guyot reported a bug in the native code compilation of inexact equality/inequality tests between floats and integers. The relevant test was:

f(X) -> Y = X / 2, Y == 0.

and hipe erroneously evaluated the calls f(0) and f(0.0) to 'false'.

The culprit was in the simplification code of the Icode range analysis which used an erroneous test (lists:any/1 instead of lists:all/1).

Own Id: OTP-9101

Document exiting and garbage_collecting process statuses

Own Id: OTP-9102

Remove hipe constants pool

Hipe constants used to be allocated within a single, fixed-size pool for interaction with the garbage collector. However, the garbage collector no longer depends on constants being allocated within a single pool, and the fixed size of the pool both meant unnecessary allocations on most deployments and crashes on deployments requiring more constants.

The code was simplified to directly invoke erts_alloc. Debugging and undocumented function hipe_bifs:show_literals/0 was removed (it returned true and output text to the console), and debugging and undocumented function hipe_bifs:constants_size/0 was rewritten with a global to count the size of allocated constants.

Own Id: OTP-9128

Several type specifications for standard libraries were wrong in the R14B01 release. This is now corrected. The corrections concern types in re,io,filename and the module erlang itself.

Own Id: OTP-9008

Compiler warnings were eliminated.

Own Id: OTP-8855

The HiPE compiler could crash when compiling certain modules (the bug has been latent, and been exposed by new optimizations introduced in the BEAM compiler in R14A). (Thanks to Mikael Pettersson.)

Own Id: OTP-8800

hipe:load/1 was broken. (Thanks to Paul Guyot.)

Own Id: OTP-8802

receive statements that can only read out a newly created reference are now specially optimized so that it will execute in constant time regardless of the number of messages in the receive queue for the process. That optimization will benefit calls to gen_server:call(). (See gen:do_call/4 for an example of a receive statement that will be optimized.)

Own Id: OTP-8623

Various changes to dialyzer-related files for R14.

- Dialyzer properly supports the new attribute -export_type and checks that remote types only refer to exported types. A warning is produced if some files/applications refer to types defined in modules which are neither in the PLT nor in the analyzed applications.

- Support for detecting data races involving whereis/1 and unregister/1.

- More precise identification of the reason(s) why a record construction violates the types declared for its fields.

- Fixed bug in the handling of the 'or' guard.

- Better handling of the erlang:element/2 BIF.

- Complete handling of Erlang BIFs.

Own Id: OTP-8699

eprof has been reimplemented with support in the Erlang virtual machine and is now both faster (i.e. slows down the code being measured less) and scales much better. In measurements we saw speed-ups compared to the old eprof ranging from 6 times (for sequential code that only uses one scheduler/core) up to 84 times (for parallel code that uses 8 cores).

Note: The API for the eprof has been cleaned up and extended. See the documentation.

*** POTENTIAL INCOMPATIBILITY ***

Own Id: OTP-8706

The documentation is now possible to build in an open source environment after a number of bugs are fixed and some features are added in the documentation build process.

- The arity calculation is updated.

- The module prefix used in the function names for bif's are removed in the generated links so the links will look like "http://www.erlang.org/doc/man/erlang.html#append_element-2" instead of "http://www.erlang.org/doc/man/erlang.html#erlang:append_element-2".

- Enhanced the menu positioning in the html documentation when a new page is loaded.

- A number of corrections in the generation of man pages (thanks to Sergei Golovan)

- The legal notice is taken from the xml book file so OTP's build process can be used for non OTP applications.

Own Id: OTP-8343

The documentation is now built with open source tools (xsltproc and fop) that exists on most platforms. One visible change is that the frames are removed.

Own Id: OTP-8201

Misc updates.

Own Id: OTP-8301

Various small bugs (one involving the handling of large binaries) were corrected and some additions to its functionality and/or code cleanups were done.

Own Id: OTP-8189

Miscellaneous updates.

Own Id: OTP-8038

Minor updates and bug fixes.

Own Id: OTP-7958

Miscellaneous updates.

Own Id: OTP-7877

The --disable-hipe option for the configure will now completely disable the hipe run-time in the emulator, as is the expected behaviour.

Own Id: OTP-7631

Minor updates.

Own Id: OTP-7522

Minor changes.

Own Id: OTP-7388

A fix for an #include problem which caused the FP exception test to fail unnecessarily on debian/glibc-2.7/x86 systems.

Added SIGFPE loop detection to the FP exception test. This prevents the test from looping indefinitely, which could happen when the CPU is supported (so we can enable FP exceptions on it) but the OS isn't (so we can't write a proper SIGFPE handler). x86 on an unsupported OS is known to have had this problem.

Own Id: OTP-7254

HiPE now also supports little-endian ARM processors.

Own Id: OTP-7255

HIPE: Corrected the choice of interface to the send/3 and setnode/3 BIFs for native-compiled code. Using the incorrect interface could, in unusual circumstances, lead to random runtime errors.

Own Id: OTP-7067

The HiPE compiler's SPARC backend has been rewritten, improving its correctness and long-term maintainability.

Own Id: OTP-7133

Minor Makefile changes.

Own Id: OTP-6689

Miscellanous updates.

Own Id: OTP-6738

Miscellanous improvements.

Own Id: OTP-6577

Dialyzer could fail to analyze certain beam files that used try/catch.

Own Id: OTP-6449 Aux Id: seq10563

HiPE runtime system:

* added notes about supported systems to README

* support 32-bit x86 on FreeBSD

* autoenable HiPE on FreeBSD (32-bit x86) and Solaris (64-bit x86)

* updated x86 runtime system to support glibc-2.5

* work around probable gcc-4.1.1 bug affecting the x86 runtime system

HiPE compiler:

* improved performance of integer multiplications on all platforms

* corrected a code optimisation error in R11B-2 that broke some bsl/bsr operations on all platforms

* corrected a type error in the ARM backend which could cause the compiler to crash

* corrected an error in the SPARC backend's naive register allocator which could throw the compiler into an infinite loop

Own Id: OTP-6423

Support for native code on Solaris 10/AMD64.

Support for native code on FreeBSD/AMD64.

Native code now handles external funs (). Native code can now also apply so-called tuple-funs (). (Tuple funs are NOT recommended for new code; they are deprecated and will be removed in some future release.)

Own Id: OTP-6305

Improved compilation of receives for the SMP runtime system.

Improved code quality in HiPE compiler on ARM.

Fix bug in handling of re-raised exceptions in try-catch.

(HiPE loader) When native code is incompatible with the current runtime system, fall back to loading the BEAM code.

Own Id: OTP-6127