* [MLIR] Encapsulate internal nodes of CompiledKernel Op to prevent later passes from accessing them.

* Fix style and namespace.

* Address PR feedback.

* Move encapsulate_nodes from pass to CompiledKernel Op.

* Address PR feedback.

* Follow MLIR naming convention.

* Allow TBB to be excluded from CPU build.

* Change some CMake scope.

* m_use_tbb can be removed if TBB is not enabled.

* Revert some CMake linkage scope as it breaks unit test.

* Migrate changes from #3652.

* [MLIR] Add support for parsing nGraph tensor type

Initial commit that enables nGraph parsing. It's needed for testing.

* Clang format

* Fix return in parser

* [MLIR] Add `ngraph` prefix to MLIR flags

Some flags collision with some MLIR flags.

* [MLIR] Add support for nGraph tensor type in parser

Initial commit that enables nGraph parsing. It's needed for testing.

* Rename ngraph print flag

* Rename ngraph dump mlir flags

* Clang format

* Revert "[MLIR] Add support for nGraph tensor type in parser"

This reverts commit ae371d6a5c8ea590322d5d3b9ba110159d4bf5fa.

* Update MKLDNN to v0.21

* Changed for MKLML asset for WIN32

* test bfloat16 with CPU maxpool

* Move test to cpu_test

* convert result from bfloat16 to float

* Modify result op to support bfloat16

* Correct comment

* Add a simple convolution test case

* initialize floats with float literals

* Guard bf16 tests with MKLDNN_VERSION_MAJOR >= 1

* [ONNX] Added function for converting negative axes.

* [ONNX] Bugfix

* [ONNX] Code formatting

* [ONNX] Changed name of function.

* Added validation for axis/axes.

* Changed abs to llabs for int64 argument.

* Changed validation function.

* [ONNX] Added function for converting negative axes.

* [ONNX] Bugfix

* [ONNX] Code formatting

* [ONNX] Changed name of function.

* Added validation for axis/axes.

* Changed abs to llabs for int64 argument.

* Changed validation function.

* Changed validation function.

* Changed validation function

* Changed rank size in onehot

* Apply suggestions from code review
Co-Authored-By: Tomasz Socha <tomasz.socha@intel.com>

* Code refactoring.

* Update flatten.cpp

* Convert remaining dynamic_pointer_casts for ops
Make is_type a function instead of a method
Direct implementation of `is_parameter`

* Add exports

* Missing includes

* headers

* missing export

* Refactor cpu/builder/dot.cpp

* Support only float and i64

* Refactor softmax and reduction to support only float and i64

* Add a new file for customized kernels

* Add compile time flag NGRAPH_CPU_LARGE_BINARY

* Add compilation flag checks in reduction.hpp

* change dot to only support float and i64

* Revert "Refactor cpu/builder/dot.cpp"

This reverts commit 0d53f27fde64872aff096f12ee9b79e5db7a7fee.

* style

* Consolidate macros

* Refactor slice ops, reshape & pad

* cleanup

* Gather op

* Concat, Convert and broadcast op

* Tile and reverse_sequence op

* Scatter_add op

* ET other then fp and i64 go through ref

* tests passing

* Consolidate macros

* Address feedback

* Fall back to reference for pad and reshape

* add scatter_add reference fallback

* Undo concat change

* Undo tile and update slice as they dont have reference implementation

* Remove update slice condition

* Gather op type check

* change routine name

* Build-time configurability for datatypes that requires optimized kernels on CPU backend (#3592)

* Inline function

* Change condition

* VS compiler workaround

* Add comment for VS workaround

* More fixes for VS

* More wrapping of nested macros for VS

* More wrapper

* variable name change and more wrapping of macros

* test

* Style and refactor

* Wrap macros

* Add a seperate macro for SELECT_KERNEL

* Change SELECT_KERNEL_3ARGS

* Unwrap couple of macros

* Syntax

* Add a new macro for fixed number of args for VS compiler

* Comment/Fake ectx

* Add detailed comment for the workaround for VS compiler

* Comment all unused ectx variables

* Templated calls to reference kernels

* const args

* Change softmax ref definition to take double

* Hardcode softmax kernel to take double ..testing

* Fix softmax

* Latest illustrations of nG components and features

* Update ABOUT.md

* Update full stack diagram

* fix typo

* Updating as per discussion

* Gather:v1 was introduced

* Added support for negative axis

* Removed unsused serialization

* Code review remarks introduced

* Change returned type of get_axis method

* Code review remarks introduced

* Chnaged axis_node to scalar during transformation

* Clang style applied

* Fixed clang errors

* style

* Add RandomUniform op

* Missing files

* Make CPU compile again (RandomUniform tests still don't pass)

* Bop users of existing RNGState class and reorder some comment junk

* Try to bop RNGState in gcpu

* Add RandomUniform to CPU manifest

* Add RandomUniform to PlaidML manifest

* Add .rst for random_uniform

* Clean up junk in the .rst

* Change UniformRNGState to always use double internally

* Change weird test failure message

* Compilation issues

* [MLIR] Add flag to dump jitted MLIR to object file

This PR adds a flag to be able to dump the jitted MLIR code to an object
file and another flag to be able to specify the object file name.

* Add curly braces

* Fix wrong merge

* Fixes bug in provenenace for subgraph replacement

* Updates unit tests for the provenance algorithm fix

* Changes provnance set to ordered set for better consistency in iteration order.

* Fix unsigned comparison and implicit double conversion

* Eliminate sign/unsigned compare warnings, implicit double conversion

* Missed type

* Neww int type

* omp compromise

* style

* Pad:v1 was introduced

* Fixed problem with foward declaration

* Code review remarks introduced

* Addtinal asserts and unit-test for Pad:v1 introduced

* Handled optinal arg_pad_value input

* Fixed unit tests messages and clang styles applied

* Styles applied, checking rank improved

* Updated changes.md

* Revert "Updated changes.md"

This reverts commit 8ee16e580705275ee0719648d5251021354e4d84.

* Clang warning fixed

* Changed name of concat axis

* Clang styles applied

* Revert "Clang styles applied"

This reverts commit 4c1d3f4436765ce9eafa00140365d5d3e358eab1.

* Revert "Changed name of concat axis"

This reverts commit cdfe6638777509f21b199ce78fc2fe28cec15d45.

* Introduced alias methods

* Updated changes.md

* Do not throw for unknown domains in ONNX models

* UT that makes sure onnx_importer does not throw for unknown domains

* Check if nGraph throws for unknown ONNX domain and op

* Enable Padding

* Small fix to match MLIR API change

* WIP

* Subtract pad below from virtual img index

* Fixed integer set inequalities

* style-apply

* remove unneeded padAbove values

* Remove dump call

* PR feedback

* style apply

* Re-use memref

* add mem opt file

* Add missing files

* Add flag

* Fix style

* Small fix

* PR fixes. WIP

* PR fixes

* Fixed conv validation logic. Invoked after ng mem opt pass. Style-apply

* style-apply

* Remove some dynamic_ptr_casts

* More removals

* Review comments

* Update src/ngraph/node.hpp
Co-Authored-By: Adam Procter <adam.m.procter@intel.com>

Replace set with vector container in MLIR sub-graphs for
nodes, inputs and outputs. Using a set caused different order of
operations in MLIR code across different executions and this led to
differences in optimizations.

* Fix style in compiler and lowerer files

* Fix comment in headers

* Revert "Fix comment in headers"

This reverts commit d52eed4c1bdf371f3cc7d3f601d9d2b1b0c233e8.

* Fix compiler.* header. Fix code style in other files

[MLIR] Bump LLVM repo

* Enable unuser parameter warnings

* Unused params

* resolve -wall warnings with clang-8

* remove -Wno-extra-semi-stmt

There are some fixes for AVX-512 vectorization.

* Unnused parameter cleanup

* style

* Fix CPU unused parameter warnings

* md used in mkldnn1.0

* latest PlaidML-GPU updates for 0.26

* Update Release Notes page for 0.26