Initial support for float16 was done before the ngraph::float16 data
type was introduced in nGraph. This PR aligns ONNX frontend with the
latest float16 implementation.

* cleanup op includes in headers

* fix missing include

* [MLIR] Enable LIT testing in CMAKE

This PR enables LIT testing in nGraph for MLIR Compiler, introduced in
PR3523. We can now do `make check-mlir-lit` to run LIT tests.

* Address feedback

* Revisit PR after cmake clean-up

* Use mkl-dnn v1.0 or v0.x depending on compilation flag.

* Change cpu builder files.

* Modify cmake files.

Use mkldnn-v1.0 for DEX if NGRAPH_USE_MKLDNN_V1 is set to true, otherwise use mkldnn-v0.x.

CODEGEN only builds with mkldnn-v1.0.

* Implement mkldnn utility functions for mkldnn-v1.0.

User mode scratchpad management for mkldnn-v1.0.

* Query scratchpad size and allocate a buffer of max scratchpad size.

* Do not create mkldnn::memory when query scratchpad size of Reorder.

Modify mkldnn utility functions.

Fix convolution_forward_init and inner_product_forward_init.

Modify CPURuntimeContextCG.

* Add user mode scratchpad to CODEGEN.

* mkldnn-v1.0 splits LSTM states. Update Rnn/Lstm Op accordingly.

* Address PR feedback: use MKLDNN_MAJOR_VERSION.

* Modify cpu rnn fusion pass and related unit tests.

* Change Rnn/Lstm arg types to Output.

* Fix Lstm for CODEGEN.

* Set native layout for Slice when input format is blocked.

* Do not print scratchpad size.

* Change external_mkldnn_v1.cmake.

Fix a typo.

* Add mkldnn_v1.patch for mkldnn-v1.0.

* Address PR feedback.

* Define MKLDNN_ERROR_MESSAGE.

* Address PR feedback: change to NGRAPH_USE_LEGACY_MKLDNN.

* Fix a bug.

* Remove unused variable.

* Fix compiler warnings.

* Fix a bug for CODEGEN.

* Move variable only needed for mkldnn-v0.20 inside #if.

* Remove unused variables.

* No in place Reshape rotation for blocked data layout with mkldnn-v1.0.

* Modify mkldnn_v1.patch to force mkldnn to link to libiomp.

* Fix style.

* Change path for find_library and find_file.

* Do not insert ConvertLayout before/after Quantize/DeQuantize for blocked data layout.

* Write strides information to visualized graph.

* Move variables only needed for mkldnn-v0 under #if.

* Move more variables in rnn fusion.

* Fix ConvertLayout constant folding for mkldnn-v1.0.

* Add missing includes

* style

* Don't hold to shared pointers after sub-graph extraction pass is done

* style

* Add replace_by_friendly_name function

* Add replace_nodes function

* Nuke replace_by_friendly_name

* Modify replace_nodes to handle parameter replacement

* Move required reshape helpers to builders

* Remove warning from matmul_factory

* Rid off onnx dependency from matmul factory

* Move malmul_factory into builders

* Add implementation of fused MatMul

* Add MatMul to serializer

* Add type_prop tests

* Remove reference.

* Make more metods private

* Use protected instead of private

* Fix compilation issues

* Change construction of matmul_factory in matmul op

* Add MatMul operator into switch of is_supported_impl function

* Change transpose flags from int to bool

* Review Fix I

* Update MatMul op

* Use OutputVector instead of NodeVector in MatmulFactories

* Fix usage of OutputVector

* Convert more shared_ptrs to Outputs

* Fix comments after merge

* Fix comments after merge II

* Fix comments after merge III

* wip

* r50 test

* update test

* R50 topk calls

* Faster topk

* Finish topk implementation

* cleanup

* checkpoint

* new test working

* more unit test

* style

* wip

* fix tests

* add needed header

* Add new TopK test to plaid manifest

* Fix windows build error:

* Fold Constant + ConvertLayout.

* Address PR Feedback.

* No folding if data layout is padded.

* Add unit test.

* Fix style error.

* Add opset_version field to Node

* Add opset version aliases to Softmax

* Add op::set1::Softmax operator

* Disable opset 1 ops in INTERPRETER

* Add serializer support for Softmax opset 1

* Opset1Transformation pass

* Added unit tests to softmax pass

* Code refactoring

* Added missing virtual to set_opset_version

* Clang styles applied

* Update src/ngraph/pass/opset1_transform.cpp
Co-Authored-By: Adam Procter <adam.m.procter@intel.com>

* Part.1 Code review remarks introduced

* Part.2 Code review remarks introduced

* Changed opset_version to op_version

* Code review remarks introduced

* Code review remarks introduced

* Set Op as base class for Softmax instead of UnaryElementwiseArithmetic

* Fixed unit tests

* v1::Softmax::generate_adjoints mark temporarily as not supported

* Fix CI. Part.2

* Fix CI. Part.3

* Code review remarks introduced

* Rename Opset1Transformation to Opset1Upgrade

* Fixed clag style problem with enum switch

* Fixes clang compilator error

* Removed unused foward declaration

* Code review remarks introduced

* Added checking if input rank is static

* [Py] Added Dequantize, Quantize, Quantized Convolution, Quantized Dot operators to Python API.

* [Py] Removed unnecess import.

* [Py] Changed docstring.
Co-Authored-By: Tomasz Socha <tomasz.socha@intel.com>

* [Py] Changed docstring.

* [Py] Changed docstring.

* [Py] Added missed imports.

* clean up and triage unit tests

* add back in onnx and closeness fails

* Update unit_test.manifest

* [MLIR] Move MLIR compiler files to contrib/mlir/compiler

We'll add contrib/mlir/tools directory in subsequent PRs for ngrpah-opt
and other tools.

* [MLIR] Clean up MLIR related CMake files

This PR prepares the introduction of src/contrib/mlir/tools and LIT testing by
refactoring and cleaning up the common part with src/contrib/mlir/compiler:

- Common code for src/contrib/mlir/tools and src/contrib/mlir/compiler is
moved to src/contrib/mlir/CMakeList.txt.
- More generic code, common for src/contrib/mlir/* and LIT configuration
files, is moved to cmake/external_mlir.cmake with pre-existing similar code.
- Redundant environment var LLVM_DIR is removed in favor of LLVM_CMAKE_PATH.
- Redundant cmake messages are removed.

* Replacing LLVM_CMAKE_PATH with LLVM_DIR

* Op decl. No verification

* WIP

* WIP: Add lowerer support

* Code-gen works.

* Added padding support. Needs MLIR fix to work

* Remove Padding support for now

* Fix arrayref init. Disable tests where reshape optimization don't apply

* clean up and style apply

* Address PR feedback

* Axes input was added to LRN

* Unit tests for axes shape check were added

* LRN node deserialization was updated

* Fixed EOF and clang style applied

* Changed Constant to Parameter type in unit tests

* Expanded LRN reference ingterface

* Fixed LRN assert description

* Fixed passing arguments

* Reference implementation for one axis

* Implementation for channel

* Implementation for hw

* working on recurence version

* Implemented recurence version for hw

* Reference implementation code refactor

* Fixed ref LRN implementation and added tests

* Added 6D unit test

* Clang styles applied

* Code review remarks introduced

* Support for dynamic shape of axes input

* Clang styles applied

* Code review remarks introduced

* Added checking if axes values are in correct range

* Clang styles applied

* Removed redundant include

* Code review remarks introduced

* Renamed auto broadcast name in constructors

* Fixed argument doc for Or op

* Changed names of fields to serialization

* Changed name of auto_broadcast in XOR op

* Clang styles applied

We'll add contrib/mlir/tools directory in subsequent PRs for ngrpah-opt
and other tools.

* Fix crash when NGRAPH_ENABLE_{VISUALIZE,SERIALIZE}_TRACING=1

* Initialization for kw (#3413)

* Fix sum reference to handle corner cases with +-inf (#3412)

* Fix sum reference to handle corner cases with +-inf

* Review comments, and try to make Windows happy

* Update GPU unit_test.manifest

* More template grindery, to make macOS happy

* Update jenkins-trigger.groovy (#3428)

* Cyphers/exec can create tensors (#3445)

* Add method to check if an Executable can create tensors

* Add a Backend check to see if Executable can create tensors

* Update per review comment

* style

* Possible fix so that backend does not keep holding on to the dummy ng_exec

* Separate dynamic loading from static linking (#3456)

* Separate dynamic loading from static linking

* Missed find_my_pathname

* Update jenkins-trigger.groovy (#3518)

* add rank id to trace file name (#3525)

* no_fork : Remove allication for empty vector

* style

* no_fork: Performance issue vector of string to T

* style

* WIP

* Fix incorrect CK output adjustment

* Bug fix and enroce sanity check

* Change cycle search depth, and fix sanity check

* cpu_fusion.validate_fuse_gru_inputs passes.

* Fix as_single_output to be able to always create a GOE

* minor fix. style-apply

* Clean up debug msgs

* Switch to backward cycle check

* Enable failing test

* PR fixes

* Address feedback: Add fwd cycle checks. Make cycle checking depth configurable

* [MLIR] Add config files for LIT

LIT is the LLVM testing tool that is used in LLVM and MLIR. It's
necessary to enable all the MLIR testing in nGraph. This will provide
a complementary finer grain level of testing than the one currently done
with gtest. LIT will allow testing each MLIR-based nGraph transformation
without having to run the whole nGraph pipeline. For example, we will be
able to write an nGraph dialect input, invoke an single MLIR transformation
on it and check that the output is the expected.

This PR adds the basic configuration files to enable LIT tool
in nGraph for MLIR Compiler. `affine_lowering/lit_test.mlir` is a
dummy test to exercise the new testing feature. Lit testing will be
enabled in CMAKE in a subsequent PR.

* Address feedback

* [Py] Added operators Shuffle Channels, Squared Difference and Squeeze to Python API.

* [Py] Changed docstring.

* [Py] Changed docstring.

* [Py] Changed docstring.

* Initialize CPU transformer the same way for static and non-static linking.

* Initialize earlier

* Update https links

* Update https links to new ngraph.ai site

* Fix links

* Fix links

* Fix more HTML links

* Reverting CODEOWNER change while we brainstorm on other solutions. As requested by adstraw

Set up visibility support for all the library backends.