* WIP

* Fixes

* Increase bitwidth for arg idx attrib

* Minor fixes

* style-apply

* nGraph-ONNX CI improvement

- Added parallel CI on many SKUs,
- Jenkinsfile written in Declarative Pipeline which allows displaying sequential stages for parallel branches in Blue Ocean
- Moved proper CI code to ngraph-onnx repository
- Moved base_image_builder to ngraph-onnx repository

* Fix license header

* try catch for git info retrieval

* Add unsupported ops to iGPU backend

* Revert previous change

* [MLIR] Enable LIT testing in CMAKE

This PR enables LIT testing in nGraph for MLIR Compiler, introduced in
PR3523. We can now do `make check-mlir-lit` to run LIT tests.

* Address feedback

* Revisit PR after cmake clean-up

* [MLIR] Introduce ngraph-opt tool

To be used, among other things, for LIT testing.
`elementwise_binary_ops.mlir` shows a simple LIT test
using ngraph-opt.

Dummy affine_lowering/lit_test.mlir test that served as initial testing
of LIT tool configuration is now removed.

* Address feedback

* Bump MLIR version and minor fixes in nGraph

* advance commit ids

* fix commit id

Fix reshape error for onnx (on master)

Fixed NormalizeL2 decomposition for input shape length != 4

Initial support for float16 was done before the ngraph::float16 data
type was introduced in nGraph. This PR aligns ONNX frontend with the
latest float16 implementation.

* cleanup op includes in headers

* fix missing include

* [MLIR] Enable LIT testing in CMAKE

This PR enables LIT testing in nGraph for MLIR Compiler, introduced in
PR3523. We can now do `make check-mlir-lit` to run LIT tests.

* Address feedback

* Revisit PR after cmake clean-up

* Use mkl-dnn v1.0 or v0.x depending on compilation flag.

* Change cpu builder files.

* Modify cmake files.

Use mkldnn-v1.0 for DEX if NGRAPH_USE_MKLDNN_V1 is set to true, otherwise use mkldnn-v0.x.

CODEGEN only builds with mkldnn-v1.0.

* Implement mkldnn utility functions for mkldnn-v1.0.

User mode scratchpad management for mkldnn-v1.0.

* Query scratchpad size and allocate a buffer of max scratchpad size.

* Do not create mkldnn::memory when query scratchpad size of Reorder.

Modify mkldnn utility functions.

Fix convolution_forward_init and inner_product_forward_init.

Modify CPURuntimeContextCG.

* Add user mode scratchpad to CODEGEN.

* mkldnn-v1.0 splits LSTM states. Update Rnn/Lstm Op accordingly.

* Address PR feedback: use MKLDNN_MAJOR_VERSION.

* Modify cpu rnn fusion pass and related unit tests.

* Change Rnn/Lstm arg types to Output.

* Fix Lstm for CODEGEN.

* Set native layout for Slice when input format is blocked.

* Do not print scratchpad size.

* Change external_mkldnn_v1.cmake.

Fix a typo.

* Add mkldnn_v1.patch for mkldnn-v1.0.

* Address PR feedback.

* Define MKLDNN_ERROR_MESSAGE.

* Address PR feedback: change to NGRAPH_USE_LEGACY_MKLDNN.

* Fix a bug.

* Remove unused variable.

* Fix compiler warnings.

* Fix a bug for CODEGEN.

* Move variable only needed for mkldnn-v0.20 inside #if.

* Remove unused variables.

* No in place Reshape rotation for blocked data layout with mkldnn-v1.0.

* Modify mkldnn_v1.patch to force mkldnn to link to libiomp.

* Fix style.

* Change path for find_library and find_file.

* Do not insert ConvertLayout before/after Quantize/DeQuantize for blocked data layout.

* Write strides information to visualized graph.

* Move variables only needed for mkldnn-v0 under #if.

* Move more variables in rnn fusion.

* Fix ConvertLayout constant folding for mkldnn-v1.0.

* Add missing includes

* style

* Don't hold to shared pointers after sub-graph extraction pass is done

* style

* Add replace_by_friendly_name function

* Add replace_nodes function

* Nuke replace_by_friendly_name

* Modify replace_nodes to handle parameter replacement

* Move required reshape helpers to builders

* Remove warning from matmul_factory

* Rid off onnx dependency from matmul factory

* Move malmul_factory into builders

* Add implementation of fused MatMul

* Add MatMul to serializer

* Add type_prop tests

* Remove reference.

* Make more metods private

* Use protected instead of private

* Fix compilation issues

* Change construction of matmul_factory in matmul op

* Add MatMul operator into switch of is_supported_impl function

* Change transpose flags from int to bool

* Review Fix I

* Update MatMul op

* Use OutputVector instead of NodeVector in MatmulFactories

* Fix usage of OutputVector

* Convert more shared_ptrs to Outputs

* Fix comments after merge

* Fix comments after merge II

* Fix comments after merge III

* wip

* r50 test

* update test

* R50 topk calls

* Faster topk

* Finish topk implementation

* cleanup

* checkpoint

* new test working

* more unit test

* style

* wip

* fix tests

* add needed header

* Add new TopK test to plaid manifest

* Fix windows build error:

* Fold Constant + ConvertLayout.

* Address PR Feedback.

* No folding if data layout is padded.

* Add unit test.

* Fix style error.

* Add opset_version field to Node

* Add opset version aliases to Softmax

* Add op::set1::Softmax operator

* Disable opset 1 ops in INTERPRETER

* Add serializer support for Softmax opset 1

* Opset1Transformation pass

* Added unit tests to softmax pass

* Code refactoring

* Added missing virtual to set_opset_version

* Clang styles applied

* Update src/ngraph/pass/opset1_transform.cpp
Co-Authored-By: Adam Procter <adam.m.procter@intel.com>

* Part.1 Code review remarks introduced

* Part.2 Code review remarks introduced

* Changed opset_version to op_version

* Code review remarks introduced

* Code review remarks introduced

* Set Op as base class for Softmax instead of UnaryElementwiseArithmetic

* Fixed unit tests

* v1::Softmax::generate_adjoints mark temporarily as not supported

* Fix CI. Part.2

* Fix CI. Part.3

* Code review remarks introduced

* Rename Opset1Transformation to Opset1Upgrade

* Fixed clag style problem with enum switch

* Fixes clang compilator error

* Removed unused foward declaration

* Code review remarks introduced

* Added checking if input rank is static

* [Py] Added Dequantize, Quantize, Quantized Convolution, Quantized Dot operators to Python API.

* [Py] Removed unnecess import.

* [Py] Changed docstring.
Co-Authored-By: Tomasz Socha <tomasz.socha@intel.com>

* [Py] Changed docstring.

* [Py] Changed docstring.

* [Py] Added missed imports.

* clean up and triage unit tests

* add back in onnx and closeness fails

* Update unit_test.manifest

* [MLIR] Move MLIR compiler files to contrib/mlir/compiler

We'll add contrib/mlir/tools directory in subsequent PRs for ngrpah-opt
and other tools.

* [MLIR] Clean up MLIR related CMake files

This PR prepares the introduction of src/contrib/mlir/tools and LIT testing by
refactoring and cleaning up the common part with src/contrib/mlir/compiler:

- Common code for src/contrib/mlir/tools and src/contrib/mlir/compiler is
moved to src/contrib/mlir/CMakeList.txt.
- More generic code, common for src/contrib/mlir/* and LIT configuration
files, is moved to cmake/external_mlir.cmake with pre-existing similar code.
- Redundant environment var LLVM_DIR is removed in favor of LLVM_CMAKE_PATH.
- Redundant cmake messages are removed.

* Replacing LLVM_CMAKE_PATH with LLVM_DIR

* Op decl. No verification

* WIP

* WIP: Add lowerer support

* Code-gen works.

* Added padding support. Needs MLIR fix to work

* Remove Padding support for now

* Fix arrayref init. Disable tests where reshape optimization don't apply

* clean up and style apply

* Address PR feedback