* LogSoftmax introduced

* Added LogSoftmax to serializer

* Fixed style

* Fixed CmakeLists style

* code review remarks introduced

* Code review remarks introduced

* Sketch of attribute walker

* Review comments

* merge error?

* Remove unused method

* simplify, make some ser tests work

* Don't look for keys that aren't there

* Factory registry, more ops visited, generic ser/dser start

* More merge

* cleanup

* Adapter for enums

* Compiler error

* Test of user-defined op

* Simplify enum name pairing

* Update distributed.hpp

* Review comments

* compiler error

* Direct access to non-primitive types from adapters

* Define and export type info

* attr enums, AvgPool*, vectors

* Cleanup

* some comments

* Allow type info to be used as a key.

* Don't leave output serialization shapes set.

* Auto adapter

* More ops, adapters

* Missing symbol

* Remove PartialShape and element::Type methods from visitor

* Fix type info

* Remove unused variable

* Simplify

* namespace error

* exports

* Uniform names

* Some better names

* More name cleanup, simplify visitor implementation

* Fix template, add test

* Revert serializer

* Add instantiations

* Work-around gcc issue

* VS exports

* VS exports

* windows export

* vs

* vs

* vs

* vs

* Simplify

* vs

* vs

* Add some missing attributes

* Missing factories

* Merge error

* Fix Add factories

* Missed type

* Atan2 op

* Fix for openvino ci

* Fix

* Resolve comments

* Revert_changes

* Add upgrade/downgrade pass for Add op.

* Add upgrade/downgrade pass for Divide op.

- Change default value of autobradcasting in v1 into NUMPY.

* Add v1 version for Equal operator.

* Rename helper functions to fix compiler errros.

Fix Divide op version.

* Add downgrade and upgrade passes for Equal op.

* Reformat test cases. Add helper functions.

Add UT for Equal op.

* Add upgrade/downgrade pass and UT for Greater op.

* Add upgrade/downgrade pass and UT for GreaterEq op.

* Add upgrade/downgrade pass and UT for Less op.

* Add upgrade/downgrade pass and UT for LessEq op.

* Add upgrade/downgrade pass and UT for Maximum op.

* Add upgrade/downgrade pass and UT for Minimum op.

* Add upgrade/downgrade pass and UT for Multiply op.

* Add upgrade/downgrade pass and UT for NotEqual op.

* Add upgrade/downgrade pass and UT for Power op.

* Force ops version 1.

* Don't inline templates.

* Fix namespaces and some formatting.

* Update ONNX Importer to produce v1 nGraph nodes.

* Fix function return type.

* Fix uninitialized local variable warning.

* Fix confilicting declarations.

* Apply clang-format.

* Fix errors for distributed nGraph with unavailable classes.

* Fix downgrade pass for LessEqual op.

* Init commit to implement interface

*  Add two op interfaces for v0 and v1. Add a unit-test

* Add missing files

* Move test to separate file

* Add Fused Op interface

* Missing files

* style

* fused ops

* Remove V1 ops for now

* Added enum attributes. WIP

* Completed non-experiemntal non-fused-ops

* Add ops_attributes

* Minor fixes

* Minor fixes

* Added enum setting/reading test

* style-apply

* Added attributes tests

* Fix dialect init

* style

* fix typo

* Fix merge errors

* Include file with MLIR on

* [SPEC] Rename operator Xor->LogicalXor

* Fix clang issue

* Fix bug in opset transformations. Add support for LogicalXor in backends

* Style fix

* Fix a bug in CPU emmiter

* [SPEC] Rename operator Or->LogicalOr

* [SPEC] Rename operator And->LogicalAnd

* [SPEC] Rename operator Not->LogicalNot

* [SPEC] Rename operator LessEq->LessEqual

* Introduced reshape:v1 downgrade

* Enable downgrade pass in dynamic backend

* Add unit test for dynamic backend downgrade pass

* Clang styles applied

* Apply unit tests name refactor based on code review
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Removed redundant pass

* Changed order of downgrade pass

* Changed order of passes in dynamic backend

* Rename input arg -> data

* Update node validation and shape propagation to support data rank and number of repeats to be different.

* Add type_prop tests

* Add UT for new tile cases

* style

* Modify CPU backend to support the new case.

* Fix backend selection in test

* Add new line back.

* DynSlice was adjusted to specyfication

* Fixed documentation

* Fixed styles

* Fixed clang warning

* Introduced StridedSlice as separate op

* revert dyn_slice

* Fixed StrideSlice implementation

* Enable downgrade pass in dynamic backend

* Implemented upgrade/downgrade pass

* Added serialization

* Styles applied

* Styles applied. Part.2

* Updated dynamic backends list

* Move StridedSlice outside experimental

* Make Slice as v0 of StridedSlice

* Styles applied

* Styles applied

* Fixed clang error

* Code review remarks introduced

* Move GenerateMask up in Opset0Downgrade to keep alphabetical sort

* Style apply

* add partial slice op placeholder

* fprop implemented

* add a dynamic ut

* implement bprop

* support decrease axis

* add bprop ut

* address comment

* use descriptive var name

* Updated nGraph backend to be compatible with OpenVINO plugins

* Resolve issue with gtest

* Resolve comments in PR

* Resolve comments in PR

* Code style fix

* Rename runtime2 to ov_runtime

* Style check fix

* Dynshape support for GenerateMask

* fix clang error

* Remove comments

* Test case correction

* Disable plaidml

* Merge

* Implemented downgrade pass

* Added v1 support in onnx importer

* Clang style applied

* Pooling factory refactor

* Removed unused variables

* clang styles apllied

* Fixed avg pool bprop UT

* unfold attributes

* Remove unnecesary if

* Rename run() -> lstm_pass()

* Unify usage of LSTMForward for one and bi directional LSTM

* Unify LSTMForward return values for one and bi directional LSTM

* Dirty moving LSTMForward into fused directory

* Accept lstm direction as string instead of enum

* Fused op which uses decompose_op in onnx_importer

* Rename LSTMForward -> LSTMSequence

* Split LSTMSequence to cpp and hpp

* Remove LSTMDirection enum

* Add getters for class fields

* Adjust constructors

* Add direction validation.

* Add support of LSTMSequence op in serializer

* Reorder fused op input order

* Style fix

* Fix for reorder of inputs

* Use NodeTypeInfo instead of static string

* Node -> value in doc

* Add doc for prepare_input method

* Fix shape inference

* Use enum instead of string for direction

* Add Type prop unit test

* Fix style

* AvgPoolBprop dynamic shape support

* Add opset_transform test

* Call the correct shape relevance function

* Unused variable

* - Added support for v1 Broadcast op specification
- Added upgrade/downgrade conversions between v0 and v1

* Added unit test for pdpd broadcast

* Make numpy default autobroadcast type and some style fixes

* Added support in Dynamic wrapper for dyn elimination and copied over unit tests from DynBroadcast

* Addressed PR feedback

* Addressed PR feedback on documentation

* LayerNorm (#3630)

* Constructors.

Type prop.

Decompose LayerNorm.

Add serialize.

* Add dummy test case.

* Add dummy type prop test.

* Fix some build errors.

* Remove build errors.

* Update decompose for bprop.

* Change begin_norm_axis default value to 1.

* Style.

* Reorder class members.

* Add actual type prop tests.

* Add fprop test.

* Working on bprop test.

* Bprop tests.

* Allow flattened scale and bias.

* Add support for flattened scale and bias.

* Fix incorrect type_name.

* PlaidML: Decompose fused_op LayerNorm

* Update Backprop constructors.

* PlaidML: Add missing header file.

* Remove doc about removed param.

* Fix type prop tests.

* PlaidML: Disable unit test.

* Fix stats flattening axes bug.

* Upgrade description to type_info.

* Add new enum: RoundingType for pooling operations

* Add v1::AvgPool op

* Add v1::MaxPool op

* Fix comments format

* Fix problem with forward declaration

* new UT & fix some bugs

* Allow TBB to be excluded from CPU build.

* Change some CMake scope.

* m_use_tbb can be removed if TBB is not enabled.

* Revert some CMake linkage scope as it breaks unit test.

* Migrate changes from #3652.

* Gather:v1 was introduced

* Added support for negative axis

* Removed unsused serialization

* Code review remarks introduced

* Change returned type of get_axis method

* Code review remarks introduced

* Chnaged axis_node to scalar during transformation

* Clang style applied

* Fixed clang errors

* style

* Add RandomUniform op

* Missing files

* Make CPU compile again (RandomUniform tests still don't pass)

* Bop users of existing RNGState class and reorder some comment junk

* Try to bop RNGState in gcpu

* Add RandomUniform to CPU manifest

* Add RandomUniform to PlaidML manifest

* Add .rst for random_uniform

* Clean up junk in the .rst

* Change UniformRNGState to always use double internally

* Change weird test failure message

* Compilation issues

* Pad:v1 was introduced

* Fixed problem with foward declaration

* Code review remarks introduced

* Addtinal asserts and unit-test for Pad:v1 introduced

* Handled optinal arg_pad_value input

* Fixed unit tests messages and clang styles applied

* Styles applied, checking rank improved

* Updated changes.md

* Revert "Updated changes.md"

This reverts commit 8ee16e580705275ee0719648d5251021354e4d84.

* Clang warning fixed

* Static linking refactorization

* File name changed

* Update changes.md

* Merge error

* revert

* Review comments

* [MLIR] Enable LIT testing in CMAKE

This PR enables LIT testing in nGraph for MLIR Compiler, introduced in
PR3523. We can now do `make check-mlir-lit` to run LIT tests.

* Address feedback

* Revisit PR after cmake clean-up

* Add replace_by_friendly_name function

* Add replace_nodes function

* Nuke replace_by_friendly_name

* Modify replace_nodes to handle parameter replacement

* Move required reshape helpers to builders

* Remove warning from matmul_factory

* Rid off onnx dependency from matmul factory

* Move malmul_factory into builders

* Add implementation of fused MatMul

* Add MatMul to serializer

* Add type_prop tests

* Remove reference.

* Make more metods private

* Use protected instead of private

* Fix compilation issues

* Change construction of matmul_factory in matmul op

* Add MatMul operator into switch of is_supported_impl function

* Change transpose flags from int to bool

* Review Fix I

* Update MatMul op

* Use OutputVector instead of NodeVector in MatmulFactories

* Fix usage of OutputVector

* Convert more shared_ptrs to Outputs

* Fix comments after merge

* Fix comments after merge II

* Fix comments after merge III

* Add opset_version field to Node

* Add opset version aliases to Softmax

* Add op::set1::Softmax operator

* Disable opset 1 ops in INTERPRETER

* Add serializer support for Softmax opset 1

* Opset1Transformation pass

* Added unit tests to softmax pass

* Code refactoring

* Added missing virtual to set_opset_version

* Clang styles applied

* Update src/ngraph/pass/opset1_transform.cpp
Co-Authored-By: Adam Procter <adam.m.procter@intel.com>

* Part.1 Code review remarks introduced

* Part.2 Code review remarks introduced

* Changed opset_version to op_version

* Code review remarks introduced

* Code review remarks introduced

* Set Op as base class for Softmax instead of UnaryElementwiseArithmetic

* Fixed unit tests

* v1::Softmax::generate_adjoints mark temporarily as not supported

* Fix CI. Part.2

* Fix CI. Part.3

* Code review remarks introduced

* Rename Opset1Transformation to Opset1Upgrade

* Fixed clag style problem with enum switch

* Fixes clang compilator error

* Removed unused foward declaration

* Code review remarks introduced

* Added checking if input rank is static

* First pass, remove QDot as experimental op, add it as core op, test case failing

* Change QuantizedMatmul API

* Tests for QuantizedDot passing, cleanup required

* Move test cases to backend_test.in.cpp

* Change reference dot API to take scale and zero point

* Onnx matmul integer tests passing

* Add validate_and_infer_types()

* Add more checks for QDot

* Add type prop tests

* Add interpreter support

* Add serializer support

* Disable tests in other backends

* Fix test and add codegen support

* Make axes optional argument

* Change fusion pattern

* Copyright

* merge changes

* more merge changes

* Fix more merge conflicts

* change builders to reflect new changes

* cleanup

* Add reduction_axes to the API

* Fix onnx test cases

* Remove debug comments

* Fix CI

* disable plaidml tests

* Remove comment

* Dynamic version of builder::flatten

* Remove as_single_output_node (no longer needed)

* Temp fix for dyn elimination

* Changed required image_shape type from u64 to float

* Proposal op was adjusted

* Clang styles applied

* Added missing new line

* Fixed problem with narrowing conversion

* Code review remarks

* Removed checking types of Proposal input params

* Removed unused input element type variables

* Add method to check if an Executable can create tensors

* Add a Backend check to see if Executable can create tensors

* Update per review comment

* style

* Axes input was added to LRN

* Unit tests for axes shape check were added

* LRN node deserialization was updated

* Fixed EOF and clang style applied

* Changed Constant to Parameter type in unit tests

* Fixed LRN assert description

* Fixed copy_with_new_args

* Clang style applied

* wip

* parse working with one test

* Add version information query and unit tests for parsing version strings

* add more comments

* doc strings

* style