* Fix broadcast v1 reference (#3880)

* Added reproducer for issue with broadcast v1

* Make reference broadcast work with V1 broadcast

* Deprecate runtime::Tensor::copy_from

* Force Gelu decompose on CPU (#3887)

* Round the right bit with denorms (#3885)

* Round the right bit with denorms

* Rounding to inf

* Attribute visitor (#3579)

* Sketch of attribute walker

* Review comments

* merge error?

* Remove unused method

* simplify, make some ser tests work

* Don't look for keys that aren't there

* Factory registry, more ops visited, generic ser/dser start

* More merge

* cleanup

* Adapter for enums

* Compiler error

* Test of user-defined op

* Simplify enum name pairing

* Update distributed.hpp

* Review comments

* compiler error

* Direct access to non-primitive types from adapters

* Define and export type info

* attr enums, AvgPool*, vectors

* Cleanup

* some comments

* Allow type info to be used as a key.

* Don't leave output serialization shapes set.

* Auto adapter

* More ops, adapters

* Missing symbol

* Remove PartialShape and element::Type methods from visitor

* Fix type info

* Remove unused variable

* Simplify

* namespace error

* exports

* Uniform names

* Some better names

* More name cleanup, simplify visitor implementation

* Fix template, add test

* Revert serializer

* Add instantiations

* Work-around gcc issue

* VS exports

* VS exports

* windows export

* vs

* vs

* vs

* vs

* Simplify

* vs

* vs

* Add some missing attributes

* Missing factories

* Merge error

* Fix Add factories

* Missed type

* [FUSED] Add new LogSoftmax fused op (#3867)

* LogSoftmax introduced

* Added LogSoftmax to serializer

* Fixed style

* Fixed CmakeLists style

* code review remarks introduced

* Code review remarks introduced

* [ONNX] Importer should use fused op for MatMul (#3842)

* [ONNX] Importer should use fused op for MatMul

* Fix a bug in fused matmul op

* Dont reshape matmul inputs to at least 2D any more

* [SPEC] Add auto_broadcast parameter to SquaredDifference (#3856)

* [SPEC] Add auto_broadcast parameter to SquaredDifference

* Rename set_autobroadcast->set_autob

* [Spec][FusedOp]Adjust SpaceToDepth fused op to specification (#3862)

* Added support mode for SpaceToDepth

* Added unit tests

* Fixed styles

* Revert changes in prototxt files

* Force AutoBroadcast defaults (#3878)

* Force AutoBroadcast to be specified at the op level since no default is correct for all ops.

* exports

* Added constant folding for binary ops (#3895)

* Modify Gather constant folding to support v1 op.

* Address PR feedback.

* Update fused ops groupconvolution, gelu and layernorm to be dynamic friendly (#3876)

* set output et

* set output et

* overwrote validate and infer

* Add full path to gtest for build via ninja (#3882)

* [FUSED] Add reciprocal op (#3851)

* [FUSED] Add reciprocal op

* Review Fix #1

* Move operator op::v1 -> op

* Fix serializer

* Review Fix I

* [SPEC] Add new v1::FloorMod operator (#3852)

* [SPEC] Add new v1::FloorMod operator

* Review Fix I

* [MLIR] Fix MLIR build on mac OS (#3896)

* Fix MLIR build on mac OS

* Style

* Style

* [MLIR] Bump MLIR commit to c61db4bb (#3879)

* WIP

* WIP

* WIP

* WIP

* style

* WIP

* WIP

* Add err msg

* Fix headers and cleanup

* Bug Fix: incorrect shape validation logic. (#3897)

* Allow for overriding functions in visualization (#3900)

* Add ReplaceSlice to ZeroDimTensorEliminiation pass (#3899) (#3910)

* Add ReplaceSlice to ZeroDimTensorEliminiation pass

* style

* Default constructor needs to init autob (#3913)

* Implementation of CrossEntropy and CrossEntropyBackprop as fused Op's (#3818)

* - Implementaion of CrossEntropy and CrossEntropyBackprop as fused Op's

* - unit test case for CE fprop
- fix bug in decompose_op

* WIP debug PDPD unit test failure

* fixed broadcasting issue

* -fix bdcast issue for multi dim tensor

* utilities to restore the original tensor shape

* i) style-fix ii) rename variables

* - unit test for multiple dimensions ii) refactor create_mask to seperate function

* - fixed unit tests

* fix style

* set output element type to dynamic in pre_validate and infer shape

* disable ce with one hot unit test on PlaidML

* add CE op to fused_op_tbl

* - add serialzier support for CE and CE Backprop

* Update ToC to better match docplan spreadsheet (#3846)

* New ToC

* Working on docplan

* Clean up for toc

* Link to existing APIs on quantization doc

* Better align topics with docplan ToC; add section for dyn shapes

* Title casing to be consistent

* PR reviews

* New build preview

* Add default opset version, new versioning schema

* Remove duplicate file causing doc build warning

* Fix CSS rendering issues (#3921)

* Fix for the bug with as_type_ptr for TensorIterator::Input/Ouput desc (#3906)

* Updated unit test to reproduce a bug

* Code style

* Add exports

* Added missed export

* Bug fix in conv v1 shape inference (#3912)

* [SPEC] Add new v1::VariadicSplit operator (#3868)

* [SPEC] Add new v1::VariadicSplit operator

* Add missing namespace, fix a typo in doc

* Apply suggestions from code review
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Style fix

* Set all of the inputs to be relevant to output shape

* Set output type if numer of outputs is known

* Add node validation for known input

* Fix for windows ninja (#3917)

* Fix for windows ninja

* Fix for centos build

* Remove fix for centosa

* Update ONNX importer to use v1 version of Softmax (#3894)

* Added downgrade pass for Softmax.

* Updated Softmax op to v1.

* Created vector with a right capacity.

* Include numeric header to enable std::iota function

* Removed unused numeric header from the old file

* Fix includes style

* Fix shape inference of TensorIterator body (#3922)

* fix for shape inference of tensor iterator body

* updated unit test for case end = -2

* indexes in unit tests

* Updated formula for num_iterations

* resolve compiler warning (#3923)

* Added u1 precision for binary weights (#3914)

* Added U1 precision for binary weights

* Handle switch cases with u1 type

* Fixed code style

* Added convert_to_string support for u1 type

* Use real C type  for u1 type.
Co-Authored-By: Robert Kimball <robert.kimball@intel.com>

* Fused_op: BatchMatMulTranspose (#3871)

* Initial commit

* Add decompose_op and unit-test

* Style fix

* Fix CI error

* Address review comments

* Remove CPUBatchFusion

* Address review feedback

* Address review feedback

* Added type_prop tests

* Moved 1 test from cpu to core to keep together

* Address PR comments

* Fix style

* Change repositories addresses to use SSH (#3889)

* Move CPU only unit tests to the cpu test file (#3919)

* Cyphers/uop (#3903)

* Address op_tbl issues

* fix

* fix

* fix

* Cleanup

* cleanup

* cleanup

* More fixes

* Revert ser changes

* Compiles

* opset conversion fixed

* Fix opset conversion tests

* Deal with Reciprocal and FloorMod movement

* Cleanup

* Remove duplicate enums

* Experiment

* experiment

* Types

* Reorg around clang 3.9 bug

* Add default constructor to some ops missing them (#3924)

* [SPEC] HardSigmoid adjustments (#3857)

* Construct HardSigmoid with alpha and beta as inputs

* Switch to the new HardSigmoid constructor entirely

* Broadcast with numpy style in hard sigmoid

* Python bindings adjustment to the new constructor

* Different way of creating constants

* Accept scalars instead of 1D vectors for alpha and beta

* Adjust the python tests to the new HardSigmoid constructor

* Use v1 ops in fused HardSigmoid

* Relax the static shape requirement for alpha and beta

* Fix merge

* CropAndResize op (#3893) (#3925)

* Stub for CropAndResize

* Cut and pasteo

* Need a cast

* Put all the op header includes in one header file, ops.hpp (#3929)

* Put all the op header includes in one header file, ops.hpp

* Update ops.hpp

* Fix compilation issues for default constructors (#3928)

* Make Node's type_info mandatory (#3891)

* Make Node's type_info mandatory

* Add ReplaceSlice to ZeroDimTensorEliminiation pass (#3899)

* Add ReplaceSlice to ZeroDimTensorEliminiation pass

* style

* Force Gelu decompose on CPU (#3902)

* Copy rt info (#3934)

* Matmul float type test case for UEP (#3877)

* Matmul float type test case for UEP
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* Removed microsoft ops domains and ran clang-format
Signed-off-by: suryasidd <surya.siddharth.pemmaraju@intel.com>

* [SPEC] Add OneHot:v1 (#3884)

* Moved OneHot to v0

* Introduced OneHot:v1

* Added shape calculation for OneHot:v1

* Added element types checking

* Added output shape tests

* Added tests to checking if inputs are scalars

* Updated OneHot:v1 doc

* Implemented OneHot:v1 downgrade pass

* Using OneHot:v1 in onnx_importer

* Implemented OneHot:v0 upgrade

* Fixed OneHot onnx_importer

* Refactored normalize_axis

* Added OneHot:v1 serialized

* Code review remarks introduced

* Added doc to normalize_axis

* Enable pipelining in CPU Backend (#3916)

* Enable pipelining in CPU Backend

* Applying clang-formatting to my previous commit

* Changing CPU backend test. executable_can_create_tensor will now return true

* [SPEC] Add support string as AutoBroadcastSpec (#3909)

* Support string casting to AutoBroadcastSpec

* Make string values consistent

* Adding default ctor for Constant (#3938)

* Adding default ctor

* Address PR feedback

*  Cumulative Sum  (#3873)

* - Op defination for cummalative sum

* WIP reference kernel for cummulative sum

* - unit test case for default cum_sum
- addition ctor for cumsum to accept axis as a integer insted of Node
type
- style fix

* - add serializer support
- fix failing unit test case
- update Op in the interpreter dispatcher

* - CPU builder and DEX support for CumSum

* - implemented mapping tensor elements to corrosponding axis

* - unit test for multiple dims
- fix axis in the op defination
- support for reference kernel to compute across all axis

* - added support for exclusive and reverse modes
- more unit test case for all modes

* - codegen support for CumSum
- disable CumSum unit test for PlaidML

* -Add missing header to  codegen stream writer

* fixed codegen writer

* change return type of exclusive and reverse to bool

* - support for dynamic shape
- support to handle all tensor types in CPU builder

* - add support for interpreter to handle different axis types

* Style fix

* Fix incorrect uses of `description()` (#3946)

* Fix incorrect uses of `description()`

* type-o/namespace

* Move non-primitive attribute adapters to adaptee's files (#3949)

* Move non-primitive attribute adapters to adaptee's files

* Cast in copy

* Update ONNX importer Gemm to produce MatMul op (#3927)

* Update ONNX importer Gemm to produce MatMul op

* Address opset3 bug

* [SPEC][FusedOp] Add Mod operator (#3908)

* Mod operator introduced

* Introduced onnx importer, fixed implementation

* styles applied

* Refactored assert comment for mod

* Add failure mod test to plaidml manifest

* Code review remarks introduced

* Changed ops used in decompose to v1

* Moved Mod to op_v1_tbl

* Partially fixed visibility for symbols (Ops, Nodes, Transformations, Matchers) (#3767)

* Partially fixed visibility for symbols:

* Resolved issues with RTTI and AppleClang

* style

* review fixes

* fixed compilation with msvc 2019

* Export extra API which is used in other public classes

* CMAKE: MSVS -> MSVC

* Fixed template export

* Fixed compilation flags

* Fixed default args

* removed self-inclusion

* export

* shape

* export strides

* Export all symbols needed for OpenVINO

* Export

* disable cpu

* AxisSet

* disable warning

* fix

* removed second declaration

* fixed runtime exports

* Reverted some changes

* Fixed LNK2005 error on Windows

* Fixed code style check

* Fixed EnumAttributeAdapterBase

* Remove export of template classes

* Fixed code style for EnumAttributeAdapterBase

* Fixed for protobuf

* Test cleanups (#3942)

* Documentation for Dynamic Shapes and additional graph construction options (#3930)

* Initial dynamic shapes doc

* Basics on dynamic shapes, with example code

* Add glossary defs and dynamic shapes example

* Slightly better organization

* Address make style check failure, maybe

* Test dynamic shapes doc w 0.27.0-rc.0+9aa81d9

* Resolve doc build error w new opset versioning

* Review comments addressed

* Add theme-relevant revised illustrations from collab_ngai

* style

* Style fixes

* Run make style-apply with clang-format-3.9

* [ONNX] Add CumSum to ONNX importer (#3918)

* Register CumSum operator in onnx importer

* Missing whitespace

* Update CMakeLists.txt

* ONNX importer - CumSum op init

* Simple CumSum onnx model

* ONNX CumSum model simple test

* Default axis

* Axis input test

* Inputs variable

* Style apply

* Test 3d exclusive reverse

* Apply style

* Add memory header and std namespace

* Add model_cum_sum tests to plsidml unit_test.manifest

* Add model_cum_sum tests to plaidml unit_test.manifest

* Changed default axis type

* Test model update

* Style apply

* Add test for dynamic axis input

* [MLIR] Fused Ops dialect declaration (#3860)

* WIP

* WIP

* WIP

* All ops

* Fix layernorm backprop op name

* WIP: Adding tests

* WIP: Adding LIT parsing/printing tests

* WIP

* Added LSTM cells. Fixed some ops

* All builder tests

* PR fixes

* Fix spacing. Add missing setter to SpaceToDepth

* Update spaceToDepth lit test

* PR fixes

* Build fix

* Another fix

* Fixed optional args

* [MLIR] Enable ViewOp in Affine Lowerer (#3911)

* Map each ng tensor to a linear buffer and a view

* fix comment

* Create views only when a value is assigned a buffer id

* style

* Fix lit test

* ConstantFolding for v1::StridedSlice operation (#3955)

* constant folding for strided slice

* code style

* Refactoring

* fix for warning: deleting an unused variable

* Opset1 Definition (#3813)

* Opset1

* Added opset1.hpp

* Added more ops to opset0 and opset1

* Move opset1.hpp up and remove opset0.hpp

* Add versioning to more ops

* Revert to older pass names to keep compatibility for external components

* Fix compilation errors with codegen

* merge

* Added compile-time check for opset

* Added opset1 tbl

* Add op_version table of all ops

* Create factories from op_version_tbl

* reorg unsupported ops in int backend

* Added temporary alias for GreaterEqual

* Add missing case to interpreter enumeration

* Finish opset serializer cleanup (#3939)

* Opset-based opset conversion (#3937)

* Opset-based opset conversion

* Add other opset conversion

* Use ops.hpp

* Update opset0_tbl.hpp

* Switch interpreter to opset0 + a few extras (#3941)

* Switch interpreter, gcpu to opset0

* Remove unnused files

* Give interpreter its own opset

* style

* Fix namespace

* Fix rounding type conversion

* Work-around for bad clang3.9 bug

* Work-around

* [SPEC] Add negative axes support for ReverseSequence (#3926)

* Added negative axes support for ReverseRequence

* code review remarks introduced

* Disable reverse sequence for PlaidMl tests

* Fixed styles

* Fixed axes assignment

* Fixed normalized axes assignment

* [SPEC] Adjust ConvolutionBackpropData op. (#3935)

* [SPEC] Adjust ConvolutionBackpropData op.

```
inputs:
  1. filters-------+
  2. output_delta  |  -> 1. data
                   +---> 2. filters
  3. data_batch_shape -> 3. output_shape(+optional)

attributes:
  1. strides          -> 1. strides
  2. dilations-----+
  3. pads_begin    |  -> 2. pads_begin
  4. pads_end      |  -> 3. pads_end
                   +---> 4. dilations
		      -> 5. +auto_pad(optional)[PadType::EXPLICIT]
		      -> 6. +output_padding(optional)[zeros]
```

* Review fix I

* [SPEC] ConvertLike op (#3944)

* [Spec] Add 3-input constructor to DetectionOutput (#3966)

* Add 3-input constructor to DetectionOutput

* Review comments

* v1::Reshape zero_flag renamed. Default value unset (#3945)

* Add groupconvolution bprop (#3940)

* add placeholder for conv bprop

* add constructor, api, serializer and can compile

* implement decompose_op

* fix arg num

* fix and update

* address comment, clean up and add ut placeholder

* update ut

* address comment on groups

* Added explicit dependencies between buildable target and external project (#3962)

*  Relax check on LRN for rank requirement to be >=3 (#3952)

*  relax check for LRN for requirement rank should be >=3

* rename unit test names

* - Disable lrn unit test with axes for CPU backend

* remove outdated unit test on rank requirement from type_prop

* - disable newly added lrn unit test in plaidMl

* [SPEC] ReduceLogicalAnd & ReduceLogicalOr (#3874)

* ReduceLogicalAnd op implementation

* ReduceLogicalOr op implementation

* Add basic constant folding support

* Fix typo

* Revert "Add basic constant folding support"

This reverts commit 5d14a1849e957858dd5f6615981b154a381a1127.

* Introduce and use a new base class for logical reductions

* Constant folding for v1::ReduceLogicalAnd

* Constant folding for v1::ReduceLogicalOr

* Obsolete cout removal

* [SPEC] Adjust Split (#3943)

* Changed axis to Node

* Added using normalize from validation util

* refactored split

* Added typrop tests to Split

* Added set_input_is_relevant_to_shape for Split

* clang style applied

* Fixed var name

* Code refactor

* mergre from master. part.2

* Constructor to provide CI compatibility

* CI compatibility

* CI compatibility

* Updated get_outputs

* CI compitability

* Fixed get_outputs function

* [SPEC] Add DeformablePSROIPooling v1 (#3954)

* Initial commit

* Moved DeformablePSROIPooling to v1

* Moved DeformablePSROIPooling to v1. Part.2

* Added missing fields

* Added inferance shape

* Added type prop UT

* Added serialization

* Doc + styles applied

* Revert incorrect changes

* Revert incorrect changes. Part.2

* Moved to NGRAPH_API

* integration with master

* Code review remarks introduced

* DeformablePSROIPooling updated to new spec

* Add v1 version of Subtract with Numpy broadcasting as default (#3957)

* V1 version of Subtract with default Numpy autobcast

* Update op_v1_tbl.hpp with v1 version of Subtract

* Use v1 of Subtract in ONNX importer

* Add v1 namespace

* Update namspece

* Missing punctuation

* Add Subtract to opset0 downgrade

* Add Subtract to opset1 upgrade

* Add Subtract header to cpu emmiter

* Update serializer

* Add Subtract to opset_pass tests

* Use downgrade method

* Add get_version method

* Style apply

* Add v1 Substract to check opset1

* Add NGRAPH_API before class name

* Removed get_version method

* Separate cases for Subtract and Subtract_v1 in serializer

* Update op_version_tbl with v1 Subtract

* NUMPY autobcast for no args constructor

* Add Subtract_v1 to serializer

* [SPEC] Add constant folding for LogicalNot:v1 (#3961)

* Added consant folding for LogicalNot

* Fixed alphabetical order

* Update the tolerance on auto_broadcast_test (#3959)

* Copy RT info for parameters (#3969)

* [SPEC] Add GatherTree:v1 (#3967)

* GatherTree introduced

* Added GatherTree type_prop tests

* Add ReplaceSlice to ZeroDimTensorEliminiation pass

* style

Comparing size_t >= 0
|= for bools

* Add anchors attribute to RegionYolo operator.

* Make op doc more consistent.

* Make anchors optional attribute.

* Added support for ONNX's clip op in set_11.

* Registered clip in set_11.

* Code formatting.

* Added reshape.

* Changed to auto_braodcast.

* Code refactoring.

* Removed unnecessary import.

* Added constant sharing support

* Added unit tests for specialize_function

* Added parameter description

* Code style fix

*  WIP graph pass to lower ngraph to ngraph dialect

* resolved compiler errors

* - refactor ngraph-dialect to graph pass

* - fix compilation issue
- unit test passes

*  - style fix

* Addressed PR comments

* - move NgDialectConversionPass to anonymous namespace

* - use getModule() to access module inside the graph pass
- address PR comments

*  - fix failing unit test case for negative padding
- make builder as an object isntead of pointer to an object

* Address PR Comments

* Add folder to hold PDPD Fluid helper codes.
Planning to move code from PDPD bridge to this folder as part of code
cleanup restructuring.

* Move folder to src/ngraph/frontend/fluid

* implemented TopK:v1 downgrade

* Using v1 in onnx_importer; styles applied

* Fixed onnx_importer

* code review remarks introduced; fix clang errors

* Fixed problem with incorrect order of TopK outputs

* Code review remarks introduced

* Fixed output_order style

* Autodiff for atan2

* atan2 not supported on PlaidML

* Atan2 op

* TensorIterator

* ssize_t is not on windows

* RNN building test

* simplify

* Simplify output

* typo

* typos

* remove arg

* Sequence version

* style

* Serialization for all but TensorIterator

* Add ops for igpu

* style

* typo, ngpu

* missing headers, output vector

* Fix const json issues

* TensorIterator serialization

* Serialization for TensorIterator
Switch Outout<T> to use shared_ptr do nodes don't vanish
Switch Result to new node style
Add serialization/deserialization to test

* Switch Output to use a shared_ptr to prevent nodes from disappearing early.

* Eliminate wrapped enum
Switch allreduce to new op form

* Convert to new op form

* Disambiguate concat

* Add autobroadcast for SequencePush
Add validation for SequencePush

* compute shapes for SequenceRepeat

* Add explicit conversion from PartialShape to dimension vector
validate and infer types for SliceInput

* validate and infer types for SequenceOutput

* Add sequence attributes

* Move test to serializer so it doesn't fail when there is no serializer?

* const arg

* Beginning of TensorIterator validation

* Validation up to parameters

* Fix shape in test

* Remove mis-typed AxisSet

* Simplify, add doc

* Review comments

* Tweaks

* free/bound

* Try fused op

* Discussion

* more

* comments

* Start of LSTMCell test

* Add LSTMCell example

* Reorg

* Reorg

* Fused ops don't need handlers

* Serialization

* Use `as_type` and `is_type` for up-conversions of descriptions
Allocate output space for each output

* Clean up type checking

* Fix ser/deser issues

* Refactor, cleanup type info to make it safer to use for non-ops

* Implement validate_and_infer_types and modify unit tests.

* For ops in the loop body: revalidate and infer types.

Nested loop is not supported.

* Put body ops in a set and call revalidate and infer types on the set.

* Set slice[axis] to part_size.

Call set_partial_shape to set shape for body parameters.

Add more unit tests.

* Give tensor iterator body a lambda

* Update validate_and_infer_types and unit tests.

* Serialization of body

* Change static function to TensorIterator function.

* review comments

* Fix for openvino ci

* Fix

* Resolve comments

* Revert_changes

* Add upgrade/downgrade pass for Add op.

* Add upgrade/downgrade pass for Divide op.

- Change default value of autobradcasting in v1 into NUMPY.

* Add v1 version for Equal operator.

* Rename helper functions to fix compiler errros.

Fix Divide op version.

* Add downgrade and upgrade passes for Equal op.

* Reformat test cases. Add helper functions.

Add UT for Equal op.

* Add upgrade/downgrade pass and UT for Greater op.

* Add upgrade/downgrade pass and UT for GreaterEq op.

* Add upgrade/downgrade pass and UT for Less op.

* Add upgrade/downgrade pass and UT for LessEq op.

* Add upgrade/downgrade pass and UT for Maximum op.

* Add upgrade/downgrade pass and UT for Minimum op.

* Add upgrade/downgrade pass and UT for Multiply op.

* Add upgrade/downgrade pass and UT for NotEqual op.

* Add upgrade/downgrade pass and UT for Power op.

* Force ops version 1.

* Don't inline templates.

* Fix namespaces and some formatting.

* Update ONNX Importer to produce v1 nGraph nodes.

* Fix function return type.

* Fix uninitialized local variable warning.

* Fix confilicting declarations.

* Apply clang-format.

* Fix errors for distributed nGraph with unavailable classes.

* Fix downgrade pass for LessEqual op.

* [FUSED] Add new Selu fused op.

* Add Selu to serializer

* Add Selu to ngraph.hpp

* Fix float16 denorm conversion, add rounding

* review comments

* Shape as a node in ConvBpropData (v1)

* Fix constant op creation

* Convbpropfilters dynamic shape

* Avgpool bprop dynamic shape

* Add downgrade pass

* Downgrade pass Avgpoolbackprop

* Shape checks and shape relevancy

* Dyn avgpoolbprop test case

* Revert "Dyn avgpoolbprop test case"

This reverts commit b094f2f99d00023593c667ff16cf060a586ad16a.

* Revert "Avgpool bprop dynamic shape"

This reverts commit ef8a4d197577c0d277d634baa9d6d082adcddae0.

* Revert "Downgrade pass Avgpoolbackprop"

This reverts commit 3f31f0fea8fe6e79bd958cbaa7cb8495008a795f.

* Call shape relevancy

* Revert Avgpoolbprop changes

* mark nodes as dynamic

* Add opset transform tests

* Change API

* Adjust strides

* Use size

* Merge PR 3776

* add shape relevance

* Add convbprop_data test case

* Add convbprop_filter test case

* Use is_constant helper

* Remove opset pdpd test case

* resolve conflict

* add checks for validate and infer

* Type prop tests

* Return pass created with register_pass call

* Add test

This matches the behavior in FindProtobuf.cmake, https://github.com/Kitware/CMake/blob/master/Modules/FindProtobuf.cmake#L624-L626 (https://cmake.org/cmake/help/latest/module/FindPackageHandleStandardArgs.html#command:find_package_handle_standard_args)

* Allow fused ops to create outputs and set types/shapes in pre_validation

* style fix

* Init commit to implement interface

*  Add two op interfaces for v0 and v1. Add a unit-test

* Add missing files

* Move test to separate file

* Add Fused Op interface

* Missing files

* style

* fused ops

* Remove V1 ops for now

* Added enum attributes. WIP

* Completed non-experiemntal non-fused-ops

* Add ops_attributes

* Minor fixes

* Minor fixes

* Added enum setting/reading test

* style-apply

* Added attributes tests

* Fix dialect init

* style

* fix typo

* Fix merge errors

* Include file with MLIR on

* Added tool for running Onnx models via nGraph C++ API.

* Code formatting.

* Added option to load inputs from binary files.

* Removed unused variables.

* Changed description.

* Moved read_binary_file function from test_tools to ngraph utils.

* Added option to provide arguments with equals sign.

* Bugfix.

* Changed reading file.

* Code refactoring.

* Added output printing.

* Added comments.

* Undo moved function.

* Removed unused imports.

* Update docstring
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Update docstring
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Added catching exception.

* Code refactoring.

* [SPEC] Rename operator Xor->LogicalXor

* Fix clang issue

* Fix bug in opset transformations. Add support for LogicalXor in backends

* Style fix

* Fix a bug in CPU emmiter

* [SPEC] Rename operator Or->LogicalOr

* [SPEC] Rename operator And->LogicalAnd

* [SPEC] Rename operator Not->LogicalNot

* [SPEC] Rename operator LessEq->LessEqual

* Added shape inference for entire graph to constant folding pass

* Updated specialize_function

* FusedOp MVN fix

* style

* Fixed issue with export symbols

* Fixed code style

* Initial commit

* Minor

* Intentional bug

* Revert "Intentional bug"

This reverts commit 11868b11ef83a92f094c7baed9c00a8b5ee2747d.

* Constant folding support for V1 Reshape

* Fixed constant folding tests

* Initial implementation

* Fixed Gelu

* Gelu backprop initial implementation

* Add GeluBackprop fusion

* Gelu and gelu backprop fusion test cases

* Prevent decompose_op() for Gelu/GeluBackpropFactor for some type

* Fixes and cleanup

* Enabled backprop fusion

* Fixed some issues

* Mostly cleanup

* Some more cleanup

* File permissions

* Remove unused variable

* Style check

* Address PR feedback

* Address PR feedback

* Incorporate changes related to latest master

* Style check

* Some more PR feedback related changes

* Remove comment

* Check for relative error

* Retrigger CI

* corrected syntax