* Autodiff for atan2

* atan2 not supported on PlaidML

* Atan2 op

* TensorIterator

* ssize_t is not on windows

* RNN building test

* simplify

* Simplify output

* typo

* typos

* remove arg

* Sequence version

* style

* Serialization for all but TensorIterator

* Add ops for igpu

* style

* typo, ngpu

* missing headers, output vector

* Fix const json issues

* TensorIterator serialization

* Serialization for TensorIterator
Switch Outout<T> to use shared_ptr do nodes don't vanish
Switch Result to new node style
Add serialization/deserialization to test

* Switch Output to use a shared_ptr to prevent nodes from disappearing early.

* Eliminate wrapped enum
Switch allreduce to new op form

* Convert to new op form

* Disambiguate concat

* Add autobroadcast for SequencePush
Add validation for SequencePush

* compute shapes for SequenceRepeat

* Add explicit conversion from PartialShape to dimension vector
validate and infer types for SliceInput

* validate and infer types for SequenceOutput

* Add sequence attributes

* Move test to serializer so it doesn't fail when there is no serializer?

* const arg

* Beginning of TensorIterator validation

* Validation up to parameters

* Fix shape in test

* Remove mis-typed AxisSet

* Simplify, add doc

* Review comments

* Tweaks

* free/bound

* Try fused op

* Discussion

* more

* comments

* Start of LSTMCell test

* Add LSTMCell example

* Reorg

* Reorg

* Fused ops don't need handlers

* Serialization

* Use `as_type` and `is_type` for up-conversions of descriptions
Allocate output space for each output

* Clean up type checking

* Fix ser/deser issues

* Refactor, cleanup type info to make it safer to use for non-ops

* Implement validate_and_infer_types and modify unit tests.

* For ops in the loop body: revalidate and infer types.

Nested loop is not supported.

* Put body ops in a set and call revalidate and infer types on the set.

* Set slice[axis] to part_size.

Call set_partial_shape to set shape for body parameters.

Add more unit tests.

* Give tensor iterator body a lambda

* Update validate_and_infer_types and unit tests.

* Serialization of body

* Change static function to TensorIterator function.

* review comments

* Fix for openvino ci

* Fix

* Resolve comments

* Revert_changes

* Add upgrade/downgrade pass for Add op.

* Add upgrade/downgrade pass for Divide op.

- Change default value of autobradcasting in v1 into NUMPY.

* Add v1 version for Equal operator.

* Rename helper functions to fix compiler errros.

Fix Divide op version.

* Add downgrade and upgrade passes for Equal op.

* Reformat test cases. Add helper functions.

Add UT for Equal op.

* Add upgrade/downgrade pass and UT for Greater op.

* Add upgrade/downgrade pass and UT for GreaterEq op.

* Add upgrade/downgrade pass and UT for Less op.

* Add upgrade/downgrade pass and UT for LessEq op.

* Add upgrade/downgrade pass and UT for Maximum op.

* Add upgrade/downgrade pass and UT for Minimum op.

* Add upgrade/downgrade pass and UT for Multiply op.

* Add upgrade/downgrade pass and UT for NotEqual op.

* Add upgrade/downgrade pass and UT for Power op.

* Force ops version 1.

* Don't inline templates.

* Fix namespaces and some formatting.

* Update ONNX Importer to produce v1 nGraph nodes.

* Fix function return type.

* Fix uninitialized local variable warning.

* Fix confilicting declarations.

* Apply clang-format.

* Fix errors for distributed nGraph with unavailable classes.

* Fix downgrade pass for LessEqual op.

* Fix float16 denorm conversion, add rounding

* review comments

* Shape as a node in ConvBpropData (v1)

* Fix constant op creation

* Convbpropfilters dynamic shape

* Avgpool bprop dynamic shape

* Add downgrade pass

* Downgrade pass Avgpoolbackprop

* Shape checks and shape relevancy

* Dyn avgpoolbprop test case

* Revert "Dyn avgpoolbprop test case"

This reverts commit b094f2f99d00023593c667ff16cf060a586ad16a.

* Revert "Avgpool bprop dynamic shape"

This reverts commit ef8a4d197577c0d277d634baa9d6d082adcddae0.

* Revert "Downgrade pass Avgpoolbackprop"

This reverts commit 3f31f0fea8fe6e79bd958cbaa7cb8495008a795f.

* Call shape relevancy

* Revert Avgpoolbprop changes

* mark nodes as dynamic

* Add opset transform tests

* Change API

* Adjust strides

* Use size

* Merge PR 3776

* add shape relevance

* Add convbprop_data test case

* Add convbprop_filter test case

* Use is_constant helper

* Remove opset pdpd test case

* resolve conflict

* add checks for validate and infer

* Type prop tests

* Return pass created with register_pass call

* Add test

* Init commit to implement interface

*  Add two op interfaces for v0 and v1. Add a unit-test

* Add missing files

* Move test to separate file

* Add Fused Op interface

* Missing files

* style

* fused ops

* Remove V1 ops for now

* Added enum attributes. WIP

* Completed non-experiemntal non-fused-ops

* Add ops_attributes

* Minor fixes

* Minor fixes

* Added enum setting/reading test

* style-apply

* Added attributes tests

* Fix dialect init

* style

* fix typo

* Fix merge errors

* Include file with MLIR on

* Added tool for running Onnx models via nGraph C++ API.

* Code formatting.

* Added option to load inputs from binary files.

* Removed unused variables.

* Changed description.

* Moved read_binary_file function from test_tools to ngraph utils.

* Added option to provide arguments with equals sign.

* Bugfix.

* Changed reading file.

* Code refactoring.

* Added output printing.

* Added comments.

* Undo moved function.

* Removed unused imports.

* Update docstring
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Update docstring
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Added catching exception.

* Code refactoring.

* [SPEC] Rename operator Xor->LogicalXor

* Fix clang issue

* Fix bug in opset transformations. Add support for LogicalXor in backends

* Style fix

* Fix a bug in CPU emmiter

* [SPEC] Rename operator Or->LogicalOr

* [SPEC] Rename operator And->LogicalAnd

* [SPEC] Rename operator Not->LogicalNot

* [SPEC] Rename operator LessEq->LessEqual

* Constant folding support for V1 Reshape

* Fixed constant folding tests

* Initial implementation

* Fixed Gelu

* Gelu backprop initial implementation

* Add GeluBackprop fusion

* Gelu and gelu backprop fusion test cases

* Prevent decompose_op() for Gelu/GeluBackpropFactor for some type

* Fixes and cleanup

* Enabled backprop fusion

* Fixed some issues

* Mostly cleanup

* Some more cleanup

* File permissions

* Remove unused variable

* Style check

* Address PR feedback

* Address PR feedback

* Incorporate changes related to latest master

* Style check

* Some more PR feedback related changes

* Remove comment

* Check for relative error

* Retrigger CI

* corrected syntax

* Introduced reshape:v1 downgrade

* Enable downgrade pass in dynamic backend

* Add unit test for dynamic backend downgrade pass

* Clang styles applied

* Apply unit tests name refactor based on code review
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Removed redundant pass

* Changed order of downgrade pass

* Changed order of passes in dynamic backend

* Rename input arg -> data

* Update node validation and shape propagation to support data rank and number of repeats to be different.

* Add type_prop tests

* Add UT for new tile cases

* style

* Modify CPU backend to support the new case.

* Fix backend selection in test

* Add new line back.

* DynSlice was adjusted to specyfication

* Fixed documentation

* Fixed styles

* Fixed clang warning

* Introduced StridedSlice as separate op

* revert dyn_slice

* Fixed StrideSlice implementation

* Enable downgrade pass in dynamic backend

* Implemented upgrade/downgrade pass

* Added serialization

* Styles applied

* Styles applied. Part.2

* Updated dynamic backends list

* Move StridedSlice outside experimental

* Make Slice as v0 of StridedSlice

* Styles applied

* Styles applied

* Fixed clang error

* Code review remarks introduced

* Move GenerateMask up in Opset0Downgrade to keep alphabetical sort

* Style apply

* - WIP fusion pattern for softmax + cross entropy

* fix compiler error

*  make summation axis integer for the fusion pattern

* - Fusion pattern for sigmoid cross entropy bprop

* WIP callback implementation for fused sigmod+crossentropy fprop

* - implemented fprop softmax+crossentropy as single layer for numerical
stabilization
- added broadcasting nodes to fix elementwise assertions

* Added unit test case for functionality test

* Move the softmax + crossentropy fusion pass to core

* i) style fix ii)added missing header

* - Added new Fused Op for Softmax + CrossEntropy
- moved the decomposition to the Softmax + CrossEntropy FusedOp

* - Add SoftmaxCrossEntropy for fused tablegen
- Add serializer support for SoftmaxCrossEntropy
- fix documentation

* Added missing json file for unit test case

* Addressed PR comment

* Addressed PR comments

* - Fix fusion string

* - Style fix

* - Added Bprop for Softmax + crossEntropy

* - added SoftmaxCrossEntropy support when soft_lable is provided
- serailizer and deserializer support for SoftmaxCrossEntropyBprop

* - Added support in decompose_op for SM+CE bprop when ignore_mask is specified

* Updated Doc strinng

* - unit test case for SoftmaxCrossEntropy backprop with soft lables
- fixed decompose_op bug in bprop

* - if soft_label=true, capture pattern only if the labels dont have one
hot encoding

* - SoftmaxCrossEntropyBprop Support if ignore_index is specified

* add serialized files for unit test

* - fix softmax + CE pattern bug
- fix softmax + CE decompose_op() bug

* - change reduction_axes to int64_t type in fprop and bprop ctor

* - add soft_labels and ignore_index attribute to SM+CE fprop ctor

* - addition asserts in unit test to ensure SM + CE fprop and bprop fusion is successful

* - move reduction_axis computation to decompose_op from ctor to relax on
dynamic shapes

* Addressd PR Comments

* - suppprt for SM+CE for ignore_index and softmax=false

* - test case for SM+CE fprop with ignore_mask, soft_labels=false
- fix bug in decompose_op

* - refactor unit test case

* - fix PDPD unit test

* broadcast delta if shape mismatches

* -fix bdcast issue in decompose_op

* Concat operator is updated to support dynamic_shape
1) Added new concat_negative_indexing test
2) Replaced size_t -> int64_t
3) Support for a negative indexing, calculate axis = axis + int64(input_rank)
   if (axis < 0) { axis = axis + int64_t(this_input_rank); }

* Remove unwanted #include "ngraph/op/constant.hpp" header

* Refactoring:
1) The name of variable is replaced: m_concatenation_axis -> m_axis

* Concat negative indexing test is adjusted to support dynamic_shape tensor
auto pshape_a = PartialShape::dynamic(); for each tensor {a,b,c} result tensor has dynamic_shape

* The backend supports dynamic shapes
auto backend = runtime::Backend::create("${BACKEND_NAME}", true);

* Other shape is supported by concat:
set_output_type(0, inputs_et, PartialShape::dynamic(concatenation_axis_output_dim));

* The NODE_VALIDATION_CHECK was moved up to be for a dynamic_shape

* [Test] The shape of output tensor was changed
[Concat CPU] Added support for a negative indexing on a cpu

* Review changes:
1) Added axis re-calculate for a reference version of concat
2) axis is not replied

* Review changes: support for a negative axis

* Comment about variable is added to concat.hpp file
Removed unused variable

* Add constant folding for v1 reduce ops.

* Add reference/mean.hpp.

* Remove extra semicolon.

* Address PR feedback.

* Add constant folding for Squeeze and Unsqueeze.

* Address PR feedback.

* add partial slice op placeholder

* fprop implemented

* add a dynamic ut

* implement bprop

* support decrease axis

* add bprop ut

* address comment

* use descriptive var name

* Updated nGraph backend to be compatible with OpenVINO plugins

* Resolve issue with gtest

* Resolve comments in PR

* Resolve comments in PR

* Code style fix

* Rename runtime2 to ov_runtime

* Style check fix

* Dynshape support for GenerateMask

* fix clang error

* Remove comments

* Test case correction

* Disable plaidml

* Merge

* Implemented downgrade pass

* Added v1 support in onnx importer

* Clang style applied

* Pooling factory refactor

* Removed unused variables

* clang styles apllied

* Fixed avg pool bprop UT

* Remove debug output

* More cleanup

* unfold attributes

* Remove unnecesary if

* Rename run() -> lstm_pass()

* Unify usage of LSTMForward for one and bi directional LSTM

* Unify LSTMForward return values for one and bi directional LSTM

* Dirty moving LSTMForward into fused directory

* Accept lstm direction as string instead of enum

* Fused op which uses decompose_op in onnx_importer

* Rename LSTMForward -> LSTMSequence

* Split LSTMSequence to cpp and hpp

* Remove LSTMDirection enum

* Add getters for class fields

* Adjust constructors

* Add direction validation.

* Add support of LSTMSequence op in serializer

* Reorder fused op input order

* Style fix

* Fix for reorder of inputs

* Use NodeTypeInfo instead of static string

* Node -> value in doc

* Add doc for prepare_input method

* Fix shape inference

* Use enum instead of string for direction

* Add Type prop unit test

* Fix style

* AvgPoolBprop dynamic shape support

* Add opset_transform test

* Call the correct shape relevance function

* Unused variable

* Support auto broadcast in FakeQuantize op

* style fix

* add pdpd unit test to plaidml manifest

* Minor cleanup

* Add support for ONNX 1.5 version of TopK

* Add unit tests

* Style apply

* Exclude failing tests

* Exclude failing tests

* Add support for ONNX 1.6 TopK attribures: larges and sorted

* Support for ONNX 1.6 TopK

* If k_node is a Constant, recreate as constant with Shape{}

* Extend `interpret_as_scalar` function

* Extend `interpret_as_scalar` function

* Remove merge artifact

* Add doc string

* Exclude failing tests

* Exclude failing tests

* Refactor function

* Remove unnecessary template param

* Use get_k function in OpSet 10 TopK

* Style apply

* Remove merge artifact

* Add tests for `interpret_as_scalar`

* Revert "Add tests for `interpret_as_scalar`"

This reverts commit 8b85965acb39c75ff9e66b06ad8f64df16e1a9da.

* - Added support for v1 Broadcast op specification
- Added upgrade/downgrade conversions between v0 and v1

* Added unit test for pdpd broadcast

* Make numpy default autobroadcast type and some style fixes

* Added support in Dynamic wrapper for dyn elimination and copied over unit tests from DynBroadcast

* Addressed PR feedback

* Addressed PR feedback on documentation

* Added a callback registration to the event class so that frameworks can decide how to write the events. Note: This is FULLY backwards compatible i.e., no change in the API so - won't break existing users

* Fixed compilation error

* Attempting to fix broken Windows build

* Fixed a race condition in the test

* Attempt to fix windows build again

* Create a variant schema and allow nodes to have a rt info

* Use map for rt_info

* style

* Another variant

* variant

* style

* Macro didn't work in gcc

* Compiler issues