* TensorIterator

* ssize_t is not on windows

* RNN building test

* simplify

* Simplify output

* typo

* typos

* remove arg

* Sequence version

* style

* Serialization for all but TensorIterator

* Add ops for igpu

* style

* typo, ngpu

* missing headers, output vector

* Fix const json issues

* TensorIterator serialization

* Serialization for TensorIterator
Switch Outout<T> to use shared_ptr do nodes don't vanish
Switch Result to new node style
Add serialization/deserialization to test

* Switch Output to use a shared_ptr to prevent nodes from disappearing early.

* Eliminate wrapped enum
Switch allreduce to new op form

* Convert to new op form

* Disambiguate concat

* Add autobroadcast for SequencePush
Add validation for SequencePush

* compute shapes for SequenceRepeat

* Add explicit conversion from PartialShape to dimension vector
validate and infer types for SliceInput

* validate and infer types for SequenceOutput

* Add sequence attributes

* Move test to serializer so it doesn't fail when there is no serializer?

* const arg

* Beginning of TensorIterator validation

* Validation up to parameters

* Fix shape in test

* Remove mis-typed AxisSet

* Simplify, add doc

* Review comments

* Tweaks

* free/bound

* Try fused op

* Discussion

* more

* comments

* Start of LSTMCell test

* Add LSTMCell example

* Reorg

* Reorg

* Fused ops don't need handlers

* Serialization

* Use `as_type` and `is_type` for up-conversions of descriptions
Allocate output space for each output

* Clean up type checking

* Fix ser/deser issues

* Refactor, cleanup type info to make it safer to use for non-ops

* Implement validate_and_infer_types and modify unit tests.

* For ops in the loop body: revalidate and infer types.

Nested loop is not supported.

* Put body ops in a set and call revalidate and infer types on the set.

* Set slice[axis] to part_size.

Call set_partial_shape to set shape for body parameters.

Add more unit tests.

* Give tensor iterator body a lambda

* Update validate_and_infer_types and unit tests.

* Serialization of body

* Change static function to TensorIterator function.

* review comments

* Fix for openvino ci

* Fix

* Resolve comments

* Revert_changes

* Add upgrade/downgrade pass for Add op.

* Add upgrade/downgrade pass for Divide op.

- Change default value of autobradcasting in v1 into NUMPY.

* Add v1 version for Equal operator.

* Rename helper functions to fix compiler errros.

Fix Divide op version.

* Add downgrade and upgrade passes for Equal op.

* Reformat test cases. Add helper functions.

Add UT for Equal op.

* Add upgrade/downgrade pass and UT for Greater op.

* Add upgrade/downgrade pass and UT for GreaterEq op.

* Add upgrade/downgrade pass and UT for Less op.

* Add upgrade/downgrade pass and UT for LessEq op.

* Add upgrade/downgrade pass and UT for Maximum op.

* Add upgrade/downgrade pass and UT for Minimum op.

* Add upgrade/downgrade pass and UT for Multiply op.

* Add upgrade/downgrade pass and UT for NotEqual op.

* Add upgrade/downgrade pass and UT for Power op.

* Force ops version 1.

* Don't inline templates.

* Fix namespaces and some formatting.

* Update ONNX Importer to produce v1 nGraph nodes.

* Fix function return type.

* Fix uninitialized local variable warning.

* Fix confilicting declarations.

* Apply clang-format.

* Fix errors for distributed nGraph with unavailable classes.

* Fix downgrade pass for LessEqual op.

* [FUSED] Add new Selu fused op.

* Add Selu to serializer

* Add Selu to ngraph.hpp

* Fix float16 denorm conversion, add rounding

* review comments

* Shape as a node in ConvBpropData (v1)

* Fix constant op creation

* Convbpropfilters dynamic shape

* Avgpool bprop dynamic shape

* Add downgrade pass

* Downgrade pass Avgpoolbackprop

* Shape checks and shape relevancy

* Dyn avgpoolbprop test case

* Revert "Dyn avgpoolbprop test case"

This reverts commit b094f2f99d00023593c667ff16cf060a586ad16a.

* Revert "Avgpool bprop dynamic shape"

This reverts commit ef8a4d197577c0d277d634baa9d6d082adcddae0.

* Revert "Downgrade pass Avgpoolbackprop"

This reverts commit 3f31f0fea8fe6e79bd958cbaa7cb8495008a795f.

* Call shape relevancy

* Revert Avgpoolbprop changes

* mark nodes as dynamic

* Add opset transform tests

* Change API

* Adjust strides

* Use size

* Merge PR 3776

* add shape relevance

* Add convbprop_data test case

* Add convbprop_filter test case

* Use is_constant helper

* Remove opset pdpd test case

* resolve conflict

* add checks for validate and infer

* Type prop tests

* Return pass created with register_pass call

* Add test

This matches the behavior in FindProtobuf.cmake, https://github.com/Kitware/CMake/blob/master/Modules/FindProtobuf.cmake#L624-L626 (https://cmake.org/cmake/help/latest/module/FindPackageHandleStandardArgs.html#command:find_package_handle_standard_args)

* Allow fused ops to create outputs and set types/shapes in pre_validation

* style fix

* Init commit to implement interface

*  Add two op interfaces for v0 and v1. Add a unit-test

* Add missing files

* Move test to separate file

* Add Fused Op interface

* Missing files

* style

* fused ops

* Remove V1 ops for now

* Added enum attributes. WIP

* Completed non-experiemntal non-fused-ops

* Add ops_attributes

* Minor fixes

* Minor fixes

* Added enum setting/reading test

* style-apply

* Added attributes tests

* Fix dialect init

* style

* fix typo

* Fix merge errors

* Include file with MLIR on

* Added tool for running Onnx models via nGraph C++ API.

* Code formatting.

* Added option to load inputs from binary files.

* Removed unused variables.

* Changed description.

* Moved read_binary_file function from test_tools to ngraph utils.

* Added option to provide arguments with equals sign.

* Bugfix.

* Changed reading file.

* Code refactoring.

* Added output printing.

* Added comments.

* Undo moved function.

* Removed unused imports.

* Update docstring
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Update docstring
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Added catching exception.

* Code refactoring.

* [SPEC] Rename operator Xor->LogicalXor

* Fix clang issue

* Fix bug in opset transformations. Add support for LogicalXor in backends

* Style fix

* Fix a bug in CPU emmiter

* [SPEC] Rename operator Or->LogicalOr

* [SPEC] Rename operator And->LogicalAnd

* [SPEC] Rename operator Not->LogicalNot

* [SPEC] Rename operator LessEq->LessEqual

* Added shape inference for entire graph to constant folding pass

* Updated specialize_function

* FusedOp MVN fix

* style

* Fixed issue with export symbols

* Fixed code style

* Initial commit

* Minor

* Intentional bug

* Revert "Intentional bug"

This reverts commit 11868b11ef83a92f094c7baed9c00a8b5ee2747d.

* Constant folding support for V1 Reshape

* Fixed constant folding tests

* Initial implementation

* Fixed Gelu

* Gelu backprop initial implementation

* Add GeluBackprop fusion

* Gelu and gelu backprop fusion test cases

* Prevent decompose_op() for Gelu/GeluBackpropFactor for some type

* Fixes and cleanup

* Enabled backprop fusion

* Fixed some issues

* Mostly cleanup

* Some more cleanup

* File permissions

* Remove unused variable

* Style check

* Address PR feedback

* Address PR feedback

* Incorporate changes related to latest master

* Style check

* Some more PR feedback related changes

* Remove comment

* Check for relative error

* Retrigger CI

* corrected syntax

* Re-organize files. Create MLIR backend classes

* WIP

* Refactored. Code compiles

* Moved context to Runtime class to outlive compilation and execution

* style-apply

* Base Runtime class. Few other modifications

* Minor fixes

* Fixed Runtime::run() to take type-erased pointer

* renamed core compiler

* rename backend compiler

* rename runtime compiler

* PR feedback

* Fix build fails

* - refactor LowerNGDialect
- addgraph pass to lower standardDialect to llvm module

* Addressed PR Comments

* i) Style fix ii) restore deleted file

* Introduced reshape:v1 downgrade

* Enable downgrade pass in dynamic backend

* Add unit test for dynamic backend downgrade pass

* Clang styles applied

* Apply unit tests name refactor based on code review
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Removed redundant pass

* Changed order of downgrade pass

* Changed order of passes in dynamic backend

* Rename input arg -> data

* Update node validation and shape propagation to support data rank and number of repeats to be different.

* Add type_prop tests

* Add UT for new tile cases

* style

* Modify CPU backend to support the new case.

* Fix backend selection in test

* Add new line back.

* Re-organize files. Create MLIR backend classes

* WIP

* Refactored. Code compiles

* Moved context to Runtime class to outlive compilation and execution

* style-apply

* Base Runtime class. Few other modifications

* Minor fixes

* Fixed Runtime::run() to take type-erased pointer

* renamed core compiler

* rename backend compiler

* rename runtime compiler

* PR feedback

* Fix build fails

* DynSlice was adjusted to specyfication

* Fixed documentation

* Fixed styles

* Fixed clang warning

* Introduced StridedSlice as separate op

* revert dyn_slice

* Fixed StrideSlice implementation

* Enable downgrade pass in dynamic backend

* Implemented upgrade/downgrade pass

* Added serialization

* Styles applied

* Styles applied. Part.2

* Updated dynamic backends list

* Move StridedSlice outside experimental

* Make Slice as v0 of StridedSlice

* Styles applied

* Styles applied

* Fixed clang error

* Code review remarks introduced

* Move GenerateMask up in Opset0Downgrade to keep alphabetical sort

* Style apply

* Initial draft start

* Add provenance doc

* Another effort at resolving doc build warning

* Revert file

* Revise provenance intro

* Ensure Clang dependencies update with new minimum version of clang needed

* PR review feedback, cleanup other change added to collab_ngai

* - WIP fusion pattern for softmax + cross entropy

* fix compiler error

*  make summation axis integer for the fusion pattern

* - Fusion pattern for sigmoid cross entropy bprop

* WIP callback implementation for fused sigmod+crossentropy fprop

* - implemented fprop softmax+crossentropy as single layer for numerical
stabilization
- added broadcasting nodes to fix elementwise assertions

* Added unit test case for functionality test

* Move the softmax + crossentropy fusion pass to core

* i) style fix ii)added missing header

* - Added new Fused Op for Softmax + CrossEntropy
- moved the decomposition to the Softmax + CrossEntropy FusedOp

* - Add SoftmaxCrossEntropy for fused tablegen
- Add serializer support for SoftmaxCrossEntropy
- fix documentation

* Added missing json file for unit test case

* Addressed PR comment

* Addressed PR comments

* - Fix fusion string

* - Style fix

* - Added Bprop for Softmax + crossEntropy

* - added SoftmaxCrossEntropy support when soft_lable is provided
- serailizer and deserializer support for SoftmaxCrossEntropyBprop

* - Added support in decompose_op for SM+CE bprop when ignore_mask is specified

* Updated Doc strinng

* - unit test case for SoftmaxCrossEntropy backprop with soft lables
- fixed decompose_op bug in bprop

* - if soft_label=true, capture pattern only if the labels dont have one
hot encoding

* - SoftmaxCrossEntropyBprop Support if ignore_index is specified

* add serialized files for unit test

* - fix softmax + CE pattern bug
- fix softmax + CE decompose_op() bug

* - change reduction_axes to int64_t type in fprop and bprop ctor

* - add soft_labels and ignore_index attribute to SM+CE fprop ctor

* - addition asserts in unit test to ensure SM + CE fprop and bprop fusion is successful

* - move reduction_axis computation to decompose_op from ctor to relax on
dynamic shapes

* Addressd PR Comments

* - suppprt for SM+CE for ignore_index and softmax=false

* - test case for SM+CE fprop with ignore_mask, soft_labels=false
- fix bug in decompose_op

* - refactor unit test case

* - fix PDPD unit test

* broadcast delta if shape mismatches

* -fix bdcast issue in decompose_op