* Unify test names for opset transformation passes

* Unify downgrade test names

* [ONNX] Added Expand op to ONNX importer.

* Added support only for static broadcating.

* Changed version of set from 8 to 1.

* Added test for expand op.

* make axes dynamic

* add ut

* update softmax deserializer

* check axes to be constant

* remove duplicates

* Implemented downgrade pass

* Using Pad:v1 in onnx_importer

* Downgrade transformation doc fixed

* Added downgrade pass for reduce_prod

* Using ReduceProd:v1 in onnx_importer

* Added ReduceProd:1 downgrade support

* Clang styles applied

* Downgrade pass added for all backends

* Added downgrade pass for reduce_prod

* Using ReduceProd:v1 in onnx_importer

* Added ReduceProd:1 downgrade support

* Clang styles applied

* Apply suggestions from code review

Changed pad_opset_pass to opset_downgrade
Co-Authored-By: Tomasz Socha <tomasz.socha@intel.com>

* Fix names

* Apply suggestions from code review

Removed redundant include, renamed tests
Co-Authored-By: Tomasz Socha <tomasz.socha@intel.com>

* Changed order of passes

* Changed way of op casting

* Changed order of passes

* Changed downgrade pass order of CPU backend

* Changed downgrade pass order of CPU backend

* styles applied

* [SPEC] Fixed NormalizeL2 (#3695)

* Fixed NormalizeL2

* style applied

* Fixed axes rank checking

* removed redundant comma

* Set keep_dims by function argument

* Improved error message

* Fixed casting method

* fix styles

* styles applied

* Fixed normalize tests

* unit tests names refactor
Co-Authored-By: Michał Karzyński <postrational@users.noreply.github.com>

* Disable not supported PlaidML tests

* Added missing EOF

* Change order of gemm operation

* Add Dot lit test

* style-apply

* Fix captures to avoid escapes on []

* Implemented downgrade pass

* Using Pad:v1 in onnx_importer

* Downgrade transformation doc fixed

* Downgrade pass added for all backends

* Apply suggestions from code review

Changed pad_opset_pass to opset_downgrade
Co-Authored-By: Tomasz Socha <tomasz.socha@intel.com>

* Changed order of passes

* Changed downgrade pass order of CPU backend

* Added reverse:v1 downgrade

* Code review remakrs introduced

* Fixed problem with foward declaration

* Modify convert op to convert from bf16 to float and vice-versa

* Add a check

* Remove conversion routines and use the convert op for casting

* disable unit tests for plaidml

* Cyphers/lastwarns (#3640)

* Build changes for -Wall

* Use properties

* Remove no-zero-as-null-pointer-constant

* add ##__VAR_ARGS__ workaround

* enable gnu-zero-variadic-macro-arguments warning

* fix gnu-zero-variadic-macro-arguments

* use PrintToDummyParamName

* remove ##__VA_ARGS__ workaround

* fix ##__VA_ARGS__ and enable gnu-zero-variadic-macro-arguments

* handle windows build

* use alternative fix to support VS compiler

* fix merge issue

* remove variadic macros from kernel_selectors

* replace remaining ##__VA_ARGS__

* fix missing braces

* Remove some clang warnings

* Warnings cleanup

* Implemented downgrade pass

* Using Pad:v1 in onnx_importer

* Downgrade transformation doc fixed

* Downgrade pass added for all backends

* Apply suggestions from code review

Changed pad_opset_pass to opset_downgrade
Co-Authored-By: Tomasz Socha <tomasz.socha@intel.com>

* Changed order of passes

* Changed downgrade pass order of CPU backend

* Code review remarks introduced

* add check for dynamic dimensions

* to_shape() -> rank()

* Delete unnecessary check

* Added in DeduceDynSlice suite to check dynamic dimension

* minor codestyle fix

* c-cast -> static_cast

* Added power constant folding

* Style apply

* Removed python operator pow

* Hotfix for negative axes in unsqueeze op (#3705)

* Hotfix for negative axes in unsqueeze op

* Review fix I

* Enable Gather with negative indices. (#3701)

* Enable Gather with negative indices.

* Address PR feedback.

* Remove GOE from Gather unit tests.

* merge error

* Disable test for MLIR

* Support non-mkldnn fallback for Batchnorm training bprop in CPU backend

* Skip unit test on PlaidML backend

* Change method of splitting data and filters for groups

* Add support for groups included in filters shape

* Add UT for groups in weights shape

* Add helper function to check if groups are in filters shape

* Review fix I

* Remove unused variables

* Skip test on PlaidML

* Review Fix II

* Internaly store groups as dimension instead of size_t

* Review fix III

* Add updating of m_groups in pre_validate_and_infer_types()

* Provenance for builders (#3644)

* Provenance for builders

* Tests

* Tests

* Update src/ngraph/node.hpp
Co-Authored-By: Sayantan Sarkar <sayantan.sarkar@intel.com>

* style

Finish migration

* Migration to master

* Handle op constructors that construct ops

* Update provenance for topk

* Add missing input (#3691)

* Add missing input

* If builder does nothing, don't dive into the inputs

* Reverse test

* simplify, add test

* Add test

* add test

* [MLIR] Add support for parsing nGraph tensor type

Initial commit that enables nGraph parsing. It's needed for testing.

* [MLIR] Enable nGraph dialect in ngraph-opt

This PR registers nGraph dialect in ngraph-opt and prepares
nGraph lowering pass for LIT testing, fixing all the related issues.
Among other things, lowering pass has to be turned into a function pass,
dead argument in constructor was removed and `convert-ngraph-to-affine`
flag was added.

* Fix issue with function name and multiple functions

* Extend module_function.mlir lit test

* [MLIR] Add support for parsing nGraph element types

It introduces initial support for parsing nGraph signed/unsigned
integer and floating point data types.

* [MLIR] Improve gather op lowering

This PR interchanges indices and param loops in gather lowering so
that a better memory access patter is generated. Fusion of gather
with other ops is also observed with this change.

* LayerNorm (#3630)

* Constructors.

Type prop.

Decompose LayerNorm.

Add serialize.

* Add dummy test case.

* Add dummy type prop test.

* Fix some build errors.

* Remove build errors.

* Update decompose for bprop.

* Change begin_norm_axis default value to 1.

* Style.

* Reorder class members.

* Add actual type prop tests.

* Add fprop test.

* Working on bprop test.

* Bprop tests.

* Allow flattened scale and bias.

* Add support for flattened scale and bias.

* Fix incorrect type_name.

* PlaidML: Decompose fused_op LayerNorm

* Update Backprop constructors.

* PlaidML: Add missing header file.

* Remove doc about removed param.

* Fix type prop tests.

* PlaidML: Disable unit test.

* Fix stats flattening axes bug.

* Upgrade description to type_info.

* [MLIR] Add support for parsing nGraph tensor type

Initial commit that enables nGraph parsing. It's needed for testing.

* [MLIR] Enable nGraph dialect in ngraph-opt

This PR registers nGraph dialect in ngraph-opt and prepares
nGraph lowering pass for LIT testing, fixing all the related issues.
Among other things, lowering pass has to be turned into a function pass,
dead argument in constructor was removed and `convert-ngraph-to-affine`
flag was added.

* Fix issue with function name and multiple functions

* Extend module_function.mlir lit test

* Improve module_function.mlir test

Remove ngraph to affine dialect conversion since we just need to verify
that we can parse and print modules and functions.
Add verification for parsing the printed code.

* [MLIR] Add support for parsing nGraph element types (#3665)

* [MLIR] Add support for parsing nGraph element types

It introduces initial support for parsing nGraph signed/unsigned
integer and floating point data types.

* Improve LIT tests

Test parsing and printing of types separately from lowering to affine
since these tests will evolve differently, particularly for tensor
types.

* Missed file

I left this file behind in the previous commit

LIT creates "Output" folders for each directory with LIT tests.
Before this change, LIT tests were executed in source directory and
"Output" folders had to be removed manually. Git also showed them as
folders to be potentially tracked. This PR changes LIT execution to
build directory to avoid this problem. Similar approach is used in MLIR.

* Strided slice

* Strided slice

* default value for strides

* Added new strided slice test, enabled old tests, refactoring

* Refactoring

* Autogenerated file: dyn_replace_slice tests

* Renaming

* Fix codestyle

* Fix build on MacOS

* Fix codestyle

* Add several tests in unit_test.manifest to skip it on PlaidML

* Disable all dyn_replace_slice tests on PlaidML

* Add new enum: RoundingType for pooling operations

* Add v1::AvgPool op

* Add v1::MaxPool op

* Fix comments format

* Fix problem with forward declaration

* new UT & fix some bugs

* add pdpd autob spec and ut

* add pdpd autob to pass check

* add dummy dynamic ut

* add dynamic test case

* use int64_t

* pass dynamic ut

* add pdpd style kernel

* handle pdpd validation

* add dummy pdpd style bcast

* implement pdpd style bcast

* add validation

* use output arg

* use ngraph_check
Co-Authored-By: Adam Procter <adam.m.procter@intel.com>

* enable error print

* accuracy mismatch in plaidml

* fix ut on windows

* make separated tests

* fix trailing one case

* fix warning

* Allow TBB to be excluded from CPU build.

* Change some CMake scope.

* m_use_tbb can be removed if TBB is not enabled.

* Revert some CMake linkage scope as it breaks unit test.

* Migrate changes from #3652.

* test bfloat16 with CPU maxpool

* Move test to cpu_test

* convert result from bfloat16 to float

* Modify result op to support bfloat16

* Correct comment

* Add a simple convolution test case

* initialize floats with float literals

* Guard bf16 tests with MKLDNN_VERSION_MAJOR >= 1

* Convert remaining dynamic_pointer_casts for ops
Make is_type a function instead of a method
Direct implementation of `is_parameter`

* Add exports

* Missing includes

* headers

* missing export

* Gather:v1 was introduced

* Added support for negative axis

* Removed unsused serialization

* Code review remarks introduced

* Change returned type of get_axis method

* Code review remarks introduced

* Chnaged axis_node to scalar during transformation

* Clang style applied

* Fixed clang errors

* style

* Add RandomUniform op

* Missing files

* Make CPU compile again (RandomUniform tests still don't pass)

* Bop users of existing RNGState class and reorder some comment junk

* Try to bop RNGState in gcpu

* Add RandomUniform to CPU manifest

* Add RandomUniform to PlaidML manifest

* Add .rst for random_uniform

* Clean up junk in the .rst

* Change UniformRNGState to always use double internally

* Change weird test failure message

* Compilation issues

* Fixes bug in provenenace for subgraph replacement

* Updates unit tests for the provenance algorithm fix

* Changes provnance set to ordered set for better consistency in iteration order.

* Fix unsigned comparison and implicit double conversion

* Eliminate sign/unsigned compare warnings, implicit double conversion

* Missed type

* Neww int type

* omp compromise

* style

* Pad:v1 was introduced

* Fixed problem with foward declaration

* Code review remarks introduced

* Addtinal asserts and unit-test for Pad:v1 introduced

* Handled optinal arg_pad_value input

* Fixed unit tests messages and clang styles applied

* Styles applied, checking rank improved

* Updated changes.md

* Revert "Updated changes.md"

This reverts commit 8ee16e580705275ee0719648d5251021354e4d84.

* Clang warning fixed