* constexpr ctor for EnumMask

* added pass properties to core passes.

* added unit tests.

* minor fixes.

* Extend lp-norm functions to take bias.

* Move lp-norm utilities to nGraph core op/util.

* Move norm files to builder directory.

* Apply clang-format.

* Sceleton for GRN operation.

* Add GRN implementation.

* Fix reshape utility function.

* Address review comments.

* Add using namespace std.

* Review comments.

* Few fixes in grn implementation.

* Clang format.

* Basic UT.

* Fix expected data.

* Add more UT and skip them on IGPU.

* Review comments: const correctness and remove using namespace std statement.

* Unblock GRN on IGPU.

* Get back GRN op case to switch.

* merge error

IntelGPU backend: Make ScaleShift op as not supported in callback of FusedOpDecomposition pass (#2940)

* IntelGPU backend: Make ScaleShift op as not supported in callback of FusedOpDecomposition pass

* style

* merge error

* Style was correct.  Return back 0965fb5 changes

* merge error

This PR removes compiler warnings like this one:

```
src/ngraph/frontend/onnx_import/utils/reduction.hpp:73:28: warning: prior to the resolution
  of a defect report against ISO C++11, local variable 'op_node' would have been copied
  despite being returned by name, due to its not matching the function return type
  ('shared_ptr<ngraph::Node>' vs 'shared_ptr<ngraph::op::ArgMin>') [-Wreturn-std-move-in-c++11]
                  return op_node;
                         ^~~~~~~
```

IntelGPU backend: Change clDNN mode of Relu op to allow ConvolutionBiasAdd fusing inside clDNN (#2939)

* Add placeholder for doc versioning

* Finalize module to include tags of verified releases only

* Add fused Squeeze op

* Use fused Squeeze op in ONNX importer

* Update serializer

* Add unit tests

* Add type prop tests

* Change Squeeze signature to accept a dynamic input for axes

* Update src/ngraph/op/fused/squeeze.cpp
Co-Authored-By: Adam Rogowiec <adam.rogowiec@intel.com>

* Code review comments

* Fix failing unit test

* Code review comments

* Code review comments

* style

* Add op to iGPU backend

* Add op to iGPU backend

* Fix clang compiler warnings

* Remove unintended file.

* style

* Not part of PR

* Another extra closure ref

* More warnings from merges

* Lambda arg was used

* Remove remaining osx compiler warnings

* style

* Try to avoid compiler warning

* Same for the other test

* IntelGPU backend: Enable FusedOpDecomposition pass

* PR2912. Adress comments.

I had renamed the directory at one point during development but forgot to update this

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Fix compile errors.

* Fix incorrect index.

* Fix UT typo.

* Interpreter passes UT.

* Fix more bugs.

* Apply style.

* Add shape check for updates tensor.

* Merge typo

* Fix clang compiler warnings

* Remove unintended file.

* style

* Not part of PR

* Another extra closure ref

* More warnings from merges

* Lambda arg was used

* Add ScaleShift operator

* Add ScaleShift to serializer

* Add UT for ScaleShift

* Add type_prop tests for ScaleShift

* Style-fix

* Skip tests on Intel GPU

* Review fix 1

* Style fix

* add gemm operation

* style apply

* erase if statement

* fix the test

* enable tests

Change CPUTensorRole -> TensorRole in ngraph core and utilize it in GPU backend instead of a local enum. This is also now use in NNP backend. (#2900)

* Dump the expected and actual values for NgraphTestCase

* Adapt to changes in master

* Some docs and API unification

* Extend lp-norm functions to take bias.

* Move lp-norm utilities to nGraph core op/util.

* Move norm files to builder directory.

* Normalize fused operator implementation.

* Fused op boilerplate.

* Fix node validation and normalization across spatial axes.

* Add UT normalize across CHW with scalar scale.

* Fix expanding input tensor to 4D.

* Add more UT for 3D and 2D.

* Add more UT, with scale and across HW.

* Update to new localization of l2_norm function.

* Add type_prop UT and update gpu/igpu manifests.

* Apply clang-format.

* Add positive UT for type_prop.

* Update unit test manifests.

* Address review comments.

* Add using namespace std.

* Remove unnecessary std prefixes.

* Remove blacklisted unittests for GPU.

* Apply clang-format.

* Review comments.

* Fix clang errors.

* Basic mean normalization

* Add NVM to serializer

* Add test for mean normalization

* Add support for across_channel atribute

* Add test for mvn_mean_normalization splited by channels

* Assume that data have n and c channels

* Add support for normalize_variance attribute

* Add test for full mean variance normalization

* Add type prop test

* Skip tests on GPU

* Use ngraph builder functions instead of my own

* Update mvn.cpp

* Change order in initializer list

* Review fix

* remove throw from dtor (#2854)

* Migrate from master (#2858)

* Migrate from master. (#2866)

* Add build option NGRAPH_ENABLE_CPU_CONV_AUTO to enable/disable mkldnn convolution_auto for CPU backend. (#2868)

* Fix a bug in mkldnn emitter. (#2878)

* Fix data type for conv builder (#2885)

* Fix data type for conv builder

* Added support for other data types

* Migrate #2889 from master (#2891)

* Migrate from #2884 (#2897)

* Migrate #2864 (#2901)

* Migrate #2864

* Remove extra changes

* Copy PR #2894 to r0.19 branch (#2903)

* Extend lp-norm functions to take bias.

* Move lp-norm utilities to nGraph core op/util.

* Move norm files to builder directory.

* Apply clang-format.

* Address review comments.

* Add using namespace std.

* Review comments.

* Fix clang errors.

* Enable non-constructor use of shape inference

* Move GPU BatchNormTrainingWithStats shape inference out of the constructor

* Addressed PR feedback

* Add more slicing attributes to dynslice

* Added output shape computation for dyn slice

* Bug fixes and added unit tests

* Style fix

* Addressed PR feedback

* Move HardSigmoid to nGraph fused operators.

* UT for HardSigmoid fused operator.

* Add type_prop UT.

* Activation function parameters and hardsigmoid activation function.

* UT for lstm with hardsigmoid activation function.

* Reorder operations in implementation.

* Fix unit tests.

* Fix typo.

* Change stored activation function to pure function pointer.

* Apply style-check.

* [ONNX] Refactor LSTM tests to use NgraphTestCase

* Enable passing instance values to comparator

* Style apply.

* Fix style, syntax

* Change order of class member to fix errors.

* Switch to single-precision parameters.

* Disable unit test for IGPU.

* Fused Clamp op implementation

* Basic clamp test with some edge cases

* Dump the expected and actual values for NgraphTestCase

* Validate the min and max params for Clamp

* Use clamp in clip

* Disable Clamp and its test on iGPU

* Use getters for Clamp's parameters

* Validate clamp's params in pre_validate_and_infer_types

* Unit tests for clamp op validation

* Revert "Dump the expected and actual values for NgraphTestCase"

This reverts commit 3a029d70e62339ee84aadf2bf16e418281b85ff7.

* Clamp op docs

* Add create_dynamic_tensor function to Backend signature

* Add skeleton of dynamic wrapper class

* Simple test for construction

* Some progress on dynamic tensor creation

* Compile dynamic wrapper into core; change config string to a factory option

* Add wrapped executable, working on simple example

* Add wrapped dynamic tensor

* Update to match new tensor API

* Update wrapper to clone the graph; basic dyn test now passes

* Update call_with_validate to grok dynamic

* Make the unit tests a little prettier

* Make get_element_type virtual

* Change dynamic tests to be backend-parametric; fix get_element_type check for dyn tensors

* Add dynamic.in.cpp

* CODEOWNERS entry for dynamic_wrapper

* Remove overly-accommodating behavior for create_dynamic_tensor on non-dynamic BEs

* Pass enable_performance_collection to wrapped compile() calls

* More comments in the 'abc' test

* Fix 'create' wrapper in pybind11

* Remove unnecessary WrappedStaticTensor class

* Better names for the classes, and add some docstrings

* Fix pybind for 'create' to return shared_ptr now

* Add interpret_as_scalar helper

* Add interpret_as_scalar to OneHot

* clang-format

* Remove interpret_as_scalar from OneHot

We currently only support OneHot with constant depth

* Review comments

* Move HardSigmoid to nGraph fused operators.

* UT for HardSigmoid fused operator.

* Add type_prop UT.

* Reorder operations in implementation.

* Fix unit tests.

* Fix typo.

* Apply style-check.

* Switch to single-precision parameters.

* Disable unit test for IGPU.

* Some hacks for graph visualization

* More betterer

* Remove debug prints

* Cheap temporary hack to deal with zombie users issue

* Less hacky fix for the zombie users issue

* Change to use get_name instead of get_friendly_name; misc. cleanup of dot output

* Allow '.dot' as VisualizeTree output format, and make it default

* Cleanup, and some documentation of this jump distance nonsense

* Comment edits

* Another comment edit

* Fix typo

* Remove reverse_topological_sort function (it's not needed)

* Rewrite the MPI_Finalize

* Change destructor to virtual finalize

* Test

* More bug fix

* Delete space

* Add variable to control initialization and finalization

* Add a bool variable to control initialization and finalization for openmpi and mlsl