* SquaredDifference implementation

* Broadcast input before using it

* Simple test of SquaredDifference

* SquaredDifference validation tests

* Formatting adjustments

* Docs correction

* Exclude the unit test on iGPU

* Keep the includes in a single group

* Update intelgpu_backend.cpp

* Update unit_test.manifest

* UT for the broadcasting path

* Add test for i32 gather

* Add support for ints to Gather op

* Move helper function to anonymous namespace

* Add more types

* Use static_cast instead of the old one

* Style fix

* Skip tests on GPU

* Add more tests

* Skip tests on gpu

* Change bool to char

* Supports more cases for Convolution Bias fusion and also removes redundant namespace qualifiers in core_fusion.cpp

* added unit test

* select all fusions

* constexpr ctor for EnumMask

* added pass properties to core passes.

* added unit tests.

* minor fixes.

* Extend lp-norm functions to take bias.

* Move lp-norm utilities to nGraph core op/util.

* Move norm files to builder directory.

* Apply clang-format.

* Sceleton for GRN operation.

* Add GRN implementation.

* Fix reshape utility function.

* Address review comments.

* Add using namespace std.

* Review comments.

* Few fixes in grn implementation.

* Clang format.

* Basic UT.

* Fix expected data.

* Add more UT and skip them on IGPU.

* Review comments: const correctness and remove using namespace std statement.

* Unblock GRN on IGPU.

* Get back GRN op case to switch.

* merge error

* Add fused Squeeze op

* Use fused Squeeze op in ONNX importer

* Update serializer

* Add unit tests

* Add type prop tests

* Change Squeeze signature to accept a dynamic input for axes

* Update src/ngraph/op/fused/squeeze.cpp
Co-Authored-By: Adam Rogowiec <adam.rogowiec@intel.com>

* Code review comments

* Fix failing unit test

* Code review comments

* Code review comments

* style

* Add op to iGPU backend

* Add op to iGPU backend

* Fix clang compiler warnings

* Remove unintended file.

* style

* Not part of PR

* Another extra closure ref

* More warnings from merges

* Lambda arg was used

* Remove remaining osx compiler warnings

* style

* Try to avoid compiler warning

* Same for the other test

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Temp save.

* Fix compile errors.

* Fix incorrect index.

* Fix UT typo.

* Interpreter passes UT.

* Fix more bugs.

* Apply style.

* Add shape check for updates tensor.

* Merge typo

* Fix clang compiler warnings

* Remove unintended file.

* style

* Not part of PR

* Another extra closure ref

* More warnings from merges

* Lambda arg was used

* Add ScaleShift operator

* Add ScaleShift to serializer

* Add UT for ScaleShift

* Add type_prop tests for ScaleShift

* Style-fix

* Skip tests on Intel GPU

* Review fix 1

* Style fix

* Dump the expected and actual values for NgraphTestCase

* Adapt to changes in master

* Some docs and API unification

* Extend lp-norm functions to take bias.

* Move lp-norm utilities to nGraph core op/util.

* Move norm files to builder directory.

* Normalize fused operator implementation.

* Fused op boilerplate.

* Fix node validation and normalization across spatial axes.

* Add UT normalize across CHW with scalar scale.

* Fix expanding input tensor to 4D.

* Add more UT for 3D and 2D.

* Add more UT, with scale and across HW.

* Update to new localization of l2_norm function.

* Add type_prop UT and update gpu/igpu manifests.

* Apply clang-format.

* Add positive UT for type_prop.

* Update unit test manifests.

* Address review comments.

* Add using namespace std.

* Remove unnecessary std prefixes.

* Remove blacklisted unittests for GPU.

* Apply clang-format.

* Review comments.

* Fix clang errors.

* Basic mean normalization

* Add NVM to serializer

* Add test for mean normalization

* Add support for across_channel atribute

* Add test for mvn_mean_normalization splited by channels

* Assume that data have n and c channels

* Add support for normalize_variance attribute

* Add test for full mean variance normalization

* Add type prop test

* Skip tests on GPU

* Use ngraph builder functions instead of my own

* Update mvn.cpp

* Change order in initializer list

* Review fix

* Enable non-constructor use of shape inference

* Move GPU BatchNormTrainingWithStats shape inference out of the constructor

* Addressed PR feedback

* Add more slicing attributes to dynslice

* Added output shape computation for dyn slice

* Bug fixes and added unit tests

* Style fix

* Addressed PR feedback

* Move HardSigmoid to nGraph fused operators.

* UT for HardSigmoid fused operator.

* Add type_prop UT.

* Activation function parameters and hardsigmoid activation function.

* UT for lstm with hardsigmoid activation function.

* Reorder operations in implementation.

* Fix unit tests.

* Fix typo.

* Change stored activation function to pure function pointer.

* Apply style-check.

* [ONNX] Refactor LSTM tests to use NgraphTestCase

* Enable passing instance values to comparator

* Style apply.

* Fix style, syntax

* Change order of class member to fix errors.

* Switch to single-precision parameters.

* Disable unit test for IGPU.

* Fused Clamp op implementation

* Basic clamp test with some edge cases

* Dump the expected and actual values for NgraphTestCase

* Validate the min and max params for Clamp

* Use clamp in clip

* Disable Clamp and its test on iGPU

* Use getters for Clamp's parameters

* Validate clamp's params in pre_validate_and_infer_types

* Unit tests for clamp op validation

* Revert "Dump the expected and actual values for NgraphTestCase"

This reverts commit 3a029d70e62339ee84aadf2bf16e418281b85ff7.

* Clamp op docs

* Add create_dynamic_tensor function to Backend signature

* Add skeleton of dynamic wrapper class

* Simple test for construction

* Some progress on dynamic tensor creation

* Compile dynamic wrapper into core; change config string to a factory option

* Add wrapped executable, working on simple example

* Add wrapped dynamic tensor

* Update to match new tensor API

* Update wrapper to clone the graph; basic dyn test now passes

* Update call_with_validate to grok dynamic

* Make the unit tests a little prettier

* Make get_element_type virtual

* Change dynamic tests to be backend-parametric; fix get_element_type check for dyn tensors

* Add dynamic.in.cpp

* CODEOWNERS entry for dynamic_wrapper

* Remove overly-accommodating behavior for create_dynamic_tensor on non-dynamic BEs

* Pass enable_performance_collection to wrapped compile() calls

* More comments in the 'abc' test

* Fix 'create' wrapper in pybind11

* Remove unnecessary WrappedStaticTensor class

* Better names for the classes, and add some docstrings

* Fix pybind for 'create' to return shared_ptr now

* Move HardSigmoid to nGraph fused operators.

* UT for HardSigmoid fused operator.

* Add type_prop UT.

* Reorder operations in implementation.

* Fix unit tests.

* Fix typo.

* Apply style-check.

* Switch to single-precision parameters.

* Disable unit test for IGPU.

* wip

* Add support for storing constant array of constant values as a single values that is automatically broadcast on deserialize

* revert some changes to serializer.cpp

* fix all_close_f to support nan and inf to allow for unit test

* update unit tests to pass for all_close_f update

* fix bug with i64

* address compile issues?

* change function name to be more accurate

* fix compiler error

* [ONNX] Hardmax implementation in the onnx importer

* [ONNX] More generic handling of types in hardmax

* [ONNX] Support for doubles in EmbeddingLookup CPU builder

* [ONNX] Throw when the provided axis is out of range

* [ONNX] Skip the hardmax test on GPU

* Unused headers clean-up

* refactor: move the identity matrix generator to common.hpp

* ASSERT_VALID_ARGUMENT for axis range validation

* Adapt to the code changes in master

* [ONNX] Refactor LSTM tests to use NgraphTestCase

* Enable passing instance values to comparator

* Review comments

* quantization cleanup

* offset changed to zero point

* fix failing tests

* code style

* code style

* Add Tile op

* Added Tile op header to GPU backend

* Add dummy GPU tile emitter

* Interpreter working

* cleanup

* cleanup

* add CPU backend

* Update the rest of the backends

* update python API

* update test_case to use new shared_ptr

* Move transpose and flatten to ngraph op utils dir

* Move gemm operator into ngraph fused ops

* Style fix

* Add Gemm to serializer

* Add type_prop test for gemm

* Use Gemm default values

* Add UT for Gemm

* Fix comments

* Little cleanup

* Remove artifact headers

* Fix gemm documentation

* Skip gemm test on GPU

* Add test for broadcasting input C

* Review fix pt. 1

* Fix typo

* Fix the cpu thread_safe_calls test on Windows.

* Use notify_one.

* ngraph core changed

* cpu bits + pattern

* change perms

* revert std::cout to NGRAPH_DEBUG

* fix comp errors

* fix comment

* more comment fixes

* Remove callback argument

* clean up.

* fixed tests.

* more fixes for backends.

* fixe namespace.

* similar fix for recurrent matcher, and improves.

* fix build.

* - Adding DetectionOutput and Interpolate layers

* Adding Unit tests

* Name fix

* Klocwork issues.

* Revert to dynamic_pointer_cast

* - add support to algebriac simplification to check dynamic shapes against the Pass Properties

* - added PassProperty to RecurrentMatcher
- added checks to check for dynamic function state  and PassProperty in GraphRewrite before applying graph optimization
- optimize number of calls to f->is_dynamic() in AlgebraicSimplification

* - make changes to Algebriac Simplicfication graph pass to accept PassProperty

* - test case for AlgebraicSimplification pass properties
- set the Pass Property in the pass ctor

* Address PR comments

* fix bug in pass manager

* Addressed PR comments

* Basic float16

* Basic fp16 support

* typo

* Change CPU backend to use PassConfig instead of backdoor for codegen

* move is_codegen decl to output dex only flag

* revert change

* Generalize types in general convolution

* type-o

* rounding

* Do prod wide

* templatize conv in cpu/kernel & add u8u8 support for Qconv

* Remove cast function

* Avoid compiler warning

* Merge problem

* Implement thread safe calls.

Create MKLDNN primitives on first iteratin for quantized_concat.

* Add buffer_data to CPURuntimeContext.

* Fix bugs.

* Modify unit test.

* Swap vectors of mkldnn primitive pointers for CODEGEN.

* Fix a bug.

* Address PR feedback.

* Rename variables.

* Update Gather, GatherND, and DeconvolutionBias.

* Fix style error.

Disable cpu thread_safe_calls test on Windows.