* Interpreter working

* cleanup

* cleanup

* add CPU backend

* Update the rest of the backends

* update python API

* update test_case to use new shared_ptr

Added NGRAPH_JSON_ENABLE to conditionally enable code/features relying on external JSON libraries (#2821)

* - add method to determine if the function contains nodes with dynamic shape
- add virtual method to node to determine if the node contains any partial shape.

* - add support to reshape op to determine if the reshape node as dynamic attributes

* Address PR comments

* - check all the inputs to determine if the node has dynamic_shape
- addressed Adam comments

* - add support to abort graph match if the nodes are dynamic

* Addressed PR comments

* - remove strict check on dynmic shape in the matcher

* Update CPU backend.

* Update INTERPRETER backend.

* Update unit tests.

* Don't use std:: prefix.

* Convert to bool for GPU backend in DEX mode.

* Handle boolean elements in Intel GPU backend.

* Disable convert to bool UT for IGPU.

* Update quoting style to fix errors raised by updated version of flake8.

* select op add types

* add a test for double for select

* Update intelgpu_op_custom_kernels.cpp

* batch dot WIP.

* cpu backend refactor and unit tests pass.

* WIP.

* batch dot interpreter impelementation.

* minor clean up.

* more clean up.

* patching the gpu backends.

* added more tests, fixes, etc.

* fixed compile error.

* renamed batch dot to batch matmul.

* refactor WIP.

* fixes some tests and formating.

* more fixes.

* Skeleton for shape specialization

* Change signature of as_constants to return the vector, with zero elements in case of failure

* Add as_constants implementation for Concat

* Some comments

* Add check for element types of replacements; fix comment typo

* Address PR feedback, and add some comments

* An extra check, and a comment, ahead of the memcpy

* Minor comment wording fix

* Add erf op, interpreter kernel and unit tests

* Add review feedback and fix unit tests

* Add unsupported op to GPU and IntelGPU

* Add one more test

* Add support for negative padding

* Use std::bind in pad builder check

* Add support for negative padding in CPU backend

* Updated kernel to do pad+slice

* Remove type conversion warnings

* Fix review comments

* Remove interior padding from core op and interpreter stuff

* Update backends other than GPU for retirement of padding_interior

* Skeleton of support for edge/reflect padding

* Post-merge cleanup

* Attempt reference implementation for EDGE.

* Fix the edge-padding reference, and add some unit tests

* Implement REFLECT padding ref; add tests

* Fixes to the CPU stuff so it compiles now

* Fix test

* Add support for different pad modes

* Restore a stub get_padding_interior function, and tweak some stale comments

* Update ONNX importer to not supply interior padding value; add checks for padding-too-small for EDGE and REFLECT

* Typo

* Bop a warning

* Attempt fix to INTELGPU backend

* Attempt another fix to INTELGPU backend

* Fix pyapi

* Style apply

* Add support for padding modes

* Remove unnecesary node validation checks

* Remove tests for minimal reflect and edge pad

* Remove commented tests

* Remove unnecesary Asserts

* Little update of pad documentation

* Monospace for pad_mode options

* Revert "Remove tests for minimal reflect and edge pad"

This reverts commit 81e4787ea47195b832cab1452dde698bc05776fe.

* Revert "Remove unnecesary node validation checks"

This reverts commit 7e68db7564f3c9b1fd40e7db1d1bda4e0677cad9.

* Test only spatial dims

* axis -> spatial axis

* Fix typo

* Style check

* Update test

* Add CoordinateDiff include

* Remove pad_mode from tree visualization

* Convert padding into NVShape

* Skip failing tests on GPU

* Revert mode change

* Remove merge artifact

* Rename pad kernel into pad_ref

* change float comparisons from == to all_close_f

* style

* address a few more direct float comparisons

* add missing include

* specify tightest tolerance for Broadcast and Reshape tests

* Increased tightness of float testing

Increased tightness of float testing via MIN_FLOAT_TOLERANCE_BITS parameter

* style

* rename and document the node name methods

* address more references to renamed methods

* fix compile error

* fix build error

* Reuse memory for CPU backend.

* Use NGRAPH_REUSE_MEMORY to enable memory reuse.

* Add a test.

* Move make_function to test_tools.cpp.

* Add more comments.

* Address PR Feedback: add a method to CPU backend.

* *Add a member to CPUOpAnnotations to remove redundant code.

*Overload compile function for CPU backend.

* Move make_function out of test_tools.

* Address PR Feedback.

* Use modified liveness analysis in CPUMemoryAssignment pass.

* Use lambda expression.

* Fix style error.

* Check if any user of the tensor has destructive io when building tensor alias map.

* Fix a bug.

* Check if tensor has multiple users.

* Allow tensor alias for destructive oi node.

* Update multiple_users_tensor set along the chain of in place ops.

* No tensor alias if input is parameter or constant.

* Use buffer sets in cpu memory assignment,
tensors sharing the same memory buffer are put into the same set.

* Add more checks and do not combine sets when allowing destructive oi.

* Style fix.

* Do no allow destructive oi if the input tensor uses function input memory.

Update set label.

* Add unit tests.

* Style fix.

* Get the correct size for memcpy when the input is padded.

* Style fix.

* Address PR feedback.

* Address PR feedback.

* Move make_function in cpu_test after #if 0 and before the disabled test.

* Add utility functions.

Use iterator.

Rename variables.

* Add pass attributes and move cpu memory assignment to common passes (#2504)

* Int unit tests that fail with bfloat

* move tests out of single file

* style

* Incorporate Bob's comments

* edits

* Incorporate comments

* style

* edits

* Add failing test to intel gpu manifest

* comments incoprorated

* use calls for new backend API in unit tests

* fix compile error

* fix compile error

* IntelGPU backend: Slice operation datatypes fix

* e correct type for int64_t

* Divert dynamic offset to reference

* update gpu manifest

* Avoid dynamic cast

* Retire Reduce, ReduceWindow, SelectAndScatter

* Remove lingering AnyAllReplacement code

* Remove apparently-now-unused macro

* Remove lingering op/reduce.hpp includes

* Remove FunctionCall

* Update Python stuff to remove FunctionCall, Reduce

* Add Any/All tests to GPU manifest

* Remove deleted .hpp #include from gpu_compiled_function.cpp

* Restore reduce_function.cpp since that is where the All/Any implementations ended up residing

* Add reduce_function.cpp back into CMakeLists.txt

* Remove #include of deleted reduce.hpp

* Re-remove AnyAllReplacement from GPU passes

* Remove deleted #includes from gpu_internal_function.cpp

* Remove git conflict stuff (whoops)

* Add newline at EOF, per review comment

* Address flake8 complaint about unused import

* Simplified & tightened all_close_f parameters

Removed specification of mantissa bits for all_close_f in favor
of just specifying tolerance bits. Tightened up all_close_f default.
Fixed LRN unit test which had insufficient result precision to pass
tighter all_close_f tolerance.

* Addressed PR comments.

Reworked mantissa bit and tolerance constants.
Clarified and improved graph comparison tolerance calculation flexibility.
Clarified unit test tolerance testing.

* update licenses for 2019

* style

* make validate public

* move compile call outside of call for unit tests

* fix compile error

* one more error

* Enable in place slice when slice's arg is function input.

* Add a corner case.

* Add codegen support.

* Set the correct offset for in-place-slice when there is a chain of in place ops starting from parameter.

* files pulled from bob/winbuild

* fix compile problems

* fix a few windows build errors

* add windows file to exclude from git

* add comment why change was made

* revert obsolete change

* more cleanup

* building interpreter and unit test on windows with DLLs

* Add flag for windows to export all symbols. Short term fix.

* enable MD build

* address warnings

* dump all windows build results to a single directory

* fix windows backend dll open issue

* remove debug

* fix file iterator for windows

* fix merge error

* fix test failure

* change header from h to hpp in hopes of making python happy

* address more linux build issues

* fix visibility enable

* change compile call to return Handle

* make CPU require compile() before call()

* fix unit tests to call compile() before call()

* fix failing ops

* update unit test

* revert some changes

* more fixups

* more diff cleanup

* a few more issues addressed

* more fixes

* update API

* more updates

* fix test_ops.py

* fix

* another attempt to fix

* fix unit test

* fix test error

* - modified cpu_assignment pass to support bn with input 5D
- added test cases for 5D bn and 5D bn+relu

* - Address PR comments
- used mkldnn_utils to validate bn for mkldnn

* fix compilation error

* Addressed PR comments
- added helpers in mkldnn_utils for assigning ngraph Op as MKLDNN op
- helper funnction for bn mkldnn assignment

* fix clang error

* Fix batchnorm argument order, cleanup some comments, fix backprop

* Merge error

* Clean up training function, organize inference test

* BatchNormInference tests

* Training case

* Training test

* Fix autodiff BatchNorm test

* Cleanup

* Move file to doc checkout

* Update disabled test name in igpu manifest
Fix unnused variable

* Unit tests disables

* Review comments

* add cuda reduce for product and max and added tests

* a quick fix for empty reduce axis and 0 axis

* adding min cuda reduce

* add for min

* fix bug and format

* add another min test

* adding sum to the mix and adding tests to intelGPU manifest

* Incorporate Chris's first comment + clang

* Some mods to the last commit

* Addressed Bob's comments + added more tests int8

* Added more int8 tests + added tests to IntelGPU manifest

* CI test failure debug attempt

* clang

* edit

* Adding the CPU failing test to manifest

* pulled changes from master to address travis ci build failure

* Move ParameterVector and ResultVector to the ngraph namespace where they belong

* update python wrapper

* more python fixes

* style

* Update setup.py

* fix some new code

* adding i32 as quantized type

* code format

* mask gpu unit tests

* unused variable

* intel gpu unit test manifest

* fix typo in unit test manifest

* add softmax cuda support

* optimize block size

* remove debug info

* remove debug

* style

* remove unused

* remove cudnn softmax

* format

* using nullptr

* move helper, add test

* fix style

* using all_close_f

* using kahansum

* style

* remove commentted out code

* Add ShapeOf op

* Helps to check in the source files

* Add shape_of_scalar to unit test manifests

* Add missing include to gpu_emitter.cpp

* Change 'this op is experimental' wording per @indie's suggestion

* New idea: let's try not mallocing 300 terabytes

* Update interpreter implementation

* Add in-place-slice optimization for CPU backend.

* Modify slice emitter function for in place slice.

* Allow arg node to have multiple outputs for in place slice.

* Remove unused variable.

* Add CPUExecutionContext argument to slice builder.

* Address PR feedback: move computation out of the functor.

* Move size computation out of the functor for in place concat.

* When CUDNN_DATA_TYPE == CUDNN_DATA_DOUBLE, it appears that the cudnn calculated workspace size is incorrect.
Adding a temporary fix here until the underlying issue is found.

* Add softmax test illustrating bug in cudnn impl.

* disable new unit test in intel GPU

* add nop backend

* nop backend

* fix flag name

* add new switch to cmake output of switch settings

* add new unit test to igpu manifest

* remove redundant test