* Fix accuracy issue

* Style fix

Cleanup runtime context in CPU_CallFrame Destructor

Moving the channel part of the sum into an inner loop lets padding be ignored
once per position rather than once per channel/position. This order of non-precise
summation also seems to be closer to other convolution implementations.

Add options to test generator for controlling precision of tests for debugging purposes,
and fix another python3 problem.

* Delete old stack diagram

* Update first paragraph

* Update introduction.rst

* Update introduction.rst

* Update introduction.rst

* Update introduction.rst

* Introduction graph optimization diagram

* Update introduction.rst

* Introduction kernel to deep learning frameworks

* Update introduction.rst

* Update introduction.rst

* Delete intro_kernel_to_fw.png

* Introduction kernel to frameworks with accent

* Update introduction.rst

* Update introduction.rst

* Update introduction.rst

* Introduction multiplying kernels

* Update introduction.rst

* Update introduction.rst

* Update introduction.rst

* Update introduction.rst

* Update introduction.rst

* Delete intro_kernel_to_fw_accent.png

* Introduction kernel explosion image

* Update introduction.rst

* Update introduction.rst

* Update introduction.rst

* Edit introduction to be relevant to a wider audience

* Refine intro

* writing thru another draft

* Another batch of updates

* Tie the conclusion to the intro

* Clean up the doc

* First reviewer feedback done!

* fix typo

* fix typos

* Minor formatting fixes

INTELGPU: Fix names duplication of generated supporting primitives for Convolution* operations (#2642)

* Adds new core op DynBroadcast

* Adds new core op DynBroadcast

* Fixes build error caused by recent changes in node validation API

* Addresses code review comments.

* Moves new op under experimental.

* Fixes style errors.

* Silee2/external project rpath (#2525)

* Set rpath for mkl-dnn.

* Set library rpath to  on Linux.

* Use patchelf to set rpath of prebuilt mklml library.

* Add patchelf to Linux Dockerfiles.

* Revert "Add patchelf to Linux Dockerfiles."

This reverts commit 1769505a866061552942e19467ddcc0dad0922e8.

* Revert "Use patchelf to set rpath of prebuilt mklml library."

This reverts commit 726f6553a0450520328607177d64baf48fa93dd2.

* Copy cldnn runtime.

* Copy mlsl libraries.

* add unit tests for the two versions of Backend create_tensor (#2607)

* add unit tests for the two versions of Backend create_tensor

* disable new unit test on GPU until we have time to address it

* Resolves merge conflicts

* Addresses code review comments.

* Fixes merge issues

* Fixes style errors

* Fixes type check to use compatible()

* Reverts unintenional change

* Reverts unintenional change

* Fixes typo in comment

* Addresses code review comments.

* Add support for negative padding

* Use std::bind in pad builder check

* Add support for negative padding in CPU backend

* Updated kernel to do pad+slice

* Remove type conversion warnings

* Fix review comments

* Remove interior padding from core op and interpreter stuff

* Update backends other than GPU for retirement of padding_interior

* Skeleton of support for edge/reflect padding

* Post-merge cleanup

* Attempt reference implementation for EDGE.

* Fix the edge-padding reference, and add some unit tests

* Implement REFLECT padding ref; add tests

* Fixes to the CPU stuff so it compiles now

* Fix test

* Add support for different pad modes

* Restore a stub get_padding_interior function, and tweak some stale comments

* Update ONNX importer to not supply interior padding value; add checks for padding-too-small for EDGE and REFLECT

* Typo

* Bop a warning

* Attempt fix to INTELGPU backend

* Attempt another fix to INTELGPU backend

* Fix pyapi

* Style apply

* Add support for padding modes

* Remove unnecesary node validation checks

* Remove tests for minimal reflect and edge pad

* Remove commented tests

* Remove unnecesary Asserts

* Little update of pad documentation

* Monospace for pad_mode options

* Revert "Remove tests for minimal reflect and edge pad"

This reverts commit 81e4787ea47195b832cab1452dde698bc05776fe.

* Revert "Remove unnecesary node validation checks"

This reverts commit 7e68db7564f3c9b1fd40e7db1d1bda4e0677cad9.

* Test only spatial dims

* axis -> spatial axis

* Fix typo

* Style check

* Update test

* Add CoordinateDiff include

* Remove pad_mode from tree visualization

* Convert padding into NVShape

* Skip failing tests on GPU

* Revert mode change

* Remove merge artifact

* Rename pad kernel into pad_ref

* - add method to conditional check for mkl version
- use conv_auto if feature is available

* fix conditional check for mkl version

* fix typo

* - added funx to query mkldnn_version

* WIP debug

* -   added test case for conv winograd algorithm selection

* i) style fix

* - fix clang errors

* - fix clang error ( clang has issue around conditional operator)
- changes to mkldnn::utils conv_heuristics helper to return mkldnn:algorithm instead of bool value

* - add right checks based on the choosen conv algorithm in the unit test

* - utililty function to determine isa_type in unit test

* - address PR comments
- add unit test for conv_winograd and executes with CPU backend

* i) fix style ii) remove unit test

* Localize mkldnn_version() based decisions to mkldnn_utils

* Handle mixed length sequences.

* UT for mixed sequence length LSTM.

* Style apply.

* Fix typos.

* Add std:: prefix to preserve unified style within file.

* Fix debugger tests crash for CODEGEN.

* Address PR feedback.

* Expect exception for CODEGEN.

* Address PR feedback.

* Do not allow in place slice if the arg is in CONSTANT buffer set.

* Add a unit test.

* Address PR feedback.

Pre-build tbb wasn't getting its headers into the master header
Reference convolution changes needed to be added to codegen

* Add NodeInput and NodeOutput classes

* Review comments

Also fix formatting

* Update sitemap.rst

* Update sitemap.rst

using the structure suggested by Kevin P instead

* add method to get underlying executable

* Copy the function because copy cleans up the graph linkage/users

* style

* change float comparisons from == to all_close_f

* style

* address a few more direct float comparisons

* add missing include

* specify tightest tolerance for Broadcast and Reshape tests

* Increased tightness of float testing

Increased tightness of float testing via MIN_FLOAT_TOLERANCE_BITS parameter

* style

* Added sqrt to constant folding

* Added negative sqrt checking

* add copy_from on GPUTensor

* add test

* remove unused code in test

* fix warning

* fix type

* fix comment texg

* using all_cloase for test

* Enable onnx, protobuf and onnx import on Windows.

* Apply style.

* Cleaner API doc reference for compile call

* Add a useful table for nGraph namespaces

* Remove layout namespace

* Show exploding kernel problem on illustration like IEEE preso

* WIP branch for new documentation restructuring that is a huge pain

* Fix the doc reorg mess

* Fix underline

* List of passes disclaimer note

* Update disclaimers on README

* More cleanup of doc reorg

* Update core docs

* Update overview on core

* Add PR feedback

* Get rid of all the gazillion of doc build errors from rearranging stuff

* Add section on tutorials

* Update branch

* Cleanup intro

* Add better detail to overview

* Revise buildlb instructions and add better title for contributing to doc

* Note about unit tests

* Editing

* Update core overview namespace table and fix more broken links due to ToC changes

* Add doc on pass manager register and run passes code from unit tests

* Add doc on pass manager register and run passes code from unit tests

* Make the compiler passes section more awesome

* Consistent sentence case on all ToC headings

* Update for gold docs

* Add better detail about execution interface

* Minor edits

* Revert strange change

* Update with bucketed list of passes

* Fix build error

* Copy and install all mkldnn libraries if versioning is enabled on linux.

* Replace magic numbers with variables.

* Support mkl-dnn library versioning on macos.

- Enable caching irrespective of cacheability hints when reuse_memory is disabled

* Add construction API for Transpose

* Add type propagation unit tests for Transpose

* Add Transpose to op_tbl, add cases for serializer, stub out execution in INTERPRETER

* Add docs for Transpose

* Remove commented-out code

* Add stub cases for op_tbl-dependent stuff

* Fix missing FAIL()s in the transpose exception checks; fix validate_and_infer_types check

* add unit tests for the two versions of Backend create_tensor

* disable new unit test on GPU until we have time to address it

* Set rpath for mkl-dnn.

* Set library rpath to  on Linux.

* Use patchelf to set rpath of prebuilt mklml library.

* Add patchelf to Linux Dockerfiles.

* Revert "Add patchelf to Linux Dockerfiles."

This reverts commit 1769505a866061552942e19467ddcc0dad0922e8.

* Revert "Use patchelf to set rpath of prebuilt mklml library."

This reverts commit 726f6553a0450520328607177d64baf48fa93dd2.

* Copy cldnn runtime.

* Copy mlsl libraries.

* QuantizedDot and QuantizedDotBias ops CPU impl

* add builders and unittests

* fix CI issue

* fix GPU emitter build

* Remove duplicate line.

Previous code silently crashes when node is not a op.

* Add support for shape-specializing functions

* Move PR comment into docstring for specialize_shapes

* Fix some broken unit tests

* Add stub cases for op_tbl-dependent stuff

* Revert "Add stub cases for op_tbl-dependent stuff"

This reverts commit 2153967dc2fe544ca78a99548c8bb3cdfefc8470.

* IntelGPU backend: Convert operation fix to be friendly with CPU floating point conversion

* PR2485. Exclude tests from GPU backend

* PR2485. Apply new tests changes

* Make this PR INTELGPU specific only

* Remove new tests from the list

* Update intelgpu_op_custom_kernels.cpp

* Update intelgpu_op_custom_kernels.cpp

* Update intelgpu_op_custom_kernels.cpp

* Update intelgpu_op_custom_kernels.cpp

* Adds basic support for provenance

* undoing accidental white space change.

* Fixes style errors

* Cometic changes.

* Addresses review comments. 1.Makes reference constant and 2.changes remove function type to void.