* - Added reorder support for rnn weights_layer/iter

* i) fixed compilation issues ii) working but still observing precision error

* i) fixed failing rnn unit test for DEX ii) refactored workspace in RNN mkldnn emitter

* i) added support for src reorder to TNC from NTC

* reorder support for rnn output fron NTC to TNC

* - added support for rnn weight reorder ldgoi -> ldigo
- code refactor for lstm/rnn kernel in mkldnn emitter

* - refactor rnn mkldnnn kernel, change variable names

* fix RNN codegen kernel

* disbale layer rnn fusion pass, to test CI

* method to validate recurrent rnn inputs

* add correlated macthes for Recurrent RNN PM

* - simplify reorder logic for rnn_weights
- fix graph pattern for fusing rnn cell across time steps

* do weights reorders in rnn timesteps fusion

* refactored LSTM graph pass

* - Bug fix for finding the lstm inputs determenstically
- Refactored LSTM graph pass to single pass
- made changes to LSTM RNN time step fusion graph pass

* - use replace_node instead of replace_output in Lstm_step_wise fusion graph pass

* fix compilation error

* Fix GNMT rnn fusion

* check if the node is in use before replacing in RNN graph passes

*  i) fix style ii) fix topo sort issue in RNN graph pass

* style fix

* fix bug in simplify_concat pass

* replaces Lstm1 -> {GOE1, GOE2} -> {Slice1, Slice2} -> Concat -> Lstm2 with Lstm1 -> Lstm2

* cse for convert layout

* addressed PR comments

* - optimization pass to remove  Lstm1 -> {GOE1, GOE2} -> {Slice1, Slice2} -> Lstm2
- conditional fusing of LSTM cells only for the decoder

* made changes to multi layer RNN fusion callback

* fix asserts in RNN op

* - added support to fuse layers when slc=dlc for RNN cells
- bug fix on the sanity checks for RNN Op

* - support RNN layer fusion till slc = dlc
- bug fixes in multi layer rnn fusion call back

* capture reshape in the RNN weights

* Addressed PR comments

* - added comments in multi layer PM call back
- fuse only if slc == DLC across layers

* restore deleted 3_lstm_cell_forward.json file

* fix typo

* fix failing unit tets

* When processing in place slice, do not change the offset of the slice node if the argument pointer comes from function input.

* Address PR feedback: process in place slice after propagating in place input.

* Set INTERMEDIATE role before propagating in place input.

* Do not add temporaries to the variable name map before propagating in place input in codegen.

* Fix a bug in codegen.

* Fix a bug in codegen slice.

* reenable disabled rnn unit test

* fix compiler error

* - bug fix in the slicing logic for the layer fused rnn cell
- fix failing rnn unit test

* - Addressed PR comments
- removed redundant checks from the rnn graph pass
- simplified rnn call back replace node logic

* - added new multilayer rnn *.json file
- fix test case

* [PRIVATE BRANCH] Style fixes (#2080)

* Style fixes

* change order of lstm gates

* [PRIVATE BRANCH] Jbobba/rnn fusion review (#2113)

* Style fixes for single-layer RNN fusion

* Style fixes to multi-layer RNN

* style fix

* disable GPU test

* fix fialing bn test

* fix style

* fix expand layout for padded dimensions

* enable squeeze padded layouts

* - modified cpu_assignment pass to support bn with input 5D
- added test cases for 5D bn and 5D bn+relu

* - Address PR comments
- used mkldnn_utils to validate bn for mkldnn

* fix compilation error

* Addressed PR comments
- added helpers in mkldnn_utils for assigning ngraph Op as MKLDNN op
- helper funnction for bn mkldnn assignment

* fix clang error

Bob/ext2

This reverts commit 1c4aa225.

Fix the incorrect way to query the size of Constant tensor, which lead invalid memory access

* IntelGPU backend: Use clDNN matrix operations for nGraph::Dot

* Update unit_test.manifest

* Update README.md

Fix broken link

* Update README.md

* ONNX Pad operator

* Disable Batch Norm is spatial checking

* Remove unused variable

This reverts commit c5b082c6.

* onnx: return signle nGraph function with multiple outputs
Signed-off-by: Artur Wojcik <artur.wojcik@intel.com>

* onnx: remove excessive code
Signed-off-by: Artur Wojcik <artur.wojcik@intel.com>

* Update ngraph python unit tests

* wip

* wip

* style check checking

* try cmake version of check/apply style

* update style check to print list of files in error

* cleanup

* IntelGPU backend: Use clDNN BatchNorm in operations

* IntelGPU backend: no duplications in cldnn output vector

* IntelGPU backend: PR2086. Fix clDNN batchNorm usage

* Additional info calculated & printed for all_close_f.

* Fixed format

* Tweaked test calls to all_close_f to make unambiguous.

* Tweaked test calls to all_close_f to match close_f for last unit test.

It seems wasteful to be generating debug output a character at a time
all the time, only to discard it on non-debug builds.  This change
replaces that behavior by introducing a no-op operator<< for the debug
log on non-debug builds.

* Add argmReduce support for int32 +  tests

* add new line

* add to intelGPU manifest

* Address Fenglei's comment

* address comments

* Small change to emitter logic.

* Chris's comments incorporated

* minor edits + clang

* edit

* Only synchronize stale input tensors

* Cache backend.call() compilations

* Cache invoker bindings

* Update test list

* New branch for doc changes

* Slightly out of scope doc requests to make some people happier;
this does technically change the API

* Doc versioning even with Beta release

* Don't remove markdown version of contrib guidelines after all

* Update changes from earlier branch

* Make sure ngraph-tf links to readme

* Update setup.py

* Update setup.py

* fix errors in edit

* fix ascii error

* get the right readme

* rename a variable at Scott's request