* MaxPoolWithIndices CPU Fusion

* fix test to pass checks in cpu_fusion

* pass test

* clean up

* add a new pass, add layouts

* remove the opt from cpu_fusion

* refactor cpu_layout logic for maxpool, clean up comments

* add comment w.r.t. indices tensor

* rename to cpu_workspace_insertion

* add CPUWorkspaceInsertion pass for TF

* Adding support for mkldnn convolution+bias+relu op to use in batch norm folding

* Style fix

* Style fix

* any -> skip

* run style check

* CPU weight fusion initial version

* add tests for weight_fusion

* address @jbobba's feedback

* before cleaning up convolution_weight_optimization.cpp

* clean up, rename, fix perms, fix format

* get_input_op -> get_argument

* more replacing

* more replacing2

* remove deprecated

* remove all legacy Backend API usage

remove deprecated files

* pull in changes from master

* fix GPU calls

* disable tests in convolution generator

* update per PR comments. Enable performance counter feature.

* update per PR comments

* fix build error

* fix conditionally compiled test :(

* CPU: Fuse zero-padded convolution backprop filters

* CPU: Add a testcase for zero-padded convolution backprop filters fusion

* refactor Adjoints to support multi-output ops

* passing tests

* switch to generate_adjoints(deltas) and backprop_node

* remove debugging code

* fix error msg

* fix typo adjoitns

* fix comp errors in mnist_mlp

* Fix clang warnings on macos

* Conditionalize warning on Apple clang version.

* WIP support bn training for global_stats

(cherry picked from commit eb81a37328ea177b1d58c9eebdbb345e0fa25f0d)

* - Style fix
- Fix test case

* Addressed PR comments
- added support for bn training/inference with a same ctor
- added more verbose comments in bn header

* Fixed bn serializer and default value in bn ctor for bwd compatibility

* proposed docs change

* - Addressed PR comments
  - added support to compute bn inference/training using same mkldnn kernel with global stats

* fix unit bn relu unit test

* initial refactoring using PM

* unit test pass

* cosmetic changes

* add another rnn test

* address louis' feedback

* lower-case labels

* fix relu(conv); the old test was fusing conv(relu) instead of running both separetely

* fix segfault due to initiating a vector of result vectors w/ a number of arguments

*  split cpu_fusion into cpu_fusion and cpu_test; clean up headers

* fix formatting

* add new line to tensor_mask.hpp

* test graph.

* rnn matrix fusion wip.

* WIP.

* matrix fused.

* clean up.

* additional refactor.

* fixed merge errors.

* testing.

* added test case.

* more testing.

* more testing.

* bias wip.

* debuggging.

* fusing bias too.

* disabled debug outputs.

* removed debugging.

* removed testing models.

* removed debug models.

* reset nbench.

* clean up and testing.

* removed debug code.

* updated comments and var names.

* rename var.

* removed debug code.

* removed debug code.

* fixed compiler warnings.

* refactored test.

* Added const to parameter.

* address some of the review comments.

* added comments and addressed reviews.

* make matmulbias callback aware that addition is commutative

* Added new ctor for bn which supports Inference
- added mkldnn emitter code for bn inference
* Added test case for bn inference
- added support for layout propogation for bn inference
* added sanity checks for gamma, beta, mean, variance shape in bn
* added serializer support for bn inference

Adjust CallFrame argument order to match Function

* rename directories to be consistent
* rename reference namespace to match directory

* - Added pattern matcher for bprop sigmoid
- mkldnn emitter code for sigmoid bprop
- Fusion pass unit test for sigmoid bprop
- style fix

* Added test case for bprop sigmoid

* fixed sigmoid bprop test case failure

* fixed bprop unit test values for sigmoid

* style fix

* fix typo

* Addressed PR comments
- added layout assignment pass to ensure delta and input have same layout for SigmoidBprop

* - Added sigmoid fusion pass
- added mkldnn emitter code for sigmoid

* - corrected sigmoid expected values
- add layout assignment for sigmoid op

* - added assert's in cpu fusion for sigmoid
- style fix

* remove debug prints

* NGMX-371 #comment addressed PR comments - Added sigmoid unit test case with 3D input ii) support in cpu_emmiter for sigmoid to handle all input shapes

* NGMX-371 #comment use shape_size() to calculate the 1d input size

* remove broadcast from matmulbias

* fix comments

* working gemm-based broadcast

* fix clang warning

* - Added support optimized bn mkldnn implementation in cpu emitter
- modified bn unit_test to support new implementation
- added layout assignment for bn op
- Style Fix

(cherry picked from commit 7747a40806d62c126059d5c873adcd2e61a0adb0)

* modified value initilization in cpu_fusion to be float explicit

(cherry picked from commit 03499d380073d0197ab8cbd154eb03f63b042a48)

* fix compilation issue

* Addressed PR comments
- added exception if gamma and beta layout isnot equal to memory::format::x
- throw exception if bn Op is not mkldnn op

* fix compilation issue

* added support to handle multiple o/ps in fprop bn fusion

* - Removed laytout pass for bn
- fixed autodiff bug in bn
- added "Add" for the dispatcher in cpu-layout pass

* style fix

* Fix bprop batchnorm test with get_output_elements

* Style fix

* CPU: Padded Convolution fusion

* CPU: Non-reshaped fusion pattern for zero-padded convolutions

* CPU: Refactor consistency checks

* CPU: Rewrite hoisted reshape expression and add tests

* CPU: Merge leftovers

* generalize matmulbias

fixes

disable logging

* unit-test failures

* one output

multiple outputs

initial clean-up

* test clean-up

current version

test pass

* clean up

* fix format

* add dbeta,dgamma asserts

* revert some files

* 0644 on node.cpp

* 0644 on mkldnn_utils.cpp

* 0644 on more files

* add support for serialization + test case

* fix merge errors

* make json lib an external project
* add env var to turn warnings to errors

* Replace using aliases with actual classes

* fix a segfault due to an unhandled op

* fix a missing new line

* fuse dot(a,b) + c

cblas_gemm working on mlp

rebase & small fixes

enable debug output

support replacing function's outputs

* WIP pattern matching for variance

* - Added pattern matcher graph to look up variance(sub graph) in bn
- Added test case to verify the variance graph pattern

* added batch norm mean pattern matcher.

* remove reshapes

(cherry picked from commit ecad321fb1b1bc3f7facda229beb940118ca0701)

* fixed mean test to use Matcher.

* resolve merge conflict in test/pattern.cpp

* WIP bn fprop pattern

* fprop bn fusion working

* - Added unit test case to read the bn serializeed *.json file and run bn fprop fusion pass
- Added batchnorm header file and defined the bn class to emit the mkldnn kernel
- Added pattern matcher for fprop bn in CPU graph_rewrite pass

* WIP MKLDNN fprop bn emitter code

* completed fprop batchnorm kernel in CPU emitter

* fixed bug in the emitter code for fprop bn

* - Fixed copilation issues
- unit tests are passing for bn emitter fprop code

* Added support to compute fprop bn with mean annd variance as input

* resolved compilation issues

* refactored bn fprop code

* - added batchnorm src file to the CMakeFilelist
- moved bn fusion under CPU runtime/pass/cpu_fusion
- fixed compilation issue

* Resolved compilation issues in bn emitted code

* Addded debug statements in fprop bn emitted code

* added batchnorm.cpp src file

* - Added test case to test fprop batchnorm with known tensor values
- fixed bug related to defining weights in fprop bn

* - Added test case for fprop batchnorm Op
- Added test case for mean and variance pattern matcher
- Added fprop bn *.json file with input having 4dmis mb2c3h2w2
- refactored fprop bn op class

* Style fix

* - Removed Debug symbols

* - Fixed header template with correct year
- appended mkldnn.hpp in the CPU generated code

*  Addressed PR review comments
 -  added support for batchnorm op in serializer and de-serializer
 - added more sanity in bn constructor
 - renamed "BatchnormFprop" -> BatchNorm

* - Addressed PR review comments
- replaced auto with speicfic mkldnn::type in emitted bn kernel
- modified function signature to take 'eps' as double instead of <Node> type

* added missing header files, resolved compilation issue

* style fix

* Addressed PR comments
1. initilized member variables for bn in the same order as they are defined
2. renamed bn member variables to start with m_* as per coding convention
3. moved bn fusion test to test/cpu_fusion.cpp
4. style fix
5. added more checks to evaluate type and shape of inputs to bn

* Added support for EMITDECL macro for batchnorm

* - made correction to batchnorm src file name batchnorm -> batch_norm as per coding guidelines
- corrected bn copy_with_new_args() method

* Removed redundant SqrtOp support in serializer