* Retire Reduce, ReduceWindow, SelectAndScatter

* Remove lingering AnyAllReplacement code

* Remove apparently-now-unused macro

* Remove lingering op/reduce.hpp includes

* Remove FunctionCall

* Update Python stuff to remove FunctionCall, Reduce

* Add Any/All tests to GPU manifest

* Remove deleted .hpp #include from gpu_compiled_function.cpp

* Restore reduce_function.cpp since that is where the All/Any implementations ended up residing

* Add reduce_function.cpp back into CMakeLists.txt

* Remove #include of deleted reduce.hpp

* Re-remove AnyAllReplacement from GPU passes

* Remove deleted #includes from gpu_internal_function.cpp

* Remove git conflict stuff (whoops)

* Add newline at EOF, per review comment

* Address flake8 complaint about unused import

* update licenses for 2019

* style

* matcher's strict mode

* fix clang warnings

* any_of matching

* include a new file any_of.hpp

* Move ParameterVector and ResultVector to the ngraph namespace where they belong

* update python wrapper

* more python fixes

* style

* Update setup.py

* fix some new code

* use line comments instead of multiline comments for license header

* update more

* update new files

* more header updates

* style

* normalize comments

* address review comments

* collect matched nodes

* clear m_matched_list

* tests

* address feedback

* add any op

* rename getters to adhere to ngraph coding guidelines

* fix renaminb

* fix build errors

* infra for algebraic simplification and simplifications for Add and Multiply (including broadcast consts)

* add tests, fix bugs

* negative tests, 0*0, 0*1, 0+0

* possible fix for 0*1

* remove stale test

* fix merge comp errors

* fix comp errors

* any -> skip

* run style check

* get_input_op -> get_argument

* more replacing

* more replacing2

* add a getter for root node

* recurrent graph rewrite

* fix perms, rename match_root -> get_match_root

* fix comp errors

* make match_root return the topmost match; fix tests

* repacking recurrent matching as a standalone class

* RecurrentMatcher

* add a getter for root node

* address Scott's feedback

* initial support for recurring matching

* fix a bug where patterns weren't populated w/ matched nodes; add recurrent tests

* add a missing newline

* address feedback

* fix function comment

* rename directories to be consistent
* rename reference namespace to match directory

* the first stab at op::Result

format fixes

disabling logging

op::Result, 2nd attempt

purge stale code

disable logging

fix copyright header

* initial cleanup

* cleanup2

* remove dead code

* result.cpp, fix comments

* fix comment

* Replace using aliases with actual classes

* relu for interpreter

* relu in serializer

* core fusion

* relu backprop

* relu backprop and test interpreter

* core fusion for CPU

* COREFusion -> CoreFusion

* relu MKL dnn

* Add product op

* Add Max (max reduce) and Min (min reduce) ops

* Refactor arithmetic reduction ops to a common base class

* Fix PREFER_EIGEN codepaths in cpu_emitter

* fuse dot(a,b) + c

cblas_gemm working on mlp

rebase & small fixes

enable debug output

support replacing function's outputs

* WIP pattern matching for variance

* - Added pattern matcher graph to look up variance(sub graph) in bn
- Added test case to verify the variance graph pattern

* added batch norm mean pattern matcher.

* remove reshapes

(cherry picked from commit ecad321fb1b1bc3f7facda229beb940118ca0701)

* fixed mean test to use Matcher.

* resolve merge conflict in test/pattern.cpp

* WIP bn fprop pattern

* fprop bn fusion working

* - Added unit test case to read the bn serializeed *.json file and run bn fprop fusion pass
- Added batchnorm header file and defined the bn class to emit the mkldnn kernel
- Added pattern matcher for fprop bn in CPU graph_rewrite pass

* WIP MKLDNN fprop bn emitter code

* completed fprop batchnorm kernel in CPU emitter

* fixed bug in the emitter code for fprop bn

* - Fixed copilation issues
- unit tests are passing for bn emitter fprop code

* Added support to compute fprop bn with mean annd variance as input

* resolved compilation issues

* refactored bn fprop code

* - added batchnorm src file to the CMakeFilelist
- moved bn fusion under CPU runtime/pass/cpu_fusion
- fixed compilation issue

* Resolved compilation issues in bn emitted code

* Addded debug statements in fprop bn emitted code

* added batchnorm.cpp src file

* - Added test case to test fprop batchnorm with known tensor values
- fixed bug related to defining weights in fprop bn

* - Added test case for fprop batchnorm Op
- Added test case for mean and variance pattern matcher
- Added fprop bn *.json file with input having 4dmis mb2c3h2w2
- refactored fprop bn op class

* Style fix

* - Removed Debug symbols

* - Fixed header template with correct year
- appended mkldnn.hpp in the CPU generated code

*  Addressed PR review comments
 -  added support for batchnorm op in serializer and de-serializer
 - added more sanity in bn constructor
 - renamed "BatchnormFprop" -> BatchNorm

* - Addressed PR review comments
- replaced auto with speicfic mkldnn::type in emitted bn kernel
- modified function signature to take 'eps' as double instead of <Node> type

* added missing header files, resolved compilation issue

* style fix

* Addressed PR comments
1. initilized member variables for bn in the same order as they are defined
2. renamed bn member variables to start with m_* as per coding convention
3. moved bn fusion test to test/cpu_fusion.cpp
4. style fix
5. added more checks to evaluate type and shape of inputs to bn

* Added support for EMITDECL macro for batchnorm

* - made correction to batchnorm src file name batchnorm -> batch_norm as per coding guidelines
- corrected bn copy_with_new_args() method

* Removed redundant SqrtOp support in serializer

* fix Shape declarations

cblas_gemm working on mlp

rebase & small fixes

enable debug output

support replacing function's outputs

productizing CPUFusion

addressing Bob and Jayaram's feedback

removing json used for simplification tests

adding comments

fixing formatting errors and removing dead code

TODO msg

removing serializer changes

* the first stab at pattern for sum

test refactoring, debug msg clean up, formatting fixes

removing v1 and cleaning up v2 + formatting

rollback the changes in reduce_ops

rename v2 -> sum_pred

remove unused funcs

switch to new c-tors

remove TensorViewType

removing an assert

fix a docstring to match a c-tor

* fixes after rebase

* remove caching of ordered_ops

* graph_util logging msgs

* small cleanup

* remove files for the TopologicalSort pass

* remove NGRAPH_DEBUG from graph_util.hpp

* recreate ops

* style

* recompute ops

* style

* fix

* recreate ops

* style

* recompute ops

* style

* fix

* some

* more

* style

* remove a line

* const

* style

* NodeMap was using non-standard operator[] behavior.

* Missing include

* Function can have multiple results
Remove external use of ValueType, TupleType, Tuple
Remove many external uses of Output and Input

* corresponding CPU backend changes

* Update master changes.

* Remove type arg from Function, add changes.md

* Merge changes.

* Move bodies to .cpp, add brief doc

* Merge CPU changes.

* Remove xla includes from non-xla files

* Remove xla from tests

* First part of xla tuple support

* change fprop_cache to assume multi-output bprop functions

* New wrappers for handling tuples with XLA

* Review comments

* remove old xla files

* fix merge errors

* hand edit models to use multi output instead of tuples

* remove ParameterizedConstant
* use simpler element Type definition
* Move TraitedType to NGVM directory

* remove use of ParameterizedConstant from unit test. Now using Constant instead. Constant is not a templated class.

* move ParameterizedTensorView to NGVM directory

* element_type cleanup

* tuple -> xla_tuple (+headers)

xla_get_tuple_element

get_tuple_element headers

adding get_tuple_element + fixes

get_tuple_element

XLAFunction; breaks tests

compiling libngraph.so w/ XLAFunction and Function; fixing tests is next

build & test fixes

formatting

m_arguments -> get_arguments (first step to hide m_arguments)

removing some get_arguments

get_arguments -> get_arguments_DEPRECATED

more DEPRECATED

formatting

m_arguments no more! at least technically

halfway

tests pass

xla_function.cpp/hpp

move defs into cpp files

get_input_argument -> get_input_op

formatting

* add xla_function.* and assert -> throw

* assert -> throw, remove cassert

* removing emitter.cpp; poor guy got left behind

* addressing feedback p1

* rename GetTupleElement -> GetOutputElement

* adding a comment to get_arguments_FOR_GRAPH_REWRITE_ONLY

* removing virtual off set_name

* subgraph labels

* adding more documentation for Label

* minor fixes

* move replace_node to util

* static run_matchers_on_nodes_list

* switching to map

* formatting

* addressing Scott's feedback and fixing warnings

* more pattern matcher refactoring

refactoring cont'd

* Start of pattern matcher

recursive graph matcher, pattern node

add matcher.cpp

add files for matcher, graph_rewrite

add const to on_match_class

fix comp errors

reshuffle pattern matching code across corresponding files

fix comment

run clang-format

graph_rewrite replace_node

getting simple test cases to work

op/pattern.cpp

toward graph_rewrite tests

older matcher API

before clean up tests

before rebase

build bbrks

more tests

clean up

more clean-up

more cleanup 2

more clean up 3

clean up 4

clang errors

clang errors2

apply code format

move match_class to matcher

major clean up after moving match_class to matcher.cpp

removing tracing changes

rebased as of 11/8

make matcher use i/o descs to traverse the graph; change replace_io

switching to io tds

graph_rewrite tests fail

all tests pass

formatting

unhandle outputs explicitly for now

reset permissions back to 0644; bad bad windows

fixes after rebase

* fixes

* addressing Scott's feedback