* cleanup

* cleanup

* fix all headers to be standalone as far as includes go

* include cleanup

* cleanup includes

* cleanup

* include tester

* wip

* cleanup

* cleanup

* cleanup

This fixes the previously broken compilation of ngraph-mxnet which directly utilized serializer.hpp

* make json lib an external project
* add env var to turn warnings to errors

* Replace using aliases with actual classes

* initial support for hybrid transformer

* add broadcast_vector_rowwise_reversed for hybrid test

* headerc

* get function placement fix

* conv ref test generator graph node in labmda fuction

* rename map_parameter_to_source_node

* type change map_parameter_to_source_node

* use interpreter for numerical derivative

* better comments

* relu for interpreter

* relu in serializer

* core fusion

* relu backprop

* relu backprop and test interpreter

* core fusion for CPU

* COREFusion -> CoreFusion

* relu MKL dnn

* compare derivatives from bprop and bprop with fprop cache

* code format

* modify existing autodiff unit tests to test fprop cache

* cleanup

* fix compile error introduced with bad merge

* remove invalid negative/negative backwards power test

inline

Inliner pass + tests

debugging

fix inliner failures due to the fact a random function is picked as an outermost one

copyright headers

cblas_gemm working on mlp

rebase & small fixes

enable debug output

support replacing function's outputs

productizing CPUFusion

addressing Bob and Jayaram's feedback

removing json used for simplification tests

adding comments

fixing formatting errors and removing dead code

TODO msg

removing serializer changes

* fix convlution reference script

* convolution backprop

* cleanup

* fix build warnings

* Missing include

* fix build warning part 2

* move numeric_compare to its own header
code review feedback

* fix build warnings 3

* fix build warnings 4

* clang-format

* cast to avoid implicit cast warning

* wip

* wip

* remove get_vector from runtime::TensorView class as it was for unit test only

* cleanup

* move writting vector to runtime::TensorView to the unit test dir

* merge fix

* PR review change

* update from PR comment

* update changes file

* add interpreter nan check option

* add unit test

* general cleanup

* remove runtime::Value

* more cleanup

* more cleanup

* Function can have multiple results
Remove external use of ValueType, TupleType, Tuple
Remove many external uses of Output and Input

* corresponding CPU backend changes

* Update master changes.

* Remove type arg from Function, add changes.md

* Merge changes.

* Move bodies to .cpp, add brief doc

* Merge CPU changes.

* Remove xla includes from non-xla files

* Remove xla from tests

* First part of xla tuple support

* change fprop_cache to assume multi-output bprop functions

* New wrappers for handling tuples with XLA

* Review comments

* remove old xla files

* fix merge errors

* hand edit models to use multi output instead of tuples

* fix autodiff on non-NGVM backends. NGVM initializes all tensors to zero on allocation while the other backends do not. Had to initialize vector before use.

* change autodiff tests to use INTERPRETER

* remove ParameterizedConstant
* use simpler element Type definition
* Move TraitedType to NGVM directory

* remove use of ParameterizedConstant from unit test. Now using Constant instead. Constant is not a templated class.

* move ParameterizedTensorView to NGVM directory

* element_type cleanup

* tuple -> xla_tuple (+headers)

xla_get_tuple_element

get_tuple_element headers

adding get_tuple_element + fixes

get_tuple_element

XLAFunction; breaks tests

compiling libngraph.so w/ XLAFunction and Function; fixing tests is next

build & test fixes

formatting

m_arguments -> get_arguments (first step to hide m_arguments)

removing some get_arguments

get_arguments -> get_arguments_DEPRECATED

more DEPRECATED

formatting

m_arguments no more! at least technically

halfway

tests pass

xla_function.cpp/hpp

move defs into cpp files

get_input_argument -> get_input_op

formatting

* add xla_function.* and assert -> throw

* assert -> throw, remove cassert

* removing emitter.cpp; poor guy got left behind

* addressing feedback p1

* rename GetTupleElement -> GetOutputElement

* adding a comment to get_arguments_FOR_GRAPH_REWRITE_ONLY

* removing virtual off set_name

* add support for n-dimensional operations by calling runtime/kernels

* rename cpu backend classes and files

* add tuple support to INTERPRETER

* move ndarray out of runtime to test where it belonged

* fix Tuple op per review comment

* Autodiff for abs

* Formatting, more tests for abs

* Cos autodiff; also a clarifying comment in the abs test

* Forgot cos.cpp

* Sin autodiff

* Again, forgot to add sin.cpp  :/

* Tan autodiff

* Minor formatting tweak

* Commit partial work on select backprop so I can run valgrind on the server  :/

* Fix boolean thingy so it works on Linux

* Autodiff for ceiling, convert (untested), floor, sign. Fix unit test for tan. Implement ceiling, floor in VM.

* Fix bug in abs/sign unit test ranges

* Add multiplicative inverse and square-root ops (needed for hyperbolic trig autodiff)

* Better formula for sqrt adjoints

* Autodiff for hyperbolic trig ops

* Forgot to add cpp files for hyperbolics

* Remove inv (don't need it after all); also formatting (oops)

* fix bug with Convert autodiff

* Autodiff for concat

* Restore the accidentally-commented-out unit test for abs

* Formatting

* Fix 'unordered_map.at' exception when Adjoints::Adjoints visit a node that has never been add_delta'd; remove workarounds for that bug

* Fix erroneous 'not implemented' docstring for op::Not

* Autodiff for sum

* Checking in broken support for replace_slice so I can test it with valgrind on the dev box

* Fix unit test bug with tensor initialization; formatting

* Implement replace-slice in CPU backend

* Autodiff for Slice and ReplaceSlice

* Tweak docs for ReplaceSlice

* Remove no-longer-needed cast of arg list to runtime::TensorView

* ParameterizedTensorView and ElementType cleanup

* change element to_type() to from()

* wip

* remove ndarray dependency from ParameterizedTensorView

* get rid of operator= on ParameterizedTensorView

* remove unimplemented ctor

* remove get_parameterized_tensor_view from TensorView class

* cleanup

* the patient will get worse before getting better. remove ParameterizedTensorView from element type

* cleanup obsolete includes

* remove unused file

* move aligned_buffer and cleanup

* cleanup

* wip

* wip

* wip

* cleanup

* cleanup

* wip

* finally got rid of getting a non-const vector from PTV

* wips

* wip

* remove unused

* fix PR comments