* add option to copy intput/output data for each iteration

* add support for stale buffers

* only print details if details enabled

* refactor print routines to main file

* refactor for multi dir support

* dir support prints nice results

* use line comments instead of multiline comments for license header

* update more

* update new files

* more header updates

* style

* Add an option to exclude the first iteration

* Switch to warmup iterations

* Cleanup

* compiles but does not link

* using async gpu timers

* remove sync for cuda calls, add async gpu stopwatch, add count to timing-detail

* add debug sync

* make timer static

* move timer to runtime context

* nbench cleanup

* update style

* Make temp memory pools static to avoid memory allocation overheads

* Initial implementation for graph control to enable caching and computation reuse

* Added sphinx documentation

* Turned off memory buffer reuse in CPU transformer to support computation reuse. Added unit test

* Change memoizable to cacheable

* Change memoizable to cacheable

* Rename variables

* Move runtime::Manager functionality into runtime::Backend

* Remove unused files

* remove obsolete function

* remove deprecated

* remove all legacy Backend API usage

remove deprecated files

* pull in changes from master

* fix GPU calls

* disable tests in convolution generator

* update per PR comments. Enable performance counter feature.

* update per PR comments

* fix build error

* fix conditionally compiled test :(

* add random init for all input types, not just float

* remove debug

Adjust CallFrame argument order to match Function

* fix detailed timing flag

* more detailed info

* cleanup

* cleanup

* fix all headers to be standalone as far as includes go

* include cleanup

* cleanup includes

* cleanup

* include tester

* wip

* cleanup

* cleanup

* cleanup

This fixes the previously broken compilation of ngraph-mxnet which directly utilized serializer.hpp