* Add builders for QLinearMatmul for onnxruntime

* Generic Dot

* Change the onnx bridge and address PR feedback

* Fix date

* Fix CI failure

* Change varibale filter to input1

* const & reference

* update branch

* Comment

* Introduce QuantizedMatmul

* change pattern

* QDot tests passing

* style

* PR feedback

* Fix pattern

* style

* Interpreter working

* cleanup

* cleanup

* add CPU backend

* Update the rest of the backends

* update python API

* update test_case to use new shared_ptr

* Generalize types in general convolution

* type-o

* rounding

* Do prod wide

* templatize conv in cpu/kernel & add u8u8 support for Qconv

* Remove cast function

* Avoid compiler warning

* Merge problem

* Add support for QDotInteger

* Address Feedback

* Support int32 as output of QuantizedDot without requantization similar to QuantizedConvolution

* QuantizedDot and QuantizedDotBias ops CPU impl

* add builders and unittests

* fix CI issue

* fix GPU emitter build

* Remove duplicate line.

* Add QuantizedConcat

* Remove unused variables and add check for size of mins and maxes vector

* Resolve conflicts

* Merged with master and addressed some PR feedback

* Avoid float comparison

* make min/max vector, add dequant/quanti

* fix dequant/quant scales

* fix CI build issue

* use calls for new backend API in unit tests

* fix compile error

* fix compile error

* Fix in place

* Style

* Adding non in-place support for all fused convadds

* fixed quantized test case on GPU build

* Fix signedconv op

* Add assert and change the dynamic scale test case

* Change assert

* Update quantized_conv_bias.cpp

* Update quantized_conv_bias.cpp

* update licenses for 2019

* style

* Support dynamic scales for Qconv's and Dequantize

* Remove constant folding

* add additional dynamic_quantize unittest

* add another mxnet quantize unittest

* add additional dynamic_dequantize tests

* fix shape error

* add dynamic signed_quantize unittest

* Pass correct scale

* Refactoring

* Added dynamic scale support for QCBA and QCBSA

* Refactor to create MKLDNN primitives on the first iteration

* remove stray code

* unused variables

* remove extraneous line

* make validate public

* move compile call outside of call for unit tests

* fix compile error

* one more error

* change compile call to return Handle

* make CPU require compile() before call()

* fix unit tests to call compile() before call()

* fix failing ops

* update unit test

* revert some changes

* more fixups

* more diff cleanup

* a few more issues addressed

* more fixes

* update API

* more updates

* fix test_ops.py

* fix

* another attempt to fix

* fix unit test

* fix test error

* Quantize the bias to int32

* Bias scale fix

* mnist works

* Quantize Bias

* Introduce Quantize op in the graph to quantize bias & feedback

* Add QuantizedConvBiasAdd

* Comments and some refactoring

* Add test case with float bias and enable int32 as quantized type in ngraph

* Change shape of scale from Shape{} to Shape{1} in the backend

* Add QuantizedConvBiasSignedAdd

* Fix Layouts, clean up and a test case for QCBA

* Test case for QCBSA

* cleanup mkldnn_emitter.hpp

* fix build error

* Constant fold

* Support dynamic scales for quantization

* Avoid static object inside functors

* Added missing capture and removed mkldnn_submit

* fix merge error

* Move ParameterVector and ResultVector to the ngraph namespace where they belong

* update python wrapper

* more python fixes

* style

* Update setup.py

* fix some new code

* Quantize the bias to int32

* Bias scale fix

* mnist works

* Quantize Bias

* Introduce Quantize op in the graph to quantize bias & feedback

* Comments and some refactoring

* Add test case with float bias and enable int32 as quantized type in ngraph

* Change shape of scale from Shape{} to Shape{1} in the backend

* Add builder for {de}quantize

* Add declaration in header

* Add mkldnn support for {de}quantize

* Add support for {de}quantize with mkldnn

* Add Dex support

* Generalizing some api's and adding a test case for DQ in backend_test.in.cpp

* Unify scale between ngraph and mkldnn

* Check for nullptrs

* PR feedback

* fix unit test failure

* Adding tests for builder and deleting the backend tests

* curly braces

* test rename