Skip to content

N
ngraph
Switch branch/tag
History Find file
  • Nishant Patel's avatar
    LRU cache for dynamic shapes (#3827) · 44b58722
    Nishant Patel authored 
    * LRU cache for caching graphs

* static

* LRU Cache

* Cache graph

* Make data members static

* Temp test case functional

* Temp test case functional

* Fix shape

* Make lru local to dynamic wrapper

* Make cache thread safe

* Remove static copies of data members

* Add a separator  between shapes of different inputs

* Clear list and map in destructor

* Caching on values of shape relevant inputs

* Replace cout's by NGRAPH_INFO

* Add a environment variable for cache size

* Add mutex header

* style

* change to int64_t

* Save the cloned function to get the output shape to allocate output storage

* Pass inputs without wrapping

* Fix conv shape relevant inputs

* gcc 4.8 doesnt support ostring stream as a copyable object

* Pass key by reference

* PR feedback

* Apply suggestions from code review

* Replace malloc
Co-authored-by: 's avatarScott Cyphers <diyessi@users.noreply.github.com>
Co-authored-by: 's avatarRobert Kimball <robert.kimball@intel.com>
    44b58722
Name
Last commit
 Last update
..
abc.in.cpp Loading commit data...
abs.in.cpp Loading commit data...
acos.in.cpp Loading commit data...
add.in.cpp Loading commit data...
aliased_output.in.cpp Loading commit data...
all.in.cpp Loading commit data...
any.in.cpp Loading commit data...
api.in.cpp Loading commit data...
arg_reduce.in.cpp Loading commit data...
asin.in.cpp Loading commit data...
atan.in.cpp Loading commit data...
atan2.in.cpp Loading commit data...
auto_broadcast.in.cpp Loading commit data...
autodiff.in.cpp Loading commit data...
batch_mat_mul.in.cpp Loading commit data...
batch_norm.in.cpp Loading commit data...
broadcast.in.cpp Loading commit data...
builder_flatten.in.cpp Loading commit data...
ceiling.in.cpp Loading commit data...
comparison.in.cpp Loading commit data...
computation_reuse.in.cpp Loading commit data...
concat.in.cpp Loading commit data...
constant.in.cpp Loading commit data...
convert.in.cpp Loading commit data...
convolution.in.cpp Loading commit data...
convolution_reference.in.cpp Loading commit data...
cos.in.cpp Loading commit data...
cosh.in.cpp Loading commit data...
cum_sum.in.cpp Loading commit data...
distributed.in.cpp Loading commit data...
divide.in.cpp Loading commit data...
dot.in.cpp Loading commit data...
dyn_broadcast.in.cpp Loading commit data...
dyn_replace_slice_reference.in.cpp Loading commit data...
dyn_reshape.in.cpp Loading commit data...
dyn_slice_reference.in.cpp Loading commit data...
dynamic.in.cpp Loading commit data...
embedding_lookup.in.cpp Loading commit data...
erf.in.cpp Loading commit data...
exp.in.cpp Loading commit data...
floor.in.cpp Loading commit data...
function_name.in.cpp Loading commit data...
fused_op.in.cpp Loading commit data...
gather.in.cpp Loading commit data...
gelu.in.cpp Loading commit data...
generate_mask.in.cpp Loading commit data...
graph_comparison.in.cpp Loading commit data...
group_convolution.in.cpp Loading commit data...
layer_norm.in.cpp Loading commit data...
log.in.cpp Loading commit data...
logical_and.in.cpp Loading commit data...
logical_or.in.cpp Loading commit data...
logical_xor.in.cpp Loading commit data...
lrn.in.cpp Loading commit data...
matmul.in.cpp Loading commit data...
max.in.cpp Loading commit data...
maximum.in.cpp Loading commit data...
min.in.cpp Loading commit data...
minimum.in.cpp Loading commit data...
mlir.in.cpp Loading commit data...
multiple_backends.in.cpp Loading commit data...
multiple_result.in.cpp Loading commit data...
multiply.in.cpp Loading commit data...
negative.in.cpp Loading commit data...
node_name.in.cpp Loading commit data...
not.in.cpp Loading commit data...
numeric.in.cpp Loading commit data...
one_hot.in.cpp Loading commit data...
pad.in.cpp Loading commit data...
parameter_as_output.in.cpp Loading commit data...
partial_slice.in.cpp Loading commit data...
pool.in.cpp Loading commit data...
power.in.cpp Loading commit data...
product.in.cpp Loading commit data...
quantize_dequantize.in.cpp Loading commit data...
quantized_convolution.in.cpp Loading commit data...
quantized_dot.in.cpp Loading commit data...
random_uniform.in.cpp Loading commit data...
range.in.cpp Loading commit data...
relu.in.cpp Loading commit data...
replace_slice.in.cpp Loading commit data...
reshape.in.cpp Loading commit data...
reverse.in.cpp Loading commit data...
reverse_sequence.in.cpp Loading commit data...
round.in.cpp Loading commit data...
scatter.in.cpp Loading commit data...
select.in.cpp Loading commit data...
shape_of.in.cpp Loading commit data...
sigmoid.in.cpp Loading commit data...
sign.in.cpp Loading commit data...
sin.in.cpp Loading commit data...
sinh.in.cpp Loading commit data...
slice.in.cpp Loading commit data...
softmax.in.cpp Loading commit data...
sqrt.in.cpp Loading commit data...
strided_slice.in.cpp Loading commit data...
subtract.in.cpp Loading commit data...
sum.in.cpp Loading commit data...
tan.in.cpp Loading commit data...
tanh.in.cpp Loading commit data...
tile.in.cpp Loading commit data...
topk.in.cpp Loading commit data...
transpose.in.cpp Loading commit data...
unhandled_op.in.cpp Loading commit data...
validate_call.in.cpp Loading commit data...
zero_sized.in.cpp Loading commit data...