[Dynamic batch size] Model Resnet50 set dynamic batch size failed!

[Dynamic batch size] Model Resnet50 set dynamic batch size failed!

Hello Sir,

 My Env: Win10, Intel CPU i7(8750H), SDK 2019 R2

 It it run OK for fixed batch size = 2;

 But When it is set to be dynamic batch size, It print failed at run:

   "executable_network = core.LoadNetwork(network, dyn_config);"

 Error log:

   "MKLDNNGraph::CreateGraph: such topology cannot be complied for dynamic batch! Error"

 My Question: Is it not support dynamic batch for Resnet50 model ?

Best Regards,

Ke

 

5 posts / 0 new
Last post
For more complete information about compiler optimizations, see our Optimization Notice.

More info:

Log is same with "Dynamic Batching with Face Detection Model"

https://software.intel.com/en-us/forums/computer-vision/topic/808634

 

Best Reply

Dear ke, xu,

As the Dynamic Batching Doc says, Dynamic Batching supports only some layers.  My guess is that Resnet50 has some unsupported layers.

Hope it helps,

Thanks,

Shubha

Dear Shubha,

 Thank you very much!

Dear Dear ke, xu,

Of course ! 

Glad to help.

Thanks,

Shubha

Leave a Comment

Please sign in to add a comment. Not a member? Join today