I did some performance comparison using OpenVino for CPU (i5-8350U) vs GPU (Intel UHD Graphics 620)
I am running a simple inference (1x3x224x224 image using ResNet18). What surprises me is that I do not see any performance difference between CPU and GPU. Both are giving average inference time of around 15ms.
Could I be missing something?