STARTING! Log parameter values verbosely: [0] Min num runs: [50] Num threads: [4] Min warmup runs: [1] Graph: [insightface_r100_quant.tflite] Enable op profiling: [1] #threads used for CPU inference: [4] Use NNAPI: [1] NNAPI accelerators available: [vsi-npu,nnapi-reference] Loaded model insightface_r100_quant.tflite Explicitly applied NNAPI delegate, and the model graph will be partially executed by the delegate w/ 51 delegate kernels. The input model file size (MB): 66.1221 Initialized session in 946.291ms. Running benchmark for at least 1 iterations and at least 0.5 seconds but terminate if exceeding 150 seconds. count=1 curr=91110186 Running benchmark for at least 50 iterations and at least 1 seconds but terminate if exceeding 150 seconds. count=50 first=483280 curr=498367 min=470233 max=515991 avg=491776 std=11877 Inference timings in us: Init: 946291, First inference: 91110186, Warmup (avg): 9.11102e+07, Inference (avg): 491776 Note: as the benchmark tool itself affects memory footprint, the following is only APPROXIMATE to the actual memory footprint of the model at runtime. Take the information at your discretion. Peak memory footprint (MB): init=51.1055 overall=82.0742 Profiling Info for Benchmark Initialization: ============================== Run Order ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] ModifyGraphWithDelegate 0.000 717.082 717.082 70.902% 70.902% 42212.000 1 ModifyGraphWithDelegate/0 AllocateTensors 570.020 294.259 147.143 29.098% 100.000% 0.000 2 AllocateTensors/0 ============================== Top by Computation Time ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] ModifyGraphWithDelegate 0.000 717.082 717.082 70.902% 70.902% 42212.000 1 ModifyGraphWithDelegate/0 AllocateTensors 570.020 294.259 147.143 29.098% 100.000% 0.000 2 AllocateTensors/0 Number of nodes executed: 2 ============================== Summary by node type ============================== [Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called] ModifyGraphWithDelegate 1 717.082 70.902% 70.902% 42212.000 1 AllocateTensors 1 294.285 29.098% 100.000% 0.000 2 Timings (microseconds): count=1 curr=1011367 Memory (bytes): count=0 2 nodes observed Operator-wise Profiling Info for Regular Benchmark Runs: ============================== Run Order ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] QUANTIZE 0.031 0.071 0.083 0.017% 0.017% 0.000 1 [data_int8]:0 QUANTIZE 0.114 0.004 0.003 0.001% 0.017% 0.000 1 [Minimum_9/x_requantized]:6 QUANTIZE 0.116 0.002 0.001 0.000% 0.017% 0.000 1 [Minimum_9/x_requantized]:16 QUANTIZE 0.118 0.001 0.001 0.000% 0.018% 0.000 1 [Minimum_9/x_requantized]:30 QUANTIZE 0.119 0.002 0.001 0.000% 0.018% 0.000 1 [Minimum_9/x_requantized]:43 QUANTIZE 0.120 0.001 0.001 0.000% 0.018% 0.000 1 [Minimum_9/x_requantized]:56 QUANTIZE 0.121 0.001 0.001 0.000% 0.018% 0.000 1 [Minimum_9/x_requantized]:70 QUANTIZE 0.122 0.002 0.001 0.000% 0.018% 0.000 1 [Minimum_9/x_requantized]:83 QUANTIZE 0.124 0.001 0.001 0.000% 0.019% 0.000 1 [Minimum_9/x_requantized]:96 QUANTIZE 0.125 0.002 0.001 0.000% 0.019% 0.000 1 [Minimum_9/x_requantized]:109 QUANTIZE 0.126 0.001 0.001 0.000% 0.019% 0.000 1 [Minimum_9/x_requantized]:122 QUANTIZE 0.127 0.001 0.001 0.000% 0.019% 0.000 1 [Minimum_9/x_requantized]:135 QUANTIZE 0.128 0.001 0.001 0.000% 0.019% 0.000 1 [Minimum_9/x_requantized]:148 QUANTIZE 0.130 0.001 0.001 0.000% 0.020% 0.000 1 [Minimum_9/x_requantized]:161 QUANTIZE 0.131 0.001 0.001 0.000% 0.020% 0.000 1 [Minimum_9/x_requantized]:174 QUANTIZE 0.132 0.001 0.001 0.000% 0.020% 0.000 1 [Minimum_9/x_requantized]:187 QUANTIZE 0.133 0.001 0.001 0.000% 0.020% 0.000 1 [Minimum_9/x_requantized]:200 QUANTIZE 0.134 0.002 0.001 0.000% 0.020% 0.000 1 [Minimum_9/x_requantized]:213 QUANTIZE 0.136 0.002 0.001 0.000% 0.021% 0.000 1 [Minimum_9/x_requantized]:226 QUANTIZE 0.137 0.001 0.001 0.000% 0.021% 0.000 1 [Minimum_9/x_requantized]:240 QUANTIZE 0.138 0.001 0.001 0.000% 0.021% 0.000 1 [Minimum_9/x_requantized]:253 QUANTIZE 0.139 0.002 0.001 0.000% 0.021% 0.000 1 [Minimum_9/x_requantized]:266 QUANTIZE 0.140 0.001 0.001 0.000% 0.021% 0.000 1 [Minimum_9/x_requantized]:279 QUANTIZE 0.142 0.001 0.001 0.000% 0.022% 0.000 1 [Minimum_9/x_requantized]:292 QUANTIZE 0.143 0.001 0.001 0.000% 0.022% 0.000 1 [Minimum_9/x_requantized]:305 QUANTIZE 0.144 0.001 0.001 0.000% 0.022% 0.000 1 [Minimum_9/x_requantized]:318 QUANTIZE 0.145 0.001 0.001 0.000% 0.022% 0.000 1 [Minimum_9/x_requantized]:331 QUANTIZE 0.146 0.001 0.001 0.000% 0.022% 0.000 1 [Minimum_9/x_requantized]:344 QUANTIZE 0.147 0.001 0.001 0.000% 0.023% 0.000 1 [Minimum_9/x_requantized]:357 QUANTIZE 0.148 0.001 0.001 0.000% 0.023% 0.000 1 [Minimum_9/x_requantized]:370 QUANTIZE 0.150 0.001 0.001 0.000% 0.023% 0.000 1 [Minimum_9/x_requantized]:383 QUANTIZE 0.151 0.001 0.001 0.000% 0.023% 0.000 1 [Minimum_9/x_requantized]:396 QUANTIZE 0.152 0.001 0.001 0.000% 0.023% 0.000 1 [Minimum_9/x_requantized]:409 QUANTIZE 0.153 0.001 0.001 0.000% 0.024% 0.000 1 [Minimum_9/x_requantized]:422 QUANTIZE 0.154 0.001 0.001 0.000% 0.024% 0.000 1 [Minimum_9/x_requantized]:435 QUANTIZE 0.156 0.001 0.001 0.000% 0.024% 0.000 1 [Minimum_9/x_requantized]:448 QUANTIZE 0.157 0.002 0.001 0.000% 0.024% 0.000 1 [Minimum_9/x_requantized]:461 QUANTIZE 0.158 0.001 0.001 0.000% 0.024% 0.000 1 [Minimum_9/x_requantized]:474 QUANTIZE 0.159 0.001 0.001 0.000% 0.025% 0.000 1 [Minimum_9/x_requantized]:487 QUANTIZE 0.160 0.002 0.001 0.000% 0.025% 0.000 1 [Minimum_9/x_requantized]:500 QUANTIZE 0.161 0.001 0.001 0.000% 0.025% 0.000 1 [Minimum_9/x_requantized]:513 QUANTIZE 0.162 0.001 0.001 0.000% 0.025% 0.000 1 [Minimum_9/x_requantized]:526 QUANTIZE 0.164 0.001 0.001 0.000% 0.025% 0.000 1 [Minimum_9/x_requantized]:539 QUANTIZE 0.165 0.001 0.001 0.000% 0.025% 0.000 1 [Minimum_9/x_requantized]:552 QUANTIZE 0.166 0.000 0.001 0.000% 0.026% 0.000 1 [Minimum_9/x_requantized]:565 QUANTIZE 0.167 0.001 0.001 0.000% 0.026% 0.000 1 [Minimum_9/x_requantized]:578 QUANTIZE 0.168 0.001 0.001 0.000% 0.026% 0.000 1 [Minimum_9/x_requantized]:591 QUANTIZE 0.169 0.001 0.001 0.000% 0.026% 0.000 1 [Minimum_9/x_requantized]:604 QUANTIZE 0.171 0.000 0.001 0.000% 0.026% 0.000 1 [Minimum_9/x_requantized]:617 QUANTIZE 0.172 0.001 0.001 0.000% 0.027% 0.000 1 [Minimum_9/x_requantized]:631 QUANTIZE 0.173 0.001 0.001 0.000% 0.027% 0.000 1 [Minimum_9/x_requantized]:644 TfLiteNnapiDelegate 0.174 24.857 24.705 5.026% 5.053% 0.000 1 [bn0/add_1;stage1_unit3_conv2;conv0;bn0/sub1, Maximum;Minimum_9/x]:657 QUANTIZE 24.882 1.412 1.628 0.331% 5.384% 0.000 1 [bn0/add_1;stage1_unit3_conv2;conv0;bn0/sub1_requantized]:7 MINIMUM 26.511 0.349 0.392 0.080% 5.464% 0.000 1 [Minimum]:8 TfLiteNnapiDelegate 26.904 56.770 58.038 11.808% 17.272% 0.000 1 [stage1_unit1_bn2/add_1;stage1_unit3_conv2;stage1_unit1_conv1;stage1_unit1_bn2/sub1, Maximum_1;Minimum_9/x, stage1_unit1_sc/add_1;stage1_unit3_conv2;stage1_unit1_conv1sc;stage1_unit1_sc/sub1]:658 QUANTIZE 84.945 1.266 1.789 0.364% 17.636% 0.000 1 [stage1_unit1_bn2/add_1;stage1_unit3_conv2;stage1_unit1_conv1;stage1_unit1_bn2/sub1_requantized]:17 MINIMUM 86.736 0.356 0.436 0.089% 17.725% 0.000 1 [Minimum_1]:18 TfLiteNnapiDelegate 87.172 32.093 34.722 7.064% 24.789% 0.000 1 [add_2, stage1_unit2_bn2/add_1;stage1_unit3_conv2;stage1_unit2_conv1;stage1_unit2_bn2/sub1, Maximum_2;Minimum_9/x]:659 QUANTIZE 121.897 0.322 0.470 0.096% 24.885% 0.000 1 [stage1_unit2_bn2/add_1;stage1_unit3_conv2;stage1_unit2_conv1;stage1_unit2_bn2/sub1_requantized]:31 MINIMUM 122.368 0.143 0.156 0.032% 24.916% 0.000 1 [Minimum_2]:32 TfLiteNnapiDelegate 122.525 17.199 18.534 3.771% 28.687% 0.000 1 [add_4, stage1_unit3_bn2/add_1;stage1_unit3_conv2;stage1_unit3_conv1;stage1_unit3_bn2/sub1, Maximum_3;Minimum_9/x]:660 QUANTIZE 141.062 0.386 0.456 0.093% 28.780% 0.000 1 [stage1_unit3_bn2/add_1;stage1_unit3_conv2;stage1_unit3_conv1;stage1_unit3_bn2/sub1_requantized]:44 MINIMUM 141.519 0.114 0.157 0.032% 28.812% 0.000 1 [Minimum_3]:45 TfLiteNnapiDelegate 141.676 19.835 20.934 4.259% 33.071% 0.000 1 [stage2_unit1_bn2/add_1;stage2_unit13_conv2;stage2_unit1_conv1;stage2_unit1_bn2/sub1, Maximum_4;Minimum_9/x, stage2_unit1_sc/add_1;stage2_unit13_conv2;stage2_unit1_conv1sc;stage2_unit1_sc/sub1]:661 QUANTIZE 162.613 0.642 0.881 0.179% 33.250% 0.000 1 [stage2_unit1_bn2/add_1;stage2_unit13_conv2;stage2_unit1_conv1;stage2_unit1_bn2/sub1_requantized]:57 MINIMUM 163.495 0.202 0.248 0.050% 33.301% 0.000 1 [Minimum_4]:58 TfLiteNnapiDelegate 163.744 15.212 16.482 3.353% 36.654% 0.000 1 [add_8, stage2_unit2_bn2/add_1;stage2_unit13_conv2;stage2_unit2_conv1;stage2_unit2_bn2/sub1, Maximum_5;Minimum_9/x]:662 QUANTIZE 180.228 0.163 0.220 0.045% 36.699% 0.000 1 [stage2_unit2_bn2/add_1;stage2_unit13_conv2;stage2_unit2_conv1;stage2_unit2_bn2/sub1_requantized]:71 MINIMUM 180.449 0.061 0.070 0.014% 36.713% 0.000 1 [Minimum_5]:72 TfLiteNnapiDelegate 180.520 9.306 9.845 2.003% 38.716% 0.000 1 [add_10, stage2_unit3_bn2/add_1;stage2_unit13_conv2;stage2_unit3_conv1;stage2_unit3_bn2/sub1, Maximum_6;Minimum_9/x]:663 QUANTIZE 190.368 0.166 0.222 0.045% 38.761% 0.000 1 [stage2_unit3_bn2/add_1;stage2_unit13_conv2;stage2_unit3_conv1;stage2_unit3_bn2/sub1_requantized]:84 MINIMUM 190.591 0.084 0.067 0.014% 38.775% 0.000 1 [Minimum_6]:85 TfLiteNnapiDelegate 190.658 12.329 10.072 2.049% 40.824% 0.000 1 [add_12, stage2_unit4_bn2/add_1;stage2_unit13_conv2;stage2_unit4_conv1;stage2_unit4_bn2/sub1, Maximum_7;Minimum_9/x]:664 QUANTIZE 200.732 0.245 0.216 0.044% 40.868% 0.000 1 [stage2_unit4_bn2/add_1;stage2_unit13_conv2;stage2_unit4_conv1;stage2_unit4_bn2/sub1_requantized]:97 MINIMUM 200.948 0.079 0.079 0.016% 40.884% 0.000 1 [Minimum_7]:98 TfLiteNnapiDelegate 201.028 9.981 9.631 1.959% 42.844% 0.000 1 [add_14, stage2_unit5_bn2/add_1;stage2_unit13_conv2;stage2_unit5_conv1;stage2_unit5_bn2/sub1, Maximum_8;Minimum_9/x]:665 QUANTIZE 210.661 0.182 0.215 0.044% 42.887% 0.000 1 [stage2_unit5_bn2/add_1;stage2_unit13_conv2;stage2_unit5_conv1;stage2_unit5_bn2/sub1_requantized]:110 MINIMUM 210.877 0.068 0.069 0.014% 42.901% 0.000 1 [Minimum_8]:111 TfLiteNnapiDelegate 210.946 9.860 9.626 1.959% 44.860% 0.000 1 [add_16, stage2_unit6_bn2/add_1;stage2_unit13_conv2;stage2_unit6_conv1;stage2_unit6_bn2/sub1, Maximum_9;Minimum_9/x]:666 QUANTIZE 220.575 0.245 0.213 0.043% 44.903% 0.000 1 [stage2_unit6_bn2/add_1;stage2_unit13_conv2;stage2_unit6_conv1;stage2_unit6_bn2/sub1_requantized]:123 MINIMUM 220.789 0.072 0.077 0.016% 44.919% 0.000 1 [Minimum_9]:124 TfLiteNnapiDelegate 220.866 9.304 9.562 1.946% 46.864% 0.000 1 [add_18, stage2_unit7_bn2/add_1;stage2_unit13_conv2;stage2_unit7_conv1;stage2_unit7_bn2/sub1, Maximum_10;Minimum_9/x]:667 QUANTIZE 230.431 0.184 0.212 0.043% 46.907% 0.000 1 [stage2_unit7_bn2/add_1;stage2_unit13_conv2;stage2_unit7_conv1;stage2_unit7_bn2/sub1_requantized]:136 MINIMUM 230.644 0.077 0.074 0.015% 46.922% 0.000 1 [Minimum_10]:137 TfLiteNnapiDelegate 230.718 9.362 9.635 1.960% 48.883% 0.000 1 [add_20, stage2_unit8_bn2/add_1;stage2_unit13_conv2;stage2_unit8_conv1;stage2_unit8_bn2/sub1, Maximum_11;Minimum_9/x]:668 QUANTIZE 240.356 0.182 0.217 0.044% 48.927% 0.000 1 [stage2_unit8_bn2/add_1;stage2_unit13_conv2;stage2_unit8_conv1;stage2_unit8_bn2/sub1_requantized]:149 MINIMUM 240.574 0.117 0.075 0.015% 48.942% 0.000 1 [Minimum_11]:150 TfLiteNnapiDelegate 240.650 9.630 10.017 2.038% 50.980% 0.000 1 [add_22, stage2_unit9_bn2/add_1;stage2_unit13_conv2;stage2_unit9_conv1;stage2_unit9_bn2/sub1, Maximum_12;Minimum_9/x]:669 QUANTIZE 250.669 0.300 0.211 0.043% 51.023% 0.000 1 [stage2_unit9_bn2/add_1;stage2_unit13_conv2;stage2_unit9_conv1;stage2_unit9_bn2/sub1_requantized]:162 MINIMUM 250.880 0.072 0.077 0.016% 51.039% 0.000 1 [Minimum_12]:163 TfLiteNnapiDelegate 250.958 10.261 9.721 1.978% 53.017% 0.000 1 [add_24, stage2_unit10_bn2/add_1;stage2_unit13_conv2;stage2_unit10_conv1;stage2_unit10_bn2/sub1, Maximum_13;Minimum_9/x]:670 QUANTIZE 260.682 0.244 0.215 0.044% 53.060% 0.000 1 [stage2_unit10_bn2/add_1;stage2_unit13_conv2;stage2_unit10_conv1;stage2_unit10_bn2/sub1_requantized]:175 MINIMUM 260.897 0.081 0.078 0.016% 53.076% 0.000 1 [Minimum_13]:176 TfLiteNnapiDelegate 260.975 10.146 9.641 1.962% 55.038% 0.000 1 [add_26, stage2_unit11_bn2/add_1;stage2_unit13_conv2;stage2_unit11_conv1;stage2_unit11_bn2/sub1, Maximum_14;Minimum_9/x]:671 QUANTIZE 270.619 0.184 0.208 0.042% 55.080% 0.000 1 [stage2_unit11_bn2/add_1;stage2_unit13_conv2;stage2_unit11_conv1;stage2_unit11_bn2/sub1_requantized]:188 MINIMUM 270.828 0.072 0.075 0.015% 55.095% 0.000 1 [Minimum_14]:189 TfLiteNnapiDelegate 270.904 9.517 9.570 1.947% 57.042% 0.000 1 [add_28, stage2_unit12_bn2/add_1;stage2_unit13_conv2;stage2_unit12_conv1;stage2_unit12_bn2/sub1, Maximum_15;Minimum_9/x]:672 QUANTIZE 280.476 0.242 0.216 0.044% 57.086% 0.000 1 [stage2_unit12_bn2/add_1;stage2_unit13_conv2;stage2_unit12_conv1;stage2_unit12_bn2/sub1_requantized]:201 MINIMUM 280.692 0.070 0.078 0.016% 57.102% 0.000 1 [Minimum_15]:202 TfLiteNnapiDelegate 280.771 10.027 9.649 1.963% 59.065% 0.000 1 [add_30, stage2_unit13_bn2/add_1;stage2_unit13_conv2;stage2_unit13_conv1;stage2_unit13_bn2/sub1, Maximum_16;Minimum_9/x]:673 QUANTIZE 290.423 0.184 0.206 0.042% 59.107% 0.000 1 [stage2_unit13_bn2/add_1;stage2_unit13_conv2;stage2_unit13_conv1;stage2_unit13_bn2/sub1_requantized]:214 MINIMUM 290.630 0.125 0.081 0.016% 59.124% 0.000 1 [Minimum_16]:215 TfLiteNnapiDelegate 290.711 10.398 10.588 2.154% 61.278% 0.000 1 [stage3_unit1_bn2/add_1;stage3_unit30_conv2;stage3_unit1_conv1;stage3_unit1_bn2/sub1, Maximum_17;Minimum_9/x, stage3_unit1_sc/add_1;stage3_unit30_conv2;stage3_unit1_conv1sc;stage3_unit1_sc/sub1]:674 QUANTIZE 301.301 0.452 0.420 0.086% 61.363% 0.000 1 [stage3_unit1_bn2/add_1;stage3_unit30_conv2;stage3_unit1_conv1;stage3_unit1_bn2/sub1_requantized]:227 MINIMUM 301.722 0.235 0.144 0.029% 61.393% 0.000 1 [Minimum_17]:228 TfLiteNnapiDelegate 301.867 8.364 8.731 1.776% 63.169% 0.000 1 [add_34, stage3_unit2_bn2/add_1;stage3_unit30_conv2;stage3_unit2_conv1;stage3_unit2_bn2/sub1, Maximum_18;Minimum_9/x]:675 QUANTIZE 310.601 0.095 0.107 0.022% 63.191% 0.000 1 [stage3_unit2_bn2/add_1;stage3_unit30_conv2;stage3_unit2_conv1;stage3_unit2_bn2/sub1_requantized]:241 MINIMUM 310.708 0.031 0.033 0.007% 63.198% 0.000 1 [Minimum_18]:242 TfLiteNnapiDelegate 310.742 5.208 5.366 1.092% 64.289% 0.000 1 [add_36, stage3_unit3_bn2/add_1;stage3_unit30_conv2;stage3_unit3_conv1;stage3_unit3_bn2/sub1, Maximum_19;Minimum_9/x]:676 QUANTIZE 316.111 0.094 0.106 0.022% 64.311% 0.000 1 [stage3_unit3_bn2/add_1;stage3_unit30_conv2;stage3_unit3_conv1;stage3_unit3_bn2/sub1_requantized]:254 MINIMUM 316.217 0.034 0.033 0.007% 64.318% 0.000 1 [Minimum_19]:255 TfLiteNnapiDelegate 316.250 5.283 5.349 1.088% 65.406% 0.000 1 [add_38, stage3_unit4_bn2/add_1;stage3_unit30_conv2;stage3_unit4_conv1;stage3_unit4_bn2/sub1, Maximum_20;Minimum_9/x]:677 QUANTIZE 321.602 0.094 0.106 0.022% 65.428% 0.000 1 [stage3_unit4_bn2/add_1;stage3_unit30_conv2;stage3_unit4_conv1;stage3_unit4_bn2/sub1_requantized]:267 MINIMUM 321.709 0.035 0.035 0.007% 65.435% 0.000 1 [Minimum_20]:268 TfLiteNnapiDelegate 321.744 5.309 5.358 1.090% 66.525% 0.000 1 [add_40, stage3_unit5_bn2/add_1;stage3_unit30_conv2;stage3_unit5_conv1;stage3_unit5_bn2/sub1, Maximum_21;Minimum_9/x]:678 QUANTIZE 327.104 0.094 0.107 0.022% 66.547% 0.000 1 [stage3_unit5_bn2/add_1;stage3_unit30_conv2;stage3_unit5_conv1;stage3_unit5_bn2/sub1_requantized]:280 MINIMUM 327.212 0.052 0.035 0.007% 66.554% 0.000 1 [Minimum_21]:281 TfLiteNnapiDelegate 327.248 5.244 5.376 1.094% 67.647% 0.000 1 [add_42, stage3_unit6_bn2/add_1;stage3_unit30_conv2;stage3_unit6_conv1;stage3_unit6_bn2/sub1, Maximum_22;Minimum_9/x]:679 QUANTIZE 332.626 0.094 0.108 0.022% 67.669% 0.000 1 [stage3_unit6_bn2/add_1;stage3_unit30_conv2;stage3_unit6_conv1;stage3_unit6_bn2/sub1_requantized]:293 MINIMUM 332.734 0.039 0.036 0.007% 67.677% 0.000 1 [Minimum_22]:294 TfLiteNnapiDelegate 332.771 5.231 5.374 1.093% 68.770% 0.000 1 [add_44, stage3_unit7_bn2/add_1;stage3_unit30_conv2;stage3_unit7_conv1;stage3_unit7_bn2/sub1, Maximum_23;Minimum_9/x]:680 QUANTIZE 338.147 0.095 0.108 0.022% 68.792% 0.000 1 [stage3_unit7_bn2/add_1;stage3_unit30_conv2;stage3_unit7_conv1;stage3_unit7_bn2/sub1_requantized]:306 MINIMUM 338.255 0.032 0.035 0.007% 68.799% 0.000 1 [Minimum_23]:307 TfLiteNnapiDelegate 338.290 5.246 5.453 1.109% 69.908% 0.000 1 [add_46, stage3_unit8_bn2/add_1;stage3_unit30_conv2;stage3_unit8_conv1;stage3_unit8_bn2/sub1, Maximum_24;Minimum_9/x]:681 QUANTIZE 343.746 0.094 0.111 0.023% 69.931% 0.000 1 [stage3_unit8_bn2/add_1;stage3_unit30_conv2;stage3_unit8_conv1;stage3_unit8_bn2/sub1_requantized]:319 MINIMUM 343.858 0.035 0.037 0.008% 69.939% 0.000 1 [Minimum_24]:320 TfLiteNnapiDelegate 343.896 5.223 5.356 1.090% 71.028% 0.000 1 [add_48, stage3_unit9_bn2/add_1;stage3_unit30_conv2;stage3_unit9_conv1;stage3_unit9_bn2/sub1, Maximum_25;Minimum_9/x]:682 QUANTIZE 349.254 0.096 0.107 0.022% 71.050% 0.000 1 [stage3_unit9_bn2/add_1;stage3_unit30_conv2;stage3_unit9_conv1;stage3_unit9_bn2/sub1_requantized]:332 MINIMUM 349.362 0.032 0.033 0.007% 71.057% 0.000 1 [Minimum_25]:333 TfLiteNnapiDelegate 349.395 5.181 5.371 1.093% 72.150% 0.000 1 [add_50, stage3_unit10_bn2/add_1;stage3_unit30_conv2;stage3_unit10_conv1;stage3_unit10_bn2/sub1, Maximum_26;Minimum_9/x]:683 QUANTIZE 354.768 0.130 0.105 0.021% 72.171% 0.000 1 [stage3_unit10_bn2/add_1;stage3_unit30_conv2;stage3_unit10_conv1;stage3_unit10_bn2/sub1_requantized]:345 MINIMUM 354.874 0.049 0.037 0.007% 72.178% 0.000 1 [Minimum_26]:346 TfLiteNnapiDelegate 354.911 5.378 5.379 1.094% 73.273% 0.000 1 [add_52, stage3_unit11_bn2/add_1;stage3_unit30_conv2;stage3_unit11_conv1;stage3_unit11_bn2/sub1, Maximum_27;Minimum_9/x]:684 QUANTIZE 360.293 0.094 0.106 0.022% 73.295% 0.000 1 [stage3_unit11_bn2/add_1;stage3_unit30_conv2;stage3_unit11_conv1;stage3_unit11_bn2/sub1_requantized]:358 MINIMUM 360.400 0.032 0.033 0.007% 73.301% 0.000 1 [Minimum_27]:359 TfLiteNnapiDelegate 360.434 5.177 5.444 1.108% 74.409% 0.000 1 [add_54, stage3_unit12_bn2/add_1;stage3_unit30_conv2;stage3_unit12_conv1;stage3_unit12_bn2/sub1, Maximum_28;Minimum_9/x]:685 QUANTIZE 365.880 0.094 0.110 0.022% 74.431% 0.000 1 [stage3_unit12_bn2/add_1;stage3_unit30_conv2;stage3_unit12_conv1;stage3_unit12_bn2/sub1_requantized]:371 MINIMUM 365.991 0.053 0.037 0.008% 74.439% 0.000 1 [Minimum_28]:372 TfLiteNnapiDelegate 366.029 5.301 5.403 1.099% 75.538% 0.000 1 [add_56, stage3_unit13_bn2/add_1;stage3_unit30_conv2;stage3_unit13_conv1;stage3_unit13_bn2/sub1, Maximum_29;Minimum_9/x]:686 QUANTIZE 371.434 0.095 0.111 0.023% 75.561% 0.000 1 [stage3_unit13_bn2/add_1;stage3_unit30_conv2;stage3_unit13_conv1;stage3_unit13_bn2/sub1_requantized]:384 MINIMUM 371.546 0.032 0.033 0.007% 75.568% 0.000 1 [Minimum_29]:385 TfLiteNnapiDelegate 371.580 5.248 5.606 1.141% 76.708% 0.000 1 [add_58, stage3_unit14_bn2/add_1;stage3_unit30_conv2;stage3_unit14_conv1;stage3_unit14_bn2/sub1, Maximum_30;Minimum_9/x]:687 QUANTIZE 377.188 0.095 0.110 0.022% 76.730% 0.000 1 [stage3_unit14_bn2/add_1;stage3_unit30_conv2;stage3_unit14_conv1;stage3_unit14_bn2/sub1_requantized]:397 MINIMUM 377.299 0.038 0.036 0.007% 76.738% 0.000 1 [Minimum_30]:398 TfLiteNnapiDelegate 377.335 5.164 5.474 1.114% 77.851% 0.000 1 [add_60, stage3_unit15_bn2/add_1;stage3_unit30_conv2;stage3_unit15_conv1;stage3_unit15_bn2/sub1, Maximum_31;Minimum_9/x]:688 QUANTIZE 382.811 0.094 0.110 0.022% 77.874% 0.000 1 [stage3_unit15_bn2/add_1;stage3_unit30_conv2;stage3_unit15_conv1;stage3_unit15_bn2/sub1_requantized]:410 MINIMUM 382.921 0.032 0.034 0.007% 77.881% 0.000 1 [Minimum_31]:411 TfLiteNnapiDelegate 382.956 5.409 5.745 1.169% 79.049% 0.000 1 [add_62, stage3_unit16_bn2/add_1;stage3_unit30_conv2;stage3_unit16_conv1;stage3_unit16_bn2/sub1, Maximum_32;Minimum_9/x]:689 QUANTIZE 388.703 0.095 0.109 0.022% 79.072% 0.000 1 [stage3_unit16_bn2/add_1;stage3_unit30_conv2;stage3_unit16_conv1;stage3_unit16_bn2/sub1_requantized]:423 MINIMUM 388.813 0.033 0.034 0.007% 79.079% 0.000 1 [Minimum_32]:424 TfLiteNnapiDelegate 388.847 5.227 5.807 1.181% 80.260% 0.000 1 [add_64, stage3_unit17_bn2/add_1;stage3_unit30_conv2;stage3_unit17_conv1;stage3_unit17_bn2/sub1, Maximum_33;Minimum_9/x]:690 QUANTIZE 394.657 0.095 0.111 0.023% 80.283% 0.000 1 [stage3_unit17_bn2/add_1;stage3_unit30_conv2;stage3_unit17_conv1;stage3_unit17_bn2/sub1_requantized]:436 MINIMUM 394.768 0.065 0.032 0.007% 80.289% 0.000 1 [Minimum_33]:437 TfLiteNnapiDelegate 394.801 5.167 5.537 1.126% 81.416% 0.000 1 [add_66, stage3_unit18_bn2/add_1;stage3_unit30_conv2;stage3_unit18_conv1;stage3_unit18_bn2/sub1, Maximum_34;Minimum_9/x]:691 QUANTIZE 400.340 0.094 0.107 0.022% 81.437% 0.000 1 [stage3_unit18_bn2/add_1;stage3_unit30_conv2;stage3_unit18_conv1;stage3_unit18_bn2/sub1_requantized]:449 MINIMUM 400.447 0.031 0.039 0.008% 81.445% 0.000 1 [Minimum_34]:450 TfLiteNnapiDelegate 400.486 5.463 5.499 1.119% 82.564% 0.000 1 [add_68, stage3_unit19_bn2/add_1;stage3_unit30_conv2;stage3_unit19_conv1;stage3_unit19_bn2/sub1, Maximum_35;Minimum_9/x]:692 QUANTIZE 405.988 0.126 0.108 0.022% 82.586% 0.000 1 [stage3_unit19_bn2/add_1;stage3_unit30_conv2;stage3_unit19_conv1;stage3_unit19_bn2/sub1_requantized]:462 MINIMUM 406.096 0.058 0.037 0.008% 82.594% 0.000 1 [Minimum_35]:463 TfLiteNnapiDelegate 406.134 6.085 5.523 1.124% 83.717% 0.000 1 [add_70, stage3_unit20_bn2/add_1;stage3_unit30_conv2;stage3_unit20_conv1;stage3_unit20_bn2/sub1, Maximum_36;Minimum_9/x]:693 QUANTIZE 411.660 0.124 0.106 0.021% 83.739% 0.000 1 [stage3_unit20_bn2/add_1;stage3_unit30_conv2;stage3_unit20_conv1;stage3_unit20_bn2/sub1_requantized]:475 MINIMUM 411.766 0.038 0.038 0.008% 83.747% 0.000 1 [Minimum_36]:476 TfLiteNnapiDelegate 411.804 6.286 5.365 1.092% 84.838% 0.000 1 [add_72, stage3_unit21_bn2/add_1;stage3_unit30_conv2;stage3_unit21_conv1;stage3_unit21_bn2/sub1, Maximum_37;Minimum_9/x]:694 QUANTIZE 417.172 0.125 0.106 0.022% 84.860% 0.000 1 [stage3_unit21_bn2/add_1;stage3_unit30_conv2;stage3_unit21_conv1;stage3_unit21_bn2/sub1_requantized]:488 MINIMUM 417.278 0.039 0.035 0.007% 84.867% 0.000 1 [Minimum_37]:489 TfLiteNnapiDelegate 417.314 5.911 5.480 1.115% 85.982% 0.000 1 [add_74, stage3_unit22_bn2/add_1;stage3_unit30_conv2;stage3_unit22_conv1;stage3_unit22_bn2/sub1, Maximum_38;Minimum_9/x]:695 QUANTIZE 422.796 0.124 0.113 0.023% 86.005% 0.000 1 [stage3_unit22_bn2/add_1;stage3_unit30_conv2;stage3_unit22_conv1;stage3_unit22_bn2/sub1_requantized]:501 MINIMUM 422.909 0.039 0.035 0.007% 86.012% 0.000 1 [Minimum_38]:502 TfLiteNnapiDelegate 422.944 5.689 5.365 1.092% 87.103% 0.000 1 [add_76, stage3_unit23_bn2/add_1;stage3_unit30_conv2;stage3_unit23_conv1;stage3_unit23_bn2/sub1, Maximum_39;Minimum_9/x]:696 QUANTIZE 428.312 0.095 0.111 0.023% 87.126% 0.000 1 [stage3_unit23_bn2/add_1;stage3_unit30_conv2;stage3_unit23_conv1;stage3_unit23_bn2/sub1_requantized]:514 MINIMUM 428.423 0.034 0.033 0.007% 87.132% 0.000 1 [Minimum_39]:515 TfLiteNnapiDelegate 428.457 5.247 5.432 1.105% 88.238% 0.000 1 [add_78, stage3_unit24_bn2/add_1;stage3_unit30_conv2;stage3_unit24_conv1;stage3_unit24_bn2/sub1, Maximum_40;Minimum_9/x]:697 QUANTIZE 433.892 0.095 0.108 0.022% 88.260% 0.000 1 [stage3_unit24_bn2/add_1;stage3_unit30_conv2;stage3_unit24_conv1;stage3_unit24_bn2/sub1_requantized]:527 MINIMUM 434.000 0.034 0.036 0.007% 88.267% 0.000 1 [Minimum_40]:528 TfLiteNnapiDelegate 434.037 5.250 5.393 1.097% 89.364% 0.000 1 [add_80, stage3_unit25_bn2/add_1;stage3_unit30_conv2;stage3_unit25_conv1;stage3_unit25_bn2/sub1, Maximum_41;Minimum_9/x]:698 QUANTIZE 439.432 0.095 0.108 0.022% 89.386% 0.000 1 [stage3_unit25_bn2/add_1;stage3_unit30_conv2;stage3_unit25_conv1;stage3_unit25_bn2/sub1_requantized]:540 MINIMUM 439.541 0.035 0.035 0.007% 89.393% 0.000 1 [Minimum_41]:541 TfLiteNnapiDelegate 439.576 5.333 5.506 1.120% 90.514% 0.000 1 [add_82, stage3_unit26_bn2/add_1;stage3_unit30_conv2;stage3_unit26_conv1;stage3_unit26_bn2/sub1, Maximum_42;Minimum_9/x]:699 QUANTIZE 445.085 0.094 0.108 0.022% 90.536% 0.000 1 [stage3_unit26_bn2/add_1;stage3_unit30_conv2;stage3_unit26_conv1;stage3_unit26_bn2/sub1_requantized]:553 MINIMUM 445.193 0.039 0.040 0.008% 90.544% 0.000 1 [Minimum_42]:554 TfLiteNnapiDelegate 445.234 5.273 5.673 1.154% 91.698% 0.000 1 [add_84, stage3_unit27_bn2/add_1;stage3_unit30_conv2;stage3_unit27_conv1;stage3_unit27_bn2/sub1, Maximum_43;Minimum_9/x]:700 QUANTIZE 450.909 0.095 0.110 0.022% 91.720% 0.000 1 [stage3_unit27_bn2/add_1;stage3_unit30_conv2;stage3_unit27_conv1;stage3_unit27_bn2/sub1_requantized]:566 MINIMUM 451.020 0.051 0.037 0.008% 91.728% 0.000 1 [Minimum_43]:567 TfLiteNnapiDelegate 451.057 5.238 5.682 1.156% 92.884% 0.000 1 [add_86, stage3_unit28_bn2/add_1;stage3_unit30_conv2;stage3_unit28_conv1;stage3_unit28_bn2/sub1, Maximum_44;Minimum_9/x]:701 QUANTIZE 456.742 0.096 0.116 0.024% 92.908% 0.000 1 [stage3_unit28_bn2/add_1;stage3_unit30_conv2;stage3_unit28_conv1;stage3_unit28_bn2/sub1_requantized]:579 MINIMUM 456.859 0.036 0.040 0.008% 92.916% 0.000 1 [Minimum_44]:580 TfLiteNnapiDelegate 456.899 5.183 5.540 1.127% 94.043% 0.000 1 [add_88, stage3_unit29_bn2/add_1;stage3_unit30_conv2;stage3_unit29_conv1;stage3_unit29_bn2/sub1, Maximum_45;Minimum_9/x]:702 QUANTIZE 462.441 0.093 0.113 0.023% 94.066% 0.000 1 [stage3_unit29_bn2/add_1;stage3_unit30_conv2;stage3_unit29_conv1;stage3_unit29_bn2/sub1_requantized]:592 MINIMUM 462.555 0.053 0.038 0.008% 94.074% 0.000 1 [Minimum_45]:593 TfLiteNnapiDelegate 462.594 5.112 5.476 1.114% 95.188% 0.000 1 [add_90, stage3_unit30_bn2/add_1;stage3_unit30_conv2;stage3_unit30_conv1;stage3_unit30_bn2/sub1, Maximum_46;Minimum_9/x]:703 QUANTIZE 468.072 0.094 0.116 0.024% 95.211% 0.000 1 [stage3_unit30_bn2/add_1;stage3_unit30_conv2;stage3_unit30_conv1;stage3_unit30_bn2/sub1_requantized]:605 MINIMUM 468.189 0.036 0.043 0.009% 95.220% 0.000 1 [Minimum_46]:606 TfLiteNnapiDelegate 468.233 6.094 6.236 1.269% 96.489% 0.000 1 [stage4_unit1_bn2/add_1;stage4_unit3_conv2;stage4_unit1_conv1;stage4_unit1_bn2/sub1, Maximum_47;Minimum_9/x, stage4_unit1_sc/add_1;stage4_unit3_conv2;stage4_unit1_conv1sc;stage4_unit1_sc/sub1]:704 QUANTIZE 474.472 0.184 0.219 0.045% 96.533% 0.000 1 [stage4_unit1_bn2/add_1;stage4_unit3_conv2;stage4_unit1_conv1;stage4_unit1_bn2/sub1_requantized]:618 MINIMUM 474.691 0.063 0.066 0.013% 96.547% 0.000 1 [Minimum_47]:619 TfLiteNnapiDelegate 474.758 6.108 5.786 1.177% 97.724% 0.000 1 [add_94, stage4_unit2_bn2/add_1;stage4_unit3_conv2;stage4_unit2_conv1;stage4_unit2_bn2/sub1, Maximum_48;Minimum_9/x]:705 QUANTIZE 480.546 0.067 0.058 0.012% 97.736% 0.000 1 [stage4_unit2_bn2/add_1;stage4_unit3_conv2;stage4_unit2_conv1;stage4_unit2_bn2/sub1_requantized]:632 MINIMUM 480.605 0.021 0.021 0.004% 97.740% 0.000 1 [Minimum_48]:633 TfLiteNnapiDelegate 480.627 4.539 3.926 0.799% 98.539% 0.000 1 [add_96, stage4_unit3_bn2/add_1;stage4_unit3_conv2;stage4_unit3_conv1;stage4_unit3_bn2/sub1, Maximum_49;Minimum_9/x]:706 QUANTIZE 484.555 0.110 0.059 0.012% 98.551% 0.000 1 [stage4_unit3_bn2/add_1;stage4_unit3_conv2;stage4_unit3_conv1;stage4_unit3_bn2/sub1_requantized]:645 MINIMUM 484.614 0.062 0.020 0.004% 98.555% 0.000 1 [Minimum_49]:646 TfLiteNnapiDelegate 484.635 7.672 7.095 1.444% 99.999% 0.000 1 [output_int8]:707 DEQUANTIZE 491.732 0.006 0.007 0.001% 100.000% 0.000 1 [output]:656 ============================== Top by Computation Time ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] TfLiteNnapiDelegate 26.904 56.770 58.038 11.808% 11.808% 0.000 1 [stage1_unit1_bn2/add_1;stage1_unit3_conv2;stage1_unit1_conv1;stage1_unit1_bn2/sub1, Maximum_1;Minimum_9/x, stage1_unit1_sc/add_1;stage1_unit3_conv2;stage1_unit1_conv1sc;stage1_unit1_sc/sub1]:658 TfLiteNnapiDelegate 87.172 32.093 34.722 7.064% 18.872% 0.000 1 [add_2, stage1_unit2_bn2/add_1;stage1_unit3_conv2;stage1_unit2_conv1;stage1_unit2_bn2/sub1, Maximum_2;Minimum_9/x]:659 TfLiteNnapiDelegate 0.174 24.857 24.705 5.026% 23.899% 0.000 1 [bn0/add_1;stage1_unit3_conv2;conv0;bn0/sub1, Maximum;Minimum_9/x]:657 TfLiteNnapiDelegate 141.676 19.835 20.934 4.259% 28.158% 0.000 1 [stage2_unit1_bn2/add_1;stage2_unit13_conv2;stage2_unit1_conv1;stage2_unit1_bn2/sub1, Maximum_4;Minimum_9/x, stage2_unit1_sc/add_1;stage2_unit13_conv2;stage2_unit1_conv1sc;stage2_unit1_sc/sub1]:661 TfLiteNnapiDelegate 122.525 17.199 18.534 3.771% 31.929% 0.000 1 [add_4, stage1_unit3_bn2/add_1;stage1_unit3_conv2;stage1_unit3_conv1;stage1_unit3_bn2/sub1, Maximum_3;Minimum_9/x]:660 TfLiteNnapiDelegate 163.744 15.212 16.482 3.353% 35.282% 0.000 1 [add_8, stage2_unit2_bn2/add_1;stage2_unit13_conv2;stage2_unit2_conv1;stage2_unit2_bn2/sub1, Maximum_5;Minimum_9/x]:662 TfLiteNnapiDelegate 290.711 10.398 10.588 2.154% 37.436% 0.000 1 [stage3_unit1_bn2/add_1;stage3_unit30_conv2;stage3_unit1_conv1;stage3_unit1_bn2/sub1, Maximum_17;Minimum_9/x, stage3_unit1_sc/add_1;stage3_unit30_conv2;stage3_unit1_conv1sc;stage3_unit1_sc/sub1]:674 TfLiteNnapiDelegate 190.658 12.329 10.072 2.049% 39.485% 0.000 1 [add_12, stage2_unit4_bn2/add_1;stage2_unit13_conv2;stage2_unit4_conv1;stage2_unit4_bn2/sub1, Maximum_7;Minimum_9/x]:664 TfLiteNnapiDelegate 240.650 9.630 10.017 2.038% 41.523% 0.000 1 [add_22, stage2_unit9_bn2/add_1;stage2_unit13_conv2;stage2_unit9_conv1;stage2_unit9_bn2/sub1, Maximum_12;Minimum_9/x]:669 TfLiteNnapiDelegate 180.520 9.306 9.845 2.003% 43.526% 0.000 1 [add_10, stage2_unit3_bn2/add_1;stage2_unit13_conv2;stage2_unit3_conv1;stage2_unit3_bn2/sub1, Maximum_6;Minimum_9/x]:663 Number of nodes executed: 203 ============================== Summary by node type ============================== [Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called] TfLiteNnapiDelegate 51 476.059 96.877% 96.877% 0.000 51 QUANTIZE 101 11.788 2.399% 99.276% 0.000 101 MINIMUM 50 3.552 0.723% 99.999% 0.000 50 DEQUANTIZE 1 0.006 0.001% 100.000% 0.000 1 Timings (microseconds): count=50 first=482997 curr=498126 min=469960 max=515735 avg=491513 std=11884 Memory (bytes): count=0 203 nodes observed