SDK Benchmarks - GPU

OperationVRAM UsageSpeed RTX 3080 LaptopSpeed GTX 1070Speed Jetson Xavier NX, 15W 6 coreSpeed Jetson Xavier NX, 10W 4 coreSpeed Jetson Nano, Max
Preprocess Image
-
5.3 ms
Face and landmark detection
1.9 Gb
4.6 ms
17.5 ms
19.9 ms
20.4 ms
52 ms
Face recognition template extraction TFV5, batch size = 1
2.73 Gb
8.7 ms
11.6 ms
70 ms
80 ms
250 ms
Face recognition template extraction TFV5, batch size = 2
2.89 Gb
5.2 ms
7.9 ms
-
-
-
Face recognition template extraction TFV5, batch size = 4
3.22 Gb
4.1 ms
6.4 ms
-
-
-
Face recognition template extraction TFV5, batch size = 8
3.78 Gb
3.25 ms
5.7 ms
-
-
-
Face recognition template extraction TFV5, batch size = 16
4.91 Gb
2.62 ms
5.1 ms
-
-
-
Face recognition template extraction TFV5, batch size = 32
6.85 Gb
2.25 ms
6.3 ms
-
-
-
Face recognition template extraction TFV6, batch size = 1
1.5 Gb
2.20 ms
-
15.36 ms
23.49 ms
-
Face recognition template extraction TFV6, batch size = 2
1.5 Gb
1.44 ms
-
-
-
-
Face recognition template extraction TFV6, batch size = 4
1.5 Gb
1.14 ms
-
10.51 ms
15.37 ms
-
Face recognition template extraction TFV6, batch size = 8
1.5 Gb
1.04 ms
-
8.75 ms
10.95 ms
-
Face recognition template extraction TFV6, batch size = 16
1.5 Gb
0.93 ms
-
-
-
-
Face recognition template extraction TFV6, batch size = 32
1.6 Gb
0.85 ms
-
-
-
-