| Operation | VRAM Usage | Speed RTX 3080 Laptop | Speed GTX 1070 | Speed Jetson Xavier NX, 15W 6 core | Speed Jetson Xavier NX, 10W 4 core | Speed Jetson Nano, Max |
|---|---|---|---|---|---|---|
Preprocess Image | - | 5.3 ms | ||||
Face and landmark detection | 1.9 Gb | 4.6 ms | 17.5 ms | 19.9 ms | 20.4 ms | 52 ms |
Face recognition template extraction TFV5, batch size = 1 | 2.73 Gb | 8.7 ms | 11.6 ms | 70 ms | 80 ms | 250 ms |
Face recognition template extraction TFV5, batch size = 2 | 2.89 Gb | 5.2 ms | 7.9 ms | - | - | - |
Face recognition template extraction TFV5, batch size = 4 | 3.22 Gb | 4.1 ms | 6.4 ms | - | - | - |
Face recognition template extraction TFV5, batch size = 8 | 3.78 Gb | 3.25 ms | 5.7 ms | - | - | - |
Face recognition template extraction TFV5, batch size = 16 | 4.91 Gb | 2.62 ms | 5.1 ms | - | - | - |
Face recognition template extraction TFV5, batch size = 32 | 6.85 Gb | 2.25 ms | 6.3 ms | - | - | - |
Face recognition template extraction TFV6, batch size = 1 | 1.5 Gb | 2.20 ms | - | 15.36 ms | 23.49 ms | - |
Face recognition template extraction TFV6, batch size = 2 | 1.5 Gb | 1.44 ms | - | - | - | - |
Face recognition template extraction TFV6, batch size = 4 | 1.5 Gb | 1.14 ms | - | 10.51 ms | 15.37 ms | - |
Face recognition template extraction TFV6, batch size = 8 | 1.5 Gb | 1.04 ms | - | 8.75 ms | 10.95 ms | - |
Face recognition template extraction TFV6, batch size = 16 | 1.5 Gb | 0.93 ms | - | - | - | - |
Face recognition template extraction TFV6, batch size = 32 | 1.6 Gb | 0.85 ms | - | - | - | - |
Mask Detection, batch size = 1 | 1.3 Gb | 0.87 ms | ||||
Mask Detection, batch size = 4 | 1.3 Gb | 0.23 ms |