add backend performance notes

master
Vladimir Mandic 2021-09-03 16:47:02 -04:00
parent 7f55fd1c8a
commit 1c337a32a0
1 changed files with 19 additions and 0 deletions

@ -10,6 +10,25 @@ Experimental support is added for `WebGPU` backend in **Browsers** and `WASM` ba
<br>
## Backend Performance Compare
Performance compare using single model:
| Backend | Variation | Warmup | Average |
| --- | --- | --- | --- |
| CPU || 1230 ms | 1230 ms |
| WASM | Default | 338 ms | 255 ms |
| WASM | SIMD | 125 ms | 62 ms |
| WebGL | Default | 6015 ms | 18 ms |
| WebGL | Pack Disable| 2698 ms | 22 ms |
| WebGL | Uniforms Enable | 2082 ms | 20 ms |
| WebGPU | GSLS | 3877 ms | 12 ms |
| WebGPU | WGSL | N/A | N/A |
| TFlite | | N/A | N/A |
| TFlite | SIMD | N/A | N/A |
<br>
## Tensorflow Backend
When used in `NodeJS`, load either `tfjs-node` or `tfjs-node-gpu` modules before loading `Human` library