From 1c337a32a0fba884d1f831ea2249f51f26d63242 Mon Sep 17 00:00:00 2001 From: Vladimir Mandic Date: Fri, 3 Sep 2021 16:47:02 -0400 Subject: [PATCH] add backend performance notes --- Backends.md | 19 +++++++++++++++++++ 1 file changed, 19 insertions(+) diff --git a/Backends.md b/Backends.md index 25e5fcf..7b06bc7 100644 --- a/Backends.md +++ b/Backends.md @@ -10,6 +10,25 @@ Experimental support is added for `WebGPU` backend in **Browsers** and `WASM` ba
+## Backend Performance Compare + +Performance compare using single model: + +| Backend | Variation | Warmup | Average | +| --- | --- | --- | --- | +| CPU || 1230 ms | 1230 ms | +| WASM | Default | 338 ms | 255 ms | +| WASM | SIMD | 125 ms | 62 ms | +| WebGL | Default | 6015 ms | 18 ms | +| WebGL | Pack Disable| 2698 ms | 22 ms | +| WebGL | Uniforms Enable | 2082 ms | 20 ms | +| WebGPU | GSLS | 3877 ms | 12 ms | +| WebGPU | WGSL | N/A | N/A | +| TFlite | | N/A | N/A | +| TFlite | SIMD | N/A | N/A | + +
+ ## Tensorflow Backend When used in `NodeJS`, load either `tfjs-node` or `tfjs-node-gpu` modules before loading `Human` library