From 479c8a3d7442c21be7542313ebcfc33e67bc6fc1 Mon Sep 17 00:00:00 2001 From: Vladimir Mandic Date: Sun, 26 Sep 2021 10:09:30 -0400 Subject: [PATCH] update todo --- TODO.md | 69 +++++++++++++++++++++++---------------------------------- 1 file changed, 28 insertions(+), 41 deletions(-) diff --git a/TODO.md b/TODO.md index 32225f83..1fcda431 100644 --- a/TODO.md +++ b/TODO.md @@ -4,16 +4,18 @@
-### Hand +### Models + +#### Hand - Evaluate and switch default default model from `handdetect` to `handtrack` -## Body +#### Body - Implement new variations of `BlazePose` models - Add virtual box frame caching to `MoveNet` -## Face +#### Face - Reimplement `BlazeFace`, `FaceMesh`, `Iris` with new pipeline and frame caching @@ -21,9 +23,28 @@ ### Backends +#### WebGL - Optimize shader packing for WebGL backend: -- Add and benchmark WGSL for WebGPU + +#### WASM + +- Backend WASM incorrect handling of `int32` tensors + + +#### WebGPU + +Implementation of WebGPU backend +Experimental support only until support is officially added in Chromium + +- Evaluate WGSL vs GLSL for WebGPU +- Backend WebGPU missing kernel ops + +- Backend WebGPU incompatible with web workers + +- Backend WebGPU incompatible with sync read calls + +
@@ -32,7 +53,7 @@ - Optical Flow: - TFLite Models: -
+


## Known Issues @@ -46,17 +67,6 @@ Feature is automatically disabled in NodeJS without user impact - Backend NodeJS missing kernel op `RotateWithOffset` -
- -### Face Emotion Detection - -Face Emotion detection using WASM backend has reduced precision due to math errors in backend - -- Backend WASM incorrect handling of `int32` tensors - - -
- ### Hand Detection Enhanced rotation correction for hand detection is not working in NodeJS due to missing kernel op in TFJS @@ -65,18 +75,11 @@ Feature is automatically disabled in NodeJS without user impact - Backend NodeJS missing kernel op `RotateWithOffset` -Hand detection using WASM backend has reduced precision due to math errors in backend - -- Backend WASM incorrect handling of `int32` tensors - - -
- ### Body Detection -MoveNet MultiPose model does not work with WASM backend due to missing F32 implementation +MoveNet MultiPose model does not work with WASM backend due to missing F32 broadcast implementation -- Backend WASM missing F32 implementation +- Backend WASM missing F32 broadcat implementation ### Object Detection @@ -87,19 +90,3 @@ Object detection using CenterNet or NanoDet models is not working when using WAS - Backend WASM missing kernel op `SparseToDense` - -### WebGPU Backend - -Implementation of WebGPU backend -Experimental support only - -*Target: `Human` v2.3 with `Chrome` v94 and `TFJS` v4.0* - -
- -- Backend WebGPU missing kernel ops - -- Backend WebGPU incompatible with web workers - -- Backend WebGPU incompatible with sync read calls -