2021-03-03 18:04:59 +01:00
|
|
|
# To-Do list for Human library
|
|
|
|
|
|
2021-03-13 00:24:34 +01:00
|
|
|
## Big Ticket Items
|
|
|
|
|
|
2021-07-31 13:43:50 +02:00
|
|
|
Implementation of WebGPU backend
|
2021-08-09 16:46:03 +02:00
|
|
|
*Target: `Human` v2.3 with `Chrome` v94 and `TFJS` v4.0*
|
2021-07-31 13:43:50 +02:00
|
|
|
|
|
|
|
|
<br>
|
2021-04-19 17:36:44 +02:00
|
|
|
|
2021-06-05 22:13:41 +02:00
|
|
|
## Work in Progress
|
2021-04-25 19:16:04 +02:00
|
|
|
|
2021-07-31 13:43:50 +02:00
|
|
|
WebGL shader optimizations for faster load and initial detection
|
|
|
|
|
|
2021-08-09 16:46:03 +02:00
|
|
|
- Implement WebGL uniforms for shaders: <https://github.com/tensorflow/tfjs/issues/5205>
|
|
|
|
|
- Fix shader packing: <https://github.com/tensorflow/tfjs/issues/5343>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
|
|
|
|
<br>
|
2021-05-31 16:40:07 +02:00
|
|
|
|
2021-08-09 16:46:03 +02:00
|
|
|
## Exploring
|
|
|
|
|
|
|
|
|
|
- Optical Flow: <https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html>
|
|
|
|
|
- TFLite Models: <https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/>
|
|
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
<br>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
## Known Issues
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
<br>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
|
|
|
|
### Face Detection
|
|
|
|
|
|
|
|
|
|
Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
|
|
|
|
|
Feature is automatically disabled in NodeJS without user impact
|
|
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
- Backend NodeJS missing kernel op `FlipLeftRight`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/4066>
|
|
|
|
|
*Target: `Human` v2.2 with `TFJS` v3.9*
|
|
|
|
|
- Backend NodeJS missing kernel op `RotateWithOffset`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5473>
|
|
|
|
|
*Target: N/A*
|
|
|
|
|
|
|
|
|
|
<br>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
|
|
|
|
### Hand Detection
|
|
|
|
|
|
|
|
|
|
Enhanced rotation correction for hand detection is not working in NodeJS due to missing kernel op in TFJS
|
|
|
|
|
Feature is automatically disabled in NodeJS without user impact
|
|
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
- Backend NodeJS missing kernel op `FlipLeftRight`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/4066>
|
|
|
|
|
*Target: `Human` v2.2 with `TFJS` v3.9*
|
|
|
|
|
- Backend NodeJS missing kernel op `RotateWithOffset`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5473>
|
|
|
|
|
*Target: N/A*
|
2021-07-31 13:43:50 +02:00
|
|
|
|
|
|
|
|
Hand detection using WASM backend has reduced precision due to math rounding errors in backend
|
2021-08-09 16:46:03 +02:00
|
|
|
*Target: N/A*
|
2021-08-12 15:31:16 +02:00
|
|
|
|
|
|
|
|
<br>
|
|
|
|
|
|
|
|
|
|
### Object Detection
|
|
|
|
|
|
|
|
|
|
Object detection using CenterNet or NanoDet models is not working when using WASM backend due to missing kernel ops in TFJS
|
|
|
|
|
|
|
|
|
|
- Backend WASM missing kernel op `Mod`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5110>
|
|
|
|
|
*Target: `Human` v2.2 with `TFJS` v3.9*
|
|
|
|
|
- Backend WASM missing kernel op `SparseToDense`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/4824>
|
|
|
|
|
*Target: `Human` v2.2 with `TFJS` v3.9*
|
2021-08-15 00:02:39 +02:00
|
|
|
|
|
|
|
|
### WebGPU
|
|
|
|
|
|
|
|
|
|
Experimental support only
|
|
|
|
|
|
|
|
|
|
- Backend WebGPU missing kernel ops
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5496>
|
|
|
|
|
- Backend WebGPU incompatible with web workers
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5467>
|
|
|
|
|
- Backend WebGPU incompatible with sync read calls
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5468>
|
