human/TODO.md

82 lines
2.1 KiB
Markdown
Raw Normal View History

2021-03-03 18:04:59 +01:00
# To-Do list for Human library
## Work in Progress
2021-04-25 19:16:04 +02:00
- Switch to custom `tfjs` for main `human` ESM bundle
2021-09-22 22:00:43 +02:00
<br>
2021-09-26 16:09:30 +02:00
### Models
- Body segmentation: `robust-video-matting`
2021-09-22 22:00:43 +02:00
<br>
### Backends
2021-07-31 13:43:50 +02:00
2021-09-26 16:09:30 +02:00
#### WASM
- Backend WASM incorrect handling of `int32` tensors
<https://github.com/tensorflow/tfjs/issues/5641>
#### WebGPU
Experimental support only until support is officially added in Chromium
2021-10-12 20:17:33 +02:00
- Performance issues:
<https://github.com/tensorflow/tfjs/issues/5689>
2021-07-31 13:43:50 +02:00
<br>
2021-09-22 22:00:43 +02:00
### Exploring
2021-08-09 16:46:03 +02:00
- Optical Flow: <https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html>
- TFLite Models: <https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/>
- Histogram Equalization: Regular, Adaptive, Contrast Limited
2021-08-09 16:46:03 +02:00
2021-09-26 16:09:30 +02:00
<br><hr><br>
2021-07-31 13:43:50 +02:00
2021-08-12 15:31:16 +02:00
## Known Issues
2021-07-31 13:43:50 +02:00
2021-08-12 15:31:16 +02:00
<br>
2021-07-31 13:43:50 +02:00
### Face Detection
Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact
2021-08-12 15:31:16 +02:00
- Backend NodeJS missing kernel op `RotateWithOffset`
<https://github.com/tensorflow/tfjs/issues/5473>
2021-07-31 13:43:50 +02:00
### Hand Detection
Enhanced rotation correction for hand detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact
2021-08-12 15:31:16 +02:00
- Backend NodeJS missing kernel op `RotateWithOffset`
<https://github.com/tensorflow/tfjs/issues/5473>
2021-07-31 13:43:50 +02:00
2021-08-20 15:05:07 +02:00
### Body Detection
2021-09-26 16:09:30 +02:00
MoveNet MultiPose model does not work with WASM backend due to missing F32 broadcast implementation
2021-08-20 15:05:07 +02:00
2021-09-26 16:09:30 +02:00
- Backend WASM missing F32 broadcat implementation
2021-08-20 15:05:07 +02:00
<https://github.com/tensorflow/tfjs/issues/5516>
2021-08-12 15:31:16 +02:00
### Object Detection
Object detection using CenterNet or NanoDet models is not working when using WASM backend due to missing kernel ops in TFJS
- Backend WASM missing kernel op `Mod`
<https://github.com/tensorflow/tfjs/issues/5110>
- Backend WASM missing kernel op `SparseToDense`
<https://github.com/tensorflow/tfjs/issues/4824>
<br><hr><br>
## Pending Release
- Enhanced **MoveNet** post-processing
- Add optional **Anti-Spoof** module
- Remove old **HandDetect** and **PoseNet** models from default installation
- Refactor **ImageFX** module