2021-03-03 18:04:59 +01:00
|
|
|
# To-Do list for Human library
|
|
|
|
|
|
2021-06-05 22:13:41 +02:00
|
|
|
## Work in Progress
|
2021-04-25 19:16:04 +02:00
|
|
|
|
2021-09-22 22:00:43 +02:00
|
|
|
<br>
|
|
|
|
|
|
2021-10-22 15:48:27 +02:00
|
|
|
### Exploring
|
2021-09-26 16:09:30 +02:00
|
|
|
|
2021-10-23 15:38:52 +02:00
|
|
|
- Switch to custom `tfjs` for main `human` ESM bundle
|
2021-10-22 15:48:27 +02:00
|
|
|
- Optical Flow: <https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html>
|
|
|
|
|
- Histogram Equalization: Regular, Adaptive, Contrast Limited
|
2021-10-23 15:38:52 +02:00
|
|
|
- TFLite Models: <https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/>
|
2021-10-19 13:58:51 +02:00
|
|
|
- Body segmentation: `robust-video-matting`
|
|
|
|
|
|
2021-09-26 16:09:30 +02:00
|
|
|
#### WebGPU
|
|
|
|
|
|
|
|
|
|
Experimental support only until support is officially added in Chromium
|
2021-10-12 20:17:33 +02:00
|
|
|
- Performance issues:
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5689>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2021-09-26 16:09:30 +02:00
|
|
|
<br><hr><br>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
## Known Issues
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
<br>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
|
|
|
|
### Face Detection
|
|
|
|
|
|
|
|
|
|
Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
|
|
|
|
|
Feature is automatically disabled in NodeJS without user impact
|
|
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
- Backend NodeJS missing kernel op `RotateWithOffset`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5473>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2021-08-20 15:05:07 +02:00
|
|
|
### Body Detection
|
|
|
|
|
|
2021-09-26 16:09:30 +02:00
|
|
|
MoveNet MultiPose model does not work with WASM backend due to missing F32 broadcast implementation
|
2021-08-20 15:05:07 +02:00
|
|
|
|
2021-09-26 16:09:30 +02:00
|
|
|
- Backend WASM missing F32 broadcat implementation
|
2021-08-20 15:05:07 +02:00
|
|
|
<https://github.com/tensorflow/tfjs/issues/5516>
|
|
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
### Object Detection
|
|
|
|
|
|
|
|
|
|
Object detection using CenterNet or NanoDet models is not working when using WASM backend due to missing kernel ops in TFJS
|
|
|
|
|
|
|
|
|
|
- Backend WASM missing kernel op `Mod`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/5110>
|
|
|
|
|
- Backend WASM missing kernel op `SparseToDense`
|
|
|
|
|
<https://github.com/tensorflow/tfjs/issues/4824>
|
2021-10-19 13:58:51 +02:00
|
|
|
|
|
|
|
|
<br><hr><br>
|
|
|
|
|
|
|
|
|
|
## Pending Release
|
|
|
|
|
|
2021-10-22 15:48:27 +02:00
|
|
|
- Update to TFJS 3.10.0
|
2021-10-25 19:09:00 +02:00
|
|
|
- Update to Node v17 for Dev environment
|
2021-10-23 15:38:52 +02:00
|
|
|
- Time based caching
|
2021-10-22 15:48:27 +02:00
|
|
|
- Multiple bug fixes
|
|
|
|
|
- Utility class `human.env`
|
2021-10-22 22:11:02 +02:00
|
|
|
- Add `skipTime` in addition to `skipFrames`
|
2021-10-23 15:42:41 +02:00
|
|
|
- Updated configuration default values
|
|
|
|
|
- Updated TS typings
|
2021-10-25 19:09:00 +02:00
|
|
|
- Updated JSDoc comments and **TypeDoc** documentation
|
2021-10-19 13:58:51 +02:00
|
|
|
- Enhanced **MoveNet** post-processing
|
2021-10-25 19:09:00 +02:00
|
|
|
- Increase `human.similarity` resolution
|
2021-10-19 13:58:51 +02:00
|
|
|
- Add optional **Anti-Spoof** module
|
|
|
|
|
- Remove old **HandDetect** and **PoseNet** models from default installation
|
|
|
|
|
- Refactor **ImageFX** module
|
2021-10-23 15:42:41 +02:00
|
|
|
- Experimental `human.custom.esm` module with custom **TFJS** build
|
