2021-03-03 18:04:59 +01:00
|
|
|
# To-Do list for Human library
|
|
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
## Work-in-Progress
|
2021-04-25 19:16:04 +02:00
|
|
|
|
2021-09-26 16:09:30 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
<hr><br>
|
2021-10-19 13:58:51 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
## Exploring
|
|
|
|
|
|
2022-09-27 17:51:55 +02:00
|
|
|
- **Optical flow** for intelligent temporal interpolation
|
2022-06-02 16:39:53 +02:00
|
|
|
<https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html>
|
2022-09-27 17:51:55 +02:00
|
|
|
- **CLAHE** advanced histogram equalization for optimization of badly lit scenes
|
|
|
|
|
- **TFLite** models
|
2022-06-02 16:39:53 +02:00
|
|
|
<https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/>
|
2022-09-27 17:51:55 +02:00
|
|
|
- **Principal Components Analysis** for reduction of descriptor complexity
|
|
|
|
|
<https://github.com/vladmandic/human-match/blob/main/src/pca.js>
|
|
|
|
|
- **Temporal guidance** for face/body segmentation
|
2022-06-02 16:39:53 +02:00
|
|
|
<https://github.com/PeterL1n/RobustVideoMatting>
|
|
|
|
|
|
|
|
|
|
<hr><br>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2022-10-02 21:09:00 +02:00
|
|
|
## Known Issues & Limitations
|
2022-07-25 14:33:07 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
### Face with Attention
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2022-09-30 16:20:08 +02:00
|
|
|
`FaceMesh-Attention` is not supported when using `WASM` backend due to missing kernel op in **TFJS**
|
2022-10-02 21:09:00 +02:00
|
|
|
No issues with default model `FaceMesh`
|
2022-08-30 16:28:33 +02:00
|
|
|
|
|
|
|
|
### Object Detection
|
|
|
|
|
|
2022-09-30 16:20:08 +02:00
|
|
|
`NanoDet` model is not supported when using `WASM` backend due to missing kernel op in **TFJS**
|
2022-10-02 21:09:00 +02:00
|
|
|
No issues with default model `MB3-CenterNet`
|
2021-11-16 19:07:44 +01:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
### WebGPU
|
|
|
|
|
|
|
|
|
|
Experimental support only until support is officially added in Chromium
|
2022-10-02 21:09:00 +02:00
|
|
|
Enable via <chrome://flags/#enable-unsafe-webgpu>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
### Firefox
|
|
|
|
|
|
|
|
|
|
Running in **web workers** requires `OffscreenCanvas` which is still disabled by default in **Firefox**
|
2022-10-02 21:09:00 +02:00
|
|
|
Enable via `about:config` -> `gfx.offscreencanvas.enabled`
|
|
|
|
|
[Details](https://developer.mozilla.org/en-US/docs/Web/API/OffscreenCanvas#browser_compatibility)
|
|
|
|
|
|
|
|
|
|
### Safari
|
|
|
|
|
|
|
|
|
|
No support for running in **web workers** as Safari still does not support `OffscreenCanvas`
|
|
|
|
|
[Details](https://developer.mozilla.org/en-US/docs/Web/API/OffscreenCanvas#browser_compatibility)
|
2022-06-02 16:39:53 +02:00
|
|
|
|
|
|
|
|
<hr><br>
|
2021-11-09 20:37:50 +01:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
## Pending Release Changes
|
2022-07-18 14:22:19 +02:00
|
|
|
|
2022-10-18 16:25:53 +02:00
|
|
|
- Upgrade to TFJS 4.0 with **strong typing**
|
|
|
|
|
see [notes](https://github.com/vladmandic/human#typedefs) on how to use
|
|
|
|
|
- `TypeDef` refactoring
|
|
|
|
|
- Add [draw label templates](https://github.com/vladmandic/human/wiki/Draw)
|
|
|
|
|
- Reduce build dependencies
|
2022-10-28 15:29:15 +02:00
|
|
|
`Human` is now 30% smaller :)
|
|
|
|
|
- Add named export for improved bundler support
|
