2021-03-03 18:04:59 +01:00
|
|
|
# To-Do list for Human library
|
|
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
## Work-in-Progress
|
2021-04-25 19:16:04 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
N/A
|
2021-09-26 16:09:30 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
<hr><br>
|
2021-10-19 13:58:51 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
## Exploring
|
|
|
|
|
|
|
|
|
|
- Optical flow for intelligent temporal interpolation
|
|
|
|
|
<https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html>
|
|
|
|
|
- Advanced histogram equalization for optimization of badly lit scenes
|
|
|
|
|
**Adaptive**, **Contrast Limited**, **CLAHE**
|
|
|
|
|
- TFLite models
|
|
|
|
|
<https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/>
|
|
|
|
|
- Body segmentation with temporal analysis
|
|
|
|
|
<https://github.com/PeterL1n/RobustVideoMatting>
|
|
|
|
|
|
|
|
|
|
<hr><br>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2021-08-12 15:31:16 +02:00
|
|
|
## Known Issues
|
2022-06-02 16:39:53 +02:00
|
|
|
### Face with Attention
|
|
|
|
|
`FaceMesh-Landmarks` model is supported only with `CPU` and `WebGL` backends due to `TFJS` issues
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
### WASM
|
2021-10-29 21:55:20 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
Support for **WASM SIMD** and **WASM MultiThreading** is still disabled by default in **Chromium** based browsers
|
|
|
|
|
Suggestion is to enable it manually for major performance boost
|
|
|
|
|
Enable via <chrome://flags/#enable-experimental-webassembly-features>
|
2021-11-16 19:07:44 +01:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
### WebGPU
|
|
|
|
|
|
|
|
|
|
Experimental support only until support is officially added in Chromium
|
|
|
|
|
Enable via <chrome://flags/#enable-unsafe-webgpu>
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
### Firefox
|
|
|
|
|
|
|
|
|
|
Running in **web workers** requires `OffscreenCanvas` which is still disabled by default in **Firefox**
|
|
|
|
|
Enable via `about:config` -> `gfx.offscreencanvas.enabled`
|
|
|
|
|
|
|
|
|
|
### Face Detection
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
Enhanced rotation correction for face detection is not working in **NodeJS** due to missing kernel op in **TFJS**
|
|
|
|
|
Feature is automatically disabled in **NodeJS** without user impact
|
2021-07-31 13:43:50 +02:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
<hr><br>
|
2021-11-09 20:37:50 +01:00
|
|
|
|
2022-06-02 16:39:53 +02:00
|
|
|
## Pending Release Changes
|
2022-04-21 15:58:13 +02:00
|
|
|
|
2022-05-30 03:12:18 +02:00
|
|
|
- Updated **FaceMesh-Landmarks** models
|
|
|
|
|
- Added **FaceMesh-with-Attention** model is disabled by defauls, enable using
|
|
|
|
|
`config.face.mesh.attention = true`
|
2022-06-02 16:39:53 +02:00
|
|
|
- If **FaceMesh-with-Attention** model is enabled, Iris model gets disabled
|
2022-05-30 03:12:18 +02:00
|
|
|
as its functionality is superseded by attention model
|
|
|
|
|
- Results include more detailed face mesh annotations
|
|
|
|
|
`result.face[].annotations`
|
2022-06-02 16:39:53 +02:00
|
|
|
- Update benchmarks: `demo/benchmark`
|
|
|
|
|
- Slight performance improvement with canvas reads using `WASM` backend
|
|
|
|
|
- Default to RTM version of `WASM` binaries
|
|
|
|
|
- Enhanced `WebGPU` compatibility
|
|
|
|
|
- Support for **NodeJS v18**
|
|
|
|
|
- Updated **Known Issues**
|
|
|
|
|
See <https://github.com/vladmandic/human/blob/main/TODO.md>
|
