human/TODO.md

74 lines
2.5 KiB
Markdown
Raw Normal View History

2021-03-03 18:04:59 +01:00
# To-Do list for Human library
## Work in Progress
2021-04-25 19:16:04 +02:00
2021-09-22 22:00:43 +02:00
<br>
2021-10-22 15:48:27 +02:00
### Exploring
2021-09-26 16:09:30 +02:00
2021-11-16 19:07:44 +01:00
- Optical flow: <https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html>
- Advanced histogram equalization: Adaptive, Contrast Limited, CLAHE
- TFLite models: <https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/>
- Body segmentation: `robust-video-matting`
2021-11-05 20:09:54 +01:00
- TFJS incompatibility with latest `long.js` 5.0.0 due to CJS to ESM switch
2021-09-26 16:09:30 +02:00
<br><hr><br>
2021-07-31 13:43:50 +02:00
2021-08-12 15:31:16 +02:00
## Known Issues
2021-07-31 13:43:50 +02:00
2021-10-29 21:55:20 +02:00
#### WebGPU
Experimental support only until support is officially added in Chromium
2021-11-16 19:07:44 +01:00
2021-10-29 21:55:20 +02:00
- Performance issues:
<https://github.com/tensorflow/tfjs/issues/5689>
2021-07-31 13:43:50 +02:00
### Face Detection
Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact
2021-08-12 15:31:16 +02:00
- Backend NodeJS missing kernel op `RotateWithOffset`
<https://github.com/tensorflow/tfjs/issues/5473>
2021-07-31 13:43:50 +02:00
2021-08-20 15:05:07 +02:00
### Body Detection
2021-09-26 16:09:30 +02:00
MoveNet MultiPose model does not work with WASM backend due to missing F32 broadcast implementation
2021-08-20 15:05:07 +02:00
2021-09-26 16:09:30 +02:00
- Backend WASM missing F32 broadcat implementation
2021-08-20 15:05:07 +02:00
<https://github.com/tensorflow/tfjs/issues/5516>
<br><hr><br>
2021-11-16 19:07:44 +01:00
## Pending Release Notes
New:
2021-11-11 23:02:32 +01:00
- new demo `demos/faceid` that utilizes multiple algorithm to validate input before triggering face recognition
- new optional model `liveness`
checks if input appears to be a real-world live image or a recording
best used together with `antispoofing` that checks if input appears to have a realistic face
2021-11-13 23:26:19 +01:00
- new face masking option in `face.config.detector.mask`
result is shading of face image outside of face area which is useful for increased sensitivity of other modules that rely on detected face as input
- new face crop option in `face.config.detector.cropFactor`
result is user-definable fine-tuning for other modules that rely on detected face as input
2021-11-11 17:30:55 +01:00
Other:
- Improved **Safari** compatibility
2021-11-11 23:02:32 +01:00
- Improved `similarity` and `match` score range normalization
2021-11-14 17:22:52 +01:00
- Improved error handling
2021-11-15 15:26:38 +01:00
- Improved VSCode out-of-the-box experience
- Documentation overhaul
- Fix for optional `gear`, `ssrnet`, `mobilefacenet` modules
- Fix for Firefox WebGPU compatibility issue
2021-11-17 21:45:49 +01:00
```
cp tfjs/tfjs.esm.d.ts types/lib/dist/
node_modules/.bin/api-extractor run --local --verbose
cp types/human.d.ts dist/human.esm-nobundle.d.ts
cp types/human.d.ts dist/human.esm.d.ts
cp types/human.d.ts dist/human.d.ts
cp types/human.d.ts dist/human.node-gpu.d.ts
cp types/human.d.ts dist/human.node.d.ts
cp types/human.d.ts dist/human.node-wasm.d.ts
```