human/TODO.md

To-Do list for Human library

Work in Progress

Exploring

• Optical flow: https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html
• Advanced histogram equalization: Adaptive, Contrast Limited, CLAHE
• TFLite models: https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/
• Body segmentation: robust-video-matting

---

Known Issues

WebGPU

Experimental support only until support is officially added in Chromium

Face Detection

Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact

• Backend NodeJS missing kernel op RotateWithOffset
  https://github.com/tensorflow/tfjs/issues/5473

---

Pending Release Notes

• Add global model cache hander using indexdb in browser environments
  see config.cacheModels setting for details
• Add additional demos
  human-motion and human-avatar
• Updated samples image gallery
• Fix face box detections when face is partially occluded
• Fix face box scaling
• Fix hand tracking when hand is in front of face
• Fix compatibility with ElectronJS
• Fix interpolation for some body keypoints
• Updated blazepose calculations
• Changes to blazepose and handlandmarks annotations
• Strong typing for string enums
• Updated TFJS