human/TODO.md

To-Do list for Human library

Work in Progress

Exploring

• Optical Flow: https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html
• Histogram Equalization: Regular, Adaptive, Contrast Limited, CLAHE
• TFLite Models: https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/
• Body segmentation: robust-video-matting
• TFJS incompatibility with latest long.js 5.0.0 due to CJS to ESM switch

---

Known Issues

WebGPU

Experimental support only until support is officially added in Chromium

• Performance issues: https://github.com/tensorflow/tfjs/issues/5689

Face Detection

Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact

• Backend NodeJS missing kernel op RotateWithOffset
  https://github.com/tensorflow/tfjs/issues/5473

Body Detection

MoveNet MultiPose model does not work with WASM backend due to missing F32 broadcast implementation

• Backend WASM missing F32 broadcat implementation
  https://github.com/tensorflow/tfjs/issues/5516

---

Pending release

• Supports all modules on all backends
  via custom implementation of missing kernel ops
• New frame change detection algorithm used for cache determination
  based on temporal input difference
• New optional input histogram equalization
  auto-level input for optimal brightness/contrast via config.filter.equalization
• Performance and precision improvements
  face, hand and gestures modules
• Use custom built TFJS for bundled version
  reduced bundle size and built-in support for all backends
  nobundle and node versions link to standard @tensorflow packages
• Fix ReactJS compatibility
• Better precision using WASM
  Previous issues due to math low-precision in WASM implementation
• Full TS type definitions for all modules and imports
• Focus on simplified demo
  https://vladmandic.github.io/human/demo/typescript/