human/TODO.md

To-Do list for Human library

Work in Progress

• Switch to custom tfjs for main human ESM bundle

Models

• Body segmentation: robust-video-matting

Backends

WASM

• Backend WASM incorrect handling of int32 tensors
  https://github.com/tensorflow/tfjs/issues/5641

WebGPU

Experimental support only until support is officially added in Chromium

• Performance issues: https://github.com/tensorflow/tfjs/issues/5689

Exploring

• Optical Flow: https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html
• TFLite Models: https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/
• Histogram Equalization: Regular, Adaptive, Contrast Limited

---

Known Issues

Face Detection

Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact

• Backend NodeJS missing kernel op RotateWithOffset
  https://github.com/tensorflow/tfjs/issues/5473

Hand Detection

Enhanced rotation correction for hand detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact

• Backend NodeJS missing kernel op RotateWithOffset
  https://github.com/tensorflow/tfjs/issues/5473

Body Detection

MoveNet MultiPose model does not work with WASM backend due to missing F32 broadcast implementation

• Backend WASM missing F32 broadcat implementation
  https://github.com/tensorflow/tfjs/issues/5516

Object Detection

Object detection using CenterNet or NanoDet models is not working when using WASM backend due to missing kernel ops in TFJS

• Backend WASM missing kernel op Mod
  https://github.com/tensorflow/tfjs/issues/5110
• Backend WASM missing kernel op SparseToDense
  https://github.com/tensorflow/tfjs/issues/4824

---

Pending Release

• Enhanced MoveNet post-processing
• Add optional Anti-Spoof module
• Remove old HandDetect and PoseNet models from default installation
• Refactor ImageFX module