human/TODO.md

To-Do list for Human library

Work-in-Progress

N/A

---

Exploring

• Optical flow for intelligent temporal interpolation
  https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html
• Advanced histogram equalization for optimization of badly lit scenes
  Adaptive, Contrast Limited, CLAHE
• TFLite models
  https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/
• Body segmentation with temporal analysis
  https://github.com/PeterL1n/RobustVideoMatting

---

Known Issues

Face with Attention

FaceMesh-Attention is not supported in browser using WASM backend due to missing kernel op in TFJS

Object Detection

NanoDet model is not supported in in browser using WASM backend due to missing kernel op in TFJS

WebGPU

Experimental support only until support is officially added in Chromium
Enable via chrome://flags/#enable-unsafe-webgpu

Firefox

Running in web workers requires OffscreenCanvas which is still disabled by default in Firefox
Enable via about:config -> gfx.offscreencanvas.enabled

---

Pending Release Changes

• New API human.video()
  Runs continous detection of an input video instead of processing each frame manually
• New simple demo Live
• Enable model cache when using web workers
• Fix for face.rotation interpolation
• Improve NodeJS resolver when using ESM
• Update demo demo/nodejs/process-folder.js
  and re-process /samples