human/TODO.md

To-Do list for Human library

Work-in-Progress

N/A

---

Exploring

• Optical flow for intelligent temporal interpolation
  https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html
• CLAHE advanced histogram equalization for optimization of badly lit scenes
• TFLite models
  https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/
• Principal Components Analysis for reduction of descriptor complexity
  https://github.com/vladmandic/human-match/blob/main/src/pca.js
• Temporal guidance for face/body segmentation
  https://github.com/PeterL1n/RobustVideoMatting

---

Known Issues

Face with Attention

FaceMesh-Attention is not supported when using WASM backend due to missing kernel op in TFJS

Object Detection

NanoDet model is not supported when using WASM backend due to missing kernel op in TFJS

WebGPU

Experimental support only until support is officially added in Chromium
Enable via chrome://flags/#enable-unsafe-webgpu

Firefox

Running in web workers requires OffscreenCanvas which is still disabled by default in Firefox
Enable via about:config -> gfx.offscreencanvas.enabled

---

Pending Release Changes

• New methods human.webcam.*
  Enables built-in configuration and control of WebCam streams
• New method human.video()
  Runs continous detection of an input video
  instead of processing each frame manually using human.detect()
• New simple demo Live | Code
  Full HTML and JavaScript code in less than a screen
• New advanced demo using BabylonJS and VRM Live | Code
• Update TypeDoc generation Link
• Update TypeDefs bundle generation Link
  No external dependencies
• Fix model caching when using web workers
• Fix face.rotation when using interpolation
• Improve NodeJS resolver when using ESM
• Update demo demo/typescript
• Update demo demo/faceid
• Update demo demo/nodejs/process-folder.js
  and re-process /samples Link