human/TODO.md

To-Do list for Human library

Work-in-Progress

N/A

---

Exploring

• Optical flow for intelligent temporal interpolation
  https://docs.opencv.org/3.3.1/db/d7f/tutorial_js_lucas_kanade.html
• Advanced histogram equalization for optimization of badly lit scenes
  Adaptive, Contrast Limited, CLAHE
• TFLite models
  https://js.tensorflow.org/api_tflite/0.0.1-alpha.4/
• Body segmentation with temporal analysis
  https://github.com/PeterL1n/RobustVideoMatting

---

Known Issues

Face with Attention

FaceMesh-Landmarks model is supported only with CPU and WebGL backends due to TFJS issues

WASM

Support for WASM SIMD and WASM MultiThreading is still disabled by default in Chromium based browsers
Suggestion is to enable it manually for major performance boost
Enable via chrome://flags/#enable-experimental-webassembly-features

WebGPU

Experimental support only until support is officially added in Chromium
Enable via chrome://flags/#enable-unsafe-webgpu

Firefox

Running in web workers requires OffscreenCanvas which is still disabled by default in Firefox
Enable via about:config -> gfx.offscreencanvas.enabled

Face Detection

Enhanced rotation correction for face detection is not working in NodeJS due to missing kernel op in TFJS
Feature is automatically disabled in NodeJS without user impact

---

Pending Release Changes

• install production-only dependencies by default results in a must faster and smaller human installation to install all dependencies use npm install @vladmandic/human --production=false
• switch to production @tensorflow/tfjs for browsers
  tfjs has stabilized in recent versions so its not necessary to run a custom bundle anymore
• add webview support
• add getModelStats method
• extract model stats in build process
• typedoc fixes
• add face contours to results
• improve face compare in demo app
• update dependencies
• gear model fixes