diff --git a/Backends.md b/Backends.md new file mode 100644 index 0000000..a027c72 --- /dev/null +++ b/Backends.md @@ -0,0 +1,45 @@ +## Backends + +Human library includes pre-bundled `CPU`, `WASM` and `WebGL` backends, there is no need to load them externally. + +
+ +### Notes: + +- CPU backend usage is not recommended for performance reasons + as TensorFlow implementation in JavaScript is by far the slowest +- WebGL backend usage is fastest on systems with modern GPU + although startup speed is a bit slower +- WASM backend has good resuts under specific conditions: + - Enable WASM SIMD support in your browser + (CPU parallel processing instructions) + - Reduce size of input image (e.g. webcam) + as WASM does not have optimized image extraction methods + +#### How to enable WASM SIMD support + +Chrome: +- Navigate to +- `WebAssembly SIMD support` set to Enabled + +Edge: +- Navigate to +- `WebAssembly SIMD support` set to Enabled + +Firefox: +- Navigate to +- `javascript.options.wasm_simd` set to True + +
+ +### Known Issues: + +- **WASM** backend without SIMD has limited processing capabilities before it causes issues + To avoid issues, start `human` with most models disabled and if needed, enable them one by one as each initializes + Typical errors messages are: + `Uncaught (in promise) Error: undefined tfjs-backend-wasm.wasm` or + `RuntimeError: memory access out of bounds in tfjs-backend-wasm.wasm` +- **NodeJS** backend is missing key operatios and thus neither `Face` nor `Hand` models are currently supported + +
+ diff --git a/Change-Log.md b/Change-Log.md index d03997a..23bb4c5 100644 --- a/Change-Log.md +++ b/Change-Log.md @@ -1,7 +1,7 @@ # @vladmandic/human -Version: **0.8.3** +Version: **0.8.5** Description: **human: 3D Face Detection, Body Pose, Hand & Finger Tracking, Iris Tracking, Age & Gender Prediction, Emotion Prediction & Gesture Recognition** Author: **Vladimir Mandic ** @@ -10,7 +10,12 @@ Repository: **** ## Changelog -### **HEAD -> main, origin/main, origin/HEAD** 2020/11/09 mandic00@live.com +### **0.8.5** 2020/11/09 mandic00@live.com +- reimplemented blazeface processing + +### **0.8.4** 2020/11/09 mandic00@live.com +- added additional gestures +- implemented blink detection - fix wasm module ### **0.8.3** 2020/11/08 mandic00@live.com diff --git a/Demos.md b/Demos.md index 74b44a3..495f724 100644 --- a/Demos.md +++ b/Demos.md @@ -63,19 +63,6 @@ found 0 vulnerabilities 2020-11-06 16:19:16 DATA: GET/2.0 200 text/javascript 1708910 /dist/demo-browser-index.js ::ffff:192.168.0.200 ``` -### WASM and WebGPU - -While `CPU` and `WebGL` backends are included in the bundle, `WASM` and `WebGPU` are not to keep the size at minimum - -If you want to use `WASM` (supported) or `WebGPU` (experimental) backends -enable loading of required modules in `index.html`: - -```html -