mirror of https://github.com/vladmandic/human
remove blazeface-front, faceboxes and blazepose-upper
Vladimir Mandic
parent
2111052766
commit
3628aa6519
537
Change-Log.md
537
Change-Log.md
|
|
@ -1,537 +0,0 @@
|
|||
# @vladmandic/human
|
||||
|
||||
Version: **0.40.8**
|
||||
Description: **Human: AI-powered 3D Face Detection, Face Embedding & Recognition, Body Pose Tracking, Hand & Finger Tracking, Iris Analysis, Age & Gender & Emotion Prediction & Gesture Recognition**
|
||||
|
||||
Author: **Vladimir Mandic <mandic00@live.com>**
|
||||
License: **MIT** </LICENSE>
|
||||
Repository: **<git+https://github.com/vladmandic/human.git>**
|
||||
|
||||
## Changelog
|
||||
|
||||
### **HEAD -> main** 2021/03/08 mandic00@live.com
|
||||
|
||||
|
||||
### **0.40.7** 2021/03/06 mandic00@live.com
|
||||
|
||||
- implemented 3d face angle calculations
|
||||
|
||||
### **0.40.6** 2021/03/06 mandic00@live.com
|
||||
|
||||
- add curve draw output
|
||||
|
||||
### **0.40.5** 2021/03/05 mandic00@live.com
|
||||
|
||||
- fix human.draw
|
||||
|
||||
### **0.40.4** 2021/03/05 mandic00@live.com
|
||||
|
||||
- cleanup blazepose code
|
||||
- fix demo
|
||||
|
||||
### **0.40.3** 2021/03/05 mandic00@live.com
|
||||
|
||||
|
||||
### **0.40.2** 2021/03/05 mandic00@live.com
|
||||
|
||||
- added blazepose-upper
|
||||
|
||||
### **0.40.1** 2021/03/04 mandic00@live.com
|
||||
|
||||
- implement blazepose and update demos
|
||||
- add todo list
|
||||
|
||||
### **0.30.6** 2021/03/03 mandic00@live.com
|
||||
|
||||
- fine tuning age and face models
|
||||
|
||||
### **0.30.5** 2021/03/02 mandic00@live.com
|
||||
|
||||
- add debug logging flag
|
||||
|
||||
### **0.30.4** 2021/03/01 mandic00@live.com
|
||||
|
||||
- added skipinitial flag
|
||||
|
||||
### **0.30.3** 2021/02/28 mandic00@live.com
|
||||
|
||||
- typo
|
||||
|
||||
### **0.30.2** 2021/02/26 mandic00@live.com
|
||||
|
||||
- rebuild
|
||||
- fix typo
|
||||
|
||||
### **0.30.1** 2021/02/25 mandic00@live.com
|
||||
|
||||
|
||||
### **0.20.11** 2021/02/24 mandic00@live.com
|
||||
|
||||
|
||||
### **0.20.10** 2021/02/22 mandic00@live.com
|
||||
|
||||
|
||||
### **0.20.9** 2021/02/21 mandic00@live.com
|
||||
|
||||
- remove extra items
|
||||
- simmilarity fix
|
||||
|
||||
### **0.20.8** 2021/02/21 mandic00@live.com
|
||||
|
||||
- embedding fix
|
||||
|
||||
### **0.20.7** 2021/02/21 mandic00@live.com
|
||||
|
||||
- build fix
|
||||
|
||||
### **0.20.6** 2021/02/21 mandic00@live.com
|
||||
|
||||
- embedding fix
|
||||
|
||||
### **0.20.5** 2021/02/21 mandic00@live.com
|
||||
|
||||
- fix imagefx and add dev builds
|
||||
|
||||
### **0.20.4** 2021/02/19 mandic00@live.com
|
||||
|
||||
- 0.20.4
|
||||
|
||||
### **0.20.3** 2021/02/17 mandic00@live.com
|
||||
|
||||
- rebuild
|
||||
|
||||
### **0.20.2** 2021/02/13 mandic00@live.com
|
||||
|
||||
- merge branch 'main' of https://github.com/vladmandic/human into main
|
||||
- create codeql-analysis.yml
|
||||
- create security.md
|
||||
- add templates
|
||||
|
||||
### **0.20.1** 2021/02/08 mandic00@live.com
|
||||
|
||||
- menu fixes
|
||||
- convert to typescript
|
||||
|
||||
### **0.11.5** 2021/02/06 mandic00@live.com
|
||||
|
||||
- added faceboxes alternative model
|
||||
|
||||
### **0.11.4** 2021/02/06 mandic00@live.com
|
||||
|
||||
|
||||
### **0.11.3** 2021/02/02 mandic00@live.com
|
||||
|
||||
|
||||
### **0.11.2** 2021/01/30 mandic00@live.com
|
||||
|
||||
- added warmup for nodejs
|
||||
|
||||
### **update for tfjs 3.0.0** 2021/01/29 mandic00@live.com
|
||||
|
||||
|
||||
### **0.11.1** 2021/01/29 mandic00@live.com
|
||||
|
||||
|
||||
### **0.10.2** 2021/01/22 mandic00@live.com
|
||||
|
||||
|
||||
### **0.10.1** 2021/01/20 mandic00@live.com
|
||||
|
||||
|
||||
### **0.9.26** 2021/01/18 mandic00@live.com
|
||||
|
||||
- fix face detection when mesh is disabled
|
||||
- added minification notes
|
||||
- version bump
|
||||
|
||||
### **0.9.25** 2021/01/13 mandic00@live.com
|
||||
|
||||
- added humangl custom backend
|
||||
- rebuild
|
||||
- code cleanup and enable minification
|
||||
- fix safari incopatibility
|
||||
|
||||
### **0.9.24** 2021/01/12 mandic00@live.com
|
||||
|
||||
- work on blazepose
|
||||
- full rebuild
|
||||
|
||||
### **0.9.23** 2021/01/11 mandic00@live.com
|
||||
|
||||
- added iris gesture
|
||||
- fix emotion labels
|
||||
- full rebuild
|
||||
|
||||
### **0.9.22** 2021/01/05 mandic00@live.com
|
||||
|
||||
- remove iris coords if iris is disabled
|
||||
- web worker fix
|
||||
|
||||
### **0.9.21** 2021/01/03 mandic00@live.com
|
||||
|
||||
|
||||
### **0.9.20** 2021/01/03 mandic00@live.com
|
||||
|
||||
- stricter linting, fix face annotations
|
||||
|
||||
### **0.9.19** 2020/12/23 mandic00@live.com
|
||||
|
||||
- added rawbox and rawmesh
|
||||
- variable name changes, setting .rawcoords only if necessary
|
||||
- option to return raw data (mesh, box) for facemesh / "preserve aspect ratio" fix from facemesh upstream
|
||||
|
||||
### **0.9.18** 2020/12/16 mandic00@live.com
|
||||
|
||||
- add z axis scaling
|
||||
- major work on body module
|
||||
- republish due to tfjs 2.8.0 issues
|
||||
|
||||
### **0.9.17** 2020/12/15 mandic00@live.com
|
||||
|
||||
- added custom webgl backend
|
||||
|
||||
### **0.9.16** 2020/12/12 mandic00@live.com
|
||||
|
||||
- change default ports
|
||||
|
||||
### **0.9.15** 2020/12/11 mandic00@live.com
|
||||
|
||||
- improved caching and warmup
|
||||
- rebuild
|
||||
|
||||
### **0.9.14** 2020/12/10 mandic00@live.com
|
||||
|
||||
- conditional hand rotation
|
||||
- staggered skipframes
|
||||
- fix permissions
|
||||
|
||||
### **0.9.13** 2020/12/08 mandic00@live.com
|
||||
|
||||
- implemented face and hand boundary checks
|
||||
- embedded sample for warmup
|
||||
- switch to central logger
|
||||
|
||||
### **0.9.12** 2020/11/26 mandic00@live.com
|
||||
|
||||
- minor compatibility fixes
|
||||
|
||||
### **0.9.11** 2020/11/23 mandic00@live.com
|
||||
|
||||
- implement multi-person gestures
|
||||
- modularize pipeline models
|
||||
|
||||
### **0.9.10** 2020/11/21 mandic00@live.com
|
||||
|
||||
- changed build for optimized node & browser
|
||||
|
||||
### **0.9.9** 2020/11/21 mandic00@live.com
|
||||
|
||||
- new screenshots
|
||||
- camera exception handling
|
||||
|
||||
### **0.9.8** 2020/11/19 mandic00@live.com
|
||||
|
||||
- force f16 textures
|
||||
- bugfix embedding check
|
||||
|
||||
### **0.9.7** 2020/11/19 mandic00@live.com
|
||||
|
||||
- ui redesign
|
||||
|
||||
### **0.9.6** 2020/11/18 mandic00@live.com
|
||||
|
||||
- optimize camera resize on mobile
|
||||
- completed tfjs wrapper
|
||||
|
||||
### **0.9.5** 2020/11/17 mandic00@live.com
|
||||
|
||||
- fix serious performance bug around skipframes
|
||||
- swtich to custom tfjs bundle
|
||||
|
||||
### **0.9.4** 2020/11/17 mandic00@live.com
|
||||
|
||||
- swtich to tfjs source import
|
||||
|
||||
### **0.9.3** 2020/11/16 mandic00@live.com
|
||||
|
||||
- switched to minified build
|
||||
|
||||
### **release: 1.2** 2020/11/15 mandic00@live.com
|
||||
|
||||
- full rebuild
|
||||
|
||||
### **0.9.2** 2020/11/14 mandic00@live.com
|
||||
|
||||
- fix camera restart on resize
|
||||
|
||||
### **0.9.1** 2020/11/13 mandic00@live.com
|
||||
|
||||
- version bump
|
||||
- full rebuild
|
||||
- implemented face embedding
|
||||
- added internal benchmark tool
|
||||
|
||||
### **0.8.8** 2020/11/12 mandic00@live.com
|
||||
|
||||
- reduced bundle size
|
||||
- implemented buffered processing
|
||||
- fix for conditional model loading
|
||||
|
||||
### **0.8.7** 2020/11/11 mandic00@live.com
|
||||
|
||||
- added performance notes
|
||||
- added notes on models
|
||||
- fix bug in async ops and change imports
|
||||
- fix wiki links
|
||||
|
||||
### **0.8.6** 2020/11/09 mandic00@live.com
|
||||
|
||||
- add wasm bundle
|
||||
|
||||
### **0.8.5** 2020/11/09 mandic00@live.com
|
||||
|
||||
- reimplemented blazeface processing
|
||||
|
||||
### **0.8.4** 2020/11/09 mandic00@live.com
|
||||
|
||||
- added additional gestures
|
||||
- implemented blink detection
|
||||
- fix wasm module
|
||||
|
||||
### **0.8.3** 2020/11/08 mandic00@live.com
|
||||
|
||||
- refresh
|
||||
- optimizations
|
||||
|
||||
### **0.8.2** 2020/11/08 mandic00@live.com
|
||||
|
||||
- fix typos
|
||||
- commit
|
||||
|
||||
### **0.8.1** 2020/11/07 mandic00@live.com
|
||||
|
||||
- fix hand detection performance
|
||||
- optimized model loader
|
||||
- merge branch 'main' of https://github.com/vladmandic/human into main
|
||||
- created wiki
|
||||
- delete bug_report.md
|
||||
- optimize font resizing
|
||||
- fix nms sync call
|
||||
|
||||
### **0.7.6** 2020/11/06 mandic00@live.com
|
||||
|
||||
- fixed memory leaks and updated docs
|
||||
- model tuning
|
||||
- cache invalidation improvements
|
||||
- full async operations
|
||||
|
||||
### **0.7.5** 2020/11/05 mandic00@live.com
|
||||
|
||||
- implemented dev-server
|
||||
|
||||
### **0.7.4** 2020/11/05 mandic00@live.com
|
||||
|
||||
- fix canvas size on different orientation
|
||||
- switched from es2020 to es2018 build target
|
||||
|
||||
### **0.7.3** 2020/11/05 mandic00@live.com
|
||||
|
||||
- optimized camera and mobile layout
|
||||
- fixed worker and filter compatibility
|
||||
- removed test code
|
||||
|
||||
### **0.7.2** 2020/11/04 mandic00@live.com
|
||||
|
||||
- major work on handpose model
|
||||
|
||||
### **0.7.1** 2020/11/04 mandic00@live.com
|
||||
|
||||
- changed demo build process
|
||||
|
||||
### **0.6.7** 2020/11/04 mandic00@live.com
|
||||
|
||||
- implemented simple gesture recognition
|
||||
|
||||
### **0.6.6** 2020/11/04 mandic00@live.com
|
||||
|
||||
- remove debug code
|
||||
|
||||
### **0.6.5** 2020/11/04 mandic00@live.com
|
||||
|
||||
- redo hand detection
|
||||
|
||||
### **0.6.4** 2020/11/03 mandic00@live.com
|
||||
|
||||
- added manifest
|
||||
|
||||
### **0.6.3** 2020/11/03 mandic00@live.com
|
||||
|
||||
- enhanced processing resolution
|
||||
- fix pause restart
|
||||
- complete model refactoring
|
||||
- fixed typo
|
||||
|
||||
### **0.6.2** 2020/11/02 mandic00@live.com
|
||||
|
||||
- optimized demo
|
||||
- package update
|
||||
|
||||
### **0.6.1** 2020/11/02 mandic00@live.com
|
||||
|
||||
- major performance improvements for all models
|
||||
- revert "optimized canvas handling"
|
||||
- optimized canvas handling
|
||||
- minor optimization to imagefx
|
||||
- fix demo image sample
|
||||
- added tfjs-vis to distribution
|
||||
|
||||
### **0.5.5** 2020/11/01 mandic00@live.com
|
||||
|
||||
- changed defaults
|
||||
|
||||
### **0.5.4** 2020/11/01 mandic00@live.com
|
||||
|
||||
- implemented memory profiler
|
||||
|
||||
### **0.5.3** 2020/10/30 mandic00@live.com
|
||||
|
||||
- improved debug logging
|
||||
|
||||
### **0.5.2** 2020/10/30 mandic00@live.com
|
||||
|
||||
- added wasm and webgpu backends
|
||||
|
||||
### **0.5.1** 2020/10/30 mandic00@live.com
|
||||
|
||||
- improve demo line continous draws
|
||||
|
||||
### **0.4.10** 2020/10/30 mandic00@live.com
|
||||
|
||||
- fix for seedrandom
|
||||
|
||||
### **0.4.9** 2020/10/29 mandic00@live.com
|
||||
|
||||
|
||||
### **0.4.8** 2020/10/28 mandic00@live.com
|
||||
|
||||
- revert "updated menu handler"
|
||||
- fix webpack compatibility issue
|
||||
|
||||
### **0.4.7** 2020/10/27 mandic00@live.com
|
||||
|
||||
|
||||
### **0.4.6** 2020/10/27 mandic00@live.com
|
||||
|
||||
- fix firefox compatibility bug
|
||||
|
||||
### **0.4.5** 2020/10/27 mandic00@live.com
|
||||
|
||||
|
||||
### **0.4.4** 2020/10/27 mandic00@live.com
|
||||
|
||||
- implelented input resizing
|
||||
|
||||
### **0.4.3** 2020/10/22 mandic00@live.com
|
||||
|
||||
|
||||
### **0.4.2** 2020/10/20 mandic00@live.com
|
||||
|
||||
- log initialization
|
||||
|
||||
### **0.4.1** 2020/10/19 mandic00@live.com
|
||||
|
||||
- breaking change: convert to object class
|
||||
- compatibility notes
|
||||
|
||||
### **0.3.9** 2020/10/18 mandic00@live.com
|
||||
|
||||
- implemented image filters
|
||||
- pure tensor pipeline without image converts
|
||||
- autodetect skipframes
|
||||
|
||||
### **0.3.8** 2020/10/17 mandic00@live.com
|
||||
|
||||
- new menu layout
|
||||
|
||||
### **0.3.7** 2020/10/17 mandic00@live.com
|
||||
|
||||
- added diagnostics output
|
||||
- parallelized agegender operations
|
||||
|
||||
### **0.3.6** 2020/10/17 mandic00@live.com
|
||||
|
||||
- fixed webcam initialization
|
||||
- fixed memory leaks and added scoped runs
|
||||
- modularized draw
|
||||
- added state handling
|
||||
- refactored package file layout
|
||||
|
||||
### **0.3.5** 2020/10/16 mandic00@live.com
|
||||
|
||||
- added auto-generated changelog
|
||||
|
||||
### **0.3.4** 2020/10/16 mandic00@live.com
|
||||
|
||||
- added camera selection
|
||||
- optimized blazeface anchors
|
||||
- added error handling
|
||||
|
||||
### **0.3.3** 2020/10/15 mandic00@live.com
|
||||
|
||||
- added blazeface back and front models
|
||||
|
||||
### **0.3.2** 2020/10/15 mandic00@live.com
|
||||
|
||||
- reduced web worker latency
|
||||
- added debugging and versioning
|
||||
- optimized demos and added scoped runs
|
||||
- added multi backend support
|
||||
|
||||
### **0.3.1** 2020/10/14 mandic00@live.com
|
||||
|
||||
|
||||
### **0.2.10** 2020/10/14 mandic00@live.com
|
||||
|
||||
- added emotion backend
|
||||
- module parametrization and performance monitoring
|
||||
- implemented multi-hand support
|
||||
- fixed documentation typos
|
||||
|
||||
### **0.2.9** 2020/10/13 mandic00@live.com
|
||||
|
||||
- added node build and demo
|
||||
|
||||
### **0.2.8** 2020/10/13 mandic00@live.com
|
||||
|
||||
- added example image
|
||||
|
||||
### **0.2.7** 2020/10/13 mandic00@live.com
|
||||
|
||||
- new examples
|
||||
|
||||
### **0.2.6** 2020/10/13 mandic00@live.com
|
||||
|
||||
- enable all models by default
|
||||
|
||||
### **0.2.5** 2020/10/12 mandic00@live.com
|
||||
|
||||
- fixed memory leak
|
||||
|
||||
### **0.2.4** 2020/10/12 mandic00@live.com
|
||||
|
||||
- removed extra files
|
||||
|
||||
### **0.2.3** 2020/10/12 mandic00@live.com
|
||||
|
||||
|
||||
### **0.2.2** 2020/10/12 mandic00@live.com
|
||||
|
||||
|
||||
### **release: 1.0** 2020/10/12 mandic00@live.com
|
||||
|
||||
|
||||
### **0.2.1** 2020/10/12 mandic00@live.com
|
||||
|
||||
- added sample image
|
||||
- initial public commit
|
||||
- initial commit
|
||||
|
|
@ -102,11 +102,8 @@ config = {
|
|||
// running detetor-only produces fast but unreliable results with false positives
|
||||
// (note: module is not loaded until it is required)
|
||||
detector: {
|
||||
modelPath: '../models/blazeface-back.json', // can be 'blazeface-front', 'blazeface-back' or 'faceboxes'
|
||||
// 'blazeface-front' is blazeface model optimized for large faces such as front-facing camera
|
||||
// 'blazeface-back' is blazeface model optimized for smaller and/or distanct faces
|
||||
// 'faceboxes' is alternative model to 'blazeface'
|
||||
inputSize: 256, // fixed value: 128 for front and 256 for 'back'
|
||||
modelPath: '../models/blazeface-back.json',
|
||||
inputSize: 256, // fixed value
|
||||
rotation: false, // use best-guess rotated face image or just box with rotation as-is
|
||||
// false means higher performance, but incorrect mesh mapping if face angle is above 20 degrees
|
||||
maxFaces: 10, // maximum number of faces detected in the input
|
||||
|
|
@ -172,7 +169,7 @@ config = {
|
|||
|
||||
body: {
|
||||
enabled: true,
|
||||
modelPath: '../models/posenet.json', // can be 'posenet', 'blazepose' or 'blazepose-upper'
|
||||
modelPath: '../models/posenet.json', // can be 'posenet' or 'blazepose'
|
||||
inputSize: 257, // fixed value, 257 for posenet and 256 for blazepose
|
||||
maxDetections: 10, // maximum number of people detected in the input
|
||||
// should be set to the minimum number for performance
|
||||
|
|
|
|||
|
|
@ -1,7 +1,6 @@
|
|||
# Credits
|
||||
|
||||
- Face Detection: [**MediaPipe BlazeFace**](https://drive.google.com/file/d/1f39lSzU5Oq-j_OXgS67KfN5wNsoeAZ4V/view)
|
||||
- Face Boxes: [**FaceBoxes**](https://github.com/TropComplique/FaceBoxes-tensorflow/)
|
||||
- Facial Spacial Geometry: [**MediaPipe FaceMesh**](https://drive.google.com/file/d/1VFC_wIpw4O7xBOiTgUldl79d9LA-LsnA/view)
|
||||
- Eye Iris Details: [**MediaPipe Iris**](https://drive.google.com/file/d/1bsWbokp9AklH2ANjCfmjqEzzxO1CNbMu/view)
|
||||
- Hand Detection & Skeleton: [**MediaPipe HandPose**](https://drive.google.com/file/d/1sv4sSb9BSNVZhLzxXJ0jBv9DqD-4jnAz/view)
|
||||
|
|
|
|||
|
|
@ -21,8 +21,7 @@ There are multiple ways to use `Human` library, pick one that suits you:
|
|||
- `dist/human.node.js`: CommonJS format for NodeJS, optimized for usage with `tfjs-node`
|
||||
- `dist/human.node-gpu.js`: CommonJS format for NodeJS, optimized for usage with `tfjs-node-gpu`
|
||||
|
||||
All versions include `sourcemap` *(.map)* and build `manifest` *(.json)*
|
||||
While `Human` is in pre-release mode, all bundles are non-minified
|
||||
All versions include `sourcemap` *(.map)*
|
||||
|
||||
Defaults:
|
||||
|
||||
|
|
|
|||
10
Models.md
10
Models.md
|
|
@ -15,14 +15,6 @@ Default models in Human library are:
|
|||
|
||||
## Notes
|
||||
|
||||
**Face detection** can be switched from `BlazeFace` to `FaceBoxes` for use in NodeJS as `BlazeFace` is currently not supported in NodeJS
|
||||
|
||||
Note that `FaceMesh` requires `BlazeFace` as their execution is performed in a single pipeline
|
||||
|
||||
Additionally, there are two versions of `BlazeFace`: `back` optimized for detection of smaller faces and `front` optimized for detection of large faces
|
||||
|
||||
<br>
|
||||
|
||||
**Body detection** can be switched from `PoseNet` to `BlazePose` depending on the use case:
|
||||
|
||||
- `PoseNet`: Works with multiple people in frame, works with only partial people
|
||||
|
|
@ -30,8 +22,6 @@ Additionally, there are two versions of `BlazeFace`: `back` optimized for detect
|
|||
- `BlazePose`: Works with single person in frame and that person should be fully visibile
|
||||
But if conditions are met, it returns far more details (39 vs 17 keypoints) and is far more accurate
|
||||
Furthermore, it returns 3D approximation of each point instead of 2D
|
||||
- `BlazePose-Upper`: Works with single person in frame and that person should have upper body in frame
|
||||
Good for use-case such as sitting in front of webcam. It returns 31 keypoints along with 3D approximations
|
||||
|
||||
<br>
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue