ambiser
/
human
mirror of https://github.com/vladmandic/human
9
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,227 Commits
1 Branch
22 Tags
576 MiB
Commit Graph

498 Commits (f0b7285d6736ef3ba9d46de7643f0d0eba505427)

Author SHA1 Message Date
Vladimir Mandic 81d5336498 switch to custom tfjs for demos 2021-10-26 15:08:05 -04:00
Vladimir Mandic b395a74701 refactoring plus jsdoc comments 2021-10-25 13:09:00 -04:00
Vladimir Mandic 2bd59f1276 increase face similarity match resolution 2021-10-25 09:44:13 -04:00
Vladimir Mandic 2923c6b5af time based caching 2021-10-23 09:38:52 -04:00
Vladimir Mandic 87465f99fd initial work on skipTime 2021-10-22 16:09:52 -04:00
Vladimir Mandic c3dab75414 enhanced typing exports 2021-10-22 13:49:40 -04:00
Vladimir Mandic 974a295407 add optional autodetected custom wasm path 2021-10-21 12:42:08 -04:00
Vladimir Mandic 975d7fb477 fix for human.draw labels and typedefs 2021-10-21 10:54:51 -04:00
Vladimir Mandic 37672d6460 refactor human.env to a class type 2021-10-21 10:26:44 -04:00
Vladimir Mandic 715f2dbfb5 update handtrack boxes and refactor handpose 2021-10-20 09:10:57 -04:00
Vladimir Mandic 5d5876e749 update demos 2021-10-19 11:28:59 -04:00
Jimmy Nyström c1243b96e4 Removed direct usage of performance.now 
Switched to using the utility function that works in both nodejs and browser environments
 2021-10-19 09:58:14 -04:00
Vladimir Mandic 5ef6158cb1 minor blazepose optimizations 2021-10-15 09:34:40 -04:00
Vladimir Mandic 761a636c2c enhanced movenet postprocessing 2021-10-14 12:26:59 -04:00
Vladimir Mandic 37a8892cfe update handtrack skip algorithm 2021-10-13 14:49:41 -04:00
Vladimir Mandic b4e6fda31b add optional anti-spoofing module 2021-10-13 10:56:56 -04:00
Vladimir Mandic b509489ed7 package updates 2021-10-12 14:17:33 -04:00
Vladimir Mandic 0f92e3023e optimize image preprocessing 2021-10-12 11:39:18 -04:00
Vladimir Mandic d23fb162a9 update imagefx 2021-10-12 09:48:00 -04:00
Vladimir Mandic 224f3d26c0 set webgpu optimized flags 2021-10-11 09:22:39 -04:00
Vladimir Mandic 7e7cba2168 major precision improvements to movenet and handtrack 2021-10-10 22:29:20 -04:00
Vladimir Mandic 924a0b24f0 image processing fixes 2021-10-10 17:52:43 -04:00
Vladimir Mandic 110f4999a4 redesign body and hand caching and interpolation 2021-10-08 18:39:04 -04:00
Vladimir Mandic 293eba8379 improve gaze and face angle visualizations in draw 2021-10-07 10:33:10 -04:00
Vladimir Mandic c47b72c56b workaround for chrome offscreencanvas bug 2021-10-06 11:30:34 -04:00
Vladimir Mandic 0e9195dca3 fix backend conflict in webworker 2021-10-04 17:03:36 -04:00
Vladimir Mandic e0ef7c5b1e add blazepose v2 and add annotations to body results 2021-10-04 16:29:15 -04:00
Vladimir Mandic 6bbbeaf452 fix backend order initialization 2021-10-03 08:12:26 -04:00
Vladimir Mandic 49112e584b breaking change: new similarity and match methods 2021-09-30 14:28:16 -04:00
Vladimir Mandic 07eb238490 update movenet-multipose and samples 2021-09-28 17:07:34 -04:00
Vladimir Mandic 3e61cb083e tweaked default values 2021-09-28 13:48:29 -04:00
Vladimir Mandic 8e801a2af5 enable handtrack as default model 2021-09-28 12:02:17 -04:00
Vladimir Mandic 156e857d32 redesign face processing 2021-09-28 12:01:48 -04:00
Vladimir Mandic 28a957316b update types and dependencies 2021-09-27 14:39:54 -04:00
Vladimir Mandic 6be1b062fb refactoring 2021-09-27 13:58:13 -04:00
Vladimir Mandic a21e3c95ed define app specific types 2021-09-27 09:19:43 -04:00
Vladimir Mandic 561d25cfc9 implement box caching for movenet 2021-09-27 08:53:41 -04:00
Vladimir Mandic 5c507ad8f3 autodetect number of bodies and hands 2021-09-25 19:14:03 -04:00
Vladimir Mandic ad2866bab6 new samples gallery and major code folder restructure 2021-09-25 11:51:15 -04:00
Vladimir Mandic 894dde3edd new release 2021-09-24 09:55:27 -04:00
Vladimir Mandic 8bbfb9615a optimize model loading 2021-09-23 14:09:41 -04:00
Vladimir Mandic c52f1c979c support segmentation for nodejs 2021-09-22 19:27:12 -04:00
Vladimir Mandic d3113d6baf update todo and docs 2021-09-22 16:00:43 -04:00
Vladimir Mandic 8a4b498357 redo segmentation and handtracking 2021-09-22 15:16:14 -04:00
Vladimir Mandic 9186e46c57 prototype handtracking 2021-09-21 16:48:16 -04:00
Vladimir Mandic a5977e3f45 automated browser tests 2021-09-20 22:06:49 -04:00
Vladimir Mandic ded141a161 support for dynamic backend switching 2021-09-20 21:59:49 -04:00
Vladimir Mandic 04fcbc7e6a initial automated browser tests 2021-09-20 17:17:13 -04:00
Vladimir Mandic 384d94c0cb enhanced automated test coverage 2021-09-20 09:42:34 -04:00
Vladimir Mandic 57f5fd391f more automated tests 2021-09-19 14:20:22 -04:00
Vladimir Mandic ccd5ba1e46 added configuration validation 2021-09-19 14:07:53 -04:00
Vladimir Mandic cb1ff858e9 updated build platform and typedoc theme 2021-09-18 19:09:02 -04:00
Vladimir Mandic 79f95aa39f prevent validation failed on some model combinations 2021-09-17 14:30:57 -04:00
Vladimir Mandic 64c6195342 webgl exception handling 2021-09-17 14:07:44 -04:00
Vladimir Mandic 8dba39245d experimental webgl status monitoring 2021-09-17 11:23:00 -04:00
Vladimir Mandic 42e6a25294 redefine draw helpers interface 2021-09-15 18:58:54 -04:00
Vladimir Mandic 5f68153af7 add simple webcam and webrtc demo 2021-09-15 13:59:18 -04:00
Vladimir Mandic 246415b8cc reorganize tfjs bundle 2021-09-14 22:07:13 -04:00
Vladimir Mandic 6eaea226da add platform and backend capabilities detection 2021-09-13 23:24:04 -04:00
Vladimir Mandic ddf9239ccd enable canvas patching for nodejs 2021-09-13 13:30:08 -04:00
Vladimir Mandic a0f5922b9a fix multiple memory leaks 2021-09-13 13:28:35 -04:00
Vladimir Mandic fd0f85a8e9 modularize human class and add model validation 2021-09-12 18:37:06 -04:00
Vladimir Mandic 203dbffa1a add dynamic kernel op detection 2021-09-12 13:17:33 -04:00
Vladimir Mandic 7fa09937b4 added human.env diagnostic class 2021-09-12 12:42:17 -04:00
Vladimir Mandic f6724de956 minor typos 2021-09-12 08:49:56 -04:00
Vladimir Mandic 83b705818d release candidate 2021-09-12 00:30:11 -04:00
Vladimir Mandic b8d594e18d parametrize face config 2021-09-12 00:05:06 -04:00
Vladimir Mandic 81bf83c948 mark all config items as optional 2021-09-11 23:59:41 -04:00
Vladimir Mandic 54c1dfb37a redefine config and result interfaces 2021-09-11 23:54:35 -04:00
Vladimir Mandic 6e8bf0f4f4 fix usge of string enums 2021-09-11 23:08:18 -04:00
Vladimir Mandic 19e4e49c41 start using partial definitions 2021-09-11 16:11:00 -04:00
Vladimir Mandic 34a3a42fba implement event emitters 2021-09-11 16:00:16 -04:00
Vladimir Mandic 52b4310992 change build process 2021-09-10 21:21:29 -04:00
Vladimir Mandic 79bb653409 add benchmark info 2021-09-05 16:42:11 -04:00
Vladimir Mandic 296501cbf8 update hand detector processing algorithm 2021-09-02 08:50:16 -04:00
Vladimir Mandic e97df8d380 simplify canvas handling in nodejs 2021-08-31 18:22:16 -04:00
Vladimir Mandic 2e36f43efb added demo node-canvas 2021-08-31 14:48:55 -04:00
Vladimir Mandic e58ba5e803 dynamically generate default wasm path 2021-08-31 13:00:06 -04:00
Vladimir Mandic 17356e0a4d updated wiki 2021-08-23 08:41:50 -04:00
Vladimir Mandic ac83b3d153 implement finger poses in hand detection and gestures 2021-08-20 20:43:03 -04:00
Vladimir Mandic 54d717bbff implemented movenet-multipose model 2021-08-20 09:05:07 -04:00
Vladimir Mandic e1546e158f add static type definitions to main class 2021-08-19 16:16:56 -04:00
Vladimir Mandic e4293511d0 fix interpolation overflow 2021-08-18 14:28:31 -04:00
Vladimir Mandic 312f51f07e rebuild full 2021-08-17 18:49:49 -04:00
Vladimir Mandic 649a3a17b5 update angle calculations 2021-08-17 18:46:50 -04:00
Vladimir Mandic f9a4f741a9 strict type checks 2021-08-17 08:51:17 -04:00
Vladimir Mandic 71f25a8f12 add webgu checks 2021-08-15 08:09:40 -04:00
Vladimir Mandic f29d85dacd experimental webgpu support 2021-08-14 18:00:26 -04:00
Vladimir Mandic f867d46b85 add experimental webgu demo 2021-08-14 13:39:26 -04:00
Vladimir Mandic eadc65cc5a complete async work 2021-08-14 11:16:26 -04:00
Vladimir Mandic 334bb7061f switch to async data reads 2021-08-12 09:31:16 -04:00
Vladimir Mandic 67b7db377d fix centernet & update blazeface 2021-08-11 18:59:02 -04:00
Vladimir Mandic 7cedebbe89 minor update 2021-08-05 10:38:04 -04:00
Vladimir Mandic b70775caa9 update build process to remove warnings 2021-07-31 20:42:28 -04:00
Vladimir Mandic b387bad3f0 enable webgl uniform support for faster warmup 2021-07-29 16:35:16 -04:00
Vladimir Mandic c7613f93e2 fix unregistered ops in tfjs 2021-07-29 16:06:03 -04:00
Vladimir Mandic e84e421a04 updated gesture types 2021-07-29 11:01:50 -04:00
Vladimir Mandic 9394aaa742 add note on manually disping tensor 2021-06-18 13:39:20 -04:00
Vladimir Mandic 733a6db43e modularize model loading 2021-06-18 09:16:21 -04:00
Vladimir Mandic c10f31ef6c added multithreaded demo 2021-06-14 10:23:06 -04:00
Vladimir Mandic bcce8e8872 fix centernet box width & height 2021-06-11 16:12:24 -04:00
Vladimir Mandic 58d46094aa modularize build platform 2021-06-06 20:34:29 -04:00
Vladimir Mandic f654b89e8a custom build tfjs from sources 2021-06-06 19:00:34 -04:00
Vladimir Mandic ccad4a8c20 update wasm to tfjs 3.7.0 2021-06-06 12:58:06 -04:00
Vladimir Mandic 525634ad26 modularize build platform 2021-06-05 17:51:46 -04:00
Vladimir Mandic d3bea52d51 enable body segmentation and background replacement in demo 2021-06-05 16:13:41 -04:00
Vladimir Mandic 4167d186ee unified build 2021-06-05 12:59:11 -04:00
Vladimir Mandic 302cc31f59 enable body segmentation and background replacement 2021-06-05 11:54:49 -04:00
Vladimir Mandic 5c6ba688c9 work on body segmentation 2021-06-04 20:22:05 -04:00
Vladimir Mandic 2d3e81181c add meet and selfie models 2021-06-04 13:51:01 -04:00
Vladimir Mandic 3aef4ec048 update gaze strength calculations 2021-06-03 09:53:11 -04:00
Vladimir Mandic 3cdbcbb860 update build with automatic linter 2021-06-03 09:41:53 -04:00
Vladimir Mandic b8db2f0a62 switch worker from module to iife importscripts 2021-06-02 16:46:07 -04:00
Vladimir Mandic 7498bd061f update tests and demos 2021-06-02 13:35:33 -04:00
Vladimir Mandic 0d0e7244ef implemented drag & drop for image processing 2021-06-02 12:43:43 -04:00
Vladimir Mandic 851ea87b18 release candidate 2021-06-01 08:59:09 -04:00
Vladimir Mandic e8cb3a361e breaking changes to results.face output properties 2021-06-01 07:37:17 -04:00
Vladimir Mandic 3708732d1a breaking changes to results.object output properties 2021-06-01 07:07:01 -04:00
Vladimir Mandic 33ba2bd266 breaking changes to results.hand output properties 2021-06-01 07:01:59 -04:00
Vladimir Mandic d670fc4ad9 breaking changes to results.body output properties 2021-06-01 06:55:40 -04:00
Vladimir Mandic 4e9a5ff552 implemented human.next global interpolation method 2021-05-31 10:40:07 -04:00
Vladimir Mandic a965e2f04d finished draw buffering and smoothing and enabled by default 2021-05-30 23:21:48 -04:00
Vladimir Mandic 7784257c76 update typedoc definitions 2021-05-30 18:45:39 -04:00
Vladimir Mandic 9aaa835395 implemented service worker 2021-05-30 17:56:40 -04:00
Vladimir Mandic f5205bafce release candidate 2021-05-30 12:03:34 -04:00
Vladimir Mandic a3bf652abc quantize handdetect model 2021-05-29 18:29:57 -04:00
Vladimir Mandic 185463e30d added experimental movenet-lightning and removed blazepose from default dist 2021-05-29 09:20:01 -04:00
Vladimir Mandic 9bcfe23395 added experimental face.rotation.gaze 2021-05-28 15:53:51 -04:00
Vladimir Mandic 7ea2bcbb5b fix and optimize for mobile platform 2021-05-28 10:43:48 -04:00
Vladimir Mandic 08386933d0 update all box calculations 2021-05-25 08:58:20 -04:00
Vladimir Mandic fd2bd21301 implemented unified result.persons that combines face, body and hands for each person 2021-05-24 11:10:13 -04:00
Vladimir Mandic 1d6f8ddff4 update iris distance docs 2021-05-24 07:18:03 -04:00
Vladimir Mandic 68afebcd24 update iris distance calculations 2021-05-24 07:16:38 -04:00
Vladimir Mandic 13b69fb4cd use green weighted for input diff calculation 2021-05-23 13:54:22 -04:00
Vladimir Mandic bce1d62135 implement experimental drawOptions.bufferedOutput and bufferedFactor 2021-05-23 13:52:49 -04:00
Vladimir Mandic f0739716e2 use explicit tensor interface 2021-05-22 21:54:18 -04:00
Vladimir Mandic 9e0318ea52 add tfjs types and remove all instances of any 2021-05-22 21:47:59 -04:00
Vladimir Mandic b192445071 enhance strong typing 2021-05-22 14:53:51 -04:00
Vladimir Mandic a21f9b2a06 rebuild all for release 2021-05-22 13:17:07 -04:00
Vladimir Mandic 3b46a05483 add id and boxraw on missing objects 2021-05-22 12:41:29 -04:00
Vladimir Mandic e49b5f1018 restructure results strong typing 2021-05-22 12:33:19 -04:00
Vladimir Mandic 1c52d42e24 caching improvements 2021-05-20 19:14:07 -04:00
Vladimir Mandic a5b5352ea6 add experimental mb3-centernet object detection 2021-05-19 08:27:28 -04:00
Vladimir Mandic 3463bb302f individual model skipFrames values still max high threshold for caching 2021-05-18 11:38:22 -04:00
Vladimir Mandic 6add9ba386 config.videoOptimized has been removed and config.cacheSensitivity has been added instead 2021-05-18 11:36:57 -04:00
Vladimir Mandic 7cc927cb1c caching determination is now dynamic based on detection of input change and not based on input types 2021-05-18 11:36:24 -04:00
Vladimir Mandic 43ec77d71b human 1.9.0 beta with breaking changes regarding caching 2021-05-18 11:26:16 -04:00
Vladimir Mandic c295588cf7 update 2021-05-17 08:56:57 -04:00
Vladimir Mandic 1652300288 fix node build and update model signatures 2021-05-11 07:53:06 -04:00
Vladimir Mandic 36715ba3cd update & fix posenet 2021-05-05 10:07:44 -04:00
Vladimir Mandic a95ca54bbf switch posenet weights 2021-05-04 20:46:33 -04:00
Vladimir Mandic 3fe8807440 add hand labels in draw 2021-04-26 07:37:29 -04:00
Vladimir Mandic 6e2d6dc40f cleanup demo workflow 2021-04-26 07:19:30 -04:00
Vladimir Mandic 66b7272987 convert blazeface to module 2021-04-25 16:56:10 -04:00
Vladimir Mandic f26dae059e remove blazeface-front and add unhandledrejection handler 2021-04-25 14:15:38 -04:00
Vladimir Mandic fab62c6332 major update for 1.8 release candidate 2021-04-25 13:16:04 -04:00
Vladimir Mandic 7b4055e23d enable webworker detection 2021-04-25 07:51:01 -04:00
Vladimir Mandic a05b9e7774 enable cross origin isolation 2021-04-24 18:43:59 -04:00
Vladimir Mandic 01c9bb24b5 rewrite posenet decoder 2021-04-24 16:04:49 -04:00
Vladimir Mandic ead7dc3153 update posenet model 2021-04-24 11:49:26 -04:00
Vladimir Mandic d234e68fc9 update 2021-04-19 16:19:03 -04:00
Vladimir Mandic 197e7dc2ef added filter.flip feature 2021-04-19 16:02:47 -04:00
Vladimir Mandic 9dd168733f update gestures 2021-04-19 09:30:04 -04:00
Vladimir Mandic 20f61a6b2b mobile demo optimization and iris gestures 2021-04-18 19:33:40 -04:00
Vladimir Mandic b9395af7ae update tfjs 3.4.0 2021-04-14 12:53:00 -04:00
Vladimir Mandic 8aec48d98a experimental node-wasm support 2021-04-13 21:45:45 -04:00
Vladimir Mandic d25d970ef4 fix for safari imagebitmap 2021-04-13 11:32:22 -04:00
Vladimir Mandic 6ff61e8546 refactored human.config and human.draw 2021-04-13 11:05:52 -04:00
Vladimir Mandic fa5f0be769 implement webrtc 2021-04-12 17:48:59 -04:00
Vladimir Mandic e3b5dcb75e added support for multiple instances of human 2021-04-12 08:29:52 -04:00
Vladimir Mandic aaec742c0a exception handling 2021-04-09 10:02:40 -04:00
Vladimir Mandic 57fe43ab5d add modelBasePath option 2021-04-09 08:07:58 -04:00
Vladimir Mandic b5c77fd149 update 2021-04-08 12:10:15 -04:00
Vladimir Mandic 6d814fd6f4 update tslib 2021-04-06 11:38:01 -04:00
Vladimir Mandic 1d6c72318b add dynamic viewport and fix web worker 2021-04-05 11:48:24 -04:00
Vladimir Mandic f55119cd70 input type validation 2021-04-02 08:37:35 -04:00
Vladimir Mandic f0c7cd9b98 normalize all scores 2021-04-01 09:24:56 -04:00
Vladimir Mandic c2dd6fe567 added face3d demo 2021-03-30 09:03:18 -04:00
Vladimir Mandic 3006266060 initial work on face3d three.js demo 2021-03-29 15:59:16 -04:00
Vladimir Mandic 77476652d2 new serve module and demo structure 2021-03-29 14:40:34 -04:00
Vladimir Mandic f9306abac5 move gl flags to correct location 2021-03-28 13:22:22 -04:00
Vladimir Mandic 718ccda645 minor rotation calculation fix 2021-03-28 08:49:56 -04:00
Vladimir Mandic 91e51cf884 remove debug output 2021-03-28 08:44:53 -04:00
Vladimir Mandic 43b4850819 new face rotation calculations 2021-03-28 08:40:39 -04:00
ButzYung ac6b220888 cleanup 2021-03-28 07:32:31 -04:00
ButzYung adbaa24220 rotationMatrixToEulerAngle, and fixes 2021-03-28 07:32:31 -04:00
ButzYung 38581a3a80 face rotation matrix 2021-03-28 07:32:31 -04:00
Vladimir Mandic 23e515d26f experimental: add efficientpose 2021-03-27 15:43:48 -04:00
Vladimir Mandic ae9d6caabc implement nanodet 2021-03-27 10:25:31 -04:00
Vladimir Mandic 1dd860d112 start working on efficientpose 2021-03-26 18:50:19 -04:00
Vladimir Mandic 1419b89f9b updated face description 2021-03-24 11:08:49 -04:00
Vladimir Mandic 4c3e9818c8 improve fact matching 2021-03-23 15:24:58 -04:00
Vladimir Mandic 1a1560cca1 update nanodet and face rotation check 2021-03-23 14:46:44 -04:00
Vladimir Mandic 7fe2e66957 update demos 2021-03-21 17:47:00 -04:00
Vladimir Mandic 35cf845fbf new module: face description 2021-03-21 14:18:51 -04:00
Vladimir Mandic 61633928cf refactor face classes 2021-03-21 07:49:55 -04:00
Vladimir Mandic 7f644a3bde update 2021-03-17 20:26:43 -04:00
Vladimir Mandic fdddebda2a redefine tensor 2021-03-17 20:23:12 -04:00
Vladimir Mandic 714d2b9187 enforce types 2021-03-17 20:16:40 -04:00
Vladimir Mandic 5f28dd09ad update 2021-03-17 18:33:12 -04:00