Commit Graph

414 Commits (b5dbb83b7882ba2394f9cfde4d6af9d3982b0ab8)

Author SHA1 Message Date
Vladimir Mandic 6854256668 update angle calculations 2021-08-17 18:46:50 -04:00
Vladimir Mandic f4a1fb2d48 strict type checks 2021-08-17 08:51:17 -04:00
Vladimir Mandic 7c6d9dd3fe add webgu checks 2021-08-15 08:09:40 -04:00
Vladimir Mandic d047ddcd73 experimental webgpu support 2021-08-14 18:00:26 -04:00
Vladimir Mandic 6f5d4d2fe2 add experimental webgu demo 2021-08-14 13:39:26 -04:00
Vladimir Mandic a77a39dbfa complete async work 2021-08-14 11:16:26 -04:00
Vladimir Mandic fc01b2a4a6 switch to async data reads 2021-08-12 09:31:16 -04:00
Vladimir Mandic 8b6e9327a4 fix centernet & update blazeface 2021-08-11 18:59:02 -04:00
Vladimir Mandic f68e76c945 minor update 2021-08-05 10:38:04 -04:00
Vladimir Mandic eeed676823 update build process to remove warnings 2021-07-31 20:42:28 -04:00
Vladimir Mandic a0248a9f7c enable webgl uniform support for faster warmup 2021-07-29 16:35:16 -04:00
Vladimir Mandic d08b657ecd fix unregistered ops in tfjs 2021-07-29 16:06:03 -04:00
Vladimir Mandic dbeaabbcbe updated gesture types 2021-07-29 11:01:50 -04:00
Vladimir Mandic fab6eb0b06 add note on manually disping tensor 2021-06-18 13:39:20 -04:00
Vladimir Mandic 3b75e5e82c modularize model loading 2021-06-18 09:16:21 -04:00
Vladimir Mandic 72d02e10f1 added multithreaded demo 2021-06-14 10:23:06 -04:00
Vladimir Mandic c07d8c2317 fix centernet box width & height 2021-06-11 16:12:24 -04:00
Vladimir Mandic 8b0f7c1ccb modularize build platform 2021-06-06 20:34:29 -04:00
Vladimir Mandic a4befc8106 custom build tfjs from sources 2021-06-06 19:00:34 -04:00
Vladimir Mandic 266679d7fb update wasm to tfjs 3.7.0 2021-06-06 12:58:06 -04:00
Vladimir Mandic 7f5e5aa00a modularize build platform 2021-06-05 17:51:46 -04:00
Vladimir Mandic bf42a1c64e enable body segmentation and background replacement in demo 2021-06-05 16:13:41 -04:00
Vladimir Mandic fd5973b0c2 unified build 2021-06-05 12:59:11 -04:00
Vladimir Mandic a092f681f9 enable body segmentation and background replacement 2021-06-05 11:54:49 -04:00
Vladimir Mandic f0f7e00969 work on body segmentation 2021-06-04 20:22:05 -04:00
Vladimir Mandic c5f0ebe03f add meet and selfie models 2021-06-04 13:51:01 -04:00
Vladimir Mandic 3be72e428d update gaze strength calculations 2021-06-03 09:53:11 -04:00
Vladimir Mandic b713dd5271 update build with automatic linter 2021-06-03 09:41:53 -04:00
Vladimir Mandic 66318c3355 switch worker from module to iife importscripts 2021-06-02 16:46:07 -04:00
Vladimir Mandic 9d7a3148ec update tests and demos 2021-06-02 13:35:33 -04:00
Vladimir Mandic 71cde6b67d implemented drag & drop for image processing 2021-06-02 12:43:43 -04:00
Vladimir Mandic b79e380114 release candidate 2021-06-01 08:59:09 -04:00
Vladimir Mandic e19c65526c breaking changes to results.face output properties 2021-06-01 07:37:17 -04:00
Vladimir Mandic a7f779378d breaking changes to results.object output properties 2021-06-01 07:07:01 -04:00
Vladimir Mandic 8e727302e4 breaking changes to results.hand output properties 2021-06-01 07:01:59 -04:00
Vladimir Mandic efc7e530df breaking changes to results.body output properties 2021-06-01 06:55:40 -04:00
Vladimir Mandic 5788a80a7a implemented human.next global interpolation method 2021-05-31 10:40:07 -04:00
Vladimir Mandic b22d92b0bc finished draw buffering and smoothing and enabled by default 2021-05-30 23:21:48 -04:00
Vladimir Mandic 5761eb282a update typedoc definitions 2021-05-30 18:45:39 -04:00
Vladimir Mandic 764c2fae0c implemented service worker 2021-05-30 17:56:40 -04:00
Vladimir Mandic 22d70df905 release candidate 2021-05-30 12:03:34 -04:00
Vladimir Mandic 363e1a3370 quantize handdetect model 2021-05-29 18:29:57 -04:00
Vladimir Mandic c980736c30 added experimental movenet-lightning and removed blazepose from default dist 2021-05-29 09:20:01 -04:00
Vladimir Mandic 1678d3192f added experimental face.rotation.gaze 2021-05-28 15:53:51 -04:00
Vladimir Mandic 54ddb2e2be fix and optimize for mobile platform 2021-05-28 10:43:48 -04:00
Vladimir Mandic 4ab5bbb6e6 update all box calculations 2021-05-25 08:58:20 -04:00
Vladimir Mandic 70af13ce8c implemented unified result.persons that combines face, body and hands for each person 2021-05-24 11:10:13 -04:00
Vladimir Mandic 5e11171344 update iris distance docs 2021-05-24 07:18:03 -04:00
Vladimir Mandic edf2d896cf update iris distance calculations 2021-05-24 07:16:38 -04:00
Vladimir Mandic bdceeea1d8 use green weighted for input diff calculation 2021-05-23 13:54:22 -04:00
Vladimir Mandic 6e894c3baf implement experimental drawOptions.bufferedOutput and bufferedFactor 2021-05-23 13:52:49 -04:00
Vladimir Mandic 5aeb449a67 use explicit tensor interface 2021-05-22 21:54:18 -04:00
Vladimir Mandic 0fb63cea21 add tfjs types and remove all instances of any 2021-05-22 21:47:59 -04:00
Vladimir Mandic 0b907e56d9 enhance strong typing 2021-05-22 14:53:51 -04:00
Vladimir Mandic b11ae9bfae rebuild all for release 2021-05-22 13:17:07 -04:00
Vladimir Mandic 4b221c17ea add id and boxraw on missing objects 2021-05-22 12:41:29 -04:00
Vladimir Mandic 714d95f6ed restructure results strong typing 2021-05-22 12:33:19 -04:00
Vladimir Mandic 6ced134157 caching improvements 2021-05-20 19:14:07 -04:00
Vladimir Mandic 0c741d2055 add experimental mb3-centernet object detection 2021-05-19 08:27:28 -04:00
Vladimir Mandic 5b0dd5783d individual model skipFrames values still max high threshold for caching 2021-05-18 11:38:22 -04:00
Vladimir Mandic 5741bce450 config.videoOptimized has been removed and config.cacheSensitivity has been added instead 2021-05-18 11:36:57 -04:00
Vladimir Mandic 956e4743c7 caching determination is now dynamic based on detection of input change and not based on input types 2021-05-18 11:36:24 -04:00
Vladimir Mandic 8741695dbd human 1.9.0 beta with breaking changes regarding caching 2021-05-18 11:26:16 -04:00
Vladimir Mandic 0131b10767 update 2021-05-17 08:56:57 -04:00
Vladimir Mandic 4f9d5c7b09 fix node build and update model signatures 2021-05-11 07:53:06 -04:00
Vladimir Mandic 48351b1539 update & fix posenet 2021-05-05 10:07:44 -04:00
Vladimir Mandic 0120290047 switch posenet weights 2021-05-04 20:46:33 -04:00
Vladimir Mandic 2546e7b7e9 add hand labels in draw 2021-04-26 07:37:29 -04:00
Vladimir Mandic b41d4783ef cleanup demo workflow 2021-04-26 07:19:30 -04:00
Vladimir Mandic 88b646b283 convert blazeface to module 2021-04-25 16:56:10 -04:00
Vladimir Mandic 5e089f1f12 remove blazeface-front and add unhandledrejection handler 2021-04-25 14:15:38 -04:00
Vladimir Mandic 3c11ef4189 major update for 1.8 release candidate 2021-04-25 13:16:04 -04:00
Vladimir Mandic 439a7af2e4 enable webworker detection 2021-04-25 07:51:01 -04:00
Vladimir Mandic 437f2f914e enable cross origin isolation 2021-04-24 18:43:59 -04:00
Vladimir Mandic 4dba6b29cb rewrite posenet decoder 2021-04-24 16:04:49 -04:00
Vladimir Mandic e060f1947a update posenet model 2021-04-24 11:49:26 -04:00
Vladimir Mandic a363a08633 update 2021-04-19 16:19:03 -04:00
Vladimir Mandic c4a353787a added filter.flip feature 2021-04-19 16:02:47 -04:00
Vladimir Mandic d270a45492 update gestures 2021-04-19 09:30:04 -04:00
Vladimir Mandic e0666cebe2 mobile demo optimization and iris gestures 2021-04-18 19:33:40 -04:00
Vladimir Mandic e42465d004 update tfjs 3.4.0 2021-04-14 12:53:00 -04:00
Vladimir Mandic e231e68d2d experimental node-wasm support 2021-04-13 21:45:45 -04:00
Vladimir Mandic 43f564a978 fix for safari imagebitmap 2021-04-13 11:32:22 -04:00
Vladimir Mandic 0af73ab567 refactored human.config and human.draw 2021-04-13 11:05:52 -04:00
Vladimir Mandic de2b82e45d implement webrtc 2021-04-12 17:48:59 -04:00
Vladimir Mandic 6e0fe556e8 added support for multiple instances of human 2021-04-12 08:29:52 -04:00
Vladimir Mandic 0e20bfe665 exception handling 2021-04-09 10:02:40 -04:00
Vladimir Mandic b572858b97 add modelBasePath option 2021-04-09 08:07:58 -04:00
Vladimir Mandic 0788b049b3 update 2021-04-08 12:10:15 -04:00
Vladimir Mandic 7022c265a7 update tslib 2021-04-06 11:38:01 -04:00
Vladimir Mandic 9b5ced8f62 add dynamic viewport and fix web worker 2021-04-05 11:48:24 -04:00
Vladimir Mandic 34f01f2053 input type validation 2021-04-02 08:37:35 -04:00
Vladimir Mandic 5931a6f541 normalize all scores 2021-04-01 09:24:56 -04:00
Vladimir Mandic 49a9717b90 added face3d demo 2021-03-30 09:03:18 -04:00
Vladimir Mandic b4c4364953 initial work on face3d three.js demo 2021-03-29 15:59:16 -04:00
Vladimir Mandic 1d715dfead new serve module and demo structure 2021-03-29 14:40:34 -04:00
Vladimir Mandic 6d978c0b9b move gl flags to correct location 2021-03-28 13:22:22 -04:00
Vladimir Mandic 957872e5a1 minor rotation calculation fix 2021-03-28 08:49:56 -04:00
Vladimir Mandic 9cdae38de1 remove debug output 2021-03-28 08:44:53 -04:00
Vladimir Mandic 491ebe018f new face rotation calculations 2021-03-28 08:40:39 -04:00
ButzYung e8d082f6ad cleanup 2021-03-28 07:32:31 -04:00
ButzYung 395b72680b rotationMatrixToEulerAngle, and fixes 2021-03-28 07:32:31 -04:00
ButzYung 749fc56646 face rotation matrix 2021-03-28 07:32:31 -04:00
Vladimir Mandic 8b9374c09b experimental: add efficientpose 2021-03-27 15:43:48 -04:00
Vladimir Mandic 9bb0769637 implement nanodet 2021-03-27 10:25:31 -04:00
Vladimir Mandic dc7abbb459 start working on efficientpose 2021-03-26 18:50:19 -04:00
Vladimir Mandic cece9f71fc updated face description 2021-03-24 11:08:49 -04:00
Vladimir Mandic 13ea73e650 improve fact matching 2021-03-23 15:24:58 -04:00
Vladimir Mandic 272985bb25 update nanodet and face rotation check 2021-03-23 14:46:44 -04:00
Vladimir Mandic ca511a5385 update demos 2021-03-21 17:47:00 -04:00
Vladimir Mandic 64adb7ebd8 new module: face description 2021-03-21 14:18:51 -04:00
Vladimir Mandic 0e15a5e846 refactor face classes 2021-03-21 07:49:55 -04:00
Vladimir Mandic 13a2472f75 update 2021-03-17 20:26:43 -04:00
Vladimir Mandic c1c6b66315 redefine tensor 2021-03-17 20:23:12 -04:00
Vladimir Mandic de0fffbfdc enforce types 2021-03-17 20:16:40 -04:00
Vladimir Mandic 2464b8c0ef update 2021-03-17 18:33:12 -04:00
Vladimir Mandic b0ed511405 type definitions 2021-03-17 18:23:19 -04:00
Vladimir Mandic 8523da07b5 fix box clamping and raw output 2021-03-17 14:35:11 -04:00
Vladimir Mandic aa79cd3b20 hierarchical readme notes 2021-03-17 12:01:54 -04:00
Vladimir Mandic 7738c2ad3d update 2021-03-17 11:40:31 -04:00
Vladimir Mandic c356b02625 add experimental nanodet object detection 2021-03-17 11:32:37 -04:00
Vladimir Mandic 5e082a5294 implement human.match and embedding demo 2021-03-15 12:14:48 -04:00
Vladimir Mandic 6294882ea8 fix broken build 2021-03-14 13:49:01 -04:00
Vladimir Mandic 1da76b4adc update 2021-03-14 13:39:47 -04:00
Vladimir Mandic 43d283125b add typedocs and types 2021-03-13 22:31:09 -05:00
Vladimir Mandic fc8e5bf258 strong typings 2021-03-13 13:47:45 -05:00
Vladimir Mandic 896cb0aac0 update embedding and strong typings 2021-03-13 11:26:53 -05:00
Vladimir Mandic 75f3e3c269 distance based on minkowski space and limited euclidean space 2021-03-12 18:24:34 -05:00
Vladimir Mandic 8de79a92b2 guard against invalid input images 2021-03-12 16:43:36 -05:00
Vladimir Mandic 12b0058a1b switched face embedding to mobileface 2021-03-12 12:54:08 -05:00
Vladimir Mandic c3ecdf5486 add test for face descriptors 2021-03-11 18:26:04 -05:00
Vladimir Mandic d5b620dbe8 autodetect inputSizes 2021-03-11 10:26:14 -05:00
Vladimir Mandic 74ad5a2837 enhanced age, gender, emotion detection 2021-03-10 09:44:45 -05:00
Vladimir Mandic f8b13a8bba remove blazeface-front and faceboxes 2021-03-09 18:32:35 -05:00
Vladimir Mandic 9fd20393be fix for face detector when mesh is disabled 2021-03-09 13:15:40 -05:00
Vladimir Mandic 36451ea918 update docs and demo 2021-03-08 07:32:24 -05:00
Vladimir Mandic cd949deec9 implemented 3d face angle calculations 2021-03-06 17:22:47 -05:00
Vladimir Mandic 18a4789639 add curve draw output 2021-03-06 10:38:04 -05:00
Vladimir Mandic de2ff38ff8 fix human.draw 2021-03-05 14:30:09 -05:00
Vladimir Mandic c2e74d2ba1 update human.draw helper methods 2021-03-05 11:43:50 -05:00
Vladimir Mandic 95519c45b7 added blazepose-upper 2021-03-05 07:39:37 -05:00
Vladimir Mandic 75161c9127 implement blazepose and update demos 2021-03-04 10:33:08 -05:00
Vladimir Mandic b77b98e8d4 fine tuning age and face models 2021-03-03 09:59:04 -05:00
Vladimir Mandic 7969623849 add debug logging flag 2021-03-02 11:27:42 -05:00
Vladimir Mandic 278cc818af added skipInitial flag 2021-03-01 17:20:02 -05:00
Vladimir Mandic b7e0674abe rebuild 2021-02-26 09:04:15 -05:00
Vladimir Mandic 87e0559706 updated model defaults 2021-02-22 09:13:11 -05:00
Vladimir Mandic 8aa92fad2c build fix 2021-02-21 14:06:13 -05:00
Vladimir Mandic 1a5d5cb37e fix imagefx and add dev builds 2021-02-21 07:20:58 -05:00
Vladimir Mandic e24882f472 update imagefx 2021-02-19 08:35:41 -05:00
Vladimir Mandic 3ca1773e12 update tfjs to 3.1.0 2021-02-17 10:22:38 -05:00
Vladimir Mandic a8ccee95bf update lint rules 2021-02-13 09:21:48 -05:00
Vladimir Mandic 17c9aa6583 updated lint rules 2021-02-13 09:16:41 -05:00
Vladimir Mandic 402ef8ae32 updated typings 2021-02-08 12:47:38 -05:00
Vladimir Mandic 3824deba29 convert to typescript 2021-02-08 11:39:09 -05:00
Vladimir Mandic 60b817ba4c added faceboxes alternative model 2021-02-06 17:41:53 -05:00
Vladimir Mandic fbd1eb94c2 added warmup for nodejs 2021-01-30 13:23:07 -05:00
Vladimir Mandic 2a041305e9 added humangl custom backend 2021-01-13 09:35:31 -05:00
Vladimir Mandic 61c4d7ae6d code cleanup and enable minification 2021-01-12 09:55:08 -05:00
Vladimir Mandic 44ae1b517a fix safari incopatibility 2021-01-12 08:24:00 -05:00
Vladimir Mandic 872fb5fdb2 work on blazepose 2021-01-11 14:35:57 -05:00
Vladimir Mandic 98bd96426a added iris gesture 2021-01-11 09:02:02 -05:00
Vladimir Mandic 049facf72b fix emotion labels 2021-01-06 06:51:20 -05:00
Vladimir Mandic 6ba9cda7bb remove iris coords if iris is disabled 2021-01-05 16:41:54 -05:00
Vladimir Mandic f7a51349bf update iris objects 2021-01-05 16:33:43 -05:00
Vladimir Mandic 79ac90f684 stricter linting, fix face annotations 2020-12-27 08:12:22 -05:00
ButzYung 94fb9408ad Variable name changes, setting .rawCoords only if necessary 2020-12-22 12:20:36 -05:00
ButzYung 2eb0578501 Option to return raw data (mesh, box) for Facemesh / "preserve aspect ratio" fix from Facemesh upstream 2020-12-22 12:20:36 -05:00
Vladimir Mandic 253030830f add z axis scaling 2020-12-16 19:16:54 -05:00
Vladimir Mandic ab87288e7d republish due to tfjs 2.8.0 issues 2020-12-16 14:49:14 -05:00
Vladimir Mandic 5921d14bfe added custom webgl backend 2020-12-12 18:34:30 -05:00
Vladimir Mandic 4d43356d73 improved caching and warmup 2020-12-11 10:11:49 -05:00
Vladimir Mandic a1aaa44e8d conditional hand rotation 2020-12-10 15:46:45 -05:00
Vladimir Mandic 5c6e610a37 implemented face and hand boundary checks 2020-12-08 10:50:26 -05:00
Vladimir Mandic 7a0e5a555d embedded sample for warmup 2020-12-08 09:58:30 -05:00
Vladimir Mandic f65effc69d switch to central logger 2020-12-08 09:00:44 -05:00
Vladimir Mandic 40e0f1c4c4 minor compatibility fixes 2020-11-26 10:37:04 -05:00
Vladimir Mandic e1b3fff07c update for node v15 2020-11-25 09:13:19 -05:00
Vladimir Mandic 4679b859b8 implement multi-person gestures 2020-11-23 23:36:04 -05:00
Vladimir Mandic 2978b319c3 modularize pipeline models 2020-11-23 22:55:01 -05:00
Vladimir Mandic 853745512e changed build for optimized node & browser 2020-11-21 12:21:47 -05:00
Vladimir Mandic a84c26c781 camera exception handling 2020-11-20 07:52:50 -05:00
Vladimir Mandic 41f7386583 force f16 textures 2020-11-19 16:16:51 -05:00
Vladimir Mandic ef13c1e560 ui redesign 2020-11-19 14:45:59 -05:00
Vladimir Mandic adcb55c83a completed tfjs wrapper 2020-11-18 08:26:28 -05:00
Vladimir Mandic d81a8bdc1e fix serious performance bug around skipframes 2020-11-17 17:42:44 -05:00
Vladimir Mandic 01ad1809f2 swtich to custom tfjs bundle 2020-11-17 12:38:48 -05:00
Vladimir Mandic a773b9e2b9 swtich to tfjs source import 2020-11-17 10:18:15 -05:00
Vladimir Mandic c7671ef89d switched to minified build 2020-11-16 15:51:46 -05:00
Vladimir Mandic a8d52c45d8 web worker fixes 2020-11-15 09:28:57 -05:00
Vladimir Mandic 86321b2523 fix camera restart on resize 2020-11-14 07:02:05 -05:00
Vladimir Mandic 9d80512e36 implemented face embedding 2020-11-13 16:13:35 -05:00
Vladimir Mandic ea88b72c52 updated face uv coordinates 2020-11-12 14:52:32 -05:00
Vladimir Mandic bfbb3042af updated packages 2020-11-12 12:58:55 -05:00
Vladimir Mandic 1b0a037d3f reduced bundle size 2020-11-12 12:17:57 -05:00
Vladimir Mandic a3fa102a77 implemented buffered processing 2020-11-12 09:21:26 -05:00
Vladimir Mandic 17a8e20a53 fix for conditional model loading 2020-11-11 22:40:05 -05:00
Vladimir Mandic fcdb076549 added performance notes 2020-11-11 15:02:49 -05:00
Vladimir Mandic ec19579e53 update dependencies 2020-11-10 09:54:07 -05:00
Vladimir Mandic 53b4542140 fix bug in async ops and change imports 2020-11-10 08:57:39 -05:00