@facemoji/mocap4face-test
Advanced tools
mocap4face by alter is a free, multiplatform SDK for real time facial motion capture based on Facial Action Coding System or (FACS). It provides real-time FACS-derived blendshape coefficients, and rigid head pose in 3D space from any mobile camera, webcam, photo, or video enabling live animation of 3D avatars, digital characters, and more.
After fetching the input from one of the mentioned sources, mocap4face SDK produces data in ARKit-compatible blendshapes, i.e., morph targets weight values as a per-frame expression shown in the video below. Useful for, e.g., animating a 2D or 3D avatar in a way that mimics the user's facial expressions in real-time à la Apple Memoji but without the need of a hardware-based TrueDepth Camera.
With mocap4face, you can drive live avatars or NFT PFPs, build Snapchat-like lenses, AR experiences, face filters that trigger actions, VTubing apps, and more with as little energy impact and CPU/GPU use as possible. As an example, check out how the popular avatar live-streaming app REALITY is using our SDK.
Please star us ⭐⭐⭐ on GitHub—it motivates us a lot!
42 tracked facial expressions via blendshapes3MB ML model size≤ ±50° pitch, ≤ ±40° yaw and ≤ ±30° roll tracking coverage50 FPS on Pixel 460 FPS on iPhone SE (1st gen)90 FPS on iPhone X or newernpm install && npm run dev to start a local server with the demonpm install && npm run dev_https to start a local server with self-signed HTTPS supportnpm install @facemoji/mocap4face in your own project to add mocap4face as a dependencyIf the webcamera button is not working, you might need to use HTTPS for the local dev server.
Run npm run dev_https and allow the self-signed certificate in the browser to start the demo in HTTPS mode.
You can also run npm run build to create a production bundle of the demo app.
This library is provided under the Facemoji SDK License Agreement—see LICENSE. Also make sure to check out our FAQ for more details.
The sample code in this repository is provided under the Facemoji Samples License
OSS used in mocap4face SDK:
Original video by LaBeouf, Rönkkö & Turner.
FAQs
mocap4face by alter
The npm package @facemoji/mocap4face-test receives a total of 0 weekly downloads. As such, @facemoji/mocap4face-test popularity was classified as not popular.
We found that @facemoji/mocap4face-test demonstrated a not healthy version release cadence and project activity because the last version was released a year ago. It has 1 open source maintainer collaborating on the project.
Did you know?
Socket for GitHub automatically highlights issues in each pull request and monitors the health of all your open source dependencies. Discover the contents of your packages and block harmful activity before you install or update your dependencies.
Security News
Ransomware negotiators share how modern cybercriminals operate like corporations, using specialized teams, negotiation tactics, and reputation management.
Security News
PyPI confirms no security flaws were exploited in the Ultralytics supply chain attack and highlights improvements for safer package publishing.
Security News
Research
The Socket Research Team breaks down a malicious wrapper package that uses obfuscation to harvest credentials and exfiltrate sensitive data.