Log in or register to post comments

Human Face Masking

July 27, 2017 - 12:09am #1


One of my client came with a human face masking project in Unity. The human face need to be detected and a virtual mask need to be applied over his/her face  as mask. It should work like a complete mask over the face interacting with face's movement and gestures. 

I found a question related to face detection: https://developer.vuforia.com/forum/unity-extension-technical-discussion/simple-face-tracking

At the point of time the Vuforia was not supporting face detection. Has Vuforia has come of with face detection feature in these years?


Thanks in advance!

Human Face Masking

July 28, 2017 - 12:47pm #3

I did a face mask project recently in Unity.  I used OpenCV for Unity and the accompaning face mask sample, both available in the asset store.  Worked out great.  You'll want a native camera feed, Unity's native webcam video feed will be a bottleneck for you.  I piped in Vuforia's camera feed data into it.  You could also use something like Natcam for that.  I had to add points for the top of the head, which required a little math.  Finally I added a Kalman filter to reduce the jitter.  Not a plug and play solution at all, you'll probably spend at least a week getting everything working if you're an experienced developer, but it works well on iOS and Android.


Human Face Masking

July 28, 2017 - 10:42am #2

Hello dharasis,

Vuforia does not currently support face detection.

Sorry for the inconvenience,

-Vuforia Support

Log in or register to post comments