Log in or register to post comments

Detecting finger touch on AR object?

March 7, 2020 - 10:28pm #1

Hi, I'm a newbie in Unity and Vuforia.

I'm trying to create a mobile AR app to create a virtual piano keyboard on a flat surface and be able to play the keys using my fingers.

I wonder if this is possible using Vuforia and how difficult this would be. Also, I wonder if the detection would be accurate enough.

If this is difficult to do with Vuforia, I would like to know if there's any better alternative solution to achieve this.

Lastly, I wonder if it is possible to show my fingers in front of the piano keyboards and not behind it.

Thank you so much for your help in advance.

Detecting finger touch on AR object?

March 8, 2020 - 9:17am #2

I don't recommend Vuforia for this.  It doesn't have hand tracking or occlusion.  You might be able to do the keys by using the button feature with markers for each key, but probably wouldn't work well.  If you can target just iOS using ARkit3 (and only newer devices), then ARFoundation might be a good choice because it does body tracking and occlusion.  Then there's something like Manomotion which doesnt work as well but has both the features you need.  https://www.youtube.com/watch?v=jKc0-9cJ2aU

 

Log in or register to post comments