Log in or register to post comments

Air-tap isn't working in the Vuforia HoloLens sample containing the MRTK v2.2

May 13, 2020 - 7:52am #1

Hiya!

 

We've been working with the Vuforia Hololens Sample 1 & 2 asset available on the Unity Asset Store for some time now, and have been unable to get air-tap working on a HoloLens 1 device using this framework.

We've followed setup instructions found at various places on the web, including those provided by representatives of Microsoft, none of which have resulted in the Hololens detecting an air-tap gesture, or any other gesture.

Most notable is that the device seems to not even be detecting a ready gesture, either in our scenes or in the default scenes provided by the framework's samples, so we whether we have missed some critical setup step, or if there's some configuration option causing gesture recognition to be disabled, or that some critical part of the MRTK has been omitted from the Vuforia Hololens Sample 1 & 2 asset on the Unity Asset Store, or moved from its expected filepath in the Assets directory.

We absolutely do need this feature for an upcoming delivery milestone for our client. It's integral to the user experience we're building and we don't have an acceptable workaround if it isn't there, so it's important that we have a fix for this as quickly as possible.

To help diagnose the issue, I've attached a zip to this post, containing a simple Unity project that reproduces the behaviour as well as an AppX that can be side-loaded directly to a HoloLens device. In the scene you will see:

  • One red sphere (This sphere should be air-tappable)
  • One green cube (This cube should toggle visibility when the red sphere is air-tapped)

If someone can look at this project and let us know what's missing and/or what's misconfigured, it would be a huge help, thanks!

AttachmentSize
Package icon VuforiaMRTKSample_UnityProject_AirTap.zip212.33 MB
ELCDeveloper
Joined:
May 15, 2019
Posts: 6
Top

Air-tap isn't working in the Vuforia HoloLens sample containing the MRTK v2.2

May 28, 2020 - 12:02am #5

Hi, 

Going over the attached pictures, I noticed that you are using 2019.3.

MRTKv2.2 is not compatible with 2019.3 and Windows XR Plugin. As per the information here: https://blogs.unity3d.com/2020/01/24/unity-xr-platform-updates/   MRTKv2.3 will be compatible with 2019.3 and Windows XR Plugin. 

In addition Microsoft official recommendation is to use 2018.4.

Thank you.

Vuforia Engine Support

 

mcotora
Joined:
March 15, 2019
Posts: 1675
Top

Air-tap isn't working in the Vuforia HoloLens sample containing the MRTK v2.2

May 26, 2020 - 11:40pm #4

Hi,

it helped for me to remove the XR Management and the Windows XR Plugin in the Package Manager.

I have also just a Hololens 2 to test here but before it did not recognize the Air tap gesture, so you can give it a try on HL1.

 

sebben
Joined:
December 6, 2019
Posts: 38
Top

Air-tap isn't working in the Vuforia HoloLens sample containing the MRTK v2.2

May 26, 2020 - 7:16pm #3

mcotora wrote:

Hi,

I've tested Airtap with our sample with the HL2 and it worked as expected. I will able to re-test tomorrow on HL1 however I do not believe it to be a significant difference between them

 

As mentioned in our other thread, we're developing on HoloLens 1, not HoloLens 2. While it is important that air-tap functions on both platforms, it's vital for our client that it functions as expected on Hololens 1.

 

mcotora wrote:

In addition I found a similar issue on stackoverflow: https://stackoverflow.com/questions/59502650/why-is-air-tap-gesture-not-working-on-hololens1-in-my-unity-mrtk-app/59655477?noredirect=1#comment105537134_59655477 that might help you further.

 

That was one of the first things we found/tried. It did not help in our case, and we think we understand why: The snippet in that post is intended to take an input event and translate it to something that the MRTK input system can use. For it to work however, it needs an input event to be fired, and we're not seeing any evidence that input events are even being detected by the application at all.

To quote my previous post in this thread:

ELCDeveloper wrote:

the device seems to not even be detecting a ready gesture, either in our scenes or in the default scenes provided by the framework's samples,

Most telling is that air-tap isn't even working with the Vuforia sample scenes that come with the sample project, so we think the issue is further up the logic chain. Perhaps some import settings are off?

We've followed the instructions at https://library.vuforia.com/content/vuforia-library/en/articles/Solution/Working-with-the-HoloLens-sample-in-Unity.html as best we can to set up the project, however that documentation appears to be obsolete / doesn't entirely work with the recommended settings for MRTK 2.2, so it's possible there's some other configuration setting we need to change.

I've attached screenshots of what we see when we configure the project. Can you please cross-reference these with your working project and note any differences between the configuration of our project and the configuration of your working project?

Thanks!

AttachmentSize
Image icon 1.XR Settings.PNG26.98 KB
Image icon 2.PackageManager.PNG51.09 KB
Image icon 3.XR Plugin Management.PNG34.72 KB
Image icon 4.XR Plugin Management-InputHelpers.PNG24.52 KB
Image icon 5.XR Plugin Management-Windows Mixed Reality.PNG31.04 KB
ELCDeveloper
Joined:
May 15, 2019
Posts: 6
Top

Air-tap isn't working in the Vuforia HoloLens sample containing the MRTK v2.2

May 26, 2020 - 7:30am #2

Hi,

I've tested Airtap with our sample with the HL2 and it worked as expected. I will able to re-test tomorrow on HL1 however I do not believe it to be a significant difference between them.

In addition I found a similar issue on stackoverflow: https://stackoverflow.com/questions/59502650/why-is-air-tap-gesture-not-working-on-hololens1-in-my-unity-mrtk-app/59655477?noredirect=1#comment105537134_59655477 that might help you further.

Will come back with an update.

Thank you.

Vuforia Engine Support

 

mcotora
Joined:
March 15, 2019
Posts: 1675
Top
Log in or register to post comments