Log in or register to post comments

Improve Object Tracking

May 4, 2017 - 4:54am #1

I used the Unity HoloLens sample to build an app that uses an object as a tracker but on the Hololens tracking is bad, the positioning is sort of okay but otherwise the whole thing is jittery, it shakes and if I move the object just a little bit things kinda go crazy (I disabled extended tracking because when it is on hololens keeps the position of the asset so you move the object there's a delay, I want the asset to follow my object tracker smoothly).

I know it's not the object tracker quality because I used the same one on mobile and it is by for the best tracker I have ever had so it must the Hololens.

My search on the internet has led me to believe there is simply no proper Vuforia sdk for object tracking, is this true?

I also came across this video --> https://www.youtube.com/watch?v=lYptlaO9rKw and in the comments they say they didn't use any SDK whatsoever, just unity and hololens. Does anyone know how to do this?

Improve Object Tracking

July 14, 2017 - 12:35am #6

I'm actually looking for the very same answers I believe: https://developer.vuforia.com/forum/hololens/object-recognition-unsatisfactory-hololens

Improve Object Tracking

May 5, 2017 - 12:03am #5

chrigit wrote:

prime8 wrote:

I used the Unity HoloLens sample to build an app that uses an object as a tracker but on the Hololens tracking is bad, the positioning is sort of okay but otherwise the whole thing is jittery, it shakes and if I move the object just a little bit things kinda go crazy (I disabled extended tracking because when it is on hololens keeps the position of the asset so you move the object there's a delay, I want the asset to follow my object tracker smoothly).

I know it's not the object tracker quality because I used the same one on mobile and it is by for the best tracker I have ever had so it must the Hololens.

My search on the internet has led me to believe there is simply no proper Vuforia sdk for object tracking, is this true?

I also came across this video --> https://www.youtube.com/watch?v=lYptlaO9rKw and in the comments they say they didn't use any SDK whatsoever, just unity and hololens. Does anyone know how to do this?

It looks like they did not do any feature recognition in that video. It's just a static scene with holograms positioned so that they overlap the correct parts.

 

I also noticed the considerable delay when using extended tracking between moving the tag and the hologram moving to the new location. I would be very interested in ways to optimize this delay.

If you take a video or a picture through mixed reality capture you will see that the RGB camera quality of the Hololens is quite bad. (Probably due to processing and other HW constraints) I guess that's why the tracking is so much worse than with a mobile device? But that's just my speculation.

 

Do you think there is a way to get it at least close to the mobile quality? Something like this ---> https://www.youtube.com/watch?v=sT4IGCAbseA 

Improve Object Tracking

May 4, 2017 - 11:52pm #4

medabit wrote:

Hello,

The Vuforia SDK's tracking quality is dependent upon multiple factors:

  1. The quality of the camera image being provided by the platform device to the SDK
  2. The quality of the object target scan, which includes the number, distribution and accuracy of the feature points
  3. The environment during the tracking session, including the intensity of the lighting, distance from target camera to the target (the further away the target is from the camera, the more tracking quality will be diminished when Extended Tracking is not used), and the amount+intensity of spectral reflections that occur upon the surface of the object target. The latter can interfere with tracking quality as they may occlude feature points, especially when the object target has shiny surfaces.

It is incorrect that the Vuforia SDK does not have a solution object tracking. We are working closely with Microsoft to continue to optimize and improve the Vuforia SDK's integration with the HoloLens platform, including introducing new features to be supported. Stay tuned!

Thanks.

 

Would you happen to know of a tutorial or guideline to achieve something like this? --> https://www.youtube.com/watch?v=5HV3fcTvZk0&t=19s

Improve Object Tracking

May 4, 2017 - 10:49am #3

prime8 wrote:

I used the Unity HoloLens sample to build an app that uses an object as a tracker but on the Hololens tracking is bad, the positioning is sort of okay but otherwise the whole thing is jittery, it shakes and if I move the object just a little bit things kinda go crazy (I disabled extended tracking because when it is on hololens keeps the position of the asset so you move the object there's a delay, I want the asset to follow my object tracker smoothly).

I know it's not the object tracker quality because I used the same one on mobile and it is by for the best tracker I have ever had so it must the Hololens.

My search on the internet has led me to believe there is simply no proper Vuforia sdk for object tracking, is this true?

I also came across this video --> https://www.youtube.com/watch?v=lYptlaO9rKw and in the comments they say they didn't use any SDK whatsoever, just unity and hololens. Does anyone know how to do this?

It looks like they did not do any feature recognition in that video. It's just a static scene with holograms positioned so that they overlap the correct parts.

 

I also noticed the considerable delay when using extended tracking between moving the tag and the hologram moving to the new location. I would be very interested in ways to optimize this delay.

If you take a video or a picture through mixed reality capture you will see that the RGB camera quality of the Hololens is quite bad. (Probably due to processing and other HW constraints) I guess that's why the tracking is so much worse than with a mobile device? But that's just my speculation.

Improve Object Tracking

May 4, 2017 - 8:17am #2

Hello,

The Vuforia SDK's tracking quality is dependent upon multiple factors:

  1. The quality of the camera image being provided by the platform device to the SDK
  2. The quality of the object target scan, which includes the number, distribution and accuracy of the feature points
  3. The environment during the tracking session, including the intensity of the lighting, distance from target camera to the target (the further away the target is from the camera, the more tracking quality will be diminished when Extended Tracking is not used), and the amount+intensity of spectral reflections that occur upon the surface of the object target. The latter can interfere with tracking quality as they may occlude feature points, especially when the object target has shiny surfaces.

It is incorrect that the Vuforia SDK does not have a solution object tracking. We are working closely with Microsoft to continue to optimize and improve the Vuforia SDK's integration with the HoloLens platform, including introducing new features to be supported. Stay tuned!

Thanks.

Log in or register to post comments