"We offer new support options and therefor the forums are now in read-only mode! Please check out our Support Center for more information." - Vuforia Engine Team

Using Advanced Camera API on HoloLens

By njessenberg on Fri, 08/23/2019 - 13:26

Hello,

 

I am working on an application using Vuforia on the HoloLens, and we would like to have some control over the image/video being analyzed by Vuforia. I saw in the FAQ that it is not possible to provide Vuforia a custom video feed, but I also saw that Vuforia offers the Advanced Camera API (https://library.vuforia.com/content/vuforia-library/en/articles/Solution/Advanced-Camera-API.html), which might be great for us. We could tweak some parameters of the camera and hopefully improve tracking in our case.

However, it seems to me that this API is only available on Android?

If so, is there any way to modify the camera footage (e.g. change contrast or brightness or even apply some image processing) on the HoloLens? Before Vuforia starts working on the footage, of course, so that hopefully we can have better tracking.

The license we have is not a problem.

 

Thanks :)

Hi,

Yes, the Advanced APi is only available for Android.

In regards to your second questions, usually we do not encourage developer to "play" with the video being send to Vuforia as this usually results in tracking issues.

njessenberg

Tue, 08/27/2019 - 14:30

Permalink

Hi!

 

Simultaneous posting it seems :).

 

The issue we are seeing is that, when we look at the image (taken through CameraDevice.Instance.GetCameraImage(...)), it appears quite poor compared to what we see with our eyes.

mcotora

Thu, 08/29/2019 - 10:46

Permalink

Hi,

Ok, so the video quality is not as expected and you would like to improve it by tweaking the video feed.

One thing that is missing and I would be good to understand, is what features from Vuforia are you using? my assumption from the last post is image targets.

njessenberg

Thu, 08/29/2019 - 11:09

Permalink

I am sorry.

We are using MT360 for now with Vuforia 8.3.8 and Unity 2018.4.2. We have a Pro license.

Most objects we need to track are quite dark and have no specific texture (they are just a single dark color), unfortunately, which we cannot change.

njessenberg

Fri, 08/30/2019 - 12:21

Permalink

So unfortunately, it seems unlikely that we can influence the camera settings for Vuforia. And I am aware that Vuforia can not be fed custom images/video source (which on HoloLens might incur a significant overhead anyway).

 

Thank you for the information :)

njessenberg

Tue, 08/27/2019 - 14:26

Permalink

Update:

 

I found some other posts where it was said that the Advanced Camera API is only available for Android.

 

I have instead been trying to use the HoloLens' "VideoDeviceController" class.