"We offer new support options and therefor the forums are now in read-only mode! Please check out our Support Center for more information." - Vuforia Engine Team

Detecting objects in images other than camera stream

Hi Vuforia Team,

firstly thanks for a great framework. I used the Vuforia sdk in my last project on iOS with great success, we had compared several similar toolkits, and vuforia seems to me to be the best by far.

I do have a question though. Is it somehow possible to track objects in imagery that does not stem from the live camera stream? The background of this question is, that I'm using opencv for tracking other things, such as faces and bodies. And I'd like to take the frames I receive from opencv and let them be analyzed by Vuforia at the same time, because in its field Vuforia outperforms opencv by far. So the ideal solution for me would be to be able to load a trackable set and manually submit new frames in some defined format to vuforia to then receive a list of transformation matrices of the found trackables.

Is this possible at the moment? And I so, could you point me in to the right direction? I've read through the code of "QCARutils.mm", but to me it seems that there is always some kind of camera connection involved.

Thank you for you time!

DavidĀ 

Hi, Vuforia does not support the processing of external images other than the camera video frames.

(actually it is possible to do the opposite, i.e. extracting the video frames using the QCAR API and feed them into OpenCV for instance).

Glad that I was helpful.

I don't know how to convert to CV:mat, but yes you can get the QCAR::Frame from the QCAR::State and then get a QCAR::Image from the QCAR::Frame; this is straightforward to do.