Log in or register to post comments

A little wishlist..

October 18, 2011 - 5:53am #1

In the course of the projects we have been working on (our first movie, about our SocializAR app) should become available any day now), I have compiled a little wishlist for the fantastic piece of work that is QCAR. Maybe you guys are keeping a tally on requested features, so here are a couple of +1's :)

  • I wanted to create multi-marker tracking using frame-markers because these are trackable over a larger distance than image targets. For this (and other purposes too) it would be convenient to have access to the matrix-form of the trackable position in camera-space. Using matrices, it's easy to find the relative pose of one coordinate system to that of another. With quaterinions and position and scale vectors, not so easy. (Unless I'm missing something of course!)
  • We are using frame markers in our SocializAR app to 'track' and connect people on trade shows, networking events, etc. So we would really like to have more ID's in the set of frame-markers, preferably in the range of millions but if that's a problem, 10 to 20 thousand would help al lot already. Would it be an option to look at the color in the camera-image once a square is found? Or add a second row of dots?
  • For the same app it would be good to have access to the 2D locations of the center/corners of the marker, without having to do the reprojection of the 3D point ourselves.
  • (even) better detection of frame-markers at a distance. Maybe by making the dots around the edge larger?
  • For testing, it would be very nice to be able to run a preview in Unity's editor using a webcam. (I realize that a calibration procedure would have to be added for this to work properly..)
  • We have an application at hand where it would be great to have a pose estimation of all markers at a very high precision. If we could snap some photos using the full resolution of the device's camera, and then feed these to QCAR and get some matrices/TRS-data out if it, that would be great.
  • We would really like to be able to create a resources package with the tracking data for a multimarker, for more than 6 markers. Imagine a scenario where you are inside a room with 18 well-trackable paintings on the walls... Right now we would have to create 3 multimarkers and combine the resulting camera pose, only because we can only get a resources package for up to 6 markers. It's no problem to define the location of the markers in the config.xml file.
  • And of course, a SLAM tracker with loop-closing and matching with known locations :-)

Hope this helps! And thanks,
Lex

Re: A little wishlist..

October 19, 2011 - 6:39pm #3

Thanks for the detailed feedback!

Quote:

Using matrices, it's easy to find the relative pose of one coordinate system to that of another. With quaterinions and position and scale vectors, not so easy. (Unless I'm missing something of course!)

This should be possible with the position/quaternion pair as well (they encapsulate the same information as the matrix, after all). Finding the relative position is easy, and I believe you can find the relative rotation using an inverse quaternion:

Quaternion relative = Quaternion.Inverse(a) * b

Does that help at all, or am I misunderstanding the problem?

Quote:

So we would really like to have more ID's in the set of frame-markers, preferably in the range of millions but if that's a problem, 10 to 20 thousand would help al lot already.

Let me ask if there's any way we can provide more. In the meanwhile, one crazy idea is to nest the frame markers (I just tested this and it seems to work). One frame marker nested inside another would provide 130k possibilities. Just a thought, not as clean as providing a larger set of codes but something you could play with right now.

Quote:

Would it be an option to look at the color in the camera-image once a square is found?

Not with any accuracy, lighting plays such a big role in the camera's perception of color.

Quote:

We would really like to be able to create a resources package with the tracking data for a multimarker, for more than 6 markers

You can already create a multi marker with more than 6 image target parts. Just upload all the relevant image targets to the TMS and create the multi target in the config file by hand.

Quote:

The ability to download additional 'qcar-resources' files from the web, and install/activate them on the fly, so that we can create an application that shows a wide variety of AR experiences, and that can be extended during the lifetime of the application, without having to deploy updates to the software

This has been a popular feature request, we're working on it!

Thanks again for the feedback,

- Kim

Re: A little wishlist..

October 18, 2011 - 10:56am #2

Oh, and probably the most important (!) ones:

  • The ability to download additional 'qcar-resources' files from the web, and install/activate them on the fly, so that we can create an application that shows a wide variety of AR experiences, and that can be extended during the lifetime of the application, without having to deploy updates to the software
  • It should be possible to have several of these resource-packages active at once. Simple use-case: there is a museum with many rooms. The markers in the package that is always active allows the user to select the correct room by viewing a certain image, and based on this input the correct 2nd package for the works in the room is loaded.
Log in or register to post comments