Log in or register to post comments

Misalignment of 3D augmentation in Stereo mode

April 21, 2016 - 11:42am #1

Good day, 

On our latest project, we had to augment a 3D model of a mechanical motor and align its animated parts on a real life printed version of it. The main goal was to show the process of disassembly of this motor by overlaying the virtual parts as close as possible to the real piece. 

To do this, we used our usual pipeline: we created a 22" x 22" marker on which the real life motor could sit right in the middle. Since the motor was positioned in the center of the marker, the alignment seemed quite on point from all angles when the scene was built as a single regular camera view. 

Once we switched to Stereo mode with the Digital Eyewear component, we noticed that the virtuel model had an unpleasant offset to the right of the marker, making all the animations running at the wrong place. The included screenshots show the problem clearly and the differences between the Mono and Stereo mode. We realized the source of the problem could come from the position of the camera on a phone, since most tests were run on a Galaxy S3, on which the rear camera is to the center left border of the phone, when held sideways. However, we did not figure how to fix this offset that is causing some major misalignment issues for our project. 

Some technical information: 
We used Vuforia 5-5-9 on Unity 5.3.4f1 32-bit on a Windows PC. 
The tests were run mostly on a Samsung Galaxy S3 with Android 4.4.2 and iPhone 4. 

We also created an empty project with only the latest Vuforia and the right target database to see if a simple cube could be properly aligned in Stereo mode, but it did not: the same problem was present after building on the Android device. In the Unity editor, the alignment remained perfect when seen from a basic webcam.

Misalignment of 3D augmentation in Stereo mode

June 1, 2016 - 8:36pm #26

The investigation is in progress, but there's no new status update to share at this time.

Misalignment of 3D augmentation in Stereo mode

June 1, 2016 - 4:44am #25

Hello @dm3d,

 

Could you give us an update on this please ? Its been over a month since you have opened the ticket with your engineering team... Still no news whatsoever. I would expect they had time to look into this by now ? 

 

Thanks.

Misalignment of 3D augmentation in Stereo mode

May 16, 2016 - 5:05pm #24

@bighandinsky2: please post your question in a new thread as it deals with optical see-through and this thread is about video see-through.

Misalignment of 3D augmentation in Stereo mode

May 16, 2016 - 3:55am #23

I wanted to add to this that I've been getting offsetting issues as well with Stereo Rendering on the ODG R7:

Where without calibration, using an A4 marker where a cube is placed at the edge of corner, all four cubes are displayed larger, closer to the user, and with a slight rotation, where on both eyes the group of cubes are rendered offset to the marker.

Using calibration, where I've matched the red rectangles on the calibration tool to be a very good match (Both rectangles being displayed on the calibration marker with little overlap over the sides of it, all four cubes are now almost at the right scale, and are being renderered in the same position on each eye, but are still being rendered offset away from the marker with a small rotation.

Sadly I can't get a good image of this in action, as with the R7 being see-through the image only shows the cubes, so I've made a rough approximation in Unity and attached the images.

Project settings:

  • Vuforia VideoPlayback 5.5.9,
  • Where the AR Camera has Digital Eyewear set to Optical See-Through,
  • In a scene with just basic A4 placeholder markers and no scale/position modification of the marker children,

I've had this offset occur amongst all my projects using the R7's, where when building to a standard Android device, the markers are functioning as expected using the same project (And a default ARCamera).

 

Edit: I've gone through and done the testing scene that was asked of Marge, and have an approximation of my results from that with my calibration, where on the ARCamera I have the Digital Eyewear set to Optical See-Through.

Misalignment of 3D augmentation in Stereo mode

May 12, 2016 - 8:33am #22

Thanks, any hope we can get an update on this today? Our client is getting a bit worried about the outcome of his demo.

Misalignment of 3D augmentation in Stereo mode

May 10, 2016 - 1:50pm #21

Thanks for changing the values to meters and posting new screenshots. I have a ticket open with our engineering team to look into this further.

Misalignment of 3D augmentation in Stereo mode

May 9, 2016 - 9:04am #20

I changed the scale of the marker to the value you told me. Basically, it's the value I had earlier before scaling the whole scene x1000 to make it work properly on the Eyewear SDK. Unfortunately, it still shows the same behavior differences between the mono and stereo versions (screenshots are attached).

Misalignment of 3D augmentation in Stereo mode

May 5, 2016 - 4:02pm #19

The calibration settings for the GS3 are already included in Vuforia. I tried the apk you provided on 2 other GS3 devices as well.

You mentioned that your physical target is 22" with the ImageTarget set to 558.8. I did confirm with one of our engineers that Vuforia's stereo calculations are expecting ImageTarget size to be specified in meters. The appropriate meters measurement for 22" would be 0.5588. Could you update to those values and provide some new screenshots?

 

Misalignment of 3D augmentation in Stereo mode

May 4, 2016 - 1:01pm #18

As a followup to my last questions, could you tell me if you ran any kind of configuration app or calibration settings on your device before starting the test app? Something like the Cardboard sdk? Maybe it's worth investigating...

Misalignment of 3D augmentation in Stereo mode

May 4, 2016 - 12:23pm #17

Wow, that is odd. I am now completely lost as to what could cause the oberved behavior.

Am I right to state that considering we are running the same binary file on two devices of the same model but that we end up with a different outcome, the problem must be linked to something at the OS level that is different on each device ?

Any hint as to what we should look for on the malfunctioning S3 phone and iOS phones and iPads ?

Settings ? OS Version ? Anything else you can think of ?

Misalignment of 3D augmentation in Stereo mode

May 4, 2016 - 12:00pm #16

Attached are the two screenshots I captured with our Galaxy S3 device running the apk you provided.

Misalignment of 3D augmentation in Stereo mode

May 4, 2016 - 5:17am #15

You should have received the .apk file in your inbox by now. Thank you!

Misalignment of 3D augmentation in Stereo mode

May 3, 2016 - 4:47pm #14

If you would like to send a PM with a link to an apk, I will load and run it on our Galaxy S3 to see if the offset is present.

Misalignment of 3D augmentation in Stereo mode

May 3, 2016 - 1:26pm #13

I have the same settings in my test project. We tested on an iPad Mini and the bug is also visible, as seen on the screenshot.

AttachmentSize
Image icon IMG_0309.PNG1.09 MB

Misalignment of 3D augmentation in Stereo mode

May 3, 2016 - 12:52pm #12

These are the settings as they appear in my project:

AttachmentSize
Image icon digitaleyewearbehaviour_gcb.png37.36 KB

Misalignment of 3D augmentation in Stereo mode

May 3, 2016 - 12:19pm #11

Yes, I just verified the settings on my ARCamera and it is indeed set to Cardboard v1 (Google). It's really odd that the viewports on my device are different than yours, since it's the very same phone model.

Misalignment of 3D augmentation in Stereo mode

May 3, 2016 - 12:15pm #10

The viewports in your screenshot appear larger. Are you using the Cardboard v1 (Google) value for the Viewer Type field?

Misalignment of 3D augmentation in Stereo mode

May 3, 2016 - 6:42am #9

Hi,

Thanks for the extensive test and procedure. I followed carefully the steps you've written but unfortunately, the bug persists... I included screenshots to show you the difference between Mono and Stereo. The offset does seem to increase when the marker is seen from afar, but it still remains at close range. We came to think it could be related to my machine, but the bug also appeared on a version built with Unity's Cloud Builder.

This test was built from a brand new project with only Vuforia 5-5-9 and the new marker database. I also have the exact device model and Android version as you, built with Unity 5.3.4f1 32-bit on PC. If you think it can help, I can send you my project folder in private. 

AttachmentSize
Image icon mono.png899.84 KB
Image icon stereo_1.png693.11 KB
Image icon stereo_2.png643.95 KB

Misalignment of 3D augmentation in Stereo mode

May 2, 2016 - 6:20pm #8

I tested the stereo view on a Galaxy S3 with a modified "stones" target with an 8x6cm box which I used for alignment with a 3D box and the alignment appears okay. Could you try to reproduce using these steps:

  1. Import Vuforia 5.5.9 into a new Unity project
  2. Create and import dataset containing modified stones target (stones8x6cm.jpg attached)
  3. Set ARCamera's DigitalEyewearBehaviour to use Video-See Through, Vuforia, and Cardboard v1
  4. Drag ImageTarget into Hierarchy (assuming 0,0,0 for position) and set to modified target
  5. Set modified stones target size to 19.05 x 13.34
  6. Create cube with position (-0.52, 2, -0.32) and scale (8,4,6) and parent to ImageTarget
  7. Add a directional light
  8. Compile to GS3 and check stereo alignment

 

AttachmentSize
Image icon stones8x6cm.jpg1.33 MB
Image icon gs3_mono.png870.96 KB
Image icon gs3_stereo_gcb_1.png394.08 KB
Image icon gs3_stereo_gcb_2.png411.57 KB

Misalignment of 3D augmentation in Stereo mode

April 27, 2016 - 7:48pm #7

Hi,

Both are currently set to 558.8, calculated in milimetres from the 22 inches width and height of the actual printed target.

Misalignment of 3D augmentation in Stereo mode

April 27, 2016 - 6:23pm #6

What values are specified for the width and height of the ImageTarget in the ImageTargetBehaviour component?

Misalignment of 3D augmentation in Stereo mode

April 27, 2016 - 8:41am #5

Thank you for the update! I appreciate. Our time frame is short, as the client needs a solution for this by May 10th. 

Misalignment of 3D augmentation in Stereo mode

April 26, 2016 - 6:58pm #4

Thanks for the extra details. We are looking into it.

Misalignment of 3D augmentation in Stereo mode

April 26, 2016 - 7:54am #3

You can see screenshots of our settings in the Digital Eyewear component. We have tried playing with the settings in the latest Vuforia, using the regular Cardboard settings and also building on all the different presets, but in the end, the offset remains. We changed the FOV to 25, 25, 25, 25 to reduce the empty black space around the two viewports on the phone.

We also tested on the previous version of Vuforia 5-0-10 with the regular Stereo Camera parameters, but this didn't seem to change anything. 

AttachmentSize
Image icon DigitalEyewearSettings.JPG34.69 KB
Image icon StereoCameraSettings.JPG25.39 KB

Misalignment of 3D augmentation in Stereo mode

April 25, 2016 - 8:01pm #2

What settings do you have selected in the DigitalEyewearBehaviour script on the ARCamera?

Log in or register to post comments