Log in or register to post comments

3D Object Scan Not Recognised On Unity

February 15, 2019 - 4:53am #1

Vuforia SDK Version: Latest -

Description with steps to reproduce: I've done everything but it still does not work.
So I've used object scanner to scan a 3D object (almost all green), and tested it. When I test it on the object scanner app, I can see the green block, indicating that the object is being recognised. I then email myself the .od file, upload it on target manager as a 3D scanned object, unity editor, and download the .unity database. I also created a new licence key.
I start a new project on unity, imported an MRI asset I bought on the asset store, and import the database I just downloaded. I enable vuforia, delete the main camera, put in an AR camera, put in 3D scanned object target. The database and object target from the object target behaviour is automatically set to the database I uploaded. I tick the 'load object targets on detection' box, name the company, etc. I place a model of an MRI scanner within the object target box and make the MRI model a child of the object target. I switch platform to android, tick enable vuforia augmented reality. I build the app and run it on my phone, and the MRI does NOT pop up when my real life 3D scanned object is in the camera. I know it's not an issue of the scanned model / lighting, etc, as the object scanner app detects the object. Unity just does not seem to load the model that I want to load upon detection of the model in real life.
It's very important that this gets fixed asap, please tell me what I'm doing wrong. When I can a 2D image target, everything works fine, but it doesn't work with a 3D scan. -

Development OS (Mac OS X, Windows, Linux): Windows, Android -

Mobile OS and Version: Latest Android for Galaxy S9 -

Mobile Device Manufacturer and Model name: Samsung Galaxy S9 -

Do the Vuforia Sample Applications show the same behavior?: no

3D Object Scan Not Recognised On Unity

February 25, 2019 - 5:11am #8

Hi,

 

Thanks for the response and suggestion, model targets feature works much better

Is there a tutorial I can follow to achieve something like this: https://www.youtube.com/watch?v=2ooSQmMrg4g

How do I have the 'menu' option displayed? How do I make the generated model disintegrate as shown in the video, only to have it be put back again? How do I put pins / labels on different parts of the model?

 

Sorry to pester you,

 

Thanks!

Sanghyuk Kim

3D Object Scan Not Recognised On Unity

February 19, 2019 - 11:27am #7

Hello,

Thanks for the pictures of the object - very helpful. Unfortunately, this is *not* a good candidate object for Vuforia Object Recognition.

Noting from the following article: https://library.vuforia.com/articles/Training/Object-Recognition (in the Supported Objects section):

"The surface of the object should have contrast-based features."

Object Recognition works similarly to Image Targets in that the object's surface must have features that can be extracted. The object in your picture has no surface features.

I highly recommend that you consider our Model Targets feature as it is tuned for these types of objects: https://library.vuforia.com/content/vuforia-library/en/features/objects/model-targets.html

Thanks,

Vuforia Engine Support

3D Object Scan Not Recognised On Unity

February 19, 2019 - 6:29am #6

The mesh renderer of the model I want to portray should activate when the 3D scanned model is recognised by the camera right? This is not occurring and whilst testing on my laptop webcam, the box for mesh renderer remains off

3D Object Scan Not Recognised On Unity

February 19, 2019 - 5:19am #5

Can you see them now?

AttachmentSize
Image icon pic2.jpg72.66 KB
Image icon pic1.jpg160.45 KB

3D Object Scan Not Recognised On Unity

February 18, 2019 - 3:45pm #4

Hello @Tredoltle97,

I cannot see the images you've provided. Can you please attach them to this thread?

Thanks,

Vuforia Engine Support

3D Object Scan Not Recognised On Unity

February 18, 2019 - 5:05am #3

Thanks for the reply but unfortunately it is not much help as everything recommended there has already been done (ie. no reflections, same environment, recommended device, etc)

I've put in some pictures from my phone so you have a better idea of the model target I am using / scanning.

I have a specific use case so I can't be using a core sample. I have used multiple different objects but all of them have the same outcome: recognised on object scanner app (green block shown) but model not displayed when using the app built on unity. I can see on other threads that this is a recurring problem from vuforia / unity users, and it is quite urgent. Please help me out to get this working.

Thanks,

Sanghyuk Kim

3D Object Scan Not Recognised On Unity

February 15, 2019 - 2:53pm #2

Hello,

I suggest that you use your dataset in our Core samples: https://assetstore.unity.com/packages/templates/packs/vuforia-core-samples-99026. This will help to eliminate some unknowns.

Can you share a picture of the object you're trying to detect? Here's some important tips about object choice and using the scanner app:

https://library.vuforia.com/articles/Training/Object-Recognition

There are many factors that can affect the tracking performance of a Object Target, both during the scanning process and when running an app. Most issues with Object Targets can be traced to the creation of the .od file using the Vuforia Object Scanner. Be sure to follow the scanner app instructions: https://library.vuforia.com/articles/Training/Vuforia-Object-Scanner-Users-Guide, paying close attention to step #8 in the article.

  • When creating the .od file, was the model scanned in an environment that was free of background details which may have introduced features that were not part of the model? Scanning in 'cluttered' environments can introduce false detection/tracking points.
  • When creating the .od file, were there any specular reflections on the model introduced by environmental lighting? Scanning objects that have reflective surfaces under direct lighting can introduce areas with no detection/tracking points.
  • Are you using the recommended devices referenced on the tool download page?: https://developer.vuforia.com/downloads/tool

In our labs, we utilize four primary strategies for creating an optimal Object Target scanning environment:

  1. All background surfaces are colored at 18% gray. An easy, off-the-shelf solution is to buy bed sheets near this color and drape everything in the environment that could be seen by the scanning device's camera.
  2. No direct lighting. We use light boxes and/or diffusers to eliminate direct lighting upon the object and minimize any spectral reflections.
  3. Utilize a 360 turntable to re-orient the device. This is especially helpful when you've set your environment to near ideal conditions within a limited area. You can spin the model and scan in 360 degrees without having to move around it.
  4. Be sure that the environment in which you’re testing (via the Object Scanner app ‘test mode’) is the same in which you’re verifying tracking (via the sample code). Environmental factors such as lighting, shadows, spectral reflections, etc. can negatively affect tracking performance, so awareness of how the environment is interacting with your model is important for qualifying performance.

Lastly, be sure to use meters and the default scale as this can also impact the feature's accuracy and performance.

Thanks,

Vuforia Engine Support

 

Log in or register to post comments