I'm developing a system that aims at overlapping a 3D model of a bone, shown in an HMD (ORA-2 glasses by Optivent), to the real 3D printed object.
To do so, I used Vuforia and I made a script that implements the SPAAM algorithm to get a 3x4 projection matrix that maps 3D points in the world to 2D points on the screen according to users perspective. If I want to put a different 2D texture on the screen, so it overlaps the real the object, it works.
The problem is that I don't know how to apply that matrix to the object so it renders to make it overlap with the real object according to user's perspective.
Could anyone please help me? I'm quite lost