The Spectacular AI SDK can provide accurate and low-latency 6-DoF pose tracking for AR, VR and XR headsets, without external lighthouses, the solution is computationally lightweight and can run on an embedded ARM processor in the headset.

Inside-out tracking is based on VISLAM, the fusion of data from multiple tracking cameras and an IMU sensors. VISLAM also removes long-term drift using loop closures.

For low-cost and experimental setups, the OAK-D devices can be useful for prototyping this use case, see, e.g., the mixed reality case in the SDK examples repository.

In general, we recommend a system with at least two hardware-synchronized fisheye global shutter cameras. Different types of hardware acceleration in embedded DSP, VPU or GPU can also be used. Contact us using the form below for more information.