Empty controllers list in RenderVRDisplay

[SoshinK]

Hello!

I am trying to use VR rendering with my Meta Qest 3 headset. More specifically, I am trying to use manualtest/vr.py script. Although rendering works fine, I can't use my controllers. self.vr.get_controller_ids() returns an empty list of controllers, and I can't get their poses. Is the problem in the steamvr_actions.json file or something else?

[fbxiang]

The VR API is quite messy and I actually do not fully understand the whole SteamVR config. SteamVR could also get broken in Steam updates. I wrote the documentation mostly from trial and error https://sapien-sim.github.io/docs/user_guide/rendering/vr.html

Overall it would be very hard for me to tell the cause of your problem, but since you also asked on ManiSkill, maybe we can wait to see if other users have a similar issue and workaround.

[SoshinK]

Thank you for your response!

I see you are using ALVR instead of WiVRn, may be that is an issue. Actually, I found a workaround for my problem - I am using pyopenxr bindings to handle signal from controllers. This helps to avoid composing these device-specific controller configs. Here are some examples for those who may need it: headless example (so OpenXR runtime won't interfere with SteamVR runtime); user input from controllers.