Controllers being inactive after scene change

I have an issue with NVRPlayer where after I change the scene the hand controllers just go inactive (they appear grey in the hierarchy). I can activate them manually from the editor but that causes the tracking to be off.

I've tried numerous approaches but I can't seem to solve the problem.

I have no idea if the problem lies in NewtonVR, SteamVR or Unity itself.