Send pose in both directions
Send pose with frames to verify what pose was used for the virtual camera. The local pose may have changed. This would allow more interactive motion in GUI that can then update correctly as new frames are received.
Edited by Nicolas Pope