-
Notifications
You must be signed in to change notification settings - Fork 87
docs(ecosystem): note Meta Quest lacks full-body robot control support #1067
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Changes from all commits
98dc521
ddc07ca
eccee44
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -27,10 +27,8 @@ and the BD skeleton format used on the server. | |
| .. note:: | ||
|
|
||
| Meta Quest 3/3S also expose body tracking to WebXR via inside-out body | ||
| tracking (IOBT), and the CloudXR client will stream it. However the Quest | ||
|
jsepulveda-nvidia marked this conversation as resolved.
|
||
| skeleton is mapped to the PICO BD 24-joint layout in the current version, | ||
| and accuracy is lower since there are no physical trackers. See | ||
| `Quest Body Tracking (Limited Support)`_ for details. | ||
| tracking (IOBT), and the CloudXR client will stream it under the WebXR | ||
|
Collaborator
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. this means a dependency to release next version right? Instead of pre-announcing this, I think we can decouple into two parts, one is to remove the things not supported (thus just remove here); and two we can add a new PR when next version is about to merge and release and then add this description. |
||
| Body Tracking extension. | ||
|
|
||
| .. seealso:: | ||
|
|
||
|
|
@@ -252,21 +250,3 @@ timestamped take into ``examples/mcap_record_replay/recordings/``, where | |
| :class: no-image-zoom | ||
|
|
||
| ``replay_full_body.py`` visualizing a recorded BD 24-joint skeleton in viser. | ||
|
|
||
| Quest Body Tracking (Limited Support) | ||
| ------------------------------------- | ||
|
|
||
| Meta Quest headsets expose inside-out body tracking (IOBT) to WebXR sessions. | ||
| The CloudXR WebXR client will stream this data when the Quest browser grants the | ||
| ``body-tracking`` feature. | ||
|
|
||
| However, in the current version the Quest IOBT skeleton is mapped to the PICO BD | ||
| 24-joint layout before being sent to the server. This means the server always | ||
| receives data in the ``XR_BD_body_tracking`` joint format regardless of the | ||
| source headset. | ||
|
|
||
| .. note:: | ||
|
|
||
| Quest body tracking does not require external trackers. It uses the | ||
| headset's built-in cameras. Tracking quality may differ from the | ||
| tracker-based PICO solution, particularly for lower-body joints. | ||
Uh oh!
There was an error while loading. Please reload this page.