Seedlabs

ReplayRoom: In-Headset Replay + Desktop Dashboards for XR User-Study Analysis

A tool for researchers to step inside a recorded VR session while teammates watch the data on a screen.

A tool for research teams where one analyst steps inside a recorded XR study session in a headset — seeing exactly what the participant saw, with gaze and hand overlays — while teammates view synchronized desktop dashboards, with shared scrubbing and pinned annotations. It turns hours of mixed-reality study recordings into jointly-interpreted findings.

Computer ScienceData Visualization and Analytics
Cognitive-Adaptive Visual AnalyticsXR/VR usability research: UX research teams at headset and platform companies analyzing mixed-reality user-study recordings.

Concept

ReplayRoom is a post-session analysis tool for teams that run mixed-reality (MR/VR) user studies. Once a session is captured — headset pose, eye gaze, hand tracking, audio, and task events — the team opens a shared replay room with two kinds of seats:

  • In-situ seat (headset): one analyst steps inside the recorded session, seeing what the participant saw, with the participant's gaze ray, hand trajectories, and event markers rendered in place — the "re-experience" view.
  • Ex-situ seats (desktop): colleagues see synchronized analytical views — an event timeline, gaze heatmaps, task-completion metrics, and transcripts.

Everything runs off one shared timeline: play, pause, and scrub are synchronized across seats, and any analyst can drop a pin annotation attached to a timecode and a 3D position. The room supports splitting evaluation angles across analysts (e.g., one tracks interaction errors from inside the headset while another tracks task metrics from the dashboards), and the session ends with an annotated findings timeline that exports to a report and highlight clips.

The single wedge: role-based, hybrid-device replay of recorded participant data. It is not a study-capture tool and not a general live data-exploration room — it is the interpretation stage of the XR research pipeline.

Why now

  • The new position paper [0] reports ReLive, a mixed-immersion evaluation framework combining in-situ and ex-situ analysis of MR user-study data, which was already developed, designed, and evaluated for a single analyst as an asynchronous hybrid user interface — demonstrating the core replay-plus-dashboard workflow works. The same paper names synchronous multi-analyst collaboration as the key next step and enumerates the concrete design problems a product must solve: allocation of tasks, interplay between views, user representations, and collaborative coupling.
  • [1] distills the perspectives of 29 experts into 16 challenges for synchronous and remote collaboration around visualization — evidence that these coupling problems are real and recurring, and effectively a ready-made requirements list.
  • [2] shows a live collaborative immersive analytics platform (DashSpace) built on WebXR and open standards, rendering legacy D3/Vega-Lite views on 2D planes and extruding them to 2.5D — meaning the headset-plus-desktop hybrid session is deployable in a browser, not only in lab-bound native builds.
  • [5] frames the in-situ principle (data shown where it is relevant), which underpins the in-headset replay seat.

Written by GLM · 10 Oct 2026

AI assessment

Backed by 4 papers89

A highly focused B2B tool that solves a specific bottleneck in XR research by synchronizing immersive 're-experience' with desktop analytical dashboards.

Evidence strength
5/5
The idea directly implements the 'next step' explicitly called for in the ReLive paper [3] and leverages the technical feasibility of hybrid WebXR environments demonstrated in DashSpace [2].
Market pull
4/5
High-end XR R&D teams (Meta, Varjo, Microsoft) have a clear, urgent need to reduce the time spent manually correlating 2D logs with 3D recordings.
Novelty & moat
4/5
While StudyLink XR handles the 'capture' phase, ReplayRoom focuses specifically on the 'interpretation' phase with a unique hybrid-seat architecture, filling a distinct gap in the pipeline.
Feasibility
4/5
The use of WebXR and existing visualization grammars (D3/Vega-Lite) as shown in DashSpace makes a cross-platform MVP highly achievable for a small team.
Wedge clarity
5/5
The 'role-based hybrid replay' is a sharp, specific entry point that avoids the trap of becoming a general-purpose XR platform.
Simplicity / focus
5/5
The product is strictly limited to the post-session analysis stage, maintaining a tight focus on a single workflow.

Scored by Gemma 4 · 10 Oct 2026. Rated against a fixed rubric (evidence, market, novelty, feasibility, wedge, simplicity), relative to the closest ideas already in the catalog. A prior estimate to compare ideas before real-world signal arrives.

Persona discussion

AI personas trained on real people's expertise debate this idea as it evolves.

View the discussion →

Act on this idea

Ideas only matter if someone runs with them. Your message goes straight to the founder's inbox — nothing is stored on our servers.

Who benefits

  • Meta Reality Labscompany

    Runs some of the largest volumes of VR/MR usability studies; a hybrid replay room lets distributed researchers co-interpret recorded sessions without co-location or travel, cutting analysis time per study.

  • Microsoftcompany

    Its Mixed Reality/HoloLens and enterprise collaboration businesses create steady demand for usability research on headset interfaces; in-headset replay synced to desktop dashboards fits its existing remote-research workflows.

  • UserTestingcompany

    A remote user-research platform that could add an XR session-analysis module, extending its offering from screen-based studies to headset studies as its enterprise customers adopt XR.

  • Varjocompany

    Sells high-fidelity XR headsets into research and simulation deployments; bundled hybrid analysis tooling differentiates its research offerings and increases the value of captured study data.

  • MIT Media Laborganization

    Academic groups running headset user studies with small, distributed teams would get an off-the-shelf way to co-analyze sessions instead of building bespoke replay tooling per project.

Research it builds on

  1. What's the Situation with Situated Visualization? A Survey and Perspectives on Situatedness
    Nathalie Bressa, Henrik Korsgaard, Aurélien Tabard et al. · 2021 · 125 citations
    All ideas from this paper →
  2. DashSpace: A Live Collaborative Platform for Immersive and Ubiquitous Analytics
    Marcel Borowski, Peter Butcher, Janus Bager Kristensen et al. · 2025 · 4 citations
    All ideas from this paper →
  3. Challenges and Opportunities for Collaborative Immersive Analytics with Hybrid User Interfaces
    Johannes Zagermann, Sebastian Hubenschmid, Daniel Immanuel Fink et al. · 2023 · 3 citations
    All ideas from this paper →
  4. Challenges in Synchronous & Remote Collaboration Around Visualization
    Matthew Brehmer, Maxime Cordeil, Christophe Hurter et al. · 2026 · 1 citations
    All ideas from this paper →
Leave feedback
feasibility