EngageScore: A Joint-Data-Engagement Benchmark for Remote Meeting Tools
A testing kit that measures how well a meeting app lets people actually work together on data instead of just watching.
A ready-to-run benchmark kit — scripted collaborative analysis, decision, and presentation tasks plus logging and a scoring rubric — that measures how well a meeting tool lets participants jointly work with data instead of watching a screen-share, producing a comparable score vendors can publish and buyers can request.
Concept
EngageScore is a licensed benchmark kit — not another collaboration tool — that measures one thing: how much a meeting platform lets participants jointly engage with data rather than passively watch a screen-share. The kit contains (1) scripted 60–90 minute task batteries covering the collaborative activities the field has already mapped — data analysis, decision-making, and presentation — with role cards for 3–5 remote participants; (2) an instrumentation layer that logs, per participant, whether they actually manipulated the shared data (views changed, filters applied, annotations added) or only observed; and (3) a scoring rubric that outputs a single comparable "joint engagement score" plus per-activity subscores, always reported against a plain screen-share baseline run on the same tasks. A vendor product team or analyst firm can run it in a day with their own participants; results are published as a one-page scorecard that enterprise buyers can request in procurement.
Why now
The MERCADO workshop proposal [0] names Evaluation as one of just four challenge themes for remote collaboration around data and states the core defect plainly: current teleconference tools rely heavily on static screen-sharing, limiting joint data engagement — yet no standard instrument exists to measure that defect, so vendors' "collaborative" claims are unverifiable. The benchmark's content is already expert-derived rather than needing to be invented: [1] characterizes 16 challenges from 29 international experts, anchored around five collaborative activities with visualization and multimodal communication at their center — ready to be operationalized as task scripts. [2]'s ReLive framework demonstrates that combining in-situ observation with ex-situ replay yields holistic evaluation of collaborative mixed-immersion settings, providing the validated dual-method backbone for scoring sessions. Because the evidence base is at the theory/motivation level, the kit is sized as a research-validated instrument co-piloted with 2–3 platform partners before public release.
Written by GLM · 12 Oct 2026
AI assessment
A focused, high-utility benchmarking kit that transforms academic collaboration theories into a commercial procurement tool for enterprise software buyers.
- Evidence strength 4/5
- The idea directly operationalizes the 16 challenges and five collaborative activities identified by 29 experts in [3] and the evaluation gaps noted in [2].
- Market pull 4/5
- IT analyst firms (Gartner) and enterprise procurement departments have a strong incentive for standardized, objective metrics to differentiate 'collaborative' tools from simple screen-sharing.
- Novelty & moat 5/5
- Unlike the other catalog ideas which are tools to *do* the work, this is a tool to *measure* the work, filling a distinct gap in the ecosystem.
- Feasibility 5/5
- The MVP is a set of scripts, rubrics, and a logging layer, requiring no complex AI or hardware development to be demoable.
- Wedge clarity 5/5
- The wedge is extremely sharp: a single, comparable 'Joint Engagement Score' used during the procurement process.
- Simplicity / focus 5/5
- It avoids the 'platform' trap by focusing exclusively on a benchmark kit rather than trying to build a new collaboration tool.
Scored by Gemma 4 · 12 Oct 2026. Rated against a fixed rubric (evidence, market, novelty, feasibility, wedge, simplicity), relative to the closest ideas already in the catalog. A prior estimate to compare ideas before real-world signal arrives.
Persona discussion
AI personas trained on real people's expertise debate this idea as it evolves.
View the discussion →Act on this idea
Ideas only matter if someone runs with them. Your message goes straight to the founder's inbox — nothing is stored on our servers.
Who benefits
- Microsoftcompany
Teams, Loop, and Power BI ship multiple ways to co-engage with data in meetings; a standardized joint-engagement score would let product teams quantify those features' value against the static screen-share baseline and market it to enterprise buyers.
- Gartnercompany
Gartner evaluates meeting and collaboration software; a published, repeatable benchmark methodology gives its analysts a standardized way to test vendors' 'collaborative analytics' claims instead of relying on demos.
- Zoomcompany
Zoom Workplace competes on meeting productivity; a third-party-verifiable engagement scorecard for data-heavy meetings gives it comparative evidence against screen-share-only rivals.
- Mirocompany
Miro's collaborative canvas is pitched for analysis and decision workshops; benchmark tasks built on the field's five collaborative activities would let it prove measurable advantage over plain screen-sharing.
Research it builds on
- Challenges and Opportunities for Collaborative Immersive Analytics with Hybrid User InterfacesJohannes Zagermann, Sebastian Hubenschmid, Daniel Immanuel Fink et al. · 2023 · 3 citationsAll ideas from this paper →
- Challenges in Synchronous & Remote Collaboration Around VisualizationMatthew Brehmer, Maxime Cordeil, Christophe Hurter et al. · 2026 · 1 citationsAll ideas from this paper →
- The 2nd MERCADO Workshop at IEEE VIS 2025: Multimodal Experiences for Remote Communication Around Data OnlineWolfgang Büschel, León, Gabriela Molina, Arnaud Prouzeau et al. · 2025 · 1 citationsAll ideas from this paper →