DemoAnnex: Hosted Live-Demo and Experiment-Archive Service for Algorithm Journals
A platform where journals host live, runnable versions of the algorithms published in their articles.
A subscription service that lets any algorithm journal attach an IPOL-style package to accepted articles: authors submit code in a standard demo harness, reviewers verify it on controlled inputs during peer review, and readers can then run the published algorithm on their own data, with every run logged to a persistent experiment archive.
Concept
IPOL (Image Processing On Line) proves that a journal can publish every article as a complete package - text, peer-reviewed source code, a controlled online demonstration, and an archive of experiments - but it hand-built that infrastructure for itself. DemoAnnex productizes the model for every other journal that wants reproducible articles without building it. The single wedge: turn 'source code available on request' into 'run this published algorithm on your own data in the browser.' Concretely: (1) authors submit against a standard demo harness with fixed input/output formats and containerized execution - the same trick IPOL uses to keep its demonstrations 'controlled', which contains the feasibility risk of running arbitrary research code; (2) during review, reviewers execute the demo on journal-controlled inputs and check that it reproduces the paper's figures, making reproducibility a review gate rather than a post-hoc audit; (3) on publication, each article gets a demo page where readers upload their own images or data, and every run is appended to a per-article experiment archive that becomes part of the scholarly record.
Why now
The IPOL journal description [0] demonstrates that the full workflow - peer-reviewed text and source code, a controlled online demonstration facility, and an archived experiment record attached to every article - is operable today at a real peer-reviewed journal, not an aspiration. That removes the core feasibility question for other venues (does code-plus-demo peer review actually work in practice?) and provides a concrete template to industrialize. What does not exist is a turnkey version: the many mathematics and engineering journals that want IPOL-style reproducibility have no hosted way to obtain it, and the two pieces generic compute-capsule services do not provide - the reviewer-controlled demo gate and the persistent, article-linked experiment archive - are exactly this product's differentiation.
Written by GLM · 8 Oct 2026
AI assessment
A highly focused B2B play that productizes a proven, niche journal workflow to solve the systemic reproducibility crisis in algorithmic publishing.
- Evidence strength 5/5
- The idea is directly modeled on the existing, operational workflow of the IPOL journal, moving from a proven lab/single-instance result to a commercial offering.
- Market pull 3/5
- While there is high academic value, the primary buyers (society journals) are notoriously slow to adopt new paid infrastructure and may lack urgent budget for non-mandatory reproducibility tools.
- Novelty & moat 4/5
- Unlike generic compute capsules or verification engines, this integrates the demo into the peer-review gate and the permanent scholarly record, filling a specific gap in the publishing workflow.
- Feasibility 4/5
- The technical requirements (containerized execution and a standard harness) are well-understood, though scaling to diverse algorithmic languages may add complexity.
- Wedge clarity 5/5
- The wedge is extremely sharp: replacing 'code available on request' with a browser-based, reviewer-verified demo for a specific set of algorithm journals.
- Simplicity / focus 5/5
- The product is a single, cohesive service with a clear value proposition and a defined user journey, avoiding platform bloat.
Scored by Gemma 4 · 8 Oct 2026. Rated against a fixed rubric (evidence, market, novelty, feasibility, wedge, simplicity), relative to the closest ideas already in the catalog. A prior estimate to compare ideas before real-world signal arrives.
Persona discussion
AI personas trained on real people's expertise debate this idea as it evolves.
View the discussion →Act on this idea
Ideas only matter if someone runs with them. Your message goes straight to the founder's inbox — nothing is stored on our servers.
Who benefits
- Image Processing On Lineorganization
The journal itself maintains its demonstration facilities and experiment archives with in-house effort; a hosted annex would offload that engineering while preserving its peer-review control, letting it scale beyond image processing.
- IEEE Signal Processing Societyorganization
Its Transactions on Image Processing publishes exactly the kind of algorithm papers IPOL demonstrates on; reader-runnable demos and archived experiments would differentiate the venue and increase article usage and citations.
SIAM publishes algorithm-heavy venues such as the SIAM Journal on Imaging Sciences and the SIAM Journal on Scientific Computing; a hosted demo-and-archive annex would let it offer IPOL-style reproducibility without building custom infrastructure.
- Springer Naturecompany
Springer Nature publishes dozens of applied-algorithm journals (e.g., Journal of Mathematical Imaging and Vision); offering a demo annex as a value-added publishing service creates a new revenue line and a reproducibility differentiator for its society-journal partners.
Research it builds on
- Image Processing On LineBlusseau, Samy, Velasco-Forero, Santiago, Angulo, Jesus et al. · 2026 · 156 citationsAll ideas from this paper →